← All posts
evaluation
2 posts ai government
+3
Weight-Space Programming for the Social Safety Net
An independent test of the claim that AI models can write, read, and edit neural network weights directly, run against US benefit formulas where the correct answer is defined by law. Written weights were exact. Trained weights failed in ways average accuracy hides. And one step of the law cannot be represented at all.
Read more
ai govtech
+2
Using Synthetic Government Benefits Data for Reasoning Evaluation
Why the question isn't 'can the model do arithmetic?' but 'does it know which rule to apply?'. Exploring synthetic data for evaluating reasoning in government benefits policy.
Read more