The Dayjob Tax Benchmark: AI Agents Pass Under 11%
Surge AI’s Dayjob: Tax benchmark landed on Hacker News on 2026-10-28 and sat at the top of the page for a day (247 points, 154 comments ). The number that …
Read more →#Evals
8 posts
An Agent That Tunes Itself Needs a Golden Unit
On the test floor there’s one rule about calibration that nobody argues with. When a station has been adjusted, you don’t trust it until it measures …
Read more →An LLM's Confidence Score Is a Meter With No Cal Sticker
On a test floor, every meter has a sticker. It says who calibrated it, against what, and when it’s due again. A meter without one isn’t an …
Read more →Humans Approve Intent, Machines Prove Conformance
The pull request was built for a world where a person wrote the diff and another person read it. Agents broke the first half. Now the second half is a queue …
Read more →Who Signs the Test Report for a Robot?
Every product I ever tested ended in the same place: a test report with a signature on it. The signature mattered more than the data. It said someone qualified …
Read more →Second-Source Your Models
Every hardware engineer learns the same lesson early, usually the hard way. Don’t design a board around a part only one company makes. It’s called …
Read more →agentevals v0.10.0: Scores Come Back as OpenTelemetry Events
agentevals v0.10.0 shipped two days ago and removed its own WebSocket ingestion path in favor of plain OpenTelemetry. Send OTLP traces in, run an eval, and the …
Read more →Regression Tests for kagent Agents with agentevals
An AI agent that stops calling its tools does not throw an error. It answers from the model’s memory, confidently and plausibly, and the output still …
Read more →