AI Agent Evaluation: Grade the Database, Not the Reply
ThinkingBox grades AI agents on the database they leave behind. Here is what its numbers show about silent failures, plus a Postgres harness to test…
ThinkingBox grades AI agents on the database they leave behind. Here is what its numbers show about silent failures, plus a Postgres harness to test…
My mocked tests said the row level security policy was fine. It wasn't. How pgsql-test runs RLS policies under the real app role, and the…
IBM's consistency gap paper shows an agent passing 77% of runs succeeds five times in a row only 53% of the time. Here's the five-run…
Fuzz testing explained through a real bug: coverage-guided fuzzing in Pest 5 found a DivisionByZeroError my hand-written dataset missed. Setup and where it fits.
I defended Jest for three years, then moved a real monorepo to Vitest in one afternoon. Here is the ESM pain that pushed me, the…
I ran Cypress for years, then moved my e2e suite to Playwright. Here's what actually broke, what improved, and how I'd do the migration again.
Six months after I converted a 410-file Jest suite to Vitest, here is what got faster, what I had to rewrite, and where I still…
Four years with testify, then I migrated off it. What I kept (assert and require), what I dropped (mock and suite), and the plain-Go alternatives…
I migrated a Laravel codebase from PHPUnit to Pest and stopped halfway. Here's where Pest actually wins, where PHPUnit still does, and what I'd skip.
I've been migrating projects from Jest to Vitest since late 2024. Here's where Vitest actually wins, where Jest still beats it, and the playbook I…