A test can pass without proving the required behavior
Weak assertions and mocks that verify wiring, not behavior, can still get merged.
Jul 30, 20267 min read3

Search for a command to run...
Weak assertions and mocks that verify wiring, not behavior, can still get merged.

Passing tests and clean code do not prove the agent finished the job or followed the process correctly.

Mindrealm caught the second one too. 19 of the 21 findings in a feature the agents wrote were real.

Claude Code marked the goal achieved and tried to stop. Mindrealm's stop hook wouldn't let it because 17 code review findings were still open.

If a completion gate reads a number the agent can change, the agent can pass it by changing the number, and probably will.

More than 6,000 documented agent failures from building one product, the six that keep coming back, and what actually catches them
