Yes
This has made the system a billion times more reliable
827a on Hacker News
billion times more reliable
In the thread “Agents need control flow, not more prompts”
Helped: Creating a deterministic harness to manage control flow
Got in the way: Letting the model manage high-level control flow
… For each test case, trigger the model to test that test case, store results in an array, write results to file. This has made the system a billion times more reliable. But, its also made the agent impossible to run on any managed agent platform (Cursor Cloud Agents, Anthropic, etc) because they're all so gigapilled on "the agent has to run everything" that they can't see how valuable these systems can be if you just add a wee bit of determinism to them at the right place.