Challenges

Agent reliability

Coding agent

DifficultyStages: 0 / 5
  1. A step runner for the agent loop
  2. Run generated code in a sandbox
  3. Resume after a crash
  4. Cap the tries
  5. Approve before merge
  6. Final test

An agent that fixes issues in a code repository: it calls a model and tools in a loop. Make it run its steps, run generated code in a sandbox, survive a crash, stop tasks that never end, and wait for a person before it merges.

Final testA tool slows down: the test service runs 4 times slower for 15 s at 0:20. Your final board runs once more with a new traffic seed.

The system, stage by stageTap, drag or use arrow keys to step through the stages

Stage 5 of 5 · 15 parts given · 12 requests/s

Users 1Worker 1LLM API 2External API 2

Progress on this page stays on this device.

Product names belong to their owners. Cogore is not affiliated with them.