Saying "Done" Isn’t Enough: How Lobe Eval Tests Agents on Real-World Tasks

Lobe Eval runs agents through LobeHub’s actual product execution path in a stateful, resettable tool environment. Each run is judged using execution traces, tool results, and artifact evidence, while Pass³ measures how often a Case passes in all three runs.