Show HN: Coder Eval – A Framework for Evals
By mihaich · 2026-09-04 · 2 points · 0 comments
https://github.com/uipath/coder_eval
We needed a framework to write our evals in and easily update them, run A/B tests, set all kinds of constraints (ex: timeouts, number of turns), and configure the execution environment (ex: sandboxes, dependencies, how to handle AskQuestion). We also have an agent judge. It…
Open the full discussion on BetterNews