Ask HN: What metrics do you track when building agents?

By rstagi · 2026-07-05 · 2 points · 0 comments

The main metric I look at is inference cost, which is a pretty good indicator when something's off. However, a couple of days a go I discovered we were loading ~300 tools due to a bug, affecting both costs and accuracy. It was going on for some time and I didn't realize it by lo…

Open the full discussion on BetterNews