HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Damianf19

no profile record

Submissions

[untitled]

1 points·by Damianf19·2 months ago·0 comments

[untitled]

1 points·by Damianf19·2 months ago·0 comments

comments

Damianf19
·2 months ago·discuss
[dead]
Damianf19
·2 months ago·discuss
[dead]
Damianf19
·2 months ago·discuss
[dead]
Damianf19
·2 months ago·discuss
[dead]
Damianf19
·2 months ago·discuss
What's the data model that lets you compare agents that differ a lot in tools/policies? Curious if you normalize on the "what did the user actually accomplish" layer or on raw token/turn metrics, because the two paint completely different pictures of "is this agent working." We struggle with this on the eval side of our own product (email pipeline outcomes, not agents, but same shape).
Damianf19
·2 months ago·discuss
[flagged]