HackerTrans
TopNewTrendsCommentsPastAskShowJobs

peter94

no profile record

Submissions

I used Claude to match 200 Clinical Trials to 700 PubMed Papers

everyrow.io
10 points·by peter94·5 tháng trước·2 comments

comments

peter94
·4 tháng trước·discuss
What's the point of having the testing be done by Claude Code via a skill, rather than just hard-coding the set of tests to be run?
peter94
·5 tháng trước·discuss
Personally, I think Claude Code played it a little too safe here, so that's why we didn't put more emphasis on its precision. Note that 100% precision is also easy to achieve in this case: Only match trials with papers that explicitly mention said trials via regex. So clearly we have to pay attention to both precision and recall. We just happened to go with F1 as the more or less canonical measure to take both into account, but I agree that, depending on your use case, you may be interested in other measures of accuracy.