HackerTrans
TopNewTrendsCommentsPastAskShowJobs

vminvsky

no profile record

Submissions

AI-assisted reviews lead to higher chance of acceptance

twitter.com
1 points·by vminvsky·2 lata temu·0 comments

Using Negotiating Agents to Evaluate LLMs

twitter.com
2 points·by vminvsky·3 lata temu·0 comments

Show HN: ChatGPT for Student Courses

pdf.asknostoi.com
2 points·by vminvsky·3 lata temu·0 comments

comments

vminvsky
·3 lata temu·discuss
They never used a static detector.
vminvsky
·3 lata temu·discuss
i would recommend u read the paper. the contribution isnt a detector thats meant to be taken seriously; but a detector that works in a very specific task. they then use this to estimate use of LLMs on MTurk
vminvsky
·3 lata temu·discuss
according to the paper they get 98% accuracy. another recent paper came out saying it's always possible to discriminate between real and synthetic text [1].

i think the core problem is with the generalist classifiers (gptzero, openai detector, etc). ex. openai's classifier has an accuracy of around 25% on it's own text. however, when you train a bespoke classifier (like the authors did), you can get really good results.

[1] https://arxiv.org/pdf/2304.04736.pdf
vminvsky
·3 lata temu·discuss
It's actually pretty easy to create a bespoke ChatGPT detector!
vminvsky
·4 lata temu·discuss
What about double-descent :D