HackerTrans
TopNewTrendsCommentsPastAskShowJobs

wbarber

no profile record

comments

wbarber
·vor 2 Jahren·discuss
What's to say this isn't just a demonstration of memorization capabilities? For example, rephrasing the logic of the question or even just simple randomizing the order of the multiple choice answers to these questions often dramatically impacts performance. For example, every model in the Claude 3 family repeats the memorized solution to the lion, goat, wolf riddle regardless of how I modify the riddle.