LLMs: Solvers vs. Judges(bensantora.com)2 points·by truelinux1·4 месяца назад·1 commentsbensantora.comLLMs: Solvers vs. Judgeshttps://bensantora.com/posts/llms-solvers-vs-judges/1 commentsPost comment[–]truelinux1·4 месяца назадreplyI gave several LLMs a logic puzzle with an embedded contradiction. Some flagged it. Some quietly bent the rules to produce an answer anyway.Knowing which type of model you're using (a helpful solver or a strict judge) really matters.
Knowing which type of model you're using (a helpful solver or a strict judge) really matters.