LLMs: Solvers vs. Judges(bensantora.com)2 points·by truelinux1·vor 4 Monaten·1 commentsbensantora.comLLMs: Solvers vs. Judgeshttps://bensantora.com/posts/llms-solvers-vs-judges/1 commentsPost comment[–]truelinux1·vor 4 MonatenreplyI gave several LLMs a logic puzzle with an embedded contradiction. Some flagged it. Some quietly bent the rules to produce an answer anyway.Knowing which type of model you're using (a helpful solver or a strict judge) really matters.
Knowing which type of model you're using (a helpful solver or a strict judge) really matters.