tkamat29·7개월 전·discussThat's apples to oranges then. You should use the same model between both harnesses if you want to evaluate the harnesses individually.
tkamat29·3년 전·discussEh, even when asked specifically to show it's work GPT-4 still frequently makes calculation errors. It's just one of the limitations of current LLMs, and can easily be solved by integration with Wolfram, or even just a basic calculator.