I asked my local LLM to add 23 numbers and got seven wrong answers(viggy28.dev)

6 ポイント投稿者 vira283 か月前4 コメント

I asked my local LLM to add 23 numbers and got seven wrong answers

https://viggy28.dev/article/local-llm-seven-wrong-answers/

4 コメント

beardyw3 か月前

This kind of thing beats me. Why should a "Large Language Model" be expected to act as a calculator. Clue one is on the name, clue two might be an understanding that it is based on statistics, it is not the deterministic tool you need.

horizontech-dev3 か月前

Though it’s obvious, nice write up. This is the kinda rabbit hole I enjoy going through and reading.

sitapati3 か月前

Have you thought of using a calculator for this task?

vira283 か月前

Did exactly that for the actual filing — Python, mentioned in the post. The 23 numbers were a probe, not the goal: I wanted to understand how it works.