My $600 Mac Mini Runs a 35B AI Model(thoughts.jock.pl)

4 pointsby danebaliahace 3 meses3 comments

https://thoughts.jock.pl/p/local-llm-35b-mac-mini-gemma-swap-production-2026

3 comments

bigyabaihace 3 meses

> The 35B Trick (Your SSD Is the New GPU Memory)

Wave "bye bye" to your write cycles.

RobMurrayhace 3 meses

why? it's mostly reads. the weights are static.

bigyabaihace 3 meses

llama-cpp's process is, but macOS itself will swap hard when 10-14gb of memory is paged for LLM inference. Dense models especially would thrash zram.