OLLAMA_FLASH_ATTENTION=1
OLLAMA_KV_CACHE_TYPE=q8_0
OLLAMA_CONTEXT_LENGTH=180000
and that fits in 23GB. The assumption is that if you send people checks, they’ll find meaning in hobbies and community. They’ll paint. They’ll garden. They’ll finally write that novel.
The author suggests it will fail because we'll all use drugs and booze and commit suicide. But it works for retired people. They love it.