This article is very brief and not deep enough. There is one I’m finding a much more “to the bone” and explaining io_uring concepts in much deeper details:
You could keep multimodal projector (understanding of audio, images & PDFs) in system RAM with `--no-mmproj-offload` in llama.cpp.
Of course, then it is not accelerated with GPU, but you save its VRAM.
- you disable all communication with a firewall (so it doesn't autoupdate)
- `sudo pkill -9 LogiPluginService && sudo rm -rf /Applications/Utilities/LogiPluginService.app` (so it does not eat resources and don't run a useless service in the bg)
https://unixism.net/loti/index.html
Feel free to reverse-search the related HN thread too.