Ask HN: Recommend a Local LLM Setup (M2 Max, 9GB)
1 コメント
The default answer is Qwen 3.6-27B in llama.cpp - tell a frontier LLM your goals and hardware and have it suggest settings. llama.cpp has built in benchmarking, you can ask the frontier LLM to tell you what benchmarks to run and what settings to tweak based on the results. Ask it why the setting changes affect the benchmarks in certain ways if you want to start learning some details.
/r/localllama for where the enthusiasts hang out
/r/localllama for where the enthusiasts hang out
I have a MacBook Pro M2 Max with 96GB (12‑core CPU, 38‑core GPU, 16‑core NE)
I’m hoping to redesign and rebuild our very customized Shopify store on a new base template, cleanup all the meta-information for all our SKUs, and create a utility script or desktop app to streamline our photography workflow.
Also, please recommend useful resources to further my own education on this front. TIA.