Mapping GPUs to LLMs (and back): A bandwidth-based estimator for local inference(localllm-advisor.com)
localllm-advisor.com
Mapping GPUs to LLMs (and back): A bandwidth-based estimator for local inference
https://www.localllm-advisor.com/blog/why-i-built-this
0 comments
—