LLM Inference Performance Engineering: Best Practices(databricks.com)

https://www.databricks.com/blog/llm-inference-performance-engineering-best-practices