MLCEngine: Universal LLM Deployment to Both Cloud and Local Devices(blog.mlc.ai)

https://blog.mlc.ai/2024/06/07/universal-LLM-deployment-engine-with-ML-compilation.html