New Recipe: Serving Llama-2 with VLLM's OpenAI-Compatible API Server(github.com)
github.com
New Recipe: Serving Llama-2 with VLLM's OpenAI-Compatible API Server
https://github.com/skypilot-org/skypilot/tree/master/llm/vllm
0 comments
—
https://github.com/skypilot-org/skypilot/tree/master/llm/vllm
—