A simple L7 proxy for vLLM that manages LoRA adapter storage via NVMes(github.com)
github.com
A simple L7 proxy for vLLM that manages LoRA adapter storage via NVMes
https://github.com/shayonj/loraplex
0 comments
—
https://github.com/shayonj/loraplex
—