Aegaeon: Effective GPU Pooling for Concurrent LLM Serving on the Market(dl.acm.org)
dl.acm.org
Aegaeon: Effective GPU Pooling for Concurrent LLM Serving on the Market
https://dl.acm.org/doi/pdf/10.1145/3731569.3764815
0 comments
—
https://dl.acm.org/doi/pdf/10.1145/3731569.3764815
—