High Performance Distributed Inference with Ray Serve LLManyscale.com3 points·by robertnishihara·24일 전·0 comments
67% Cost Savings with PD Disaggregation Using Ray and vLLM on AMD MI325Xanyscale.com4 points·by robertnishihara·27일 전·0 comments
Major upgrades to Ray Serve: 88% lower latency and 11.1x higher throughputanyscale.com2 points·by robertnishihara·4개월 전·1 comments
SkyRL brings Tinker to your GPUs (2025)novasky-ai.notion.site24 points·by robertnishihara·5개월 전·5 comments
vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-epblog.vllm.ai147 points·by robertnishihara·6개월 전·54 comments
Massively Parallel Agentic Simulations with Rayanyscale.com2 points·by robertnishihara·10개월 전·0 comments