High Performance Distributed Inference with Ray Serve LLManyscale.com3 points·by robertnishihara·hace 24 días·0 comments
Data Processing Is Becoming a GPU Workloadanyscale.com2 points·by robertnishihara·hace 26 días·0 comments
67% Cost Savings with PD Disaggregation Using Ray and vLLM on AMD MI325Xanyscale.com4 points·by robertnishihara·hace 26 días·0 comments
Major upgrades to Ray Serve: 88% lower latency and 11.1x higher throughputanyscale.com2 points·by robertnishihara·hace 4 meses·1 comments
SkyRL brings Tinker to your GPUs (2025)novasky-ai.notion.site24 points·by robertnishihara·hace 5 meses·5 comments
vLLM large scale serving: DeepSeek 2.2k tok/s/h200 with wide-epblog.vllm.ai147 points·by robertnishihara·hace 6 meses·54 comments
Massively Parallel Agentic Simulations with Rayanyscale.com2 points·by robertnishihara·hace 10 meses·0 comments