Deploying inference endpoints with PD disaggregation on AMD GPUsdstack.ai2 points·by cheptsov·2 เดือนที่ผ่านมา·0 comments
cheptsov·5 เดือนที่ผ่านมา·discussNice, we build something similar at dstackWe recently also added support for agents: https://skills.sh/dstackai/dstack/dstackOur approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference
cheptsov·7 เดือนที่ผ่านมา·discussFinally a step in the right direction. This brings the best of two worlds: the lightweightness of Fleet and agents battle-tested with Junie/IntelliJ.Congrats to the team. Can’t wait to try it.
We recently also added support for agents: https://skills.sh/dstackai/dstack/dstack
Our approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference