Deploying inference endpoints with PD disaggregation on AMD GPUsdstack.ai2 ポイント·投稿者 cheptsov·2 か月前·0 コメント
cheptsov·5 か月前·議論Nice, we build something similar at dstackWe recently also added support for agents: https://skills.sh/dstackai/dstack/dstackOur approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference
cheptsov·7 か月前·議論Finally a step in the right direction. This brings the best of two worlds: the lightweightness of Fleet and agents battle-tested with Junie/IntelliJ.Congrats to the team. Can’t wait to try it.
We recently also added support for agents: https://skills.sh/dstackai/dstack/dstack
Our approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference