Deploying inference endpoints with PD disaggregation on AMD GPUsdstack.ai2 points·by cheptsov·2 bulan yang lalu·0 comments
cheptsov·5 bulan yang lalu·discussNice, we build something similar at dstackWe recently also added support for agents: https://skills.sh/dstackai/dstack/dstackOur approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference
cheptsov·7 bulan yang lalu·discussFinally a step in the right direction. This brings the best of two worlds: the lightweightness of Fleet and agents battle-tested with Junie/IntelliJ.Congrats to the team. Can’t wait to try it.
We recently also added support for agents: https://skills.sh/dstackai/dstack/dstack
Our approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference