Deploying inference endpoints with PD disaggregation on AMD GPUsdstack.ai2 points·by cheptsov·vor 2 Monaten·0 comments
cheptsov·vor 5 Monaten·discussNice, we build something similar at dstackWe recently also added support for agents: https://skills.sh/dstackai/dstack/dstackOur approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference
cheptsov·vor 7 Monaten·discussFinally a step in the right direction. This brings the best of two worlds: the lightweightness of Fleet and agents battle-tested with Junie/IntelliJ.Congrats to the team. Can’t wait to try it.
We recently also added support for agents: https://skills.sh/dstackai/dstack/dstack
Our approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference