Deploying inference endpoints with PD disaggregation on AMD GPUsdstack.ai2 points·by cheptsov·il y a 2 mois·0 comments
cheptsov·il y a 5 mois·discussNice, we build something similar at dstackWe recently also added support for agents: https://skills.sh/dstackai/dstack/dstackOur approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference
cheptsov·il y a 7 mois·discussFinally a step in the right direction. This brings the best of two worlds: the lightweightness of Fleet and agents battle-tested with Junie/IntelliJ.Congrats to the team. Can’t wait to try it.
We recently also added support for agents: https://skills.sh/dstackai/dstack/dstack
Our approach though is more tide-case agnostic and in the direction of brining full-fledged container orchestration converting from development to training and inference