DerivativeBS·il y a 4 heures·discussCurious about: does it have fault tolerance if one of the machines goes down mid-inference? Can it dynamically reroute, or does it just retry?