Model Batch Inference in Ray: Actors, ActorPool, and Datasets(anyscale.com)

https://www.anyscale.com/blog/model-batch-inference-in-ray-actors-actorpool-and-datasets