Token-Count-Based Batching: Faster, Cheaper Embedding Inference for Queries(mongodb.com)

https://www.mongodb.com/company/blog/engineering/token-count-based-batching-faster-cheaper-embedding-inference-for-queries