Host overhead is killing your inference efficiency(modal.com)

https://modal.com/blog/host-overhead-inference-efficiency