Modal Auto Endpoints: Optimized inference you own(modal.com)
modal.com
Modal Auto Endpoints: Optimized inference you own
https://modal.com/blog/introducing-auto-endpoints
4 comments
I'm a bit confused. In my world, "I own it" means it's running on hardware physically in my control, by default physically in my possession, and nobody can turn off my account...
I had the same thought. I don't own the inference here, I just have more granular access to the inference process, right? Seems like the only way I would own inference is if I own the hardware it's running on?
FYI, it seems Modal will add $70 to your free "standard" accounts when you try out Endpoints.
How is this different from say BiFrost?