I mean the whole ebs complaint is invalid you are complaining about a san disk vs local disk. If you want high speed local storage use a d instance with nvme storage.
Its called economies of scale. When they server 200000 ai subscriptions they dont expect everyone to use the max. They expect some will use more and some will use less and at the end of the day it will even out. Thats how every service works that is for the masses. As soon as you want a guaranteed 1000 tokens you should pay for that.
I don't understand why any solo dev would use aws. Its awfully priced and 99% of people can just use a vps and that should be enough. By the time you blow up and need cloud scale you can afford it.
I used to work one of the top 1000 visited websites, and we have massive bot issues where 60% of our traffic was bots and had to implement solutions similar to cloudflare to reduce the bots. Also, with the raise of ai, it's become even more important since a lot of ai data scraping companies do not respect robots.