Ask HN: Is a slow ChatGPT response an indication of difficulty in some sense?
Maybe it requires data that is not cached? Or maybe there is more computation involved?
3 comments
It could be system load, or it could be Microsoft trying to manipulate you into buying premium. Could be anything, really. OpenAI is far from open.
LLMs don’t currently “think”. So I assume a slow response is just a system load issue.
No, It's just because the service is overloaded