Ask HN: Self-hosting LLMs, is it worth the setup?

1 pointsby sb13anno scorso2 comments

With the advent of DeepSeek, I was thinking if I should consider self-hosting open source LLMs vs using OpenAI APIs. Who here has done this already? And what are your main reasons, privacy or cost?

3 comments

8thcrossanno scorso

people have been doing this for a while now? cost is one factor obviously, but privacy, security, and offline use comes to mind.

sb13anno scorso

I was thinking more about them in my cloud environment. Was it easy to setup and maintain for you?

[deleted]anno scorso