HackerTrans
TopNewTrendsCommentsPastAskShowJobs

pastaheld

no profile record

Submissions

Ask HN: Using selfhosted LLMs in your company

8 points·by pastaheld·há 2 anos·0 comments

comments

pastaheld
·ano passado·discuss
> My guess as to why most apps are now a web UI on top of a DB is because it’s easy to “install”.

That plus web dev is trendy and everybody is learning it. I wouldn't know how to code a proper desktop app right now, I've not done it in years. I don't want to criticize that or the centralization aspect – there will still be ways to put these centralized things on a PC for example.
pastaheld
·ano passado·discuss
Love it! I've been thinking about this a lot lately. It's crazy how many great FOSS alternatives are out there to everything – and while they might be relatively easy to install for tech-people ("docker compose up"), they are still out of reach for non-tech people.

Also, so many of these selfhostable apps are web applications with a db, server and frontend, but for a lot of use cases (at least for me personally) you just use it on one machine and don't even need a "hosted" version or any kind of sync to another device. A completely local desktop program would suffice. For example I do personal accounting once a month on my computer – no need to have a web app running 24/7 somewhere else. I want to turn on the program, do my work, and then turn it off. While I can achieve that easily as a developer, most of the people can't. There seems to be a huge misalignment (for lack of a better word) between the amount of high-quality selfhostable FOSS alternatives and the amount of people that can actually use them. I think we need more projects like yours, where the goal is to close that gap.

I will definitely try to use selfhostblocks for a few things and try to contribute, keep it up!
pastaheld
·ano passado·discuss
Exactly what I have been brainstorming a couple of times recently. I think it's a really cool idea, although I wouldn't know why anybody would want to switch? It would probably become rather niche (which is possibly even for the best). And if a critical mass switches over, what would prevent it from having the same kind of people and behaviour?

That being said I would be absolutely down to go down that rabbithole.
pastaheld
·ano passado·discuss
Yes I get mad at these posts, and then even madder at me for scrolling through the feed in the first place. But this is great, thanks!