Having read above article, I just gave llama.cpp a shot. It is as easy as the author says now, though definitely not documented quite as well. My quickstart:
Go to localhost:8000 for the Web UI. On Linux it accelerates correctly on my AMD GPU, which Ollama failed to do, though of course everyone's mileage seems to vary on this.
It's a new-ish project FYI. But to answer your questions:
- Apps: It's Linux (like desktop or server), but "image-based" so you install apps in containers like iOS or Android do (and therefore OS updates basically-never break). https://flathub.org is generally the main app store for Linux containerized phone apps.
Updating without worries has made it much more daily-drivable for me on a Oneplus 6 (ie. it has rollbacks and image-based updates), despite being so new. It's fun that image-based OSs - which were arguably popularlized by phones - are now coming back to phones on the Linux side too.
Hot take from an AI skeptic: between this, Nano Banana and generative AI integrated into Gmail for repetitive emails, I’m starting to actually use Google’s AI for tasks I hate most.
Google appears to have their AI product game together!
I'm working on a super-simple budgeting app called https://4keynumbers.com, which is based on Ramit Sethi's Conscious Spending Plan. It currently syncs my expenses from Plaid and cooks it down into a single chart, with only savings, investments, bills/fixed, and "safe to spend" as categories.
As soon as Fedora/Centos updates their images (pretty much immediately usually as it's upstream of EL), and the CI runs to re-layer the Bluefin changes. They also have Dependabot set up. https://github.com/ublue-os/bluefin/actions
Yes! I used to use Silverblue too. Things like Tailscale, Docker, Davinci Resolve, nvidia drivers, and all codecs are a button-click away or already properly set up for you out of the box on the universal blue projects.
Same here! Been developing embedded, server and frontend stuff all fron Bluefin/Bazzite for 2 years now. Having Homebrew and Tailscale all set up for me is super clean, and the system is just set-and-forget. Gaming works great too.
Very well written and reasoned article. I’ve struggled with a lot of the same issues with SQLite prod deployments. They appear simple, but then after you’ve ensured your file is on non-ephemeral storage, sorted out backups, and thought about vertical scaling or having separate dbs for jobs and models, a lot of the benefits over psql disappear IMO.
The main benefit over psql of course being that you don’t need to pay for a hosted db like RDS, or have a separate database server.
I’ve found a happy middle ground in simply self-hosting psql and my apps on the same VPS with something like dokploy. Local development is still easy enough, and remote deployment in containers is 1-click with Dokploy, and ends up being simpler to reason about IMO. My take below, if anyone’s interested.
The product: https://pilaenergy.com