When you watch on vhs or laserdisc the loss of resolution only bothers you til the movie sucks you in.
At that point it’s irreverent because your eyeballs are not watching a long sequence of pretty still pictures, but rather your brain is watching a story in a way similar to reading a good book.
It’s not a process monitor, really, but to me the AWS Lightsail monitor tab feels like this. The “sustainable” line hits me right in the OCD to keep me grinding on cpu usage of the workload to keep extra spend at zero.
I have this as well, but run a heavily locked down and isolated BIND server with NSD and Unbound for external authoritative and internal caching DNS respectively.
Its easy to feed an RBL to unbound to do pi-hole type work, I use pf to transparently redirect all external DNS requests to my local unbound server but I get the bind automation around things like DNSSEC, DHCP ddns and ACME cert renewals.
It's a bit harder when they've provided the safetensors in FP8 like for the DS3 series, but these smaller distilled models appear to be BF16, so the normal convert/quant pipeline should work fine.
I think we agree on almost all points, but I thought ollama-gui was an official gui, so I’m even more baffled as to what the draw is. Running as a llama.cpp as a service/API endpoint is trivial (I do just that). Maybe you can outline for me what the value proposition of ollama is so I can better understand what it does that plain llama.cpp doesn’t.
It's very hard to put into words without coming off as being unfair to one side or the other, but the ollama project really does provide little-to-no _innovative_ value over simply running components of llama.cpp directly from the command line. 100% of the heavy lifting (from an LLM perspective) is in the llama.cpp codebase. The ollama parts are all simple, well understood, commodity components that most any developer could have produced.
Now, applications like ollama obviously need to exist, as not everyone can run CLI utilities, let alone clone a git repo and compile themselves. Easy to use GUIs are essential for the adoption of new tech (much like how there are many apps that wrap ffmpeg and are mostly UI).
However, if ollama are mostly doing commodity GUI things over a fully fleshed-out, _unique_ codebase to which their very existence is owed, they should do everything in their power to point that out. I'm sure they're legally within their rights because of the licensing, but just from an ethical perspective.
I think there is a lot of ill-will towards ollama in some hard-core OG LLM communities because ollama appears to be attempting to capture the value that ggerganov has provided to the world in this tool without adequate attribution (although there is a small footnote, iirc). Basically, the debt that ollama owes to llama.cpp is so immense that they need to do a much better job recognizing it imo.
I also agree. I was IT lead for a Kraft paper plant in the recent past, and the control rooms were indistinguishable from these.
The big difference, which you wouldn't realize from pictures, is that the guts of all the old relay-based control systems had been ripped out, and the entire place was being run on a few racks of Delta-V automation controllers.
The also had an enormous data centre room in the admin building that had been knocked back to two sparsely populated racks from maybe 50 at its peak.
So much crufty and interesting tech at that place...VAX, AS/400, Netware 4...and I could go on about the scale of the place (7 story tall boiler!)
I'm currently reading "Mathematics: From the Birth of Numbers
by Jan Gullberg" with my 3 sons (16, 12 and 10), and by taking it slow (one minor number per day) with lots of work together its helping build things up for them from first principles.
I read it myself years ago and it was a great and entertaining way to fill in the gaps from my meager math education.
At that point it’s irreverent because your eyeballs are not watching a long sequence of pretty still pictures, but rather your brain is watching a story in a way similar to reading a good book.