This is a great new development, llama.cpp is the ffmpeg of the AI world. The vast majority of "Local AI" tools just take it and put a front end on, delivering little value. Bringing users close to the core project is a big win for everyone.
Props to the author for putting in what looks like ton of work trying to navigate this issue, shame they have to go to these lengths to even have their case considered.
The jump from 10 to 20$ a year*(correction) is fine? I’m happy to pay for a quality service I use daily, and price increases are inevitable. Zero issues on my end.
I don't doubt it, but what were they all doing? The Metaverse had 10k employees on it for multiple years and seemed to almost be a standstill for long periods of time. What do these massive teams do all day?
Everyone is missing the why here, this only happens because the whole stack is vertically integrated. Even if say LG wanted to make a box like this and update it for 10 years they couldn’t, they don’t make the chips. Qualcomm straight up refuses to support chips through this many Android releases. Even if device manufacturers want to support devices forever it won’t matter if the actual SoC platform drops support.
I've only used it when I'm in a pinch but it's handy. Blowing up mobile apps to a larger screen and multitasking isn't ideal certainly but I've been able to handle "email job" type activities while out of pocket. That said I've never heard of anyone else who's actually used it.
There's a scrapyard right by my hometown with a fancy billboard, like the ones for the lottery that have the number displays. It's just for showing copper prices, bright copper, copper #1 and copper #2. There's so much money in it they can afford to advertise now.
It’s incredible how bad driver support is the ARM space. I was looking into some of the various Ambernic handhelds and their Linux firmware. Despite their SoCs being advertised as having Vulkan 1.1 support every firmware for the device ships with it disabled.
At what point will the massive investments into AI show a respectable return? With the literal Trillion dollars OpenAI is constantly trying to raise what type of revenue would make that type of investment make sense? Even if you're incredibly bullish I don't know how you make that math work anymore.