Super cool! I noticed you had a blurb about it being used for mesh networks? Could you please go into more details/provide links to resources to learn more about that?
Really? It's what he did after he spent nearly a third of a billion dollars to influence an election (which doesn't include the incalculable value of his influence via Twitter!) that makes him a Bond villain.
It's Chesterton's Fence[0] in action - Elon took a self-proclaimed woodchipper to the United States government without understanding what he was destroying and without concern for the repercussions to society. He used that influence to benefit himself and his companies directly. It's not sharks with laser beams, but it's far more impactful and the world will living with it for decades to come.
It's an inherently different thing. Fibre is infrastructure. It'll still function decades later. GPUs at this scale are consumables. I've heard 3-5 years lifespan before they fail out. This might be a low estimate, but even if you double it - they're 50% of the cost of datacenters. We're flushing entire countries worth of economic value down an Nvidia shaped toilet.
I think part of it is the feeling of false understanding that comes from using llms regularly. They let you operate at a higher conceptual level, and they paper over enough of the actual details that your conceptual model might not actually be correct.
I'm a mechanical engineer by training, and have similar vibes with the similarities I see between llm training and metallurgy. I could probably put together a formal concept for these vibes at this point, but is there actually a "there" there? I have no idea. And it would take me years to actually dive in and learn everything to gain the deep understanding that would be required to know if I'm just experiencing my own brand of AI psychosis or not.
It seems that we're exact opposites! But if mathematics is your thing, it might be interesting for you to explore trying to learn things from a lagrangian perspective first?
Not sure if it'll help you with gaining an intuitive understanding, but at least it'll be interesting!
Ding ding ding! This is a huge reason. Being able to bootstrap a domestic weapons manufacturing base is a massive win for any country these days. South Korea is one of the few countries that are both willing and able to do so with high quality modern materiel.
I've always wanted to figure out how to implement a cooperative source license. Something like, you're allowed to do what you want with it, but any derivative work requires the same license, and X% of any income goes to the cooperative?
Not sure how it'd work, but there's absolutely a niche for a privacy focused data cooperative out there.
I do enjoy the immediate out of touch signaling with the "runs on your 16gb vram laptop" line. Because everyone has a laptop with 16gb vram, or can just pop out and buy a new one, right?
Do you have a collection of these benchmark apps saved anywhere? I'd be particularly interested in seeing the relative cost differences between different models in a use case like this.
It's always been this way. America has just been able to coast on being the only remaining major economy after WW2, and exploited the rest of the world instead. That exploitation of the rest of the globe has been mostly optimized now, so those shareholder returns are now coming at the expense of the 90% of Americans who aren't sitting at the table.
Parts of these cities worse off than the third world? Have you been to a third world country? Or Seattle, for that matter?
The commonly scapegoated cities in the United States are not experiencing third world conditions. Appalachia is experiencing third world conditions. Hollowed out rust belt cities in the Midwest are experiencing third world conditions. These areas are not run by lefty politicians. The United States has a systemic problem, not a local one.
And yes, the systemic problem is that there are a tiny number of ultra wealthy people with wildly outsized influence on the government of the United States, doing everything they can to reduce the amount they need to pay in taxes while simultaneously ensuring they extract the maximum amount of profit from the US government's wildly excessive expenditures.
Indeed. Thankfully - as has been proven time and time again in America - if leniency is given to those who abuse their power, they will absolutely never ever decide to abuse their power again.
That looks like a really nice hackathon! That said, the fact that they probably had a majority of the best NixOS developers in the world under one roof and they weren't solely focused on NixOS error messages is borderline criminal...
It doesn't have to do any thing interesting - it's completely fascinating all on it's own. If you understand anything about the math and science behind LLMs, you'll understand that this is an achievement worthy of sharing to a community like HN.
That being said, small models like these have plenty of use cases. They allow for extra "slack" to be introduced into a programmatic workflow in a compute constrained environment. Something like this could help enable the "ever present" phone assistant, without scraping all your personal data and sending it off to Google/OpenAI/etc. Imagine if keywords in a chat would then trigger searches on your local data to bring up relevant notes/emails/documents into a cache, and then this cache directly powers your autocomplete (or just a sidebar that pops up with the most relevant information). Having flexible function calling in that loop is key for fault tolerance and adaptability to new content and contexts.