I got LLaMa 7B running on the CPU on Apple Silicon a while ago by simply removing references to CUDA in the python code and changing an unsupported half-precision float to a full, but couldn’t get the larger models running.
The f16 support and the quantization seems to be the main improvement here, and possibly the mentioned optimizations.
Interesting, but seems that this still has a long way to go. The highest maximum energy product they've been able to achieve is 20 MGOe in thin foils, compared to approx 40 for NdFeB. But, at least might work out being a cheaper and more environmentally friendly alternative to SmCo.
As a fan of everything along the Roguelike spectrum, I’m happy enough with the “compromise” labels.
Traditional Roguelike for full-on Berlin Interpretation Roguelikes, like Nethack and Dungeon Crawl Stone Soup.
Roguelite for Slay the Spire, FTL, and similar. Much easier to say than Roguelikelikes or Games with Roguelike Elements.
And the word Roguelike? The battle was lost a long time ago, and most people will understand it to encompass both categories above. (Even though I personally have a tough time taking it to include the three great games in the mechanics radical column of the chart).
Maybe a random post button? I sort of like the idea of experiencing the overwhelming incoherentness. I often find interesting stuff when clicking the “new” button on HN.
I really like this, and I like the first few random posts I read. Is there a way to view the newest public posts? Discover seems to show random posts from months ago.
My previous job was perfect, except for the terrible manager. I spent years wishing a product like yours existed, in the hopes that I could refer him anonymously without any risk of retaliation and another company could recruit him away.
Alas, society wasn’t ready for your startup, and I was the one allowing myself to get recruited away.