I'm hoping the current oil-war will cause people to re-assess fossil fuel use as expense becomes untenable and we start choosing electric vehicles and renewables.. which will just become "normal" and oil can stick around for synthetic chemistry routes.
When is a heap of sand a heap of sand? The answer isn't in the heap of sand, it's in the observer. LLMs are a VERY heap-like pile of sand, and people are starting to see a mind where one might not yet be. I'm trying out a new word for this phenomenon...
Good enough for me. I created the project because I love terminal, and wanted to make something using Claude (to learn how this tool works, strictly for personal enrichment) that solves a small problem I had with some overlapping cron job management.
Sometimes you have a cron job that takes longer than it should (but inconsistently so), and another cron job that clobbers what that cron job is doing.
A lot of people throw around 5% efficiency for Peltiers, and it's just not true - it depends heavily on the temperature differential and current vs. IMax. You can (with care) drive them >2.0 COP.
This isn't anything like a compressor or heatpump system, but Peltiers get a bad rap... they move heat really well if you're not pushing them to the edge.
I've spent an afternoon attempting to compile and run RWKV7 locally.. and I just don't get it. lotta errors in compiling... and it's a lot. Like a lot, a lot... it's walls of versions and sub projects.
Any kind of quickstart guide?
Also found.tried rwkv.cpp, and I can't seem to compile that either.
You can add a little calcium carbonate to these inks to give them a little shine and offset some of the acidity.
The really neat thing about these inks is that they are soluble when made, and you can write on a document, then - as they dry - , the soluble iron tannates that work into the fibers form an Fe3+ tannate, which is insoluble - you aren't writing on the surface, you're dying the fibers. This is why palimpsest can occur when documents where scraped and re-used (so you can read the originals with Xray methods)
Source: I have a battery patent based on iron-gall inks (US10749168B1), and it's fun stuff to play with! (see more @ http://bigattichouse.com )
I've been fascinated by a small mention in the 1.58bit quantization article that mentioned 0.68 quantization , which I believe to mean 0,1 instead of 1.58's -1,0,1. When I read https://www.reddit.com/r/LocalLLaMA/comments/1bpa6ol/unoffic... great experiment of making their own unofficial 1.58b quantization, I began to wonder if I could squeeze a vector down to 1 bit. And.. I can! (with some caveats in the discussion)
It was when I realized that XNOR and population count could basically score 32 dimensions at a time.
While this isn't ANYTHING like an actual quantized LLM, I thought it was a really nice proof-of-concept, and could be very useful for smaller machines running RAG applications.
I've been fascinated by a small mention in the 1.58bit quantization article that mentioned 0.68 quantization , which I believe to mean 0,1 instead of 1.58's -1,0,1. When I read https://www.reddit.com/r/LocalLLaMA/comments/1bpa6ol/unoffic... great experiment of making their own unofficial 1.58b quantization, I began to wonder if I could squeeze a vector down to 1 bit. And.. I can! (with some caveats in the discussion)
It was when I realized that XNOR and population count could basically score 32 dimensions at a time.
While this isn't ANYTHING like an actual quantized LLM, I thought it was a really nice proof-of-concept, and could be very useful for smaller machines running RAG applications.