Quoting the famous Science paper More Is Different [1]:
Knowing the laws of physics doesn't tell you how a brain, economy, or society works - because at every level of scale, genuinely new phenomena emerge that require their own science.
I cringe every time I see Claude trying to co-author a commit. The git history is expected to track accountability and ownership, not your Bill of Tools. Should I also co-author my PRs with my linter, intellisense and IDE?
That's very nice and I ended up with the same font I tend to use (Source Code Pro) vs the font I used before (Noto Sans Mono). Some features I'd love to see:
- An ELO-based version with many more variables, so that I can open the site from time to time and find more nice fonts
...at least until we get real Test-Time Training (TTT) that encodes the state into model weights. If vast amounts of human knowledge can be compressed into ~400GB for frontier models, it's easy to imagine the same for our entire context
There is a fantastic book on this topic called "By Design : Why There Are No Locks on the Bathroom Doors in the Hotel Louis XIV" that cover the inception of modern brands. It's a very similar story to what happened to watches. The industrial revolution made quality clothing accesible for everyone, so the cloth appearance no longer was a clear indicative of status, so brands started placing their emblems on the outside of the fabric inside of the inside. At the time it was seen as gross, obvious and bad taste. Guess we had a century to normalize it.
Another big factor is that many areas of the US feature horizontal architecture instead of vertical ones (i.e. Los Angeles vs NY). A bus stop in those areas cover orders of magnitude less people given the same radius
With such a high throughput because of sparsity, I'm particulary interested in distilling it into other architectures. I'd like to try a recurrent transformer when I have the time
To add to this, the low-level constraints also make this assumption noisy, no matter how smart the compiler is. On the CPython case, if you do `dis.dis('DAY = 24 * 60 * 60)` you will see that constant folding nicely converts it to `LOAD_CONST 86400`. However, if you try `dis.dis('ATOMS_IN_THE_WORLD = 10*50')` you will get LOAD_CONST 10, LOAD_CONST 50, BINARY_OP **.
Knowing the laws of physics doesn't tell you how a brain, economy, or society works - because at every level of scale, genuinely new phenomena emerge that require their own science.
[1] https://www.science.org/doi/10.1126/science.177.4047.393