This is awesome, been going through the little book as a way to refresh myself on linear algebra which I see has been updated as well. Luckily only on chapter 4 so definitely going to start doing the labs alongside the book now!
Huh never thought of the process of drafting while writing to be similar to how diffusion models start with a noisy set. Super cool for sure though I'm curious if this (and other similar research on making models think more at inference time) are showing that the best way for models to "think" is the exact same way humans do
I remember this paper when it came out a couple months ago. Makes a lot of sense, the use of tools like ChatGPT essentially offshore the thinking processes in your brain. I really like the analogy to time under tension they talk about in https://www.theringer.com/podcasts/plain-english-with-derek-... (they also discuss this study and some of the flaws/results with it)