When you train a neural network, it is not search, it is descending through a curve.
If you were to search for billions of parameters by brute force, you literally could not do it in the lifespan of the universe.
A neural network is differentiable, meaning you can take the derivative of it. You train the parameters by taking finding gradient with respect to each parameter, and going in the opposite direction. Hence the name of the popular algorithm, gradient descent.
"The fact that I started a new career all over again, at the bottom of the ladder, after being fired by IBM and rejected by family and friends . . . may also give hope to others trapped in similar situations."
My understanding is that a meme spreads through memetics similar to how a gene spreads through genetics. Ideas will spread that are fit for reproduction, i.e. communication.
Oftentimes memes are powerful at reproducing, but in science we don't want ideas that are likely to spread. We want ideas that are truthful
"A meme is an idea, behavior, or style that spreads by means of imitation from person to person within a culture and often carries symbolic meaning representing a particular phenomenon or theme."
Paper authors use "All You Need" to allude to the well-known transformer paper, even if their proposed technique is not in fact all you need.
This trend of "All You Need" in paper titles needs to die. The original "Attention is All You Need" used that title because it is literally true in their case. So many papers just use it as a meme now, and it distracts from the true insight of the paper.
I don't find Ted Kaczynski's manifesto to be insightful. It points out that technology has flaws, which is frankly quite obvious and is a fact that everyone already agrees with. Furthermore, his proposed solution is crap.
He proposes that we just go back to wilderness, which is bad for many obvious reasons. Technology and division of labor has allowed us to spend our days improving humanity rather than finding food just to survive. We need to find better coordination mechanisms that allow us to apply technology towards good things.
Nobody actually follows the philosophy of "you take, and give as you can"
As the article mentions, nobody else contributed to corejs in a meaningful way. Everyone takes, but nobody gives. This is called tragedy of the commons, and it is a well-known problem in economics
Claude Code seems neither quick nor simple