> why does bit erasure end up in energy expenditure
Following this explanation from the link:
"Theoretically, room‑temperature computer memory operating at the Landauer limit could be changed at a rate of one billion bits per second with energy being converted to heat in the memory media at the rate of only 2.85 trillionths of a watt (that is, at a rate of only 2.85 pJ/s). Modern computers use millions of times as much energy."
I understand that to flip a 1 to a 0 it is necessary to dissipate that energy into heat.
Edit: But also I'm not sure how reversibility avoids that.
https://github.com/ggerganov/llama.cpp/discussions/4167