What do you mean? In the whitepaper they say that the original can't run on an iPhone 17 at all, and on an M4 the Bonsai version runs 5.6x faster than the original.
This quantization has a small order of magnitude improvement on memory and compute requirements, how can it be slower?
I had a long ELI16 session with Claude about it, and the way I understand it is that they
- use Ising machines to describe a certain problem into clauses, storing system state (e.g. spin of something) in variables
- then use a neural network layer where each neuron determines the value of one clause
- then for each state item, use the neuron output to determine if flipping that state would improve the overall system score
- and then use FN-like "noise" to determine whether to flip or no
If the energy landscape of the problem is pretty local, this is guaranteed to find a good solution to the system, using way less compute than brute-forcing it.
In armageddon, you would run out of fuel around day 3 and then that's it.
A CyberTruck will charge just fine from anything that can generate the proper AC or DC, no phoning home needed. Many home solar installations can work off grid and charge your car.
This quantization has a small order of magnitude improvement on memory and compute requirements, how can it be slower?
And all that while retaining quality.