How to scale AI without using nuclear reactors (Adaptive attention)(medium.com)

https://medium.com/@hyborian_/sparse-adaptive-attention-moe-how-i-solved-openais-650b-problem-with-a-700-gpu-343f47b2d6c1