Training a 67M-parameter transformer on an M4 Mac Mini(geddydukes.com)
geddydukes.com
Training a 67M-parameter transformer on an M4 Mac Mini
https://geddydukes.com/blog/tiny-llm
4 comments
Cool post. And you might find it interesting. https://github.com/KellerJordan/modded-nanogpt
Thanks, I hadn't seen this repo before I'll check it out!
Cool post but the cursor shadow is a huge distraction
Just went ahead and removed that, thanks for the comment and hopefully this will make it less distracting.