GPT-2 implementation in Modular MAX(github.com)
github.com
GPT-2 implementation in Modular MAX
https://github.com/tommyip/max-gpt-2
1 comments
I am learning to write LLM pipelines using the Modular MAX inference framework. As a starting point I got GPT-2 working after reading through "The Illustrated GPT-2", Karpathy's nanoGPT codebase and existing models in the Modular repo. The MAX framework does require a lot of boilerplates and not designed to be very flexible, but you do gain awesome performance out of the box.