Petals runs Llama 2 (70B) from Colab at 5 tokens/sec(github.com)
github.com
Petals runs Llama 2 (70B) from Colab at 5 tokens/sec
https://github.com/bigscience-workshop/petals/releases/tag/v2.0.0.post1
3 comments
We've moved to a new domain, the chat is now at https://chat.petals.dev
Great project and I'm happy to see it expand to more models!
Colab: https://colab.research.google.com/drive/1uCphNY7gfAUkdDrTx21...
Project description: https://github.com/bigscience-workshop/petals