Show HN: Tokiwi – An online tokenizer for any Hugging Face modeltokiwi.dev2 points·by TweedBeetle·l’année dernière·0 comments
TweedBeetle·il y a 2 ans·discussRegarding how they’re getting to 10M context, I think it’s possible they are using the new SAMBA architecture.Here’s the paper: https://arxiv.org/abs/2312.00752And here’s a great podcast episode on it: https://www.cognitiverevolution.ai/emergency-pod-mamba-memor...
Here’s the paper: https://arxiv.org/abs/2312.00752
And here’s a great podcast episode on it: https://www.cognitiverevolution.ai/emergency-pod-mamba-memor...