Show HN: Rust BPE tokenizer for Qwen models that's 12x faster than HuggingFace(github.com)
github.com
Show HN: Rust BPE tokenizer for Qwen models that's 12x faster than HuggingFace
https://github.com/sweepai/bpe-qwen
0 コメント
—
https://github.com/sweepai/bpe-qwen
—