Bits-per-Byte (BPB): a tokenizer-agnostic way to measure LLMs(dipkumar.dev)
dipkumar.dev
Bits-per-Byte (BPB): a tokenizer-agnostic way to measure LLMs
https://dipkumar.dev/posts/llm/bits-per-byte/
0 comments
—
https://dipkumar.dev/posts/llm/bits-per-byte/
—