Adaptive speculative decoding: picking draft lengths at runtime(fergusfinn.com)
fergusfinn.com
Adaptive speculative decoding: picking draft lengths at runtime
https://fergusfinn.com/blog/adaptive-speculation/
0 comments
—
https://fergusfinn.com/blog/adaptive-speculation/
—