Tide: Token-Informed Depth Execution for Per-Token Early Exit in LLM Inference(arxiv.org)
arxiv.org
Tide: Token-Informed Depth Execution for Per-Token Early Exit in LLM Inference
https://arxiv.org/abs/2603.21365
1 comments
You forgot to remove the NeurIps tag