Top New Trends Comments Past Ask Show Jobs

Local 1M Context Inference at 15 tokens/s and ~100% "Needle In a Haystack"(old.reddit.com)

1 points·by quxinxin·2 lata temu·0 comments

Local 1M Context Inference at 15 tokens/s and ~100% "Needle In a Haystack"

https://old.reddit.com/r/LocalLLaMA/comments/1f3xfnk/local_1m_context_inference_at_15_tokenss_and_100/

0 comments

—

Local 1M Context Inference at 15 tokens/s and ~100% "Needle In a Haystack" · HackerTrans