Ask HN: Could an LLM predict someone's speech 5 seconds ahead in realtime?1 ポイント·投稿者 comova·2 年前·3 コメント
comova·昨年·議論I believe this is to improve performance by shortening the context window for long thinking processes. I don't think this is referring to real-time summarizing for the users' sake.