sophia_james·9 か月前·議論I’m not sure if I understood this correctly:1.Recursion is used to break down the large context and dispatch to different LLM calls to get the useful context.2.This may lead to longer test-time execution on large contexts (even with parallelism in deep recursion), and the monetary cost may increase rapidly.I think it’s a different idea from using RAG or manually maintaining a context windowcorrect me if I'm wrong
1.Recursion is used to break down the large context and dispatch to different LLM calls to get the useful context.
2.This may lead to longer test-time execution on large contexts (even with parallelism in deep recursion), and the monetary cost may increase rapidly.
I think it’s a different idea from using RAG or manually maintaining a context window
correct me if I'm wrong