Prompts and prompt rot could potentially be solved by dynamic injection of relevant, embedded snippets to dynamically build prompts. Right now most company's prompts are too small to suffer from such bloat, but I'm guessing soon we'll see it.
Have any of you tried this? What was the LOE and did you benchmark it? What did you find?
Have any of you tried this? What was the LOE and did you benchmark it? What did you find?