Do we want to train the model during inference? I would think we want to be very particular about the data used to train - notably after OpenAI's notes on the subject.
What happens when you hit a guardrail because there was a politically-charged or socially-condoned phrase? What if the documents are potentially sensationalist news articles or Wikipedia articles with potentially-questionable topics?