Depending on the pre-training structure, you can fine-tune old local models (even locally if you have a nice GPU) to steer behavior towards your desires.
Curious if others have tried any of these and what their thoughts are? Feels like a really great use case for agents that benefits both humans and downstream agents.