Teaching My AI to Sleep: Continual Learning with Llama 3 on a Mac Mini(medium.com)
medium.com
Teaching My AI to Sleep: Continual Learning with Llama 3 on a Mac Mini
https://medium.com/@brfmjvgd/teaching-my-ai-to-sleep-continual-learning-with-llama-3-on-a-mac-mini-e797055d6b7a
1 comments
Looks like a great application of the Titans and Miras paper published by Google research a year ago. You seem to be facing a problem of what to learn during 'sleep'. The paper has a great opinion on determining exactly that mathematically. This gives me an idea too