I spent 2 weeks playing god. My learnings from 597 genetic algorithm lineages(blog.silennai.com)
blog.silennai.com
I spent 2 weeks playing god. My learnings from 597 genetic algorithm lineages
https://blog.silennai.com/genetic-algorithm
2 comments
Thanks! I do have a section on this in the article "Why genetic algorithms aren't state of the art"
"Physics simulation involves discontinuities (contacts, friction regimes), long rollouts, and chaotic dynamics where small parameter changes lead to large outcome differences. Even with simulator internals, differentiating through thousands of unstable timesteps would yield noisy, high-variance gradients. Evolution is simpler and more robust for this regime." "The real tradeoff is sample-efficient but complex (RL) vs compute hungry but simple (GA). DQN extracts learning signal from every timestep and assigns credit to individual actions."
DQN likely would have handled this much better.
"Physics simulation involves discontinuities (contacts, friction regimes), long rollouts, and chaotic dynamics where small parameter changes lead to large outcome differences. Even with simulator internals, differentiating through thousands of unstable timesteps would yield noisy, high-variance gradients. Evolution is simpler and more robust for this regime." "The real tradeoff is sample-efficient but complex (RL) vs compute hungry but simple (GA). DQN extracts learning signal from every timestep and assigns credit to individual actions."
DQN likely would have handled this much better.
To be clear I think GAs are way cooler though haha. So kudos to you for this awesome write up