What do you mean by intelligence? And by your definition of it, can intelligence be improved intentionally or it happens as it happens like for evolution? If it happens by intention then why we have not pushed it at its maximium yet?
Man that's what I've been asking people all the time: what is our end goal? When will we say "this is enough", we can stop here? If we don't know the answers for these question, then we better find answers before going "forward" blindly.
Imagine people like Sam Altman having access to frontier models without any restrictions that allows them plot strategies to reach their goal in a long term timespan that you don't even realize when it even began.
That's scary. They could fight for censored model for the mass, not for them.