We can keep math, but switch to better theories, with plausible explanations.
A kind of Pilot Wave can explain quantum weirdness to layman people with ease.
We can ditch theory relativity and calculate speeds relatively to CMB, which is much easier to understand.
We can ditch Big Bang theory and, instead, accept that light is not immortal, because it ages with time. IMHO, Dipole Repeller and Shapley Attractor are much more attractive and easier to explain than Big Bang.
I'm trying to explain quantum physics using single photo[0] (in Ukrainian, but you will get it). It has good adoption among regular people. It based on real physical experiment, just labels are added. BUT scientist are insane when they see it. They argue that quantum physics cannot be explained using picture, because the only true way to explain quantum physics is using mathematics.
Foundations of physics have not progressed in 40 years because all other alternative theories are downvoted to death.