Note that I am not saying that "throw away regulation, always less regulation is better".
That would be asking to drop all regulations.
I am saying that regulations have cost so you should have as little as regulation as possible to achieve wanted effect.
And wanted effect often should not be literally zero of accidents or bribery or corruption. As it may be either impossible to achieve or extra side effects not worth it past certain point.
In other words minimisation of how much regulations you have should be one of targets.
This applies also to enacting monstrously stupid regulations. Or even ones that were introduced entirely as revenge or to create opportunity for corruption.