This is not a "standard evopsych position". Evolutionary psychology seems to get conflated with a lot of unsavory bullshit just because the latter uses appeals to the former. Most people I know who do evolutionary psychology are extremely careful to point out all the ways they differ from (usually) sexists because they're so damn tired of people conflating one with the other.
There are probably lots of people who need to hear this, and given the people who'll be attending and made it clear how much of a fuss they would make, it was obviously the right call to disinvite him.
I think it's still worth briefly lamenting that our culture is heading in this direction. I see more and more echoes of the worldview and tactics that ultimately killed just shy of a hundred million people or so last century, and yes, it scares me.
Do you have any thoughts you'd be disinvited via public pressure from the best conferences for having? Will you in the culture of twenty or thirty years from now? Grist for the mill.