You may already be aware, but SE marks all commits making those kinds of changes as '[Editorial]', so it is generally trivial to use their tooling to build your own high-quality ebook without any of the editorial changes.
Mods using AI to clone voice actors' voices without their consent or explicitly against their wishes has certainly been controversial in the Skyrim modding community.
Editorial commits are all marked as such and contain no non-editorial changes. The tools for compiling ebook files are available at https://github.com/standardebooks/tools, so creating your own versions with only the work you're interested in is straightforward (and can be at least partially automated).