Even if you assume best intentions, A/B testing often comes down to a variation of a t-test, the interpretation of which can be fuzzy too - https://www.amstat.org/asa/files/pdfs/P-ValueStatement.pdf (TLDR - when it comes to statistical significance you can be either wrong or vague).