It doesn't really even sound sci-fi, or rather, it would make for some bad sci-fi. What we are at risk of, is having deterministic model artifacts trigger complex unintended consequences from being fetishized as decision-making agents. Considering how few CS and AI people I've met who even know that e.g. pragmatics are a critical component of sentence meaning, I sense the most proximate AI dystopia is a lot closer to this latter scenario.
Conceptually the possibility of an AGI does present a real challenge (& one worth grappling); in practice, we haven't made any progress really toward realizing that problem. We've become good at feeding "large" datasets into algorithms that are many orders of magnitude less advanced than a lizard brain. Then we get to the issue that our large datasets are only large when thinking of classical statistical sample sizes. They nonetheless are lacking in redundancy, interactivity, stakes or any centered perspective such that there is no chance of anything resembling intelligence, agency, or plain old intentions arising.
The former is a superset of the latter. Companies are political entities. At the most obvious level they are legal entities, and law is politics.
But the mistake here (and some other comments) of drawing "lawmakers", "politics", etc as being conceptually distinct from private corporations is particularly absurd from a historical view. The Protestant Reformation and the Enlightenment forged political battles with substantial effort, debate, human cost that over centuries invented the concept you take granted as "companies", but which no other human civilization previous would have been familiar with. That there are "companies" at all is political, and so the OP is already pointing to a failure of politics.
Many things that are deemed socially uncomfortable are a part of the same board on which the socially comfortable game is played.
Moreover, the vast majority of examples one can come up in science are not truths, and in fact a core premise of science is each state of scientific knowledge is contingent and not final, i.e. it's not True, but it should be a more faithful description of what is happening than we had before.
Conceptually the possibility of an AGI does present a real challenge (& one worth grappling); in practice, we haven't made any progress really toward realizing that problem. We've become good at feeding "large" datasets into algorithms that are many orders of magnitude less advanced than a lizard brain. Then we get to the issue that our large datasets are only large when thinking of classical statistical sample sizes. They nonetheless are lacking in redundancy, interactivity, stakes or any centered perspective such that there is no chance of anything resembling intelligence, agency, or plain old intentions arising.