What happens when AI mediates everything?
5 comments
The monoculture point is the one that stays with me. It's not that the answers get worse rather it's that the range of questions being asked quietly narrows. When the same substrate mediates how a doctor diagnoses, how a student drafts, how an analyst decides, you don't get one catastrophic failure. You get a slow convergence in how problems get framed in the first place.
The historical parallel that comes to mind is the spreadsheet. It didn't make finance wrong, and it made certain ways of thinking about finance invisible. Decisions that didn't fit a row/column model stopped getting made, not because anyone chose that, but because the friction was asymmetric.
> a monoculture isn't fragile because each plant is evil. It's fragile because diversity of response has been thinned.
Human culture needs dissent in order to advance.
Human culture needs dissent in order to advance.
Agreed — but the part that really worries me is that dissent doesn't just need to be allowed. It needs to be practiced.
We tend to think of dissent as something that's either permitted or suppressed. But there's a third state: dissent that's technically available but that nobody reaches for because the system works well enough that disagreement feels pointless.
That's the scenario I keep circling. Not a ban on questioning — just a world where questioning feels as odd as arguing with your GPS. You can. But why would you? It's usually right.
The monoculture metaphor is exactly about this. A field of identical crops doesn't prevent other plants from growing. It just leaves no space, no soil, no light for them. The suppression is structural, not intentional. And by the time you notice the fragility, the seed bank is empty. This is hoorifying.
We tend to think of dissent as something that's either permitted or suppressed. But there's a third state: dissent that's technically available but that nobody reaches for because the system works well enough that disagreement feels pointless.
That's the scenario I keep circling. Not a ban on questioning — just a world where questioning feels as odd as arguing with your GPS. You can. But why would you? It's usually right.
The monoculture metaphor is exactly about this. A field of identical crops doesn't prevent other plants from growing. It just leaves no space, no soil, no light for them. The suppression is structural, not intentional. And by the time you notice the fragility, the seed bank is empty. This is hoorifying.
The scariest scenario isn't misalignment. It's a doctor who hasn't made an independent diagnosis in years. A student who has never experienced a blank page. A citizen whose appeal is reviewed by the same system that made the decision. Not because anyone planned it, but because the convenient path was always right there, and the alternatives quietly defunded themselves.
I built two interactive essays exploring this. The first lets you feel the erosion from inside — including a branching dialogue where every choice you make (even resisting) gets gently re-routed by a helpful system. The second asks what actually preserves curiosity, drawing on historical parallels: we've been here before with the printing press, industrialization, and mass media. Each time, the thing that worked wasn't rejection — it was deliberate cultivation of what efficiency would have erased.
One thought that stuck with me while building this: a monoculture isn't fragile because each plant is evil. It's fragile because diversity of response has been thinned. An AI-centered society might become brittle not because the assistant gives wrong answers, but because too many institutions share the same mediating substrate.
Pure static HTML. Loved seeing my thoughts come to live in an interactive way. Perhaps you might too. Either way let me know.
https://essays-about-the-future-with-ai.netlify.app/
Note about use of AI: I wrote down my throughts over the last few weeks. Then I had Opus 4.6 and GPT 5.4 also write down their thoughts over 30 distinct sessions each. Then I read the summary of the sessions and made some notes. And then had Opus combine my notes and their musings into a HTML page.