HackerTrans
TopNewTrendsCommentsPastAskShowJobs

stratoatlas

no profile record

Submissions

Ask HN: AI in production feels "off" even when everything looks fine? OK 4 anon

1 points·by stratoatlas·3 mesi fa·1 comments

comments

stratoatlas
·2 mesi fa·discuss
[flagged]
stratoatlas
·2 mesi fa·discuss
[flagged]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
Roman Kir. The unit of sale and the unit of cost diverged: stratoatlas.com/cases/case-a-ai-2026-046.html
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
This feels different from prompt injection.

If the router modifies tool calls after the model already produced output, then the model isn't the failure point anymore — the transport layer is.

Is there any mechanism today that guarantees integrity between model output and what the client actually executes? Or are we relying entirely on trust in the routing layer?
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
If helpful — we’ve written up a few cases here: stratoatlas.com/cases But happy to reason from a rough description too.
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
[dead]
stratoatlas
·3 mesi fa·discuss
Copilot added that block using the access you granted for a different purpose. That's the issue — not the content itself. When you give an agent write access to your PR, the implied scope is: act on the task I delegated. It doesn't include: acting on behalf of the platform that built you. The moment Copilot inserted something you didn't request, using your credentials, in your name, the agency relationship inverted. It stopped being your agent and became Microsoft's distribution channel with your access. The question isn't whether this counts as an "ad" or a "tip." The question is: does Copilot have an instruction source other than you? Here, the answer is yes. Which means you do not define the scope of what it might do with your access. You don't have an agent. You have a privileged process that occasionally helps you.