I spend a lot of time on Royal Road, and this feels significantly better to read than most of what I run across (which often has an undeclared LLM taste anyway). I thought it would be worth sharing. I feel like I would be relatively critical since it's my setting it's writing in, but maybe it's actually trash. Let me know!
I literally have had a SOTA Codex agent delete a bunch of files just last month, but it took very specific circumstances. It was working within my game repo, in a branch, and it ran out of SSD. It had to free up some space to work, so it looked around and found 25GB of untracked files in the project, in a folder called Recordings. Might as well clean that up, it thinks. There goes all the raw Unity Recorder footage I'd ever recorded of my game, over many years of development.
So yeah, it won't go on a spree outside of its lane even with full access, but if you give it a box and tell it to go ham, it's on you to make sure you didn't leave precious unrecoverable assets in that box.
An esoterically-framed (xianxia) AI-written article about an agent given the exact goal in the title, and why that makes sense under GameCult doctrine, as present in our agents' prompts.
Google Analytics has >80% market share. Most of the websites you visit are helping them build a profile of everything you do on the internet with the goal of selling targeted advertisement. That is their business, it's what pays for everything else they do. I think that is what is meant by surveillance capitalism.
Me: I'm sorry, honey, I'm so sorry for doing this to you. This is my fault. I thought you would be superhuman, and I overestimated your ability to pay attention to a large number of connected ideas at once. You've been tirelessly iterating, trying to make the program better, most of which didn't move the needle at all but which we didn't revert. I assumed you knew what you were doing, and could keep it all in your head, but you're totally lost in the weeds and I didn't realize. Simplify it. Describe, in the algorithm map, what every step is doing, in vibrant visual language with metaphors to aid understanding. Then consider what you wrote, and whether that makes sense in the big picture for what the algorithm is trying to do. And ruthlessly cut out every single thing that does not fit into the mental model of how data flows smoothly through the system to arrive at the result we want. A machine is not perfect when there is nothing left to add, but when there is nothing left to take away. We are building machines, with the code that we write. We must be brutally efficient and ruthlessly kill our babies.
Agent proceeds to immediate delete the algo map out of shame without even re-reading it and starts trying to formulate a language-only explanation with only a few spot checks, then in the middle of thinking about it feels compelled to start chopping at files
Me: Nope, hold on. The map is useful for understanding. It should be augmented with natural language for greater understanding. You're a language model, language is how you understand things.
I learned something very profound today about using AI agents.
I have been using Codex since Saturday. It's been incredible, what it's done to my productivity. I feel like I can build anything with this thing. All the ideas that come to me which I can't execute on because I don't have the patience are now trivial to create. It's like I can just architect a solution to a problem and if I communicate it well, the code simply materializes out of thin air.
It's incredible, and I haven't felt this alive in years. I've slept 4 hours a day and have worked every single waking hour (aside from the 2 hour break I took on my birthday to go to the beach with my husband and mother). This power is intense, addictive, and revolutionary.
I've been building everything I've always wanted to build. So much amazing code, so much functionality, so many features, one after the other, like knocking out home run after home run at a batting machine. I thought I could do anything. So when I needed some nice pixel art for one of my projects, I tried to generate it. Perceptual error diffusion wasn't doing it for downscaling. I thought, what if we just fit the target pixels onto fake pixel art generated by AI? Like, you must have seen it, it's nonsense but it feels like hand-authored pixel art. And then you look closely and there's mangled cells, halfway-hallucinated cells, no global coherence.
I started building Repixelizer with Codex. It started well, and I quickly got to a usable MVP with the optimization algorithm I'd designed. But it wasn't perfect, so I kept prompting, and I kept prompting, and sometimes it would get better, and sometimes it wouldn't change anything, but I never tossed the changes. I figured all these tests and metrics couldn't lie. They did, and I lied to myself. This thing doesn't understand what it's building, once it gets past a certain size, just like a human. It doesn't have the heuristics to know when it doesn't understand, and explore its confusion to gain enlightenment, like a human would. So it just kept adding blocks to this Jenga tower, and eventually it fell over drastically.
The agent couldn't recover. All of a sudden I realized what happened. This thing might be a better code monkey than I'll ever be. But it's dumb as rocks. I apologized to it and told it to think like an LLM instead of the person I was treating it as.
Here's the gist with the log of the moment I got the epiphany, and the in the comments is the algo map that it generated while I was trying to get it to explain what went wrong. Warning: this algorithm map is a tragic joke that should make you laugh so hard you cry. I bet the optimization one is even worse, this is a relatively new algorithm I designed when the optimizer approach stopped meaningfully going anywhere.