> Then I compared the implementation, for correctness, to other systems, finding that other implementations sometimes contained more errors. I researched more, and found that the local inference world is full of subtle errors that accumulate and damage the model output, issues in the attention implementation causing performance slopes after the context is over a certain limit because indexed attention implementations are broken (do more work than they should, for instance), and so forth.
I agree 100% that AI helps a lot with that. But I feel like there's something missing between "AI helps a lot with that" and "I believe reading code is mostly pointless". I genuinely wonder how the above can be accomplished without reading any code.
The idea that you need to motivate yourself to do a thing you don't want to do is an idea that needs deeper investigation. I've caught myself trying to do that a bunch of times. Why the hell I think I need to do this thing in the first place?
I totally get things like I have a job and there's a task that needs to get done. But what about outside the job life?