abel_ · HackerTrans

3 bulan yang laludiscuss

This misses the broader ongoing trend. For a few million dollars, of course you can create a startup that builds tools it can use to more efficiently find code vulnerabilities. And of course you can do this with weaker models with scaffolds that incorporate lots of human understanding. The difference now is that you don't need an expensive team, nor a bunch of human heuristics, nor a million dollars. The requisite cost and skill are falling rapidly.

abel_

4 tahun yang laludiscuss

On the contrary -- the opposite will happen. There's a decent body of research showing that just by training foundation models on their outputs, you amplify their capabilities.

Less common opinion: this is also how you end up with models that understand the concept of themselves, which has high economic value.

Even less common opinion: that's really dangerous.

abel_

4 tahun yang laludiscuss

I wonder what the net effect of such pieces of writing is. The problem is that these abstract and contextless statements make sense only if they cause the reader to reflect on some experience, and thus only mildly reinforce currently held beliefs. Otherwise, I can't see how the statements would stick for most people (not even as cached memory).

What would add significantly to this is a bunch of Gwern-style links embedded within each of these quips. The author is clearly speaking from a vantage point not many others have attained, and he'd be able to provide a story or other context to each.

comments