Is current AI architecture broken? Jagged intelligence suggests it may be(old.reddit.com)

1 pointsby jaggshace 8 meses1 comments

old.reddit.com

Is current AI architecture broken? Jagged intelligence suggests it may be

https://old.reddit.com/r/singularity/comments/1p5khov/llion_jones_coinventor_of_the_transformers/

1 comments

jaggshace 8 meses

"There's something still not quite right with the current technology. I think the phrase that's becoming popular is 'jagged intelligence'. The fact that you can ask an LLM something and they can solve literally a PhD level problem, and then in the next sentence they can say something so clearly, obviously wrong that it's jarring. And I think this is probably a reflection of something fundamentally wrong with the current architectures, as amazing as they are."

Llion Jones, co-inventor of transformers architecture and now co-founder of https://sakana.ai/ researching alternatives.