HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Graviscalar

no profile record

Submissions

Ask HN: Who's regularly using LLMs at work?

9 points·by Graviscalar·el año pasado·21 comments

comments

Graviscalar
·el año pasado·discuss
The geometric intuition is solid, but actually applying topology has been less fruitful in spite of a lot of people trying their best, as Chris Olah himself has said elsewhere in this thread.
Graviscalar
·el año pasado·discuss
I would expect model/algorithm improvements from using topological concepts to analyze the manifolds in question or concrete results in model interpretability. Gunnar has studied some toy examples, but they were barely a step up from the ones Olah constructed for the sake of explanation and they haven't borne any further fruit.

You can say any advance or insight is just lying dormant, it doesn't mean anything unless you can specifically articulate why it still has potential. I haven't made any claims on the future of the intersection of deep learning and topology, I was pointing out that it's been anything but dormant given the interest in it but it hasn't lead anywhere.
Graviscalar
·el año pasado·discuss
I was one of the people that was super excited after reading the Chris Olah blogpost from 2014, and over the past decade I've seen the insight go exactly nowhere. It's neat but it hasn't driven any interesting results, though Ayasdi did some interesting stuff with TDA and Gunnar Carlson has been playing around with neural nets recently.
Graviscalar
·el año pasado·discuss
He's specifically addressing people who have the same goals as him but aren't seeing progress for the reasons he's listed. Nothing in the article suggests that he sees other goals as less valid, and it seems like you're being uncharitable because he reads as a "bro" to you ("swollen muscles").