My answer is usually to make a process.
Do you need to know if X is faster than Y? Do both. Measure. Sometimes the answer requires actual research.
Maybe you need a real Subject Matter Expert because it turns out that nobody ever published something on the internet about something so that an LLM could soak up the real world information.
Before the internet, we would consult with books. After the internet, it seemed faster to search and find answers in things like blog posts, (paid) articles, and CDs. Wikipedia and Stack Overflow are great resources. Maybe you need an answer from Hacker News - ask HN.
By relying on LLMs more than these other sources and allowing LLMs to write articles and posts to these other sources, we lose subject matter experts.
Add to that companies like Microsoft and Meta and others laying off and offering retirement packages to get rid of institutional knowledge as fast as possible, and we are headed towards a gigantic crash of knowledge.
Do you need to know if X is faster than Y? Do both. Measure. Sometimes the answer requires actual research.
Maybe you need a real Subject Matter Expert because it turns out that nobody ever published something on the internet about something so that an LLM could soak up the real world information.
Before the internet, we would consult with books. After the internet, it seemed faster to search and find answers in things like blog posts, (paid) articles, and CDs. Wikipedia and Stack Overflow are great resources. Maybe you need an answer from Hacker News - ask HN.
By relying on LLMs more than these other sources and allowing LLMs to write articles and posts to these other sources, we lose subject matter experts.
Add to that companies like Microsoft and Meta and others laying off and offering retirement packages to get rid of institutional knowledge as fast as possible, and we are headed towards a gigantic crash of knowledge.
Lurker on hacker news from 2012 - 2019