I have been a pretty consistent user of AI since 2022 (Instruct-GPT), so I don't have a bad opinion about the topic. However, I think the real problem now has become pretty obvious. We are hitting a reality wall, where we simply don't have enough ressources to feed the AI industry. We don't generate enough electrical power nor enough GPU or TPU. For the first time in computer science, the real issue here is the finitude of the physical world. Unless, we start digging asteroids, we are already facing a shortage of raw material and industrial output. In my opinion, the only way to go is small models running on regular hardwares.
LispE is a programming language that has been ported to WASM. It's lightweight (about 3.3MB) and provides many features natively, with no external dependencies. You can now try it directly in your browser.
Gary Marcus tries to exit his personal hole of irrelevance. I have been working in the fielf of computational linguistics for 30 years. Back in 2000, I worked with a team of linguists to implement a pretty refined syntactic parser (XIP) based on Shallow Parsing, a symbolic approach. We won with this system a SemEval competition as late as 2016 on Sentiment Analysis. But I never expected LLM to reach this level of competency in my lifetime. Critics are prone to describe the errors these models make, but they seem to forget that 1. It is not a search engine and 2. it is pretty knowledgeable in a huge range of domains, which no humans can equal. I use these models every day to create code or to explain concepts to me. It never ceases to amaze me.