Why instead of expecting a language to get math, don't we use the language model to generate code, run the code and use the result?
If a language model basically is the equivalent of a dumb human, how can we expect it to be better than us at math?Most humans use calculators even for simple equations.
I've been thinking about giving access to a search engine and a command line to a GPT-3 based AI, so that it can choose to run code it wrote or to expand its knowledge, I think that's a good way to expand its capabilities, even if that's probably how we're going to get skynet in the end.
If a language model basically is the equivalent of a dumb human, how can we expect it to be better than us at math?Most humans use calculators even for simple equations.
I've been thinking about giving access to a search engine and a command line to a GPT-3 based AI, so that it can choose to run code it wrote or to expand its knowledge, I think that's a good way to expand its capabilities, even if that's probably how we're going to get skynet in the end.