ML model evaluation techniques may be hiding new developments in AI(arielos.substack.com)
arielos.substack.com
ML model evaluation techniques may be hiding new developments in AI
https://arielos.substack.com/p/on-evals-and-ideas
1 comments
Choosing the wrong evaluation method may lead us to subobtimal models, while there may be new architectures (the author suggests to look back to neuroscience for inspiration) that can better handle what we expect from future models