“Broken Neural Scaling Laws”; New Scaling Law; SotA Extrapolation of All Things2 points·by evc123·4 năm trước·0 comments
What do we already know about Generalization? What should we ask next about it?reddit.com1 points·by evc123·8 năm trước·0 comments
Revisiting Small Batch Training for Deep Neural Networksgraphcore.ai2 points·by evc123·8 năm trước·0 comments
Revisiting Small Batch Training for Deep NNs; batch_size less than 64 is bestarxiv.org1 points·by evc123·8 năm trước·0 comments
Prefrontal cortex as a meta-reinforcement learning system [DeepMind]biorxiv.org3 points·by evc123·8 năm trước·0 comments
Pan-Asian Deep Learning Conference; Kuala Lumpur, Malaysia; 2028youtube.com1 points·by evc123·9 năm trước·0 comments
evc123·3 năm trước·discuss> Whether scaling laws hold or not, is up for debate.The scaling laws have broken: https://arxiv.org/abs/2210.14891
evc123·3 năm trước·discussBut what about "Broken Neural Scaling Laws" (https://arxiv.org/abs/2210.14891)?
evc123·8 năm trước·discussWhat about benefitting non-human animals? Hopefully the benefits are distributed to all creatures and not just humanity.
evc123·8 năm trước·discussNah, fchollet just doesn't want pytorch to minimize keras:https://twitter.com/jekbradbury/status/976612114260357120
The scaling laws have broken: https://arxiv.org/abs/2210.14891