Sophia: Stochastic Second-Order Optimizer for Language Model Pre-Training(arxiv.org)7 points·by alechammond·3년 전·0 commentsarxiv.orgSophia: Stochastic Second-Order Optimizer for Language Model Pre-Traininghttps://arxiv.org/abs/2305.143420 commentsPost comment—