Sophia: Stochastic Second-Order Optimizer for Language Model Pre-Training(arxiv.org)7 points·by alechammond·3 lata temu·0 commentsarxiv.orgSophia: Stochastic Second-Order Optimizer for Language Model Pre-Traininghttps://arxiv.org/abs/2305.143420 commentsPost comment—