HackerTrans
TopNewTrendsCommentsPastAskShowJobs

ZQ-Dev8

no profile record

Submissions

Unsloth creators fix universal error with gradient accumulation

unsloth.ai
4 points·by ZQ-Dev8·قبل سنتين·2 comments

comments

ZQ-Dev8
·السنة الماضية·discuss
How's this compare with docling (https://github.com/docling-project/docling)?
ZQ-Dev8
·قبل سنتين·discuss
Jeremy, this is awesome! Personally excited for a new wave of sentence transformers built off ModernBERT. A poster below provided the link to a sample ST training script in the ModernBERT repo, so that's great.

Do you expect the ModernBERT STs to carry the same advantages over ModernBERT that BERT STs had over the original BERT? Or would you expect caveats based on ModernBERT's updated architecture and capabilities?
ZQ-Dev8
·قبل سنتين·discuss
seems like something pytorch maintainers would want to know about and fix asap...