HackerTrans
TopNewTrendsCommentsPastAskShowJobs

ZQ-Dev8

no profile record

Submissions

Unsloth creators fix universal error with gradient accumulation

unsloth.ai
4 points·by ZQ-Dev8·hace 2 años·2 comments

comments

ZQ-Dev8
·el año pasado·discuss
How's this compare with docling (https://github.com/docling-project/docling)?
ZQ-Dev8
·hace 2 años·discuss
Jeremy, this is awesome! Personally excited for a new wave of sentence transformers built off ModernBERT. A poster below provided the link to a sample ST training script in the ModernBERT repo, so that's great.

Do you expect the ModernBERT STs to carry the same advantages over ModernBERT that BERT STs had over the original BERT? Or would you expect caveats based on ModernBERT's updated architecture and capabilities?
ZQ-Dev8
·hace 2 años·discuss
seems like something pytorch maintainers would want to know about and fix asap...