Carbon: Autoregressive Genomic Foundation Modelhuggingface.co7 points·by kashifr·hace 2 meses·1 comments
The ultimate guide to RL environments: building and scaling them in the LLM erahuggingface.co7 points·by kashifr·hace 2 meses·0 comments
Distilling 100B+ Models 40x Faster with TRLhuggingface.co13 points·by kashifr·hace 3 meses·0 comments
Keep the Tokens Flowing: Lessons from 16 Open-Source RL Librarieshuggingface.co2 points·by kashifr·hace 4 meses·0 comments
The Smol Training Playbook: The Secrets to Building World-Class LLMshuggingface.co265 points·by kashifr·hace 9 meses·19 comments
Unlocking On-Policy Distillation for Any Model Familyhuggingface.co6 points·by kashifr·hace 9 meses·1 comments
Smollm3: Smol, multilingual, long-context reasoner LLMhuggingface.co388 points·by kashifr·el año pasado·79 comments
kashifr·hace 3 meses·discussYou can try out TinyLoRA in PEFT main now: https://huggingface.co/docs/peft/main/en/package_reference/t...
kashifr·el año pasado·discussHave you tried https://geobase.app/ they recently also had a post about duckdb integration: https://geobase.app/blog/duckdb-1-1-3