HackerTrans
トップ新着トレンドコメント過去質問紹介求人

nicolevin

no profile record

投稿

DeepSeek's Hidden Bias: How We Cut It by 76% Without Performance Loss

hirundo.io
108 ポイント·投稿者 nicolevin·昨年·119 コメント

コメント

nicolevin
·昨年·議論
reach out at @nicilevv on X for questions
nicolevin
·昨年·議論
Bias-Unlearned DeepSeek-R1-Distill-Llama-8B here: https://huggingface.co/hirundo-io/DeepSeek-R1-Distill-Llama-...
nicolevin
·昨年·議論
DeepSeek-R1 (8B) exhibited 2x more bias than base Llama. We applied targeted unlearning, reduced bias by up to 76% across race/gender/nationality, while maintaining model performance (TruthfulQA: 9.8→9.9, LogiQA: 42.6%→42.5%). Done in ~1hr on consumer hardware. Debiased model on HuggingFace.