Top New Trends Comments Past Ask Show Jobs

Why Gemma-4 26B MoE works in HuggingFace but breaks in prod inference engines(github.com)

1 points·by maeddesg·vor 2 Monaten·0 comments

Why Gemma-4 26B MoE works in HuggingFace but breaks in prod inference engines

https://github.com/maeddesg/vulkanforge/blob/main/docs/gemma4_26b_moe_solution.md

2 comments

maeddesg·vor 2 Monaten

abelzentric·vor 2 Monaten

Why Gemma-4 26B MoE works in HuggingFace but breaks in prod inference engines · HackerTrans