A new local LLM king: Step-3.5-Flash-int4(old.reddit.com)

2 pointsby diyer22vor 5 Monaten1 comments

old.reddit.com

A new local LLM king: Step-3.5-Flash-int4

https://old.reddit.com/r/LocalLLaMA/comments/1qtvo4r/128gb_devices_have_a_new_local_llm_king/

1 comments

diyer22vor 5 Monaten

StepFun has open-sourced Step-3.5-Flash: 196 B total parameters, 11 B active, 256 K context length. Strong performance, with speed as the highlight—blazing fast, peaking at 350 tokens/s. It’s currently in promotion and free on OpenRouter `step-3.5-flash:free`.

More detials: https://static.stepfun.com/blog/step-3.5-flash/