What coding agent do you use with StepFun-3.5-flash? I just tried it from siliconflow's api with opencode. The toolcalling is broken:
AI_InvalidResponseDataError: Expected 'function.name' to be a string.
The python MLX version of Parakeet indeed support streaming: https://github.com/senstella/parakeet-mlx
It requires modification of the inference algorithm. In this implementation, I see the author even uses a custom metal kernerl to get maximum performance.
The Parakeet model batch inference logic is simple. But for streaming, it may require some effort to get the best performance. It's not only the depencency issue.
dots.ocr requires requires a considerable amount of computational resources. If you have Mac device with ARM CPU(M series), you can try my dots.ocr.runner(https://github.com/jason-ni/app.dots.ocr.runner).