MLX-Serve a Native LLM Runtime for Apple Silicon(ddalcu.github.io)7 ポイント·投稿者 ddalcu·3 か月前·1 コメントddalcu.github.ioMLX-Serve a Native LLM Runtime for Apple Siliconhttps://ddalcu.github.io/mlx-serve/1 コメントコメントを投稿[–]ddalcu·3 か月前返信Native Zig server that runs MLX-format language models on Apple Silicon and exposes an OpenAI-compatible HTTP API. No Python.Optional app MLX Claw, a macOS menu bar app with built-in chat, agent mode, and model management.No dependencies 34MB, very low ram usage compared to other LLM runners.
Optional app MLX Claw, a macOS menu bar app with built-in chat, agent mode, and model management.
No dependencies 34MB, very low ram usage compared to other LLM runners.