Show HN: Run AI chat, image gen, vision, and voice offline on your Mac(github.com)
github.com
Show HN: Run AI chat, image gen, vision, and voice offline on your Mac
https://github.com/off-grid-ai
5 コメント
This is pretty cool. We've been experimenting with local models for internal tooling, and the biggest surprise was how capable smaller models have become on Apple Silicon. Looking forward to trying this out.
I checked and it's a whole environment provided by offgrid ai. For phones, laptops, all running on local network. No internet or cloud needed. Amazing work
yeah seems pretty insane!
Thats pretty interesting. with what is possible with openweight models now, having this multimodal functionality on your device itself will be quite next level
Download a model and it all runs on your machine. Ask it something on a flight with no wifi. Summarize a confidential document that never leaves your laptop. Run a hundred image generations in a loop and pay nothing, because it's your own GPU doing the work. Swap your paid dictation app for local Whisper. Talk through a coding problem at 1am with no meter running.
Developers: it exposes a local OpenAI-compatible endpoint at 127.0.0.1:7878/v1. Point Claude Code or any OpenAI client at it and run loops against local models at zero token cost. You can run it headless as just the gateway, or open the full studio with chat, RAG over your own docs, live artifacts, and MCP connectors.
Under the hood it's llama.cpp for text, stable-diffusion.cpp for images (Metal, ships SDXL-Lightning and Z-Image-Turbo), Whisper for voice, Kokoro for speech. Encrypted local DB, LanceDB for vectors, Electron and React.
Open core is AGPL. Signed macOS build on Releases, Windows coming.
Inference and your data stay on the machine; once a model's downloaded the open core makes no network calls.