Flint – local AI runtime for Rust (no internet, no API keys)(flint.brantandco.com)1 ポイント·投稿者 Lbrant·4 か月前·1 コメントflint.brantandco.comFlint – local AI runtime for Rust (no internet, no API keys)https://flint.brantandco.com2 コメントコメントを投稿[–]Lbrant·4 か月前返信I wanted to run AI in my Rust app without sending data to OpenAI. Built Flint — drop it in and run any GGUF model locally on device.cargo install flint-ai flint use TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUFRuns on Apple Silicon via Metal, NVIDIA via CUDA, AMD via ROCm, or any CPU as fallback. Models store in ~/.flint/models and persist across projects.Still early (v0.1.0) but works. Would love feedback from anyone who tries it.[+]49MadMax91·4 か月前
cargo install flint-ai flint use TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF
Runs on Apple Silicon via Metal, NVIDIA via CUDA, AMD via ROCm, or any CPU as fallback. Models store in ~/.flint/models and persist across projects.
Still early (v0.1.0) but works. Would love feedback from anyone who tries it.