Show HN: WebGPU enables local LLM in the browser – demo site with AI chatandreinwald.github.io145 ポイント·投稿者 andreinwald·12 か月前·54 コメント
andreinwald·12 か月前·議論Model used: Llama 3.2 1B (small). Quality hould be similar with running Ollama app with same small model.
andreinwald·12 か月前·議論On my Android device works pretty fast.But keep in mind that it's small Llama-3.2-1B model, specially for less powerfull GPU.