HackerTrans
TopNewTrendsCommentsPastAskShowJobs

andreinwald

no profile record

Submissions

Show HN: WebGPU enables local LLM in the browser – demo site with AI chat

andreinwald.github.io
145 points·by andreinwald·قبل 12 شهرًا·54 comments

comments

andreinwald
·قبل 12 شهرًا·discuss
It works on small Llama-3.2-1B model, specially for less powerfull GPU devices
andreinwald
·قبل 12 شهرًا·discuss
Model used: Llama 3.2 1B (small). Quality hould be similar with running Ollama app with same small model.
andreinwald
·قبل 12 شهرًا·discuss
On my Android device works pretty fast.

But keep in mind that it's small Llama-3.2-1B model, specially for less powerfull GPU.
andreinwald
·قبل 12 شهرًا·discuss
Yes, its very similar to Ollama app, and Llama-3.2-1B model used
andreinwald
·قبل 12 شهرًا·discuss
Llama 3.2 1B
andreinwald
·قبل 12 شهرًا·discuss
Also here https://caniuse.com/webgpu
andreinwald
·قبل 12 شهرًا·discuss
Demo site is asking before download