andreinwald

It works on small Llama-3.2-1B model, specially for less powerfull GPU devices

Model used: Llama 3.2 1B (small). Quality hould be similar with running Ollama app with same small model.

On my Android device works pretty fast.

But keep in mind that it's small Llama-3.2-1B model, specially for less powerfull GPU.

12 mesi fadiscuss

Yes, its very similar to Ollama app, and Llama-3.2-1B model used

12 mesi fadiscuss

Llama 3.2 1B

12 mesi fadiscuss

12 mesi fadiscuss

Demo site is asking before download

Submissions