andreinwald

vor 12 Monatendiscuss

It works on small Llama-3.2-1B model, specially for less powerfull GPU devices

vor 12 Monatendiscuss

Model used: Llama 3.2 1B (small). Quality hould be similar with running Ollama app with same small model.

vor 12 Monatendiscuss

On my Android device works pretty fast.

But keep in mind that it's small Llama-3.2-1B model, specially for less powerfull GPU.

vor 12 Monatendiscuss

Yes, its very similar to Ollama app, and Llama-3.2-1B model used

vor 12 Monatendiscuss

Llama 3.2 1B

vor 12 Monatendiscuss

vor 12 Monatendiscuss

Demo site is asking before download

Submissions