Llama-Cpp-WASM(tangledgroup.com)

https://tangledgroup.com/blog/240213_tangledgroup_llama_cpp_wasm

4 comments

How does the performance of the desktop versions of Chrome, Safari, and Firefox compare?

We are proud to launch our game-changing llama-cpp-wasm engine, a breakthrough in-browser LLM engine that executes on the edge using general purpose computing based on llama.cpp.

Desktop browser version is OK. Mobile browser version is WIP.

adastra222년 전

Does it use webgpu?

mtasic2년 전

Nope, it is just Wasm/JS. Please test it on desktop Firefox multi-threading version since it turns out to be the fastest one.