Show HN: a desktop app to discover, download, and run offline LLMs(lmstudio.ai)

10 ポイント投稿者 ybu3 年前7 コメント

https://lmstudio.ai

8 コメント

[deleted]3 年前

Wow, this makes running LLMs locally significantly more approachable. Very cool!

Agreed!

This is great! CPU only for now or can it leverage GPU for sped up inference?

ybu3 年前

Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build

Looks very useful! Can't wait to try the Windows version. Thanks!

ybu3 年前

Follow up: Windows release is out.

ybu3 年前

hopefully soon!