Show HN: a desktop app to discover, download, and run offline LLMs(lmstudio.ai)

10 pointsby ybu3 lata temu7 comments

https://lmstudio.ai

8 comments

[deleted]3 lata temu

Wow, this makes running LLMs locally significantly more approachable. Very cool!

leeholim3 lata temu

Agreed!

This is great! CPU only for now or can it leverage GPU for sped up inference?

ybu3 lata temu

Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build

dtagames3 lata temu

Looks very useful! Can't wait to try the Windows version. Thanks!

ybu3 lata temu

Follow up: Windows release is out.

ybu3 lata temu

hopefully soon!