Show HN: a desktop app to discover, download, and run offline LLMslmstudio.ai10 ポイント·投稿者 ybu·3 年前·7 コメント
Show HN: tokmon – CLI to monitor your program's OpenAI token costsgithub.com11 ポイント·投稿者 ybu·3 年前·1 コメント
ybu·3 年前·議論Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
ybu·3 年前·議論Now that you mention it ... GPT did say "don't worry about it" ... Jokes aside, I didn't want to deal with distributing it just yet. People are welcome to package it and install it themselves from source.
ybu·3 年前·議論Very cool! Adding the current file / selection to the context of the convo with GPT is definitely a great idea.