HackerTrans
TopNewTrendsCommentsPastAskShowJobs

ybu

no profile record

Submissions

Show HN: a desktop app to discover, download, and run offline LLMs

lmstudio.ai
10 points·by ybu·3 năm trước·7 comments

Self-hosted dashboard for monitoring your OpenAI API usage

github.com
6 points·by ybu·3 năm trước·0 comments

Show HN: tokmon – CLI to monitor your program's OpenAI token costs

github.com
11 points·by ybu·3 năm trước·1 comments

Show HN: ChatIDE – DIY Github Copilot X

github.com
43 points·by ybu·3 năm trước·6 comments

comments

ybu
·3 năm trước·discuss
Follow up: Windows release is out.
ybu
·3 năm trước·discuss
Focus is CPU for now - but it'd be very useful to have GPU support. As a baseline, this can support anything that llama.cpp. Relevant link: https://github.com/ggerganov/llama.cpp#blas-build
ybu
·3 năm trước·discuss
hopefully soon!
ybu
·3 năm trước·discuss
Now that you mention it ... GPT did say "don't worry about it" ... Jokes aside, I didn't want to deal with distributing it just yet. People are welcome to package it and install it themselves from source.
ybu
·3 năm trước·discuss
Very cool! Adding the current file / selection to the context of the convo with GPT is definitely a great idea.