HackerLangs
トップ新着トレンドコメント過去質問紹介求人

Kostic

no profile record

コメント

Kostic
·15 日前·議論
A very beautiful website and a machine. Oxide folks should be proud, you can see the love that went into it.
Kostic
·18 日前·議論
Time to copy&improve the niche solution.
Kostic
·18 日前·議論
70% of the Steam users have a PC that's weaker than the Steam Machine[0]. These things will sell out, that's not the issue. The issue is that Valve probably won't have enough power to secure hardware deals to fulfill all the orders, thus limiting the growth of their hardware side.

[0] https://www.techpowerup.com/342970/valve-claims-steam-machin...
Kostic
·25 日前·議論
Auth with Github Copilot and then point it to localhost[0]. Hopefully the auth to Copilot requirement will be dropped for local models at some point. Would love to use a fully open stack (VSCodium and everything) in the future. My config:

``` [ { "name": "http://127.0.0.1:8888/v1", "vendor": "customendpoint", "apiKey": "llama.cpp", "models": [ { "id": "gemma4-31b", "name": "Gemma 4 31B", "url": "http://127.0.0.1:8888/v1/chat/completions", "toolCalling": true, "vision": true, "maxInputTokens": 65536, "maxOutputTokens": 8192 }, { "id": "qwen3.6-27b", "name": "Qwen 3.6 27B", "url": "http://127.0.0.1:8888/v1/chat/completions", "toolCalling": true, "vision": true, "maxInputTokens": 180224, "maxOutputTokens": 8192 } ] } ] ```

[0] https://code.visualstudio.com/blogs/2025/10/22/bring-your-ow...
Kostic
·26 日前·議論
For personal needs I connected VSCode with llama.cpp running Qwen 3.6 27B or Gemma 4 31B and it's good enough to cancel my cloud subscription.

Qwen running on my 1st GPU at q4@176k context from 70 to 50 tok/s with MTP, pretty good for coding.

Gemma on the other hand is using both GPUs, running q8@64k context, doing document sentiment analysis, summarization, proofreading and translating, at consistent 25 tok/s. Somewhat slow but usable for batched workflows. Might get some more once llama.cpp starts supporting MTP with tensor split mode.

Still using frontier LLMs at dayjob since I'm not paying it and those are obviously better. Hopefully we'll have a Sonnet 4.6/Opus 4.5 level 30B model in a year or so.

EDIT: Prompt processing starts from 800 t/s and drops to 400 t/s. In most cases my starting prompts are around 16k-24k of tokens and require from 60 to 90 seconds to be processed. Not great but acceptable.
Kostic
·先月·議論
"I'm sorry" is not gaslighting but an admission of fault it learned from our texts. And if an LLM managed to delete your database, it's time to slow down the vibe train and put up some guard rails.

LLMs are awesome but not without supervision.
Kostic
·3 か月前·議論
Taalas showed that you could make LLMs faster by turning them into ASICs and get 10k+ token generation. It's a matter of time now.
Kostic
·4 か月前·議論
For now. These will be pretty cool Linux machines if Asahi starts supporting them at some point.
Kostic
·5 か月前·議論
I would not go below q8 if comparing to sonnet.
Kostic
·5 か月前·議論
I assume you're living in a city. You're already renting out a lot of things to others (security, electricity, water, food, shelter, transportation), what is different with white collar work?
Kostic
·8 か月前·議論
At least with GitHub it's hard to hide when you get "no healthy upstream" on a git push.
Kostic
·10 か月前·議論
I don't understand how you can ship a car without proper papers out of the country so easily. Maybe focus on that first?
Kostic
·9 年前·議論
Are you aware that the name was already taken[0] for something which also has to do with file systems?

[0] https://wiki.gnome.org/Projects/gvfs