HackerTrans
TopNewTrendsCommentsPastAskShowJobs

wirybeige

no profile record

comments

wirybeige
·25 hari yang lalu·discuss
I have noticed it to be slightly worse, mostly on "bad" sites. Just using Brave at this point though.
wirybeige
·bulan lalu·discuss
Granite is IBM
wirybeige
·bulan lalu·discuss
I presume the providers are the ones giving the info to OpenRouter? I mean, technically it is a mix of fp8 and fp4 (although it is predominately fp4), so I don't think either is inaccurate.
wirybeige
·bulan lalu·discuss
DS4 Pro/Flash were post trained with QAT, so they are already quantized to FP4 for the most part. That's why when downloading the weights, they are much smaller than what their weights at fp8 or fp16 would be. For example, Flash is a 284B model, but its GB size is only ~160GB. OFC maybe DeeppInfra went even further, but there is no proof of that.
wirybeige
·2 bulan yang lalu·discuss
Personal anecdote --- Proton Pass very quickly went from worse than Bitwarden to better with more reliable auto-fill.
wirybeige
·2 bulan yang lalu·discuss
These were trained on NVIDIA gpus. It is running inference on Huawei.
wirybeige
·2 bulan yang lalu·discuss
Why would these 3rd-party providers be taking losses? Together, Novita, etc... are not losing money on inference services, they are profiting. You can easily do napkin math with current & last gen Nvidia cards to calculate cost to host/serve these models. I would also doubt that any 1st-party providers like OpenAI and Anthropic lose money on per token billing. There is almost undoubtedly healthy margin being made on that.
wirybeige
·2 bulan yang lalu·discuss
Pricing for DeepSeek V4 flash is $0.14 in/$0.28 out across basically every provider or close to it. It seems most providers just follow the model creator and set their prices to match. V4 pro was set to be $1.74 in/$3.48 out when DeepSeek first announced it; all providers have set their prices to be about that price, & now DeepSeek has set their pricing to $0.435 in/ $0.87 out. I don't know if this is special pricing, or the promise they made for dropping the price when they get more Huawei cards online. It seems that providers like ParaSail, Together, and Novita just set the price when the model comes out and don't compete.
wirybeige
·4 bulan yang lalu·discuss
The vulkan backend for llama.cpp isn't that far behind rocm for pp and tp speeds
wirybeige
·5 bulan yang lalu·discuss
Sodium batteries don't yet have the scale that lifepo4 batteries have. I'd expect we will see them get cheaper.
wirybeige
·6 bulan yang lalu·discuss
HDR playback in chrome on KDE works as expected from what I can tell. For GNOME 49.2 it does not, it doesn't get the luminance that it should at this time. 49.3 may fix this.
wirybeige
·9 bulan yang lalu·discuss
The post links to this: https://github.com/MCRcortex/nvidium

nvidium is using GL_NV_mesh_shader which is only available for nVIDIA cards. This mod is the only game/mod I know of that uses mesh shaders & is OpenGL. & so the new gl extension will let users of other vendors use the mod if it gets updated to use the new extension.
wirybeige
·9 bulan yang lalu·discuss
Sorry it doesn't work for you. I don't have that issue. Gnome looks proper in HDR mode for both HDR and SDR content for me.
wirybeige
·9 bulan yang lalu·discuss
GNOME has both color management and color representation protocols implemented. HDR works fine on it
wirybeige
·10 bulan yang lalu·discuss
Their GUI is closed-source. If someone wants an easy to use & easy to setup app, may as well use LMStudio, which doesn't try to pretend to be OSS. Or use ramalama which is basically just containerizing LLMs and the relevant bits, pretty damn similar to ollama. Or just go back to "basics" and use llama.cpp or vllm.
wirybeige
·10 bulan yang lalu·discuss
Xe2 is superior to current AMD integrated already