HackerTrans
TopNewTrendsCommentsPastAskShowJobs

ycui1986

186 karmajoined 14 лет назад

Submissions

China tests crewed spacecraft abort and rocket recovery in major lunar milestone

spacenews.com
3 points·by ycui1986·5 месяцев назад·1 comments

comments

ycui1986
·5 дней назад·discuss
i always thought Ryzen AI Halo, together with DGS Spark, has mismatched compute capacity with memory size. Given 128GB VRAM, people would want to run large models, but the GPU compute is constraint in these types of use case. If the box runs models that don't need high compute, then there is no need of 128GB VRAM.

On the high end side, it is too slow. On the low end size, it waste money on VRAM.
ycui1986
·3 месяца назад·discuss
[flagged]
ycui1986
·3 месяца назад·discuss
So, dual RTX PRO 6000
ycui1986
·3 месяца назад·discuss
I really like the pro version. The pelican is so cute.
ycui1986
·3 месяца назад·discuss
32GB RAM on mac also need to host OS, software, and other stuff. There may not even be 24GB VRAM left for the model.
ycui1986
·3 месяца назад·discuss
just because a bunch of rockets went up without blowing up, does not mean they are profitable. it cost money to shot rocket, and it is very expensive, reusable or not. most launches are internal launch without external paying customers.
ycui1986
·3 месяца назад·discuss
another 60 billion to save a failed AI endeavor.
ycui1986
·3 месяца назад·discuss
outputting docx files does not have much to do with model capability. it is about whether tool calling has be configured .
ycui1986
·3 месяца назад·discuss
There are also many Chines AI-target GPU/NPU producers. You can get a hold of some boards on taobao.com. They are usable in some way.

No, nVidia and AMD are not the only ones benefiting.
ycui1986
·3 месяца назад·discuss
i give it in real ubuntu, no vm, no docker. so long I don't ask it to organize files, it will behave. it has not screw me so far.
ycui1986
·3 месяца назад·discuss
qwen3.5 and qwen3.6 are both good at tool calling.
ycui1986
·3 месяца назад·discuss
For many LLM load, it seems ROCm is slower than vulkan. What’s the point?
ycui1986
·3 месяца назад·discuss
he won't. if anything, openai is falling behind recently. the trend won't change easily. it is like the old time Netscape.
ycui1986
·3 месяца назад·discuss
only works if the users are evenly distributed around the globe (which is likely more of less the case). if the user concentrates in on century, the token rate will be terrible.
ycui1986
·3 месяца назад·discuss
i hope someone do a 100b 1-bit parameter model. that should fit into most 16GB graphics cards. local AI democratized.
ycui1986
·4 месяца назад·discuss
i am guessing, without any proof, that, when one breaker fails the server lose it all, or loose two GPUs, depending on whether one connected to the cpu side failed.
ycui1986
·4 месяца назад·discuss
9070XT provide roughly same inference performance at double the power, half the cost, as RTX PRO 4500. So this one is optimized for total BOM cost.
ycui1986
·4 месяца назад·discuss
they could had gone with the Max-Q version RTX PRO 6000 and only require 120V circuit. 10% performance hit, but half the power.

fundamentally, looks like they are shipping consumer off-the-shelf hardwares in a custom box.
ycui1986
·4 месяца назад·discuss
for all past years, I have been told wayland is the future. but the decade long dragged out rolling out did not made much sense to me. neither did I investigate why. until today, I found out how difficult to force a 1920x1200 resolution over remote desktop. it is plain feature degradation.

people ask why do you need it. I have a 3440x1440 physical monitor on the server, I need to remove login with a 1920x1200 laptop. I want full screen at laptop's native resolution. Windows can do this decade ago.
ycui1986
·5 месяцев назад·discuss
the reality is no where to get the fuel. hydrogen stations are shutting down not building up.