HackerTrans
TopNewTrendsCommentsPastAskShowJobs

LTL_FTC

no profile record

comments

LTL_FTC
·vorige maand·discuss
There's a photo here showing 600GBps memory bandwidth so maybe they have doubled it:

https://www.servethehome.com/nvida-introduces-rtx-spark-an-a...
LTL_FTC
·2 maanden geleden·discuss
Looks like Antigravity cli is moving to weekly limits whereas Gemini cli was daily. Ouch
LTL_FTC
·3 maanden geleden·discuss
Kai | Engineering (Multiple) | Onsite (San Jose, CA) | Full-time

Ai + Cybersecurity. Our Ai team is well funded, and growing. Although we have a dedicated engineering team, the Ai team is looking for dedicated engineers to work closely with the applied Ai scientist to build the platform and pipelines.

Principal Software Engineer, AI Platform: https://ats.rippling.com/kai-cyber-inc/jobs/a6d62968-4831-42...

Senior Software Engineer, AI Platform: https://ats.rippling.com/kai-cyber-inc/jobs/d567048a-7b1b-4e...

We are also looking for a few more applied Ai scientists as well as many other roles. I invite you to take a look:

https://www.kai.security/careers#open
LTL_FTC
·4 maanden geleden·discuss
Microsoft used to with their Azure Service Dev Kit. the ASDK was a single-node "sandbox" meant to emulate the entire Azure cloud locally. They may have something similar now but paired back
LTL_FTC
·4 maanden geleden·discuss
Those keys are easily replaced, my friend.
LTL_FTC
·5 maanden geleden·discuss
Well… I did/do see many around the Bay Area. Especially during the morning commute. But I agree, overall it was a low volume car.
LTL_FTC
·5 maanden geleden·discuss
Toyota restricted the sale of its hydrogen fuel cell vehicles to specific, qualified customers who lived or worked near existing, functional hydrogen refueling stations. I remember looking into them when first released but realized I wasn’t eligible and the fact that Toyota restricted the sale meant there was a huge risk in buying them.

With all the recent outrage and lawsuits, I wonder how many buyers actually did their due diligence and weighed the risk before committing to them? Or maybe the huge fuel subsidy was seen as a win even if this event played out? Idk but I commend Toyota for taking the risk and going for it.

Edit: typo
LTL_FTC
·5 maanden geleden·discuss
This video is pretty great. “The joke is this is not a joke” comment in there… how many of us understood everything that was said and then felt like maybe we need a different hobby…
LTL_FTC
·5 maanden geleden·discuss
This is such a great website. I have enjoyed reading the articles in the past. It was the final push that inspired me to build my own wheel set instead of buying a complete when I was building my new mountain bike piece by piece. The art and zen (and frustration of trying to feed a shift/brake line through a frame), I tell ya.
LTL_FTC
·5 maanden geleden·discuss
If they have an Apple TV, you can just install the app and use it as an exit node. I would check out the devices that are on their network currently, chances are you can use one of those.
LTL_FTC
·5 maanden geleden·discuss
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.
LTL_FTC
·5 maanden geleden·discuss
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.

My old threadripper pro was seeing about 15tps, which was quite acceptable for the background tasks I was running.
LTL_FTC
·5 maanden geleden·discuss
I started off using gpt-oss-120b on cpu. It uses about 60-65gb of memory or so but my workstation has 128gb of ram. If I had less ram, I would start off with the gpt-oss-20b model and go from there. Look for MoE models as they are more efficient to run.
LTL_FTC
·5 maanden geleden·discuss
I don’t get it? Are they sharing a quote they liked or taking credit for it? Maybe they just saw the YouTube video and decided to turn it into the page?

Edit: Seems like a way to show they’re looking for roles, I guess.
LTL_FTC
·6 maanden geleden·discuss
It sounds like you don’t need immediate llm responses and can batch process your data nightly? Have you considered running a local llm? May not need to pay for api calls. Today’s local models are quite good. I started off with cpu and even that was fine for my pipelines.
LTL_FTC
·6 maanden geleden·discuss
I linked results where the user ran Kimi k2 across his 8-node cluster. Inference results are listed for 1,10,100 concurrent requests.

Edit to add:

Yeah, those stations with the GB300 look more along the lines of what I would want as well but I agree, they’re probably way beyond my reach.
LTL_FTC
·6 maanden geleden·discuss
I mean, you could put together a cluster of dgx sparks (8 of them) and hit 100tps with high concurrency:

https://forums.developer.nvidia.com/t/6x-spark-setup/354399/...

Or a single user at about 10tps.

This is probably around $30k if you go with the 1tb models.
LTL_FTC
·6 maanden geleden·discuss
I found that rotating my phone to landscape makes it readable, just as an fyi
LTL_FTC
·6 maanden geleden·discuss
Just yesterday I was reading through this five year old post on triton by its creator. Triton was their PHD thesis and they coined the name before the inference server was renamed to it… if this is what you are referring to?

Here is the Reddit thread:

https://www.reddit.com/r/MachineLearning/comments/otdpkx/n_i...
LTL_FTC
·6 maanden geleden·discuss
Well it looks like as you were typing your comment, a press release was going out announcing OpenAi’s $10B investment in Cerebras.