HackerTrans
トップ新着トレンドコメント過去質問紹介求人

bcatanzaro

no profile record

投稿

Nvidia Nemotron 3

developer.nvidia.com
2 ポイント·投稿者 bcatanzaro·7 か月前·0 コメント

コメント

bcatanzaro
·25 日前·議論
"A founder-engineer driven company. Facebook is one of the few Big Tech firms whose founder is an engineer, and still is the CEO. Netflix is the other one where founder and co-CEO Reed Hastings was also a software engineer before starting the company. Amazon was the other example of this until recently, but it’s not the case at Google or Apple."

So funny how people overlook Jensen Huang repeatedly. As if NVIDIA wasn't big tech, or Jensen wasn't a founder, or an engineer...
bcatanzaro
·30 日前·議論
I have been in an SF muni car with someone actively smoking something that was not marijuana or a cigarette. I think it was fentanyl but I’m not sure. This was about two years ago. I hope this is tolerated less now than it has been.
bcatanzaro
·2 か月前·議論
Underrated comment
bcatanzaro
·2 か月前·議論
OMG
bcatanzaro
·3 か月前·議論
Yes
bcatanzaro
·3 か月前·議論
Nemotron has two reasons to exist, both of which are strategic to NVIDIA.

1. Help NVIDIA design future systems for AI by more deeply understanding what it takes to build AI.

2. Keep the AI ecosystem strong and diverse throughout the world by providing AI infrastructure that many companies can innovate on.

This is not a science project, nor is it for the joy of giving something away. Both of these reasons are core to NVIDIA.
bcatanzaro
·3 か月前·議論
Some of these concerns are precisely why we are building Nemotron at NVIDIA. We want to make it possible for people to invent and deploy AI in all sorts of new and unforeseen ways.

Nemotron is:

1. Not just open weight, but open data (to the limits of what is feasible), open recipe, open technique

2. In the future built by a coalition of organizations coming together to build great openly developed AI.

Nemotron 3 Super is our most successful model yet. [1]

Ultra is coming soon. And then Nemotron 4.

We can afford to do this because when AI grows, NVIDIA's opportunity also grows.

[1] https://kaitchup.substack.com/p/the-fastest-and-cheapest-120...
bcatanzaro
·5 か月前·議論
AI is a mirror. If you are boring, you will use AI in a boring way.
bcatanzaro
·5 か月前·議論
sadly, disembodied brains are not very useful. embodied brains require a civilization's worth of energy consumption and environmental impact in order to do their work. so we really need to take the world's power/water/carbon impact (divided by the world population) to talk about how much power it takes for a human brain to solve a problem.
bcatanzaro
·5 か月前·議論
As I said - anything surprisingly gluten free or surprisingly vegan is going to be UPF.

Sometimes I wonder if the gluten free trend is a ploy by food processing companies to whitewash expensive proprietary processed foods as “whole”.
bcatanzaro
·5 か月前·議論
Agreed. Which makes the statement “ultraprocessed foods should be treated more like cigarettes” seem wrong.

I guess “bad foods should be treated more like cigarettes” is too obvious.
bcatanzaro
·5 か月前·議論
Most of the things on sale at “Whole Foods” are ultra-processed these days. Anything that requires effort to make gluten free or vegan for example. Like impossible burger. Extreme ultra-processed. Or gluten free bread.

Please don’t tell me impossible burger patties are like cigarettes.
bcatanzaro
·7 か月前·議論
The Nano model isn’t pretrained in FP4, only Super and Ultra are. And posttraining is not in FP4, so the posttrained weights of these models are not native FP4.
bcatanzaro
·10 か月前·議論
I had a similar experience. The "Sanctus Sanctus Sanctus" written in stone was not an aspiration or a motto for me when I visited, it was a statement of fact.