HackerTrans
TopNewTrendsCommentsPastAskShowJobs

bcatanzaro

no profile record

Submissions

Nvidia Nemotron 3

developer.nvidia.com
2 points·by bcatanzaro·hace 7 meses·0 comments

comments

bcatanzaro
·hace 25 días·discuss
"A founder-engineer driven company. Facebook is one of the few Big Tech firms whose founder is an engineer, and still is the CEO. Netflix is the other one where founder and co-CEO Reed Hastings was also a software engineer before starting the company. Amazon was the other example of this until recently, but it’s not the case at Google or Apple."

So funny how people overlook Jensen Huang repeatedly. As if NVIDIA wasn't big tech, or Jensen wasn't a founder, or an engineer...
bcatanzaro
·hace 30 días·discuss
I have been in an SF muni car with someone actively smoking something that was not marijuana or a cigarette. I think it was fentanyl but I’m not sure. This was about two years ago. I hope this is tolerated less now than it has been.
bcatanzaro
·hace 2 meses·discuss
Underrated comment
bcatanzaro
·hace 2 meses·discuss
OMG
bcatanzaro
·hace 3 meses·discuss
Yes
bcatanzaro
·hace 3 meses·discuss
Nemotron has two reasons to exist, both of which are strategic to NVIDIA.

1. Help NVIDIA design future systems for AI by more deeply understanding what it takes to build AI.

2. Keep the AI ecosystem strong and diverse throughout the world by providing AI infrastructure that many companies can innovate on.

This is not a science project, nor is it for the joy of giving something away. Both of these reasons are core to NVIDIA.
bcatanzaro
·hace 3 meses·discuss
Some of these concerns are precisely why we are building Nemotron at NVIDIA. We want to make it possible for people to invent and deploy AI in all sorts of new and unforeseen ways.

Nemotron is:

1. Not just open weight, but open data (to the limits of what is feasible), open recipe, open technique

2. In the future built by a coalition of organizations coming together to build great openly developed AI.

Nemotron 3 Super is our most successful model yet. [1]

Ultra is coming soon. And then Nemotron 4.

We can afford to do this because when AI grows, NVIDIA's opportunity also grows.

[1] https://kaitchup.substack.com/p/the-fastest-and-cheapest-120...
bcatanzaro
·hace 5 meses·discuss
AI is a mirror. If you are boring, you will use AI in a boring way.
bcatanzaro
·hace 5 meses·discuss
sadly, disembodied brains are not very useful. embodied brains require a civilization's worth of energy consumption and environmental impact in order to do their work. so we really need to take the world's power/water/carbon impact (divided by the world population) to talk about how much power it takes for a human brain to solve a problem.
bcatanzaro
·hace 5 meses·discuss
As I said - anything surprisingly gluten free or surprisingly vegan is going to be UPF.

Sometimes I wonder if the gluten free trend is a ploy by food processing companies to whitewash expensive proprietary processed foods as “whole”.
bcatanzaro
·hace 5 meses·discuss
Agreed. Which makes the statement “ultraprocessed foods should be treated more like cigarettes” seem wrong.

I guess “bad foods should be treated more like cigarettes” is too obvious.
bcatanzaro
·hace 5 meses·discuss
Most of the things on sale at “Whole Foods” are ultra-processed these days. Anything that requires effort to make gluten free or vegan for example. Like impossible burger. Extreme ultra-processed. Or gluten free bread.

Please don’t tell me impossible burger patties are like cigarettes.
bcatanzaro
·hace 7 meses·discuss
The Nano model isn’t pretrained in FP4, only Super and Ultra are. And posttraining is not in FP4, so the posttrained weights of these models are not native FP4.
bcatanzaro
·hace 10 meses·discuss
I had a similar experience. The "Sanctus Sanctus Sanctus" written in stone was not an aspiration or a motto for me when I visited, it was a statement of fact.