Nvidia Tackles Chipmaking Process, Claims 40X Speed Up with CuLitho(tomshardware.com)
tomshardware.com
Nvidia Tackles Chipmaking Process, Claims 40X Speed Up with CuLitho
https://www.tomshardware.com/news/nvidia-tackles-chipmaking-process-claims-40x-speed-up-with-culitho
33 comments
I'm excited to see what area of chipmaking they tackle next. I'd love to see a 40X speedup in my HDL simulator/compiler or in the timing tools, the placement tools, or the ATPG vector generators. So much of this stuff just limps along today.
How can I find places that have these interesting problems to solve? And then, how does one go about "trying" to solve them? Sometimes I can look into what someone is doing and propose (or implement) a performance optimization, but it's never a sure thing without really digging in. It's the kind of thing I enjoy but I'm not sure how to market myself or whom to approach.
On a related note, a LOT of software suffers from suboptimal performance but it's not usually so bad that it obviously impacts the electric bill.
On a related note, a LOT of software suffers from suboptimal performance but it's not usually so bad that it obviously impacts the electric bill.
> How can I find places that have these interesting problems to solve? And then, how does one go about "trying" to solve them? [...] On a related note, a LOT of software suffers from suboptimal performance but it's not usually so bad that it obviously impacts the electric bill.
In scientific computing and HPC, I believe the solution to many problems can be accelerated significantly. For example, redesigning the algorithms in a way that can be benefited from GPUs. Unfortunately, it's not just a matter of rewriting the code, sometimes they require one to completely reinvent the algorithms in order to transform them to a form suitable for modern hardware, and it takes expert-level knowledge of the underlying mathematics and physics to do so. So many people just choose to keep running the decade-old existing code.
In scientific computing and HPC, I believe the solution to many problems can be accelerated significantly. For example, redesigning the algorithms in a way that can be benefited from GPUs. Unfortunately, it's not just a matter of rewriting the code, sometimes they require one to completely reinvent the algorithms in order to transform them to a form suitable for modern hardware, and it takes expert-level knowledge of the underlying mathematics and physics to do so. So many people just choose to keep running the decade-old existing code.
As someone dealing with this right now, the challenges are multilayered. You need someone who's an expert at the underlying math and physics, then they also need to understand optimal GPU programming patterns and need to be convinced of the value of GPU acceleration in the first place.
On top of that, the expert maintaining the HPC code has most likely personally contributed a lot of the things the code is using to run efficiently on CPUs, so proposing large design changes for GPU acceleration also leads to ego clashes because they (somewhat reasonably) don't just want to completely throw out most of their own R&D.
For the application I'm working with, it has taken ~2 years just to get through basic issues like convincing the scientists of the value of GPU acceleration, striking a balance between their existing methods and restructuring large parts for GPU, and convincing them that instead they'll end up having a lot of room to explore new things like methods which utilize both CPU and GPU.
On top of that, the expert maintaining the HPC code has most likely personally contributed a lot of the things the code is using to run efficiently on CPUs, so proposing large design changes for GPU acceleration also leads to ego clashes because they (somewhat reasonably) don't just want to completely throw out most of their own R&D.
For the application I'm working with, it has taken ~2 years just to get through basic issues like convincing the scientists of the value of GPU acceleration, striking a balance between their existing methods and restructuring large parts for GPU, and convincing them that instead they'll end up having a lot of room to explore new things like methods which utilize both CPU and GPU.
What language do you use, CUDA-flavored C? I have found Numba's GPU JIT to be a great alternative, since you get to write Python.
Yep, CUDA-flavored C/C++. We looked into Python-based solutions but in the end they didn't really meet the scientist's requirements for the code (things like maintaining the existing experience for some people in other labs who have been using the C/C++ library directly).
What you do is try to provide value to the business. I.e. How does this company make money? What is preventing them from having more business or from saving money providing the same goods/services? If among those challenges there is something that can be addressed with better technology in an area of your expertise, you make a proposal to your management, and if you are lucky they will give you the "go ahead".
In the real world, though, as a junior developer, somebody with much more expertise in the business and the technology side of things will be the one making these proposals and your job as a junior person will be to implement them. Get good enough at implementing them, show enough initiative, skill and business acumen, and over time you will be the one proposing ideas. You will need both hard work and good luck to succeed.
Do that... or collect a paycheck and live your life. That also works.
In the real world, though, as a junior developer, somebody with much more expertise in the business and the technology side of things will be the one making these proposals and your job as a junior person will be to implement them. Get good enough at implementing them, show enough initiative, skill and business acumen, and over time you will be the one proposing ideas. You will need both hard work and good luck to succeed.
Do that... or collect a paycheck and live your life. That also works.
Sounds to me that they are solving a very "local" problem in the sense that the solution depends strongly on local shapes only. And also the number of shapes seems very limited, so you could cache a lot of this probably. But please correct me if I'm wrong.
Apply to NVIDIA!
We need a periodic table of elements for all of the new AI model 'portmanteau' acronyms.
cuLitho isn't an AI process. Ian Cutress covered that in his article
https://morethanmoore.substack.com/p/nvidia-enabling-computa...
> Of course when speaking about NV, it’s hard not to mention machine learning. Currently cuLitho is purely a mathematical solution tool, and not a machine learning accelerated tool. The engineering team we spoke to, when asked about adding ML tools to something like this, had a gleam in their eyes and essentially said ‘that would be the dream’. So not yet, but perhaps in the future.
> Of course when speaking about NV, it’s hard not to mention machine learning. Currently cuLitho is purely a mathematical solution tool, and not a machine learning accelerated tool. The engineering team we spoke to, when asked about adding ML tools to something like this, had a gleam in their eyes and essentially said ‘that would be the dream’. So not yet, but perhaps in the future.
This is amusing to me because AI could also be considered a "mathematical solution tool". Numbers go in, math is performed, and numbers come out.
For a moment there, I thought they figured out how to do 1-2nm lithography with visible light, which would be quite a feat, but perhaps possible with White light holograms??
Sweet. I should then expect they will have 4090s for purchase on their website again then?
They've been for a while now.
Seriously? "Culito" ?
I read it as "Cthulhu" on the first pass.
> Seriously? "Culito" ?
The Head Of Diveristy Hiring at NVidia is probably going to be obliged to have a number of "conversations".
The Head Of Diveristy Hiring at NVidia is probably going to be obliged to have a number of "conversations".
Unlikely. They are Taiwanese, they speak Chinese not Spanish. Also capitalisation makes it abundantly clear its a contraction of CUDA + Lithography
Lol. Get a sense of humor. It sounds like "little ass".
NVidia is from California where 40% of the population speaks Spanish.
Doesn't matter if it's "abundantly clear" when it's a hilariously bad choice. Or a hilariously good choice actually. I like it.
EDIT: And don't get me started with the Orin line of chips. (Orin = Urine)
NVidia is from California where 40% of the population speaks Spanish.
Doesn't matter if it's "abundantly clear" when it's a hilariously bad choice. Or a hilariously good choice actually. I like it.
EDIT: And don't get me started with the Orin line of chips. (Orin = Urine)
Nvidia have flexed their prowess in Spanish on one of their A.I. natural language processing presentations, to some Level-N. Nvidia is working with Nordic archivists. They have a general interest in language seems to be the driver. Archiving languages before they go extinct is a use for A.I.
> Also capitalisation makes it abundantly clear its a contraction of CUDA + Lithography
Not when you hear it.
/me giggles in Spanish
Not when you hear it.
/me giggles in Spanish
[deleted]
Makes it abundantly clear they should have spent $100 on a branding consultant to prevent them from making newbie mistakes.
Most of their target market has indicated they are purchasing from them. Clearly they didn't need that branding consultant.
[deleted]
CULitho?
cuLitho, not CuLitho, unfortunately the auto-capitalizer on Hacker News messed it up. It perfectly follows the convention of naming a GPU-accelerated program as "cuX", "cu" for CUDA.
cuLitho. So bad it's good.