HackerTrans
TopNewTrendsCommentsPastAskShowJobs

_ntka

no profile record

comments

_ntka
·vor 2 Jahren·discuss
Radiation would perhaps be better pictured with a light blue glow (Cherenkov radiation).

The green glow used in pop culture has its origin in the widespread use of radium paint to achieve a glow-in-the-dark effect (e.g. on watch faces) in the early 20th century. I still own a radium watch. The paint was always fluorescent green. And it did glow.
_ntka
·vor 2 Jahren·discuss
Isn't JAX the most widely used framework in the GenAI space? Most companies there use it -- Cohere, Anthropic, CharacterAI, xAI, Midjourney etc.
_ntka
·vor 2 Jahren·discuss
No, I am saying, with JAX you train on G.P.U., with a G, and your training runs are >2x faster, so your training costs are 2x lower, which matters whether your training spend is $1k or $100M. You're not interested in that? That's ok, but most people are.
_ntka
·vor 2 Jahren·discuss
Or alternatively, do you want faster training runs (and thus lower training costs)? Then JAX is a good choice for you.
_ntka
·vor 2 Jahren·discuss
It's all about cost and performance. If you can train a foundation model 2x faster with JAX on the same hardware, you are effectively slashing your training costs by 2x, which is significant for a multi-million dollar training run.
_ntka
·vor 2 Jahren·discuss
JAX is used by almost every large genAI player (Anthropic, Cohere, DeepMind, Midjourney, Character.ai, XAi, Apple, etc.). Its actual market share in foundation models development is something like 80%.

Also JAX is not just for TPU. It's mainly for GPU. It's usually 2-3x faster than torch on GPU: https://keras.io/getting_started/benchmarks/

Far more industry users of JAX use it on GPU compared to TPU.