For most aspects my opinions don't change. But on coding, it has changed a lot. Two years ago I would just dismiss at the possibility that llm could write up a simple function. Now it has proven me wrong.
I don't know if "AI agrees" is reliable enough to count. Do you have a particular scientific article that you based on? And what are your example? Your post is mostly describing without concrete example so I can't follow.
An open model that is competitive to commercial models is a big deal if true. I hope someday I can find a way to run such high performance model locally on my laptop.
There is an article said that a DOGE member had write access as well (See [1]). But it was quickly changed back to read only. So there was a risk, but I can only hope nothing happened.
ImageNet dataset is the main thing AFAIK. But even so I find Dr. Li's contribution big enough. For a context, datasets for computer vision at her time were mostly small, so nn was rarely considered a good method for CV. Not until AlexNet won the challenge, and the world changes after that. I remember many people initially scoffed at ImageNet, arguing that the dataset was flawed and that a “bad” method like NN (AlexNet) could only win because of those flaws. Simply saying “paying” is an understatement because we also need to account for the academic politics of her time.
A little fun fact, even if most research papers nowadays try to propose new dataset, if we take imagenet and pretrain the backbone, we usually end up with a very strong baseline.
Btw, not sure why you think Karpathy has a bigger impact than Fei-Fei Li. I can't think what he is doing that is actually changing the playing field.
When I was a college student, I attended a conference regarding IoT. I still remember a developer of a face ID software for a safe box was so sure that their technology was secure because Apple deployed face ID on iPhone. Then a few days later, an article about fooling iPhone's face ID with a printed paper with the victim's face got published.
Wow. Good insight! I have never viewed vacation this way. I always thought the only reason vacation exists is because companies have to give vacation due to laws and well being of their employee. So when I get some days off, I always feel a bit guilty because the company is losing out something.
Thank you for your answer! TIL a new word: qualia
I like your two examples. They have different perspectives. Though I must say the "qualia to manifestation" is still a bit abstract for me now. I'll keep them in mind.
That is such a good quote to remember. Thanks for your answer! It actually opened my understanding a lot. I searched your quote and found some other good ones.
Wow. Thank you for your thoughtful answer!
> “human creativity is the ability to create an infinite range of outputs from a finite range of inputs that nonetheless pertain to our motivations/context in some useful way”
Do you think this can be used as a metric? Like the more useful answer we can come up with, the more "creative" we are. The constraint of outputs and "some useful way" is such a good insight.
> “With the addition of the far-infrared measurements from PREFIRE, we’re seeing for the first time the full energy spectrum that Earth radiates into space, which is critical to understanding climate change.”
Does anyone know what the other measurements are, besides far-infrared?
I wonder how they will deal with those complex data to understand cloud and heat. This sounds vague and complicated to me.