This doesn’t hold up imo. Your phone analogy fits the description of a harness. That is the thing you interact with. The LLM is more like the processor in that phone. As long as it gets the work done, I will choose the cheapest/fastest because I can switch it out in a matter of seconds anyways.
That is very true but I was surprised by how clear the “signal” was. Only Gemini really confidently solved all levels. But yeah the goal is now to include harder levels as well!
I think this view assumes no human will/should ever read the code. This is considered bad practice because someone else will not understand the code as well whether written by a human or agent. Unless 0% human oversight is needed anymore agents should still code like us.
Genuine question to people more knowledgeable: Why are politicians/technocrats doing this?
Also generally speaking e.g. in relation to chat control and so on. Do they think this is what the people actually want because of lobbying or are they aware and believe they know better? Is it literally just corruption? Or are there actual benefits and we are just in the HN bubble where most people think its a bad idea?
I am amazed that the IDM is able to produce enough high quality annotations for the downstream FDM to work, even matching the ground truth contractor annotations!
As an EU citizen I really hope we can gain some meaningful distance to the US asap. I hope my leaders feel the same. And if everything works out I think this will be great for the EU.
This is really some sort of diplomatic Streisand effect. If the US would not have been so aggressive and just string us along they could have continued to feed us their slop indefinitely without us noticing.
Here is what I don’t get tho: you have UX designers/engineers creating a new interface. What do you tell them? Just to do whatever? They probably spent months designing the new interface but why not fix this? They must have seen it is unusable…
It will be tough to run on our 4x H200 node… I wish they stayed around the 350B range. MLA will reduce KV cache usage but I don’t think the reduction will be significant enough.
Yeah true, but also this is a bit like saying the lock screen of your phone should not become a "one stop shop" for all push notifications. I actually do not own an Apple TV but I just imaging you have a list of shows from different streaming providers on the "home screen" (like it is on my PS4). And on a technical level it is just an API you integrate with (same as push notifications), which helps UX.
As an EU citizen hosting LLMs for researchers and staff at the university I work at, this is hits home. Without Chinese models we could not do what we do right now. IMO, in the EU (and anywhere else for that matter), we should be grateful for the Chinese labs to release these models with such permissive licenses. Without them the options would be bleak. Sometimes we would get some non-frontier model „as a treat“ and if you would like something more powerful the US labs would suggest your country pay some hundred millions for an NVIDIA data center and the only EU option is to still pay them a license fee to host on your own hardware (afaik) while they protect all the expertise. Meanwhile DeepSeek has a week where they post the „secret sauce“ to host their model more efficiently, which helped open-source projects like vLLM (which we use) to improve.