You're throwing the baby out with the bathwater, though. Waiting a week still prevents a decent amount of attacks. Not every attack can evade detection for two weeks. Even if it did, security scanning tools might still detect them.
Say hypothetically that 20% of attack slip through, which is still worrying, you can mitigate 80% of attacks by just waiting a week. It's a low risk, high reward strategy.
What do you mean there is no such thing as R1-1.5b? DeepSeek released a distilled version based on a 1.5B Qwen model with the full name DeepSeek-R1-Distill-Qwen-1.5B, see chapter 3.2 on page 14 of their research article [0].
It hasn't been great. Applying for jobs in this market while having the post-MSc burnout has been tough. I finished an MSC in AI back in June, but there are so few AI-relevant jobs where I live it's depressing. I've interview for data science and analyst roles, but barely get in the door.
I'm getting a good amount of interviews for developer and data engineering positions, but the competition is tough. Many positions have seen a 5x increase in candidates since the same time last year, according to my interviewers.
However, I'm hopefully getting an offer as a data platform engineer soon. The department leader has ranked me as their first choice, so unless the higher-ups complain... Knock on wood.
I have multiple questions regarding the methods of this test.
The biggest one is that, well... The test doesn't aim to see what GPT-4 can do and how well it does it, only whether the participant can guess the (possibly cherry-picked) answer the author decided on. In short, we don't know if he sampled answers and decided on the most probable answer (akin to consensus voting/self-consistency[1]), or if he asked a question and chose the first one.
Maybe GPT-4 guesses the correct answer for a question 80% of the time, but he got unlucky? You don't know, the author doesn't tell you. The answers are generated ahead of time and are the same every time you go through the test.
Say hypothetically that 20% of attack slip through, which is still worrying, you can mitigate 80% of attacks by just waiting a week. It's a low risk, high reward strategy.