Not knowledgable, but irradiated flies should not be expected to be irradiated again. There are 3 population pools:
1. The Factory spawning population - This is self-sustained, and never encounters radiation.
2. A subset of the spawned males from the factory population are irradiated, making them sterile.
3. The wild population, consisting of the sterile males + wild males + wild females.
If for some reason the sterile population is not fully sterile (unlikely), then maybe there is a gene that helps for radiation resistance, but the children of that strain will not encounter radiation, so it fades away.
The factories are not going out to the regions where the flies are deployed to get new fly studs.
but some tokens are not really needed? This is probably bad because it is mismatched with training set, but if you trained a model on a dataset removing all prepositions (or whatever caveman speak is), would you have a performance degradation compared to the same model trained on the same dataset without the caveman translation?
> How do they audit that Anthropic can't alter model outputs for contexts they (the ethics board or whatever it's called, can't remember) don't like?
I was thinking that Anthropic would just be providing the models/setup support to run their models in aws gov cloud. They do not have any real insight into what is being asked. Maybe a few engineers have the specific clearances to access and debug the running systems, but that would one or two people who are embedded to debug inference issues - not something that would be analyzed by others in the company.
The whole 'do not use our models for mass surveillance' is at the end of the day an honor system. Companies have no real way of enforcing that clause, or determining that it has been violated. That being said, at least historically, one has been able to trust the government to abide by commercial agreements. The people who work in cleared positions are generally selected for honesty, and ability, willingness to follow rules.
The other side of this is that if this is over investment (likely)
Then in 5 years time resources will be much cheaper and spur alot of exploration developments. There are many people with many ideas, and a lot of them are just lacking compute to attempt them.
My back of mind thought is that worst case it will be like how the US overbuilt fiber in the 90s, which led the way for cloud, network and such in 2000s.
I wonder how many companies will be doing more bugfixes now...
For example, the initial product generates "hello world".
What it was supposed to do was control a robot to automatically do pick and place.
It's Definitely a bug that the program failed to work, it's even tracked as a defect in the issue management. No R&D involved just fixing a pretty severe software bug, namely that the product does not work.