Why would they spend a ton of effort ensuring that their customers spend less money on them?
Token economics also are weird. If you design a fancy new frontend that for example uses a cheap model to parse a PDF into text that is fed into an expensive model, you will probably spend more money because you are on API payscale rather than the "max plan" payscale.
You aren't looking for a random set of tokens that have the exact same logit, you are looking for the largest n tokens to have the exact same probability.
This is exceedingly unlikely, as training will only push one of them up for any individual sample. There are likely some pathological situations that could end up with that situation, maybe, but it is pretty unlikely in a general case.
They are all pretty par for the course. Google used to be outstanding... but I'm not sure of a single product they have that is outstanding (def: significantly better than the competition) anymore. On the other hand I rarely use any google products these days, so maybe I'm not the one to be judging.
I've been waiting for something like this to be released since then.
The annoying thing is that chameleon was multi-modal out based on the same principles, but this model is just inputs... (I'm curious how they did pre-training without having multi-modal outputs as well. I wonder if they just chopped them off rather than support image output).
Before, you measured diffusion rate of oxygen and inferred oxygen concentration from that (the concentration outside the chamber is always greater than the concentration inside). Dirty membranes etc all changed the rate of diffusion, which caused issues.
After you measure oxygen concentration directly (the concentration inside and outside the chamber are always the same).
> there wouldn’t be different ideological factions in the first place.
Maybe I’m just very jaded, but I don’t think this is true.
Our values are significantly more aligned than we generally believe, however as long as there is power to be gained by creating the illusion of a difference of values, there will be factions dedicated to ensuring that illusion is maintained.