Yeah, I noticed with 'Gemini Pro' , it didn't seem to be able to remember much about earlier outputs in the conversation (apparently little to no context window), which obviously drastically dumbs it down.
I was starting to get OK results with 'Pro', but I had to use special prompting tricks.
Tried 'Advanced' (Ultra), seems only marginally better so far.
Well, it says I'm in to 'Bard Advanced' (which is the same as 'Gemini Ultra'). I only did a couple of queries so far, text output seemed only marginally better than 'Gemini Pro', which I was just starting to get decent results with after getting used to prompting. It's possible they'd done a stealth release earlier, obviously need to do a lot of experiments to make a proper comparison with GPT-4.