I saw similar artifacts in dalle-1 a lot (as if the image was pasted onto geometry). Definitely wouldn't surprise me if they use synthetic rasterized data to in the training, which could totally create artifacts like this.
This is the second time OpenAI has released something right at the same time as google did (Gemini 1.5 Pro with 10M token context length just now). Can't just be a coincidence