Which AI models can write banger tweets?(alignedhq.ai)

2 pointsby pmmucsdقبل سنتين3 comments

Which AI models can write banger tweets?

https://www.alignedhq.ai/post/aligned-s-irl-social-media-eval-which-ai-models-can-write-banger-tweets

4 comments

gwernقبل سنتين

Probably should try more base models, given that the weaknesses sound characteristically mode-collapsed, like ChatGPTese. (Prompt engineering tweets with base models is near trivial - just include a bunch of tweets.)

It would also be more relevant to examine win rates by generating a large batch of candidates and using the best rated one. There is no point optimizing for mean win rate, when you actually care about the best possible tweet you can get out - you can't tweet every tweet a LLM can generate to begin with, and you need the best possible tweet, not reliable mediocrity.

pmmucsdقبل سنتين

Report: https://app.alignedhq.ai/demo/report/irl_social_media

_sam__قبل سنتين

Claude 3.5 sonnet is the winner for me. At Hypespot, we fine-tune to create AI-generated tweets that resonate with audiences and boost engagement.

[deleted]قبل سنتين