Show HN: RateMyPrompt – share and rate prompts with auto AI evals(josh.ing)
josh.ing
Show HN: RateMyPrompt – share and rate prompts with auto AI evals
https://www.josh.ing/ratemyprompt
6 comments
Love your work, but can you share what criteria these llms use to evaluate prompts and it would be nice if these llms can give feedback on improving these prompts beside giving just a score!
Nice! You should integrate with github.com/danielmiessler/fabric!
I see what you are doing there - HLRF for free.
HLRF? do you mean RLHF?
yes yes, i am dyslexic so it shows up a lot more in short responses.
Already has 500+ prompts generated by AI using the latest model prompting guidelines
5 different supported prompt types: full prompt, enhancement, template, system, chain
20+ categories: coding, writing, marketing, business, creative, etc.
Every prompt gets evaluated automatically by multiple AI models (Claude 3 + GPT-4 Mini, more to come)
Then humans can rate and there is an overall score that takes both AI & humans into account
AI eval prompt here: https://www.josh.ing/ratemyprompt/evaluation-prompt
I'm still quite the noob when it comes to AI stuff so I'd love feedback about RateMyPrompt and ways that it could be improved