HackerTrans
TopNewTrendsCommentsPastAskShowJobs

grace77

no profile record

Submissions

Show HN: Agent Runner – open-source agent harness to benchmark real coding

designarena.ai
4 points·by grace77·8개월 전·0 comments

Launch HN: Design Arena (YC S25) – Head-to-head AI benchmark for aesthetics

74 points·by grace77·11개월 전·24 comments

Show HN: DesignArena – crowdsourced benchmark for AI-generated UI/UX

designarena.ai
89 points·by grace77·작년·29 comments

comments

grace77
·11개월 전·discuss
yes - the changes since Show HN have been builders (https://www.designarena.ai/builder), audio (https://www.designarena.ai/audio), video (https://www.designarena.ai/diffusion), and compare (https://www.designarena.ai/studio). We also had a feed at some point, but ripped that out because it looked messy
grace77
·11개월 전·discuss
We keep our system prompts across the board as bare bones as possible: https://www.designarena.ai/system-prompts

As for good game dev prompts, here's one from a user that made a pretty fun game: Make asteroids with 2 computers playing against each other on one screen. There should be asteroids flying and 2 ships being controlled by 2 computers. Pay attention to thoroughly implementing the logic to make the ships avoid asteroids at all costs. Absolutely no user input should be necessary, no click to start, no click to restart. The game starts automatically on load and automatically restarts when either computer is dead. The ships should survive as long as possible. The ships should fly around, avoid asteroids as a priority, but also shoot asteroids and each other. Make ships and asteroids positions random each time. Asteroids should split when shot. The goal is to create a robust algorithm for ships so they can survive as long as possible. The game should be playable at 500x500 screen resolution.
grace77
·11개월 전·discuss
Exactly - we think the ai design tools are in the equivalent of the 'uncanny valley' territory that a lot of the diffusion models were stuck in just 1-2 months ago; most average diffusion models are still in this local optimum, but the best of the best seem to have escaped it.
grace77
·11개월 전·discuss
yes! to the second point, someone in our show HN proposed encouraging human designers to compete in submissions as well - we tried implementing this and found that, at least right now, LLMs are still so bad at design that asking a human to beat them is trivial - our plan right now is to focus more on this once it becomes more of challenges and therefore hopefully more interesting/entertaining
grace77
·11개월 전·discuss
yes - we're trying to figure out why that is
grace77
·11개월 전·discuss
we're not training models or proxying human votes with models
grace77
·11개월 전·discuss
yes! LMArena recently started pushing "webdev" arena, but there was no explicit emphasis on design or aesthetics, just web-based content
grace77
·12개월 전·discuss
yes! sorry to ping this post late, but we're experimenting with something now - excited to update :)
grace77
·작년·discuss
ayy great to hear!
grace77
·작년·discuss
yes! we have a copy code and copy react code button on https://www.designarena.ai/play
grace77
·작년·discuss
I wish—just added them back
grace77
·작년·discuss
yes! that is the hope — /play is our first attempt at building out utility, would love your feedback and will ship hard to make it happen!
grace77
·작년·discuss
As are we, seems like the natural next step
grace77
·작년·discuss
thank you! posting now :)
grace77
·작년·discuss
Yes — great point. We originally waited for all model responses and randomized the vote order, but that made it a very bad user experience -- some models, especially open-source ones, took over 4 minutes to respond, leading to a high voter drop-off rate.

To preserve the voter experience without introducing bias, our current approach waits for the slowest model within each binary comparison — so even if one model is faster, we don’t display until both are ready. You're right that this does introduce some bias for the two smallest models, and we'd love to hear suggestions for how to make this better!

As for the 5th request: we actually kick off one reserve model alongside the four randomly selected for the tournament. This backup isn’t shown unless one of the four fails — it’s not the fastest or lowest-latency model, just a randomly selected fallback to keep the system robust without skewing results.
grace77
·작년·discuss
wow this is a super interesting idea, and the team loves it — we'll fast follow-through and follow-up here when we add it, thanks for the suggestion!
grace77
·작년·discuss
[dead]