degrews · HackerTrans

9 months agodiscuss

No one is assuming printing costs are the only costs to produce the catalogue. The point of pricing the catalogue at printing costs is to cover the marginal cost of offering the catalogue for sale. The fixed costs of producing the calendar are incurred either way.

degrews

11 months agodiscuss

That eval hasn't been relevant for a while now. Performance there just doesn't seem to correlate well with real-world performance.

degrews

11 months agodiscuss

It's because those markets are based on the LLM Arena leaderboard (https://lmarena.ai/), where Claude has historically done poorly.

That eval has also become a lot less relevant (it's considered not very indicative of real-world performance), so it's unlikely Anthropic will prioritize optimizing for it in future models.

comments