HackerTrans
TopNewTrendsCommentsPastAskShowJobs

popey

no profile record

Submissions

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering

arxiv.org
1 points·by popey·23 giorni fa·1 comments

A Proposed Framework for Evaluating AI Agent Skills

tessl.io
2 points·by popey·3 mesi fa·0 comments

A 'high blast radius': Amazon probes surge in outages linked to AI coding tools

tessl.io
5 points·by popey·4 mesi fa·0 comments

Skills on Tessl: the package manager for agent skills

tessl.io
1 points·by popey·5 mesi fa·0 comments

Kilo bets on context as the bridge between AI coding agents and chat apps

tessl.io
1 points·by popey·6 mesi fa·0 comments

Malware Peddlers Are Now Hijacking Snap Publisher Domains

blog.popey.com
3 points·by popey·6 mesi fa·0 comments

comments

popey
·22 giorni fa·discuss
That was a nice diversion. I got 76,750.
popey
·2 mesi fa·discuss
It took a bit of clicking, but no login needed to see the "feed". https://cringeout.com/feed
popey
·4 mesi fa·discuss
My worry with the confidence scoring is that it conflates "an agent used this and didn't obviously break" with "this is correct". An agent can follow bad advice for several steps before anything fails. So a KU gaining confirmation weight doesn't tell you much about whether it's actually true, just that it propagated. You're crowd-sourcing correctness from sources that can't reliably detect their own mistakes.

It's why at Tessl we treat evals as a first-class part of the development process rather than an afterthought. Without some mechanism to verify quality beyond adoption, you end up with a very efficient way to spread confident nonsense at scale.
popey
·5 mesi fa·discuss
The agents are smart enough to write the evals too.

It's agents all the way down!

Submit a GitHub repo containing skills to Tessl, and it will generate the evals, run them, and present the results. https://tessl.io/registry/skills/submit

The evals and results are all shown, no login necessary, so you can assess them yourself. e.g. https://tessl.io/registry/skills/github/coreyhaines31/market... (click details to see the eval texts).
popey
·5 anni fa·discuss
I certainly get "use it every day", for sure. Clubs, celebrities, enthusiast groups.

"love it" though?

Feels to me that it's a necessary evil, like car insurance.