HackerTrans
TopNewTrendsCommentsPastAskShowJobs

popey

no profile record

Submissions

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering

arxiv.org
1 points·by popey·hace 23 días·1 comments

A Proposed Framework for Evaluating AI Agent Skills

tessl.io
2 points·by popey·hace 3 meses·0 comments

A 'high blast radius': Amazon probes surge in outages linked to AI coding tools

tessl.io
5 points·by popey·hace 4 meses·0 comments

Skills on Tessl: the package manager for agent skills

tessl.io
1 points·by popey·hace 5 meses·0 comments

Kilo bets on context as the bridge between AI coding agents and chat apps

tessl.io
1 points·by popey·hace 6 meses·0 comments

Malware Peddlers Are Now Hijacking Snap Publisher Domains

blog.popey.com
3 points·by popey·hace 6 meses·0 comments

comments

popey
·hace 22 días·discuss
That was a nice diversion. I got 76,750.
popey
·hace 2 meses·discuss
It took a bit of clicking, but no login needed to see the "feed". https://cringeout.com/feed
popey
·hace 4 meses·discuss
My worry with the confidence scoring is that it conflates "an agent used this and didn't obviously break" with "this is correct". An agent can follow bad advice for several steps before anything fails. So a KU gaining confirmation weight doesn't tell you much about whether it's actually true, just that it propagated. You're crowd-sourcing correctness from sources that can't reliably detect their own mistakes.

It's why at Tessl we treat evals as a first-class part of the development process rather than an afterthought. Without some mechanism to verify quality beyond adoption, you end up with a very efficient way to spread confident nonsense at scale.
popey
·hace 5 meses·discuss
The agents are smart enough to write the evals too.

It's agents all the way down!

Submit a GitHub repo containing skills to Tessl, and it will generate the evals, run them, and present the results. https://tessl.io/registry/skills/submit

The evals and results are all shown, no login necessary, so you can assess them yourself. e.g. https://tessl.io/registry/skills/github/coreyhaines31/market... (click details to see the eval texts).
popey
·hace 5 años·discuss
I certainly get "use it every day", for sure. Clubs, celebrities, enthusiast groups.

"love it" though?

Feels to me that it's a necessary evil, like car insurance.