HackerTrans
TopNewTrendsCommentsPastAskShowJobs

popey

no profile record

Submissions

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering

arxiv.org
1 points·by popey·23 วันที่ผ่านมา·1 comments

A Proposed Framework for Evaluating AI Agent Skills

tessl.io
2 points·by popey·3 เดือนที่ผ่านมา·0 comments

A 'high blast radius': Amazon probes surge in outages linked to AI coding tools

tessl.io
5 points·by popey·4 เดือนที่ผ่านมา·0 comments

Skills on Tessl: the package manager for agent skills

tessl.io
1 points·by popey·5 เดือนที่ผ่านมา·0 comments

Kilo bets on context as the bridge between AI coding agents and chat apps

tessl.io
1 points·by popey·6 เดือนที่ผ่านมา·0 comments

Malware Peddlers Are Now Hijacking Snap Publisher Domains

blog.popey.com
3 points·by popey·6 เดือนที่ผ่านมา·0 comments

comments

popey
·22 วันที่ผ่านมา·discuss
That was a nice diversion. I got 76,750.
popey
·2 เดือนที่ผ่านมา·discuss
It took a bit of clicking, but no login needed to see the "feed". https://cringeout.com/feed
popey
·4 เดือนที่ผ่านมา·discuss
My worry with the confidence scoring is that it conflates "an agent used this and didn't obviously break" with "this is correct". An agent can follow bad advice for several steps before anything fails. So a KU gaining confirmation weight doesn't tell you much about whether it's actually true, just that it propagated. You're crowd-sourcing correctness from sources that can't reliably detect their own mistakes.

It's why at Tessl we treat evals as a first-class part of the development process rather than an afterthought. Without some mechanism to verify quality beyond adoption, you end up with a very efficient way to spread confident nonsense at scale.
popey
·5 เดือนที่ผ่านมา·discuss
The agents are smart enough to write the evals too.

It's agents all the way down!

Submit a GitHub repo containing skills to Tessl, and it will generate the evals, run them, and present the results. https://tessl.io/registry/skills/submit

The evals and results are all shown, no login necessary, so you can assess them yourself. e.g. https://tessl.io/registry/skills/github/coreyhaines31/market... (click details to see the eval texts).
popey
·5 ปีที่แล้ว·discuss
I certainly get "use it every day", for sure. Clubs, celebrities, enthusiast groups.

"love it" though?

Feels to me that it's a necessary evil, like car insurance.