HackerTrans
トップ新着トレンドコメント過去質問紹介求人

popey

no profile record

投稿

Position: Coding Benchmarks Are Misaligned with Agentic Software Engineering

arxiv.org
1 ポイント·投稿者 popey·23 日前·1 コメント

A Proposed Framework for Evaluating AI Agent Skills

tessl.io
2 ポイント·投稿者 popey·3 か月前·0 コメント

A 'high blast radius': Amazon probes surge in outages linked to AI coding tools

tessl.io
5 ポイント·投稿者 popey·4 か月前·0 コメント

Skills on Tessl: the package manager for agent skills

tessl.io
1 ポイント·投稿者 popey·5 か月前·0 コメント

Kilo bets on context as the bridge between AI coding agents and chat apps

tessl.io
1 ポイント·投稿者 popey·6 か月前·0 コメント

Malware Peddlers Are Now Hijacking Snap Publisher Domains

blog.popey.com
3 ポイント·投稿者 popey·6 か月前·0 コメント

コメント

popey
·22 日前·議論
That was a nice diversion. I got 76,750.
popey
·2 か月前·議論
It took a bit of clicking, but no login needed to see the "feed". https://cringeout.com/feed
popey
·4 か月前·議論
My worry with the confidence scoring is that it conflates "an agent used this and didn't obviously break" with "this is correct". An agent can follow bad advice for several steps before anything fails. So a KU gaining confirmation weight doesn't tell you much about whether it's actually true, just that it propagated. You're crowd-sourcing correctness from sources that can't reliably detect their own mistakes.

It's why at Tessl we treat evals as a first-class part of the development process rather than an afterthought. Without some mechanism to verify quality beyond adoption, you end up with a very efficient way to spread confident nonsense at scale.
popey
·5 か月前·議論
The agents are smart enough to write the evals too.

It's agents all the way down!

Submit a GitHub repo containing skills to Tessl, and it will generate the evals, run them, and present the results. https://tessl.io/registry/skills/submit

The evals and results are all shown, no login necessary, so you can assess them yourself. e.g. https://tessl.io/registry/skills/github/coreyhaines31/market... (click details to see the eval texts).
popey
·5 年前·議論
I certainly get "use it every day", for sure. Clubs, celebrities, enthusiast groups.

"love it" though?

Feels to me that it's a necessary evil, like car insurance.