datastoat · HackerTrans

قبل 19 يومًاdiscuss

I believe that chain-of-thought reasoning blocks don't really correspond to what humans think of as reasoning. (See section 6.2.2 of the Fable/Mythos system card about "illegible reasoning", and the questions raised by the Apple paper on "The illusion of thinking".) I assumed they obscure the reasoning blocks because if users saw what's going on they'd be alarmed. Just as I'd probably be alarmed if I saw what was really going on in the heads of my colleagues ...

datastoat

قبل 4 أشهرdiscuss

Goodhart's Law of Specification: When a spec reaches a state where it's comprehensive and precise enough to generate code, it has fallen out of alignment with the original intent.

Of course there are some systems where correctness is vital, and for those I'd like a precise spec and proof of correctness. But I think there's a huge bulk of code where formal specification impedes what should be a process of learning and adapting.

datastoat

قبل 7 أشهرdiscuss

Wouldn’t it be handy if the browser could intelligently join this author’s sentences into paragraphs?! (in connection to the thread about Mozilla putting AI in the browser)

datastoat

قبل 10 أشهرdiscuss

Darwin would claim otherwise! Single cells plus random mutation plus selective copying = rocket ships.

comments