HackerTrans
TopNewTrendsCommentsPastAskShowJobs

thinkzilla

15 karmajoined hace 11 meses

Submissions

AI alignment research is unintentionally building a censor's toolkit

s-ball-10.github.io
2 points·by thinkzilla·hace 4 días·0 comments

comments

thinkzilla
·hace 5 meses·discuss
Making estimates is fine, but we should be clear that they are (provably) just opinions.

http://scribblethink.org/Work/kcsest.pdf

https://news.ycombinator.com/item?id=13731975

https://www.amazon.ca/Limits-Software-People-Projects-Perspe...
thinkzilla
·hace 8 meses·discuss
I generally agree with the point of the article ("Fourier transform is not magical").

However saying it is "just" curve fitting with sinusoids fails to mention that, among an infinite number of basis functions, there are some with useful properties, and sinusoids are one such: they are eigenvectors of shift-invariant linear systems (and hence are also eigenvectors of derivative operators).
thinkzilla
·hace 9 meses·discuss
The comparison to railroad infrastructure is interesting.

I think the author is wrong on this point however: > Today’s tech just cannot do what will be required of it (AI shouldn’t be dispensing medication when it can’t even count to 7).

The failures of AI are thought provoking, and more so when considered together with other results where AI performs at near expert level on challenging benchmarks. However, perfect reasoning is hardly a requirement. Most humans are not particularly good at reasoning, and most jobs do not need it. Both humans and AI can use calculators and other tools. All that's needed is that the AI is more or less as good as a human, while requiring much less pay.

A good exercise to appreciate the current state of AI might be to ask AI to write an essay about this topic ("how much revenue is needed to justify current AI spend, and draw parallels to the dotcom boom and building the transcontinental railroad"). Try it with two different models, using the deep research mode. I expect the results would be humbling.
thinkzilla
·hace 10 meses·discuss
I am sympathetic to the motivations and argument in the article, but the analogy with bridge building is flawed.

In engineering, if your assumptions are correct and you apply the formulas correctly, the bridge will not fall.

This is _not_ true of software, since it suffers from mathematical incompleteness. Computation is isomorphic to mathematics, and, just as there is no way to objectively estimate how long it will take to prove a theorem, there is no way _objectively_ estimate program properties, even simple things like "will this program ever print the string "xx". The proofs are variations of the Halting problem.

http://scribblethink.org/Work/Softestim/kcsest.pdf

Writing software is analogous to discovering the equations of physics of a bridge (physics/math) rather than applying them (engineering).