nh43de · HackerTrans

It seems to be the definition of general superintelligence that they are putting forth here. That superintelligence is a turing machine that "knows everything" - e.g. it knows every possible program that can be run (e.g. including simulators for physical phenomena), and the state of the world, with infinite RAM for computation, etc.

nh43de

5년 전discuss

This is probably the best and most relevant argument. But still - aren't the companies still pulling the strings? If FB wanted to prioritize things that got people outside and interacting with their community (and off FB), could they? It seems like it's always the humans picking the ethical parameters, not the AI.

nh43de

5년 전discuss

From the paper:

"Interestingly, reduced versions of the decidability problem have produced a fruitful area of re-search: formal verification, whose objective is to produce techniques to verify the correctness of computer programs and ensure they satisfy desirable properties (Vardi & Wolper, 1986). However, these techniques are only available to highly restricted classes of programs and inputs, and have been used in safety-critical applications such as train scheduling. But the approach of considering restricted classes of programs and inputs cannot be useful to the containment of superintelligence. Superintelligent machines, those Bostrom is interested in, are written in Turing-complete programming languages, are equipped with powerful sensors, and have the state of the world as their input. This seems unavoidable if we are to program machines to help us with the hardest problems facing society, such as epidemics, poverty, and climate change. These problems forbid the limitations im-posed by available formal verification techniques, rendering those techniques unusable at this grand scale."

nh43de

5년 전discuss

The most depressing day of my life was the day I learned the proof of Godel's Incompleteness Theorem and the Insolubility of the Halting Problem. Attributing more than is deserved to the antics of classical computers is still wildly prevalent but oh so adolescent.

nh43de

5년 전discuss

Same here. When I first experienced HD VR, I knew it had the power to be extremely addictive. However, the plug and play experience isn't there. Yet. Still waiting for the killer app.

comments