HackerTrans
TopNewTrendsCommentsPastAskShowJobs

lxnn

no profile record

Submissions

Why Clip Art Was Everywhere Until It Wasn't [video]

youtube.com
2 points·by lxnn·3 years ago·0 comments

comments

lxnn
·last year·discuss
Note that we only got to observe outcomes in which we didn't die from nuclear annihilation. https://en.wikipedia.org/wiki/Anthropic_principle
lxnn
·3 years ago·discuss
I hope they are out-competed by a better alternative.
lxnn
·3 years ago·discuss
[flagged]
lxnn
·3 years ago·discuss
Technically, I think it's not that instrumental goals tend to converge, but rather that there are instrumental goals which are common to many terminal goals, which are the so-called "convergent instrumental goals".

Some of these goals are ones which we really would rather a misaligned super-intelligent agent not to have. For example:

- self-improvement;

- acquisition of resources;

- acquisition of power;

- avoiding being switched off;

- avoiding having one's terminal goals changed.
lxnn
·3 years ago·discuss
You can't take an empirical approach to existential risk as you don't get the opportunity to learn from your mistakes. You have to prospectively reason about it and plan for it.
lxnn
·3 years ago·discuss
As the pre-amble to the statement says: they kept the statement limited and succinct as there may be disagreement between the signatories about the exact nature of the risk and what to do about it.
lxnn
·3 years ago·discuss
The emergence of something significantly more intelligent than us whose goal are not perfectly aligned with ours poses a pretty clear existential risk. See, for example, the thousands of species made extinct by humans.
lxnn
·3 years ago·discuss
The problem is that's unilateralism.
lxnn
·3 years ago·discuss
Why are you so confident in calling existential AI risk fantasy?