HackerTrans
TopNewTrendsCommentsPastAskShowJobs

lxnn

no profile record

Submissions

Why Clip Art Was Everywhere Until It Wasn't [video]

youtube.com
2 points·by lxnn·3 năm trước·0 comments

comments

lxnn
·năm ngoái·discuss
Note that we only got to observe outcomes in which we didn't die from nuclear annihilation. https://en.wikipedia.org/wiki/Anthropic_principle
lxnn
·3 năm trước·discuss
I hope they are out-competed by a better alternative.
lxnn
·3 năm trước·discuss
[flagged]
lxnn
·3 năm trước·discuss
Technically, I think it's not that instrumental goals tend to converge, but rather that there are instrumental goals which are common to many terminal goals, which are the so-called "convergent instrumental goals".

Some of these goals are ones which we really would rather a misaligned super-intelligent agent not to have. For example:

- self-improvement;

- acquisition of resources;

- acquisition of power;

- avoiding being switched off;

- avoiding having one's terminal goals changed.
lxnn
·3 năm trước·discuss
You can't take an empirical approach to existential risk as you don't get the opportunity to learn from your mistakes. You have to prospectively reason about it and plan for it.
lxnn
·3 năm trước·discuss
As the pre-amble to the statement says: they kept the statement limited and succinct as there may be disagreement between the signatories about the exact nature of the risk and what to do about it.
lxnn
·3 năm trước·discuss
The emergence of something significantly more intelligent than us whose goal are not perfectly aligned with ours poses a pretty clear existential risk. See, for example, the thousands of species made extinct by humans.
lxnn
·3 năm trước·discuss
The problem is that's unilateralism.
lxnn
·3 năm trước·discuss
Why are you so confident in calling existential AI risk fantasy?