On 03/07/2008 05:28 AM, Mark Waser wrote:
*/Attractor Theory of Friendliness/*
There exists a describable, reachable, stable attractor in state space
that is sufficiently Friendly to reduce the risks of AGI to acceptable
levels
I've just carefully reread Eliezer's CEV
<http://www.singinst.org/upload/CEV.html>, and I believe your basic idea
is realizable in Eliezer's envisioned system.
For example, if including all Friendly beings in the CEV seems
preferable to our extrapolated smarter, better ... selves, then a system
implementing Eliezer's approach (if working as intended) would certainly
renormalize and take into account the CEV of non-humans. And if our
smarter, better ... selves do not think it preferable, I'd be inclined
to trust their judgment, assuming that the previous tests and
confirmations that are envisioned had occurred.
The CEV of humanity is only the initial dynamic, and is *intended* to be
replaced with something better.
joseph
-------------------------------------------
agi
Archives: http://www.listbox.com/member/archive/303/=now
RSS Feed: http://www.listbox.com/member/archive/rss/303/
Modify Your Subscription:
http://www.listbox.com/member/?member_id=8660244&id_secret=95818715-a78a9b
Powered by Listbox: http://www.listbox.com
