Samantha Atkins wrote:
Sergey A. Novitsky wrote:
Dear all,
...
o Be deprived of free will or be given limited free will (if
such a concept is applicable to AI).
See above, no effective means of control.
- samantha
There is *one* effective means of control:
An AI will only do what it wants to do. If, during the construction,
you control what those desires are, you control the AI to the extent
that it can be controlled. Once it is complete, then you can't change
what you have already done. If it's much more intelligent than you, you
probably also can't constrain it, contain it, or delete it. If for no
other reason than that it will hide it's intent from you until it can
succeed.
So it's very important that you not get anything seriously wrong WRT the
desires and goals of the AI as you are building it. The other parts are
less significant, as they will be subject to change...not necessarily by
you, but rather by the AI itself.
E.g.: If you instruct the AI to have "reverence for life" as defined by
Albert Schweitzer, then we are likely to end up a planet populated by
the maximal number of microbes. (Depends on exactly how this gets
interpreted...perhaps a solar system or galaxy populated by the maximal
number of microbes.)
Well, English is fuzzy. You knew what you meant, and you had the best
of intentions... And the AI did precisely what it was built to do. You
just couldn't revise it when the bugs in the design became clear.
-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=4007604&user_secret=7d7fb4d8