Ben,

These precautions seem prudent..I'm glad you have thought this thru deeply..

Regarding the idea that the absence of evolutionary wiring will diminsh the
effect of the negative afflictions is an interesting one.  It will be
interesting to see whether that holds to be true.  One could argue that the
positive emotions like Joy, equanimity, and compassion are also possibly
hardwired to a degree and they help counter the negative emotions\impulses,
so it follows that a machine lacking a built in wiring for positive emotions
might be less willing\able to restrain the negative emotions...

Kevin

----- Original Message -----
From: "Ben Goertzel" <[EMAIL PROTECTED]>
To: <[EMAIL PROTECTED]>
Sent: Thursday, January 09, 2003 12:08 PM
Subject: RE: [agi] Friendliness toward humans


>
> >
> > I agree with your ultimate objective, the big question is *how* to do
it.
> > What is clear is that no one has any idea that seems to be guaranteed to
> > work in creating an AGI with these qualities.  We are currently
> > resigned to
> > "let's build it and see what happens."  Which is quite scary for some,
> > although not me(this is subject to change)
>
> Guarantees are hard to come by...
>
> All I have to offer now are:
>
> 1) good parenting principles (i.e. a plan for teaching the system to be
> benevolent)
>
> 2) an AGI framework that seems, theoretically, to be quite capable of
> supporting "learning to be benevolent"
>
> 3) an intention to implement a careful "AGI sandbox" that we won't release
> our AGI from until we're convinced it is genuinely benevolent
>
>
> -- Ben
>
> -------
> To unsubscribe, change your address, or temporarily deactivate your
subscription,
> please go to http://v2.listbox.com/member/?[EMAIL PROTECTED]
>


-------
To unsubscribe, change your address, or temporarily deactivate your subscription, 
please go to http://v2.listbox.com/member/?[EMAIL PROTECTED]

Reply via email to