--- Matt Mahoney <[EMAIL PROTECTED]> wrote:
> ----- Original Message ---- > From: Stephen Reed <[EMAIL PROTECTED]> > To: Matt Mahoney <[EMAIL PROTECTED]> > Sent: Monday, September 11, 2006 5:10:40 PM > Subject: Re: [singularity] Is Friendly AI Bunk? > > --- Matt Mahoney <[EMAIL PROTECTED]> wrote: > > This discussion on how to guarantee that AI be > > friendly seems to presume that a super AI and > human > > brains will be separate entities. I believe this > > will not be the case, and the issue will be moot. > > Your conclusion seems to be justified by the > assumptions that either a human/AI hybrid will be > friendly, or that an uploaded human mind will > necessarily make the AI friendly. I would like to > see > a more persuasive argument if they are in fact your > assumptions. > > ------------ > > I am assuming two technologies not yet developed, AI > and uploading. If both happen and all human minds > are merged into a single huge AI, then there will be > nothing for it to be unfriendly to. Leaving aside the debate as to whether all human minds are uploaded with or without coercion, then I wonder about whether unmodified uploaded human minds would be able to affect the behavior of the containing AI. If not then the humans are in a virtual zoo. But if so then there is the possibility of war among the uploaded human minds - death to the crusaders and such. How do imagine a safe upload of all humanity would unfold? -Steve __________________________________________________ Do You Yahoo!? Tired of spam? Yahoo! Mail has the best spam protection around http://mail.yahoo.com ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/[EMAIL PROTECTED]
