--- Dennis Gorelik <[EMAIL PROTECTED]> wrote:

> Matt,
> 
> You are right that AGI may seriously weaken human civilization just by
> giving humans what they want. Lots of individuals can succumb to some
> form of pleasure machine.
> 
> On the other hand -- why would you worry about human civilization or
> any civilization at all if you personally get what you want?

That is exactly the problem.  I wouldn't worry about reducing my own fitness.
 
> However I don't think that civilization would be totally destroyed.
> Natural selection would keep working.
> Whoever succumb to pleasure machines (or any other dangers) will
> simply lose the competition, but other would survive and adapt to new
> technologies.

True, but it would not be anything like civilization as we know it.  I wrote
my thoughts on this. http://www.mattmahoney.net/singularity.html


> 
> 
> Thursday, November 1, 2007, 8:33:16 AM, you wrote:
> 
> > Your goals are selected by evolution.  There is a good reason why you fear
> > death and then die.  You want what is good for the species.  We could
> > circumvent our goals through technology, for example, uploading our brains
> > into computers and reprogramming them.  When a rat can stimulate its
> nucleus
> > accumbens by pressing a lever, it will forgo food, water, and sleep until
> it
> > dies.  We worry about AGI destroying the world by launching 10,000 nuclear
> > bombs.  We should be more worried that it will give us what we want.
> 


-- Matt Mahoney, [EMAIL PROTECTED]

-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=8660244&id_secret=66277887-f56a94

Reply via email to