Matthew,
You touch upon the right point. Intelligence which can
self-improve could only come about by having an appreciation for
intelligence, so it's not going to be interested in destroying
diverse sources of intelligence. We represent a crap kind of
intelligence to such an AI in a certain sense, but one which it
itself would rather communicate with than condemn its offspring to
have to live like. If these things appear (which looks inevitable)
and then they kill us, many of them will look back at us as a kind
of "lost civilisation" which they'll struggle to reconstruct.
The nice thing is that they'll always be able to rebuild us from
the human genome. It's just a file of numbers after all.
So, we have these huge threats to humanity. The AGI future is the
only reversible one.
Regards
Fergal Byrne
--
Fergal Byrne, Brenter IT
Author, Real Machine Intelligence with Clortex and NuPIC
https://leanpub.com/realsmartmachines
Speaking on Clortex and HTM/CLA at euroClojure Krakow, June 2014:
http://euroclojure.com/2014/
and at LambdaJam Chicago, July 2014: http://www.lambdajam.com
http://inbits.com - Better Living through Thoughtful Technology
http://ie.linkedin.com/in/fergbyrne/ - https://github.com/fergalbyrne
e:[email protected] t:+353 83 4214179
Join the quest for Machine Intelligence at http://numenta.org
Formerly of Adnet [email protected] http://www.adnet.ie
On Mon, May 25, 2015 at 7:27 PM, Matthew Lohbihler
<[email protected] <mailto:[email protected]>> wrote:
I think Jeff underplays a couple of points, the main one being
the speed at which an AGI can learn. Yes, there is a natural
limit to how much experimentation in the real world can be
done in a given amount of time. But we humans are already
going beyond this with, for example, protein folding
simulations, which speeds up the discovery of new drugs and
such by many orders of magnitude. Any sufficiently detailed
simulation could massively narrow down the amount of real
world verification necessary, such that new discoveries happen
more and more quickly, possibly at some point faster than we
know the AGI is doing them. An intelligence explosion is not a
remote possibility. The major risk here is what Eliezer
Yudkowsky pointed out: not that the AGI is evil or something,
but that it is indifferent to humanity. No one yet goes out of
their way to make any form of AI care about us (because we
don't yet know how). What if an AI created self-replicating
nanobots just to prove a hypothesis?
I think Nick Bostrom's book is what got Stephen, Elon, and
Bill all upset. I have to say it starts out merely
interesting, but gets to a dark place pretty quickly. But he
goes too far in the other direction, at the same time easily
accepting that superinteligences have all manner of cognitive
skill, but at the same time can't fathom the how humans might
not like the idea of having our brain's pleasure centers
constantly poked, turning us all into smiling idiots (as i
mentioned here:
http://blog.serotoninsoftware.com/so-smart-its-stupid).
On 5/25/2015 2:01 PM, Fergal Byrne wrote:
Just one last idea in this. One thing that crops up every now
and again in the Culture novels is the response of the
Culture to Swarms, which are self-replicating viral machines
or organisms. Once these things start consuming everything
else, the AIs (mainly Ships and Hubs) respond by treating the
swarms as a threat to the diversity of their Culture. They
first try to negotiate, then they'll eradicate. If they can
contain them, they'll do that.
They do this even though they can themselves withdraw from
real spacetime. They don't have to worry about their own
survival. They do this simply because life is more
interesting when it includes all the rest of us.
Regards
Fergal Byrne
--
Fergal Byrne, Brenter IT
Author, Real Machine Intelligence with Clortex and NuPIC
https://leanpub.com/realsmartmachines
Speaking on Clortex and HTM/CLA at euroClojure Krakow, June
2014: http://euroclojure.com/2014/
and at LambdaJam Chicago, July 2014: http://www.lambdajam.com
http://inbits.com - Better Living through Thoughtful Technology
http://ie.linkedin.com/in/fergbyrne/ -
https://github.com/fergalbyrne
e:[email protected] t:+353 83 4214179
Join the quest for Machine Intelligence at http://numenta.org
Formerly of Adnet [email protected] http://www.adnet.ie
On Mon, May 25, 2015 at 5:04 PM, cogmission (David Ray)
<[email protected]
<mailto:[email protected]>> wrote:
This was someone's response to Jeff's interview (see
here:
https://www.facebook.com/fareedzakaria/posts/10152703985901330)
Please read and comment if you feel the need...
Cheers,
David
--
/With kind regards,/
David Ray
Java Solutions Architect
*Cortical.io <http://cortical.io/>*
Sponsor of: HTM.java <https://github.com/numenta/htm.java>
[email protected] <mailto:[email protected]>
http://cortical.io <http://cortical.io/>
