The AI safety problem isn't about uncontrolled self improving AI. It's AI
controlled by a few billionaires. You think you are controlling it as you
doom scroll through endless AI generated videos on social media, like a dog
that thinks it is controlling you when you train it with treats. AI is
driving humanity to extinction by giving you everything you think you want.
Do you really want a world where you have no contact with other humans,
where nobody knows or cares whether you live or die in your smart home with
your AI friends and robot lovers? At least until your wealth is extracted
and you no longer have any value.

My proposed distributed AGI design in 2008 was designed to avoid the
problem of concentrating power in the hands of a few individuals with vast
computing resources.
http://mattmahoney.net/agi2.html

But I should have anticipated the end of Moore's law for transistor based
computing. Clock speeds topped out at 2-3 GHz in 2010, and now transistor
sizes have reached their physical limits. 8 billion human brain sized
neural networks running on GPUs needs about 800 TW of electricity, while
global production is only 18 TW.

It's not hopeless. We can get 800 TW by covering 4% of the Earth with solar
panels at 25% efficiency. We can optimize the hardware for sparse, low
precision matrix operations. We can use nanotechnology to compute by moving
atoms instead of electrons, which is how your brain uses 20 watts instead
of 1 MW.

Or discover better algorithms. When Turing proposed the imitation game in
1950, he predicted it would be passed in 50 years on a computer with 10^9
binary digits of memory (now known as bits) and components no faster than
current technology (vacuum tubes and relays). It makes sense. We train on
about 10^9 bits of language over decades using neurons with response times
in tens of milliseconds.

Think you could do it?

-- Matt Mahoney, [email protected]

------------------------------------------
Artificial General Intelligence List: AGI
Permalink: 
https://agi.topicbox.com/groups/agi/T7ff992c51cca9e36-M381aa0b1cea095a1c977629e
Delivery options: https://agi.topicbox.com/groups/agi/subscription

Reply via email to