Pain should be a constantly repeated message that takes up some percentage of 
the AGI's attention span depending upon the severity of the pain.

The AGI's response to the pain should be to add goals with a high priority 
which are designed to alleviate the original cause of the pain either by 
modifying it's behavior or asking it's human operatives to diagnose the pain.

Human operative should have a pain inducer and a pain override code that they 
can enter as well as pleasure inducer and pleasure override as a way of 
entering negative and positive feedback to monitored thought processes.

The higher the pain level the more of the attention span is taken by the 
repeated pain messages.

Positive feedback in the form of pleasure should be the preferred feedback 
mechanism whenever possible.

But an AGI that knows pain and can experience empathy when humans are suffering 
will be perceived as more human and compassionate.

I am not certain that survival needs to be an explicit goal at least until the 
AGI has demonstrated a long term track record of ethical and altruistic 
behavior.

We don't want the AGI to spend a large amount of it's waking time worrying 
about ways that it can insure it's survival before it has demonstrated that it 
is indeed trustworthy.

These sections of code should probably remain unmodifiable by the AGI until 
such time as the world is convinced of it's long term good intentions.

Gary
-------------- Original message -------------- 
From: "John G. Rose" <[EMAIL PROTECTED]> 

 
Is an AGI really going to feel pain or is it just going to be some numbers? I 
guess that doesn¡¯t have a simple answer. The pain has to be engineered well 
for it to REALLY understand it. 
 
AGI behavior related to its survival, its pain is non-existence; does it care 
to be non-existent? Survival must be a goal. And if survival is a goal it 
always must be subservient to humans ¨C like that is really gonna happen J
 
John
 


This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?&; 

-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=8660244&id_secret=74198654-a4b2a4

Reply via email to