Pain should be a constantly repeated message that takes up some percentage of the AGI's attention span depending upon the severity of the pain.
The AGI's response to the pain should be to add goals with a high priority which are designed to alleviate the original cause of the pain either by modifying it's behavior or asking it's human operatives to diagnose the pain. Human operative should have a pain inducer and a pain override code that they can enter as well as pleasure inducer and pleasure override as a way of entering negative and positive feedback to monitored thought processes. The higher the pain level the more of the attention span is taken by the repeated pain messages. Positive feedback in the form of pleasure should be the preferred feedback mechanism whenever possible. But an AGI that knows pain and can experience empathy when humans are suffering will be perceived as more human and compassionate. I am not certain that survival needs to be an explicit goal at least until the AGI has demonstrated a long term track record of ethical and altruistic behavior. We don't want the AGI to spend a large amount of it's waking time worrying about ways that it can insure it's survival before it has demonstrated that it is indeed trustworthy. These sections of code should probably remain unmodifiable by the AGI until such time as the world is convinced of it's long term good intentions. Gary -------------- Original message -------------- From: "John G. Rose" <[EMAIL PROTECTED]> Is an AGI really going to feel pain or is it just going to be some numbers? I guess that doesn¡¯t have a simple answer. The pain has to be engineered well for it to REALLY understand it. AGI behavior related to its survival, its pain is non-existence; does it care to be non-existent? Survival must be a goal. And if survival is a goal it always must be subservient to humans ¨C like that is really gonna happen J John This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?& ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?member_id=8660244&id_secret=74198654-a4b2a4