I noticed in a later read that you differentiate between systems
designed to operate via goal stacks and those operating via motivational
system. This is not the meaning of goal that I was using.
To me, if a motive is a theory to prove, then a goal is a lemma needed
to prove the theory. I trust that's a clear enough metaphor.
Motives are potentially unchanging in direction, though varying in
"intensity" as the state of the system changes. (Consider Maslow's
"hierarchy of needs": if you're hungry and suffocating, you ignore the
hunger.)
This has it's problems, which need to be considered. E.g.:
If an animal has a motive to eat, then the motive will be adjusted (by
evolution) to be sufficiently strong to keep the animal healthy, and
weak enough to be safe. Now change the situation, so that a plains ape
is living in cities with grocery stores, and lots of foods that have
been specially designed to be "supernaturally appealing". Call these
Burger King's. Then you can expect that animal to put on an unhealthy
amount of weight. It's motivational system no longer fits with it's
environment, and the motivational system is resistant to change.
When designing an AGI, we need to provide a motivational system with
both positive and negative adjustable weights. It may want to protect
human life, but if someone is living in an intolerable state, and
nothing can be done to ameliorate this, then it needs to be able to
allow that human life to be ended. (Say a virus that cannot be cured,
which cannot be thrown into remission, and which directly stimulates the
neural cortex to perceive the maximal amount of pain while
simultaneously killing off cerebellar neurons. If that's not
sufficiently bad, think of something worse.)
Goals are steps that are taken to satisfy some motive, which is
currently of sufficiently high priority. I don't see goals and motives
as alternatives. (This is probably a definitional matter, but I'm being
verbose to avoid confusion.)
-----
This list is sponsored by AGIRI: http://www.agiri.org/email
To unsubscribe or change your options, please go to:
http://v2.listbox.com/member/?member_id=4007604&id_secret=57920826-4f6da3
