On 10/26/07, Stefan Pernar <[EMAIL PROTECTED]> wrote: > CEV is a concept that avoids answering the question of what friendliness is > by letting an advanced AI figure out what good might be. Doing so makes > endowing an AI implementation with friendliness not feasible. CEV is > circular.
You misunderstand. For CEV to be circular, it would be required that when extrapolating the wishes of humans, one would end up in a loop. I'm quite convinced that what I would want, for example, is not circular. And I find it rather improbable that many of you other humans would end up in a loop either. So CEV is not circular either, since it is about finding out / extrapolating what humans would want. > See the following core sentence for example: > > "...if we knew more, thought faster, were more the people we wished we were, > had grown up farther together; where the extrapolation converges rather than > diverges, where our wishes cohere rather than interfere; extrapolated as we > wish that extrapolated, interpreted as we wish that interpreted..." > > Simplified: "If we were better people we were better people." This "simplification" you wrote does not have much anything to do with that fragment of a sentence that you claim to be simplifying here. > not adding value as key concepts such as 'friendliness', 'good', > 'better' and 'benevolence' remain undefined. Friendliness is defined in the CEV model, by stating that the CEV dynamic will be the initial content for it (whereas these other words you mention are not independent key concepts in the CEV model). That initial dynamic will then extrapolate / find out what humans would want, thereby converging on a stable definition of Friendliness. What humans think is 'good' is what the CEV dynamic would find out. We don't have to define it when we set the dynamic in motion. -- Aleksei Riikonen - http://www.iki.fi/aleksei ----- This list is sponsored by AGIRI: http://www.agiri.org/email To unsubscribe or change your options, please go to: http://v2.listbox.com/member/?member_id=4007604&id_secret=57760859-6f86c5
