Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-22 Thread Bill Hibbard
Hi Brad, > > Yes, its amazing what even simple animal brains can do with > > simple learning problems, when rewards quickly follow > > behaviors. The forebrain evolved to solve the hard learning > > problems, when there are long delays between behaviors and > > rewards, and multiple behaviors prec

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Brad Wyble
> > Yes, its amazing what even simple animal brains can do with > simple learning problems, when rewards quickly follow > behaviors. The forebrain evolved to solve the hard learning > problems, when there are long delays between behaviors and > rewards, and multiple behaviors precede rewards. To

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Bill Hibbard
On Fri, 21 Feb 2003, Brad Wyble wrote: > . . . > Interestingly, there are some primitive parts of our brain that are better at logic > and are more rational than our executive function. Animals (and humans) in a > classical conditioning paradigm are *excellent* at performing simple behaviors in

RE: Re: Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Ben Goertzel
Brad said, responding to Moshe: > > We have insufficient knowledge, so we need to make some assumptions to > > approximate P(Xi|Xj). I argue that under these circumstances, the best > > assumption to make is that Xi and Xj are independent, (ie, > P(Xi|Xj)=P(Xi)). > > Does this clarify things? > >

Re: Re: Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Brad Wyble
> > Brad wrote: > > I think this is a core principle of AGI design and that a system that > > only makes inferences it *knows* are correct would be fairly > > uninteresting and incapable of performing in the real world. The fact > > that the information in the P(xi|xj) list is very incomplete is

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Brad Wyble
> This is also an example of how weird the brain can be from an algorithmic > perspective. In designing an AI system, one tends to abstract cognitive > processes and create specific processes based on these abstractions. (And > this is true in NN type AI architectures, not just logicist ones.) B

RE: Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Ben Goertzel
> Brad wrote: > > I think this is a core principle of AGI design and that a system that > > only makes inferences it *knows* are correct would be fairly > > uninteresting and incapable of performing in the real world. The fact > > that the information in the P(xi|xj) list is very incomplete is w

Re: Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Moshe Looks
Brad wrote: > I think this is a core principle of AGI design and that a system that > only makes inferences it *knows* are correct would be fairly > uninteresting and incapable of performing in the real world. The fact > that the information in the P(xi|xj) list is very incomplete is what > makes

RE: Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Ben Goertzel
> > Hi Ben, > > > > Thanks for the brain teaser! As a sometimes believer in > Occam's Razor, I > > think it makes sense to assume that Xi and Xj are indepenent, > unless we know > > otherwise. This simplifies things, and is the "rational" thing > to do (for > > some definition of rational ;->).

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Ben Goertzel
> Lakoff and Nunez > (http://perso.unifr.ch/rafael.nunez/reviews.html) have a theory > that we compare lengths in our head to do arithmetic, when we're > not using school-learned rules. Our innate mathematical ability > is based on visuo-spatial comparisons in their view. > > This would basically

Re: Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Brad Wyble
> > Hi Ben, > > Thanks for the brain teaser! As a sometimes believer in Occam's Razor, I > think it makes sense to assume that Xi and Xj are indepenent, unless we know > otherwise. This simplifies things, and is the "rational" thing to do (for > some definition of rational ;->). So why not con

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Moshe Looks
Hi Ben, Thanks for the brain teaser! As a sometimes believer in Occam's Razor, I think it makes sense to assume that Xi and Xj are indepenent, unless we know otherwise. This simplifies things, and is the "rational" thing to do (for some definition of rational ;->). So why not construct a bayes

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Brad Wyble
> > 1) Humans use special-case algorithms to solve these problem, a different > algorithm for each domain > > 2) Humans have a generalized mental tool for solving these problems, but > this tool can only be invoked when complemented by some domain-specific > knowledge > > My intuitive inclinat

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Ben Goertzel
> > The problem at hand is, you're given some absolute and > > some conditional probabilities regarding the concepts > > at hand, and you want to infer a bunch of others. > > Hmm. The think I find interesting here is that humans don't have a good > solution to this problem. Give a typical human a

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Billy Brown
Ben Goertzel wrote: > Suppose you have a large set of people, say, all the people on Earth > > Then you have a bunch of categories you're interested in, say: ... > The problem at hand is, you're given some absolute and > some conditional probabilities regarding the concepts > at hand, and you wan

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Ben Goertzel
> I think I proposed about 6 or so basic variations on this > theme to test the reasoning system's ability with deal with > various level or noise and missing data... you can come up > with all sorts of interesting variations with a bit of thought. > > Yeah, just a fancy Venn diagram really used

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-21 Thread Philip Sutton
: "Ben Goertzel" <[EMAIL PROTECTED]> To: <[EMAIL PROTECTED]> Subject: RE: [agi] A probabilistic/algorithmic puzzle... Date sent: Thu, 20 Feb 2003 14:25:54 -0500 Send reply to: [EMAIL PROTECTED] OK... lif

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Shane Legg
Hi Cliff and others, As I came up with this kind of a test perhaps I should say a few things about its motivation... The problem was that the Webmind system had a number of proposed reasoning systems and it wasn't clear which was the best. Essentially the reasoning systems took as input a whole

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
> Isn't there some way, if a "full curve" is too computationally > exensive, some way of expressing, say, 2 sigmas (standard deviations) > or whatever? E.g. 74% will fall within 1 standard dev. of optimum X? We tried that, but generally, after a few inference iterations, the confidence intervals

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Cliff Stabbert
Thursday, February 20, 2003, 8:11:48 PM, Ben Goertzel wrote: CS> Somehow I see this ending up as finding a set a bell curves (i.e. CS> their height, spread and optimum) for each estimate. That is to say I CS> don't see *just* the probability as relevant but the probability CS> distribution...if I

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
Hi Cliff, > BG> One thing that complicates the problem is that ,in some > cases, as well as > BG> inferring probabilities one hasn't been given, one may want to make > BG> corrections to probabilities one HAS been given. For > instance, sometimes > BG> one may be given inconsistent information,

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
--- > From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On > Behalf Of Brad Wyble > Sent: Thursday, February 20, 2003 3:26 PM > To: [EMAIL PROTECTED] > Subject: Re: [agi] A probabilistic/algorithmic puzzle... > > > > > > But anyway, using the weighted-averaging rule dy

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Cliff Stabbert
Thursday, February 20, 2003, 2:25:54 PM, Ben Goertzel wrote: BG> The basic situation can be thought of as follows. Thanks, this does clarify things a lot. Your first statement of the problem did leave some things out though...but, perhaps unsurprisingly, I'm still a bit puzzled. I don't mean

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Brad Wyble
> > But anyway, using the weighted-averaging rule dynamically and iteratively > can lead to problems in some cases. Maybe the mechanism you suggest -- a > nonlinear average of some sort -- would have better behavior, I'll think > about it. The part of the idea that guaranteed an eventual equilib

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
> If P1 and P2 are contradictory, compare the truth values of the > assertions. If they are very similar, do nothing, because it's > impossible to know which is correct. If they vary > significantly(and at least one of them is above a certain > threshold), alter the probabilities towards one ano

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Brad Wyble
> > One thing that complicates the problem is that ,in some cases, as well as > inferring probabilities one hasn't been given, one may want to make > corrections to probabilities one HAS been given. For instance, sometimes > one may be given inconsistent information, and one has to choose which >

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
EMAIL PROTECTED]Subject: Re: [agi] A probabilistic/algorithmic puzzle... Isn't this problem made more complex when we consider that things belong to various categories.   For instance, if we know that -40% of americans are fat -americans are "people" -a person can b

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Kevin
PM Subject: RE: [agi] A probabilistic/algorithmic puzzle...   OK... life lesson #567: When a mathematical explanation confuses non-math people, another mathematical explanation is not likely to help   The basic situation can be thought of as follows.   Suppose you have

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
  OK... life lesson #567: When a mathematical explanation confuses non-math people, another mathematical explanation is not likely to help   The basic situation can be thought of as follows.   Suppose you have a large set of people, say, all the people on Earth   Then you have a bunch of ca

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
> BG> I don't know if this "test problem" will clarify things or > confuse them ;-) > > For me, it's confused them. I thought I was following it before, > sorta... OK, well I'm pressed for time today, so I'll write a nonmathematical version of the problem late tonight or tomorrow or over the wee

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Cliff Stabbert
Thursday, February 20, 2003, 10:58:57 AM, Ben Goertzel wrote: BG> OK... I can see that I formulated the problem too formally for a lot of BG> people BG> I will now rephrase it in the context of a specific "test problem." BG> I don't know if this "test problem" will clarify things or confuse t

RE: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Ben Goertzel
k parameters of Novamente's first-order inference module (which embodies one solution to the problem)...     -- Ben         -Original Message-From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED]]On Behalf Of Jonathan StandleySent: Thursday, February 20, 2003 4:25 AMTo: [EMAIL

Re[2]: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Cliff Stabbert
Thursday, February 20, 2003, 4:25:24 AM, Jonathan Standley wrote: JS> a challenge! cool :) but let me try to put it in less-math terms JS> for myself and others who are not math-types BG>Let X_i, i=1,...,n, denote a set of discrete random variables JS> X_i is the set of all integers between i

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Jonathan Standley
    >Let X_i, i=1,...,n, denote a set of discrete random variables   X_i is the set of all integers between i and n, initial value for i is 1? or is i any member of the set X? or does i function only as a lower bound to set X?   hi me again.  if forgot to ask: is i

Re: [agi] A probabilistic/algorithmic puzzle...

2003-02-20 Thread Jonathan Standley
a challenge! cool :)  but let me try to put it in less-math terms for myself and others who are not math-types   >Let X_i, i=1,...,n, denote a set of discrete random variables   X_i is the set of all integers between i and n, initial value for i is 1? or is i any member of the set X? or do

[agi] A probabilistic/algorithmic puzzle...

2003-02-19 Thread Ben Goertzel
Hi, This one is for the more mathematically/algorithmically inclined people on the list. I'm going to present a mathematical problem that's come up in the Novamente development process. We have two different solutions for it, each with strengths and weaknesses. I'm curious if, perhaps, someone