Chetan, Yes there was an implementation of Temporal Pooling and the white paper describes it pretty well. I don't know why Fergal says there wasn't one. We spent a lot of time testing the temporal pooler in the context of a hierarchical vision system. We worked with it for many months. Ultimately most of the code was removed as we refactored.
As I said previously the CLA consists of three parts: 1) Spatial pooler 2) Sequence memory 3) Temporal pooler We got in the habit of using the term "temporal pooler" for both the sequence memory and temporal pooler. If you want I can go into the difference between the new and old temporal pooler, but I would prefer to just focus on the new one. The other thing I mentioned is that the functions of spatial pooling and temporal pooling are similar and we will probably combine them in any new implementation. Speaking of which, we (Grok) are committed to implementing both the new temporal pooler and the layer 4 idea this year. We will do this openly and hope others will contribute to the effort, but either way we are going to do it. Jeff From: nupic [mailto:[email protected]] On Behalf Of Chetan Surpur Sent: Monday, January 27, 2014 4:12 PM To: NuPIC general mailing list. Subject: Re: [nupic-discuss] New Temporal Pooler Proposal Hi Fergal, Thanks for your response. Regarding the first question: On Sat, Jan 25, 2014 at 1:12 AM, Fergal Byrne <[email protected]> wrote: There was no previous design for Temporal Pooling in the theory. There is a bit of the algorithm called Temporal Pooler (TP) which is misnamed, it should be called Sequence Recognition or Sequence Prediction (Jeff uses the term Sequence Memory so the choice of corrected name is unclear). If I recall the whitepaper correctly, there was indeed a previous design for Temporal Pooling in the theory. It involved neurons forming connections to previously-active neurons, stretching farther and farther back in time as long as there was a stable sequence to learn. I meant to ask specifically about that idea, compared to the new one Jeff introduced here. Thank you Fergal, for your time in writing up your thoughts. I would also love to hear Jeff's take on it as well. - Chetan
_______________________________________________ nupic mailing list [email protected] http://lists.numenta.org/mailman/listinfo/nupic_lists.numenta.org
