I've got a question regarding patterns and noise. I've experimented a bit
with HTM now, and I can get it to learn a wide variety of varying patterns
such as for example: 1, 2, 3, 1, 2, 3, 1,... or 5, 6, 5, 6, 5, 6, ... but
patterns such as 5, 5, 6, 5, 5, 6, ... or 5, 5, 5, 5, 5, 5, 5, 5, 5, 6, 5,
5, 5, 5, 5, 5, 5, 5, 5, 6, ... are things that HTM struggles with, which is
understandable considering HTM is really good at creating "links" between
values with respect to time and context. But the previously mentioned
example makes it really hard to create "links" between self-repeating
values, even though HTM can manage to differ between contexts. So what
exactly is the "line" between a pattern and noise? I fed HTM 20000 values
of 10 fives followed by one 6 (5, 5, 5, 5, 5, 5, 5, 5, 5, 5, 6, 5, ...) and
it still didn't manage to learn that pattern. Any ideas?
