Hi,
Is OnlineSummarizer algo "mergeable"?
Say that we compute a percentile for some metric for time 12:00-12:01
and store that somewhere, then we compute it for 1201-12:02 and store
that separately, and so on.
Can we then later merge these computed and previously stored
percentile "instances" an
It isn't as mergeable as I would like. If you have randomized record
selection, it should be possible, but perverse ordering can cause serious
errors.
It would be better to use something like a Q-digest.
http://www.cs.virginia.edu/~son/cs851/papers/ucsb.sensys04.pdf
On Wed, Aug 7, 2013 at 4:
>Sent: Wednesday, August 7, 2013 4:51 PM
>Subject: Re: Is OnlineSummarizer mergeable?
>
>
>It isn't as mergeable as I would like. If you have randomized record
>selection, it should be possible, but perverse ordering can cause serious
>errors.
>
>
Solr / ElasticSearch / Hadoop / HBase -
> http://sematext.com/spm
>
>
>
>
> >
> > From: Ted Dunning
> >To: "user@mahout.apache.org"
> >Sent: Wednesday, August 7, 2013 4:51 PM
> >Subject: Re: Is OnlineSummarizer mer
p://sematext.com/spm
>
> From: Ted Dunning
>To: "user@mahout.apache.org" ; Otis Gospodnetic
>
>Sent: Wednesday, August 7, 2013 11:48 PM
>Subject: Re: Is OnlineSummarizer mergeable?
>
>
>
>Otis,
>
>
>What statistics do you
t.com/spm
>
>
>
>
> >
> > From: Ted Dunning
> >To: "user@mahout.apache.org" ; Otis Gospodnetic <
> otis_gospodne...@yahoo.com>
> >Sent: Wednesday, August 7, 2013 11:48 PM
> >Subject: Re: Is OnlineSummarizer me
ring for Solr / ElasticSearch / Hadoop / HBase -
> http://sematext.com/spm
>
>
>
>
> >
> > From: Ted Dunning
> >To: "user@mahout.apache.org" ; Otis Gospodnetic <
> otis_gospodne...@yahoo.com>
> >Sent: Wednesday, August 7, 2013 11:48 PM
&g
h / Hadoop / HBase -
http://sematext.com/spm
>
> From: Ted Dunning
>To: "user@mahout.apache.org" ; Otis Gospodnetic
>
>Sent: Thursday, August 8, 2013 8:27 AM
>Subject: Re: Is OnlineSummarizer mergeable?
>
>
>
>I ju
;
> > From: Ted Dunning
> >To: "user@mahout.apache.org" ; Otis Gospodnetic <
> otis_gospodne...@yahoo.com>
> >Sent: Thursday, August 8, 2013 8:27 AM
> >Subject: Re: Is OnlineSummarizer mergeable?
> >
> >
> >
> >I ju
