Re: How to implement custom aggregations or algorithms
Thank you so much! On Saturday, January 3, 2015 1:23:44 AM UTC+5:30, Adrien Grand wrote: > > There is a way, but it is not documented as the aggregations internal API > is not stable (and we kind-of like having this ability to break it whenever > we want...) so it's very likely that upgrading your code to a new release > would require important refactorings. Basically you need to write a plugin > that will call AggregationModule.addAggregatorParser with a parser for your > own aggregation. You can get inspiration from an existing aggregation such > as the stats aggregation (in org.elasticsearch.search.aggregations.stats) > to get started. > > That said if you think that you need is common, a better option might be > to open an issue so that we implement it and expose it in Elasticsearch, > this way you would not have to maintain it yourself. > > On Thu, Jan 1, 2015 at 10:39 AM, cto@TCS > wrote: > >> Hi, >> >> I have been using ElasticSearch for the past 2 months and have tried >> various aggregations and filtering options on my data and is very happy >> with the performance. >> But, recently there is a requirement to implement some algorithms on my >> data set while retrieving data from ElasticSearch. This requirement is not >> solved by existing aggregations or filters. >> >> So, is there a way of implementing any algorithm or custom aggregations >> on the data present in ElasticSearch ??? >> >> Thanks >> cto@TCS >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearc...@googlegroups.com . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/f4a1b1c5-cad8-4ab4-a4c9-844508d6f96b%40googlegroups.com >> >> <https://groups.google.com/d/msgid/elasticsearch/f4a1b1c5-cad8-4ab4-a4c9-844508d6f96b%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> For more options, visit https://groups.google.com/d/optout. >> > > > > -- > Adrien Grand > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/be63da4f-99bd-46e3-924e-69adf6f16682%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: How to implement custom aggregations or algorithms
There is a way, but it is not documented as the aggregations internal API is not stable (and we kind-of like having this ability to break it whenever we want...) so it's very likely that upgrading your code to a new release would require important refactorings. Basically you need to write a plugin that will call AggregationModule.addAggregatorParser with a parser for your own aggregation. You can get inspiration from an existing aggregation such as the stats aggregation (in org.elasticsearch.search.aggregations.stats) to get started. That said if you think that you need is common, a better option might be to open an issue so that we implement it and expose it in Elasticsearch, this way you would not have to maintain it yourself. On Thu, Jan 1, 2015 at 10:39 AM, cto@TCS wrote: > Hi, > > I have been using ElasticSearch for the past 2 months and have tried > various aggregations and filtering options on my data and is very happy > with the performance. > But, recently there is a requirement to implement some algorithms on my > data set while retrieving data from ElasticSearch. This requirement is not > solved by existing aggregations or filters. > > So, is there a way of implementing any algorithm or custom aggregations on > the data present in ElasticSearch ??? > > Thanks > cto@TCS > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/f4a1b1c5-cad8-4ab4-a4c9-844508d6f96b%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/f4a1b1c5-cad8-4ab4-a4c9-844508d6f96b%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- Adrien Grand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j4AS9SCkU4apC-e5Q%2BqjVN3Nws33qjNzL9A9jmBXxE-jw%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
How to implement custom aggregations or algorithms
Hi, I have been using ElasticSearch for the past 2 months and have tried various aggregations and filtering options on my data and is very happy with the performance. But, recently there is a requirement to implement some algorithms on my data set while retrieving data from ElasticSearch. This requirement is not solved by existing aggregations or filters. So, is there a way of implementing any algorithm or custom aggregations on the data present in ElasticSearch ??? Thanks cto@TCS -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/f4a1b1c5-cad8-4ab4-a4c9-844508d6f96b%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Custom Aggregations
Hi Jin, It is possible to write a custom aggregation, you can for example look at this plugin: https://github.com/algolia/elasticsearch-cardinality-plugin that implements a aggregation as a plugin. If that would work for you, another option would be to contribute this aggregation to Elaticsearch so that it would be available out of the box (feel free to open an issue on Github and ping me (@jpountz), I'd be happy to help). On Sat, Aug 9, 2014 at 8:19 PM, Jin Huang wrote: > Hi Alex, > > Is there an updates on this topic? I want to know how easy or how complex > is it to write a custom aggregator. For example, I want to calculate all > the n-th central moments, with n=2,3,4,..10. By the way, Elasticsearch > already provides the 2nd central moment, i.e. square of the standard > deviation. > > In general, I would like to know what kind of custom aggregator is easy to > write? > > Thanks, > Jin > > > On Wednesday, February 12, 2014 5:49:28 AM UTC-8, Alexander Reelsen wrote: > >> Hey, >> >> sure, you can write a custom plugin, which implements your custom >> aggregations, if you want to. >> Any specific functionality you are missing (might be interesting to get >> it in the core anyway?). >> >> >> --Alex >> >> >> On Tue, Feb 11, 2014 at 9:41 PM, Justin Uang wrote: >> >>> Is there any way we can define our own aggregation functions beyond the >>> provided metric and bucket aggregations? >>> >>> Thanks! >>> >>> Justin >>> >>> -- >>> You received this message because you are subscribed to the Google >>> Groups "elasticsearch" group. >>> To unsubscribe from this group and stop receiving emails from it, send >>> an email to elasticsearc...@googlegroups.com. >>> >>> To view this discussion on the web visit https://groups.google.com/d/ >>> msgid/elasticsearch/90accf78-6540-4126-8268-7f997353ad74% >>> 40googlegroups.com. >>> For more options, visit https://groups.google.com/groups/opt_out. >>> >> >> -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/b2b8894d-c26d-4787-af4c-c45f793befc6%40googlegroups.com > <https://groups.google.com/d/msgid/elasticsearch/b2b8894d-c26d-4787-af4c-c45f793befc6%40googlegroups.com?utm_medium=email&utm_source=footer> > . > For more options, visit https://groups.google.com/d/optout. > -- Adrien Grand -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j5pEbWQKAptt10jtwOwuLRXJ5SzLmDY2yn5f_4eqeaY1Q%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: Custom Aggregations
Hi Alex, Is there an updates on this topic? I want to know how easy or how complex is it to write a custom aggregator. For example, I want to calculate all the n-th central moments, with n=2,3,4,..10. By the way, Elasticsearch already provides the 2nd central moment, i.e. square of the standard deviation. In general, I would like to know what kind of custom aggregator is easy to write? Thanks, Jin On Wednesday, February 12, 2014 5:49:28 AM UTC-8, Alexander Reelsen wrote: > > Hey, > > sure, you can write a custom plugin, which implements your custom > aggregations, if you want to. > Any specific functionality you are missing (might be interesting to get it > in the core anyway?). > > > --Alex > > > On Tue, Feb 11, 2014 at 9:41 PM, Justin Uang > wrote: > >> Is there any way we can define our own aggregation functions beyond the >> provided metric and bucket aggregations? >> >> Thanks! >> >> Justin >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearc...@googlegroups.com . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/90accf78-6540-4126-8268-7f997353ad74%40googlegroups.com >> . >> For more options, visit https://groups.google.com/groups/opt_out. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b2b8894d-c26d-4787-af4c-c45f793befc6%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
Re: Custom Aggregations
Hi, I'm trying to create a new aggregator plugin. I was able to understand the structure needed to create and register my new aggregator but I don't know who to get the document field values inside collect method. How can I do that? Em quarta-feira, 12 de fevereiro de 2014 11h49min28s UTC-2, Alexander Reelsen escreveu: > > Hey, > > sure, you can write a custom plugin, which implements your custom > aggregations, if you want to. > Any specific functionality you are missing (might be interesting to get it > in the core anyway?). > > > --Alex > > > On Tue, Feb 11, 2014 at 9:41 PM, Justin Uang > > wrote: > >> Is there any way we can define our own aggregation functions beyond the >> provided metric and bucket aggregations? >> >> Thanks! >> >> Justin >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearc...@googlegroups.com . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/90accf78-6540-4126-8268-7f997353ad74%40googlegroups.com >> . >> For more options, visit https://groups.google.com/groups/opt_out. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/15e052d8-41d6-48f8-9f29-5482bc4bf8f0%40googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Custom Aggregations
I'm just interested in the flexibility of this platform. How would I implement the custom aggregation? On Wednesday, February 12, 2014 8:49:28 AM UTC-5, Alexander Reelsen wrote: > > Hey, > > sure, you can write a custom plugin, which implements your custom > aggregations, if you want to. > Any specific functionality you are missing (might be interesting to get it > in the core anyway?). > > > --Alex > > > On Tue, Feb 11, 2014 at 9:41 PM, Justin Uang > > wrote: > >> Is there any way we can define our own aggregation functions beyond the >> provided metric and bucket aggregations? >> >> Thanks! >> >> Justin >> >> -- >> You received this message because you are subscribed to the Google Groups >> "elasticsearch" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to elasticsearc...@googlegroups.com . >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/90accf78-6540-4126-8268-7f997353ad74%40googlegroups.com >> . >> For more options, visit https://groups.google.com/groups/opt_out. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/02905d0a-a7a3-465b-9475-e9dedcefd658%40googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: Custom Aggregations
Hey, sure, you can write a custom plugin, which implements your custom aggregations, if you want to. Any specific functionality you are missing (might be interesting to get it in the core anyway?). --Alex On Tue, Feb 11, 2014 at 9:41 PM, Justin Uang wrote: > Is there any way we can define our own aggregation functions beyond the > provided metric and bucket aggregations? > > Thanks! > > Justin > > -- > You received this message because you are subscribed to the Google Groups > "elasticsearch" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to elasticsearch+unsubscr...@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/elasticsearch/90accf78-6540-4126-8268-7f997353ad74%40googlegroups.com > . > For more options, visit https://groups.google.com/groups/opt_out. > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/CAGCwEM9_%3DqiV2dBUnMoj4rYkCdbbBCbt6%2Bd5K1w_xh1dBzagSQ%40mail.gmail.com. For more options, visit https://groups.google.com/groups/opt_out.
Custom Aggregations
Is there any way we can define our own aggregation functions beyond the provided metric and bucket aggregations? Thanks! Justin -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/90accf78-6540-4126-8268-7f997353ad74%40googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
