Re: Help with the percentiles aggregation

2014-08-18 Thread John Ogden
That's spot on. Thanks!
On 18 Aug 2014 09:08, Adrien Grand adrien.gr...@elasticsearch.com wrote:

 Hi John,

 You should be able to do something like:

 {
   aggs: {
 verb: {
   terms: {
 field: verb
   },
   aggs: {
 load_time_outliers: {
   percentiles: {
 field: responsetime
   }
 }
   }
 }
   }
 }

 This will first break down your documents according to the http verb that
 is being used and then compute percentiles separately for each unique verb.



 On Fri, Aug 15, 2014 at 11:23 AM, John Ogden johnog65...@gmail.com
 wrote:

 Hi,

 Am trying to run a single command which calculates percentiles for
 multiple search queries.
 The data for this is an Apache log file, and I want to get the percentile
 response times for the gets, posts, heads (etc) in one go

 If I run this:
 curl -XPOST 'http://localhost:9200/_search?search_type=countpretty=true'
 -d '{
 facets: {
 0: {query : {term : { verb : get  }}},
 1: {query : {term : { verb : post }}}
 },
 aggs : {load_time_outlier : {percentiles : {field :
 responsetime}}}
 }'

 The response I get back has the counts for each subquery but only does
 the aggregations for the overall dataset
   facets : {
 0 : {
   _type : query,
   count : 5678
 },
 1 : {
   _type : query,
   count : 1234
 }
   },
   aggregations : {
 load_time_outlier : {
   values : {
 1.0 : 0.0,
  ...
 99.0 : 1234
   }
 }
   }

 I cant figure out how to structure the request so that I get the
 percentiles separately for each of the queries

 Could someone point me in in the right direction please

 Many thanks
 John

 --
 You received this message because you are subscribed to the Google Groups
 elasticsearch group.
 To unsubscribe from this group and stop receiving emails from it, send an
 email to elasticsearch+unsubscr...@googlegroups.com.
 To view this discussion on the web visit
 https://groups.google.com/d/msgid/elasticsearch/9d9696cb-adfa-4812-bd81-5efee0d29032%40googlegroups.com
 https://groups.google.com/d/msgid/elasticsearch/9d9696cb-adfa-4812-bd81-5efee0d29032%40googlegroups.com?utm_medium=emailutm_source=footer
 .
 For more options, visit https://groups.google.com/d/optout.




 --
 Adrien Grand

 --
 You received this message because you are subscribed to a topic in the
 Google Groups elasticsearch group.
 To unsubscribe from this topic, visit
 https://groups.google.com/d/topic/elasticsearch/6tHMOeWYtoo/unsubscribe.
 To unsubscribe from this group and all its topics, send an email to
 elasticsearch+unsubscr...@googlegroups.com.
 To view this discussion on the web visit
 https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j5JwTLK2q10fEKX6bVBzYH69dSRgA2njoEvhhronqfh1A%40mail.gmail.com
 https://groups.google.com/d/msgid/elasticsearch/CAL6Z4j5JwTLK2q10fEKX6bVBzYH69dSRgA2njoEvhhronqfh1A%40mail.gmail.com?utm_medium=emailutm_source=footer
 .
 For more options, visit https://groups.google.com/d/optout.


-- 
You received this message because you are subscribed to the Google Groups 
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/CAGfq%3DRjVu58Jetkgf%3DGvJ4BkLjhWYPvm789UGPrr0U%2BOiA_Wxg%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


Re: Help with the percentiles aggregation

2014-08-18 Thread John Ogden
Slight follow on - do you know if returning this sort of stuff via Kibana 
is on the cards?
Just looking for an easy way to graph the results.

Thanks.





On Friday, 15 August 2014 10:23:16 UTC+1, John Ogden wrote:

 Hi,

 Am trying to run a single command which calculates percentiles for 
 multiple search queries.
 The data for this is an Apache log file, and I want to get the percentile 
 response times for the gets, posts, heads (etc) in one go

 If I run this:
 curl -XPOST 'http://localhost:9200/_search?search_type=countpretty=true' 
 -d '{
 facets: { 
 0: {query : {term : { verb : get  }}},
 1: {query : {term : { verb : post }}}
 },
 aggs : {load_time_outlier : {percentiles : {field : 
 responsetime}}}   
 }'

 The response I get back has the counts for each subquery but only does the 
 aggregations for the overall dataset 
   facets : {
 0 : {
   _type : query,
   count : 5678
 },
 1 : {
   _type : query,
   count : 1234
 }
   },
   aggregations : {
 load_time_outlier : {
   values : {
 1.0 : 0.0,
  ...
 99.0 : 1234
   }
 }
   }

 I cant figure out how to structure the request so that I get the 
 percentiles separately for each of the queries

 Could someone point me in in the right direction please

 Many thanks
 John


-- 
You received this message because you are subscribed to the Google Groups 
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/579dad15-4470-4f0d-a787-9b51fd7b447a%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Help with multiple data ranges in a single query

2014-08-18 Thread John Ogden
I've been given a requirement to produce a single kibana dashboard showing 
app response times for multiple date ranges, and am stumped at how to 
proceed.
The user wants to see today's graph, along with the previous working day, 
day -7, day -28 and day -364 on the same screen - ideally, all 4 metrics in 
the same histogram  if they select another date range they want that to 
show the day-1, day-7 (etc) results too

The only thing I've been able to come up with so far is pushing each source 
event into elastic search  4 times (once with right timestamp,one with +1 
day, one with +7 days, one with +28 days, etc.) and writing separate 
queries for each, but this just feels wrong.

Any ideas how else the requirement could be met?


Many thanks.


-- 
You received this message because you are subscribed to the Google Groups 
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/3525d473-4172-45b6-852f-a0e4826eca3b%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: ES on windows without admin permissions?

2014-08-17 Thread John Ogden
Odd - I've had ES 1.1 with logstash 1.3 running on an XP machine with no 
admin rights
Was only connecting to it locally though

On Saturday, 16 August 2014 07:40:59 UTC+1, Eduardo Avaria wrote:

 Hi, I want to setup a demo for my manager on ES with production data (from 
 the mainframe). I don't have admin rights on my machine and production data 
 is sensitive, so if I load it in a server elsewhere the whole department 
 may be in trouble.

 Is there any way that I can mount a portable server, add some plugins and 
 load some data for making some graphs and visual reporting on my non admin 
 laptop?
 Thanks.


-- 
You received this message because you are subscribed to the Google Groups 
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/0a59e57e-8b53-4f24-9d67-769cc15d42bb%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Help with the percentiles aggregation

2014-08-15 Thread John Ogden
Hi,

Am trying to run a single command which calculates percentiles for multiple 
search queries.
The data for this is an Apache log file, and I want to get the percentile 
response times for the gets, posts, heads (etc) in one go

If I run this:
curl -XPOST 'http://localhost:9200/_search?search_type=countpretty=true' 
-d '{
facets: { 
0: {query : {term : { verb : get  }}},
1: {query : {term : { verb : post }}}
},
aggs : {load_time_outlier : {percentiles : {field : 
responsetime}}}   
}'

The response I get back has the counts for each subquery but only does the 
aggregations for the overall dataset 
  facets : {
0 : {
  _type : query,
  count : 5678
},
1 : {
  _type : query,
  count : 1234
}
  },
  aggregations : {
load_time_outlier : {
  values : {
1.0 : 0.0,
 ...
99.0 : 1234
  }
}
  }

I cant figure out how to structure the request so that I get the 
percentiles separately for each of the queries

Could someone point me in in the right direction please

Many thanks
John

-- 
You received this message because you are subscribed to the Google Groups 
elasticsearch group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to elasticsearch+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/elasticsearch/9d9696cb-adfa-4812-bd81-5efee0d29032%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.