aggregation for similar strings

2015-05-06 Thread Lior Goldemberg
hi guys, i have similar string that i want to aggregate, but they seem to be different within few characters at the end. for example: doc1: {message:hello world and good morning1 300} doc2: {message:hello world and good morning1 200} doc3: {message:hello world and good morning1 100} i would

kibana

2015-05-06 Thread Lior Goldemberg
hi, can kibana be used for end-users security wise, without to give them ability to send queries as they like using F12/fiddler etc? -- Please update your bookmarks! We moved to https://discuss.elastic.co/ --- You received this message because you are subscribed to the Google Groups

Re: Need Query Help

2015-05-06 Thread Lior Goldemberg
hi i hope i understand your question. you should use exists filter: http://www.elastic.co/guide/en/elasticsearch/reference/current/query-dsl-exists-filter.html -- Please update your bookmarks! We moved to https://discuss.elastic.co/ --- You received this message because you are subscribed to

[hadoop] newbie question

2015-05-03 Thread Lior Goldemberg
hi, i have few basic questions about es-hadoop, and i would really appreciate your kind help 1. if i have currently ES cluster, do i have motivation to add hadoop layer? 2. is the idea of ES-hadoop, that hadoop will be the data store, and ES the search engine above it? 3. can logstash write

Re: [hadoop] newbie question

2015-05-03 Thread Lior Goldemberg
thanks guys, i have an app that needs to write big data, currently writes directly to ES. also i have really heavy aggregations (scripted metric), which takes a long time (few min) since i know that ES supposed to be a search engine and not DB (by their claim), i started to look

Re: [hadoop] newbie question

2015-05-03 Thread Lior Goldemberg
Hi guys, Thanks again for the quick replies, very much appreciated!! We are using ES for the past year and from day 1 we haven’t had good perforce for groovy script that use scripted metric aggregations. Our data is not huge yet, we have 163 indices, 356 shards and 360M documents but when we

Re: [hadoop] newbie question

2015-05-03 Thread Lior Goldemberg
come on guys, you were so helpful so far :) On Sun, May 3, 2015 at 2:32 PM, Lior Goldemberg lio...@gmail.com wrote: Hi guys, Thanks again for the quick replies, very much appreciated!! We are using ES for the past year and from day 1 we haven’t had good perforce for groovy script that use

Re: Navigation path

2015-03-19 Thread Lior Goldemberg
come on guys, someone must know this :) On Wednesday, March 18, 2015 at 6:23:50 PM UTC+2, Lior Goldemberg wrote: hi all How would you handle the following problem. I save for each back office user the list of pages he visited. Now I want to fetch all the users who visited page

Re: Navigation path

2015-03-19 Thread Lior Goldemberg
You mean specific type? On Thursday, March 19, 2015, Yarden Bar ayash.jor...@gmail.com wrote: HI Lior, Have your tried aggregation http://www.elastic.co/guide/en/elasticsearch/reference/current/search-aggregations.html query? On Wednesday, March 18, 2015 at 6:23:50 PM UTC+2, Lior

Navigation path

2015-03-18 Thread Lior Goldemberg
hi all How would you handle the following problem. I save for each back office user the list of pages he visited. Now I want to fetch all the users who visited page a and then page b and then page e Does elasticsearch have something built in? Thanks -- You received this message because you

node.js client timeout doesn't work (for me)

2015-02-12 Thread Lior Goldemberg
hi guys, i wonder if someone had the same problem. i have a heavy query, with complicated script, and i want to give this query larger timeout. but no matter, what number i put there, the timeout happens after 30 seconds. here is the code: var queryBegin = moment();

Main database

2014-11-26 Thread Lior Goldemberg
hi all, which is the most common main db, to work with ES, so it will be easy to sync between the main db to ES. preferably it should accept data in the same structure. thanks! -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe

Re: Main database

2014-11-26 Thread Lior Goldemberg
actually im looking for a way to backup my ES data, since it cant be used as primary db at this stage. so i thought to insert my data to another db - just for backup -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this

percentiles and outliers

2014-09-30 Thread Lior Goldemberg
hi all, i'm trying to filter a search by 99 percentile, which for now i consider as outlier. currently i have 3 phases: 1. get all rows 2. calculate the 99 percentile for each row (by its key)- update the row with outlier=true or false 3. search again with filter outlier=false