Need help/suggestion for the massive queries user case

Hi guys, I have some streaming sensor data as input to ES. For each incoming data message, I need to do a query on the historic data in ES according to the 'timestamp' and 'messageId' in that message. I need to get the aggregated query results in real-time. My problem is each data message

Re: Need help/suggestion for the massive queries user case

? -- *David Pilato* | *Technical Advocate* | *Elasticsearch.com* @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr Le 2 septembre 2014 à 08:53:13, Yuheng Du (yuheng@gmail.com javascript:) a écrit: Hi guys, I have some streaming sensor

Re: Need help/suggestion for the massive queries user case

2014 à 09:17:31, Yuheng Du (yuheng@gmail.com javascript:) a écrit: Each query is doing a search in _all indexes in the cluster. Maybe that's also a hold up of the availability of ES server. I tried to run 3 ES nodes on my desktop machine but it does not seems to help, it also

Re: Need help/suggestion for the massive queries user case

-- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 2 sept. 2014 à 15:49, Yuheng Du yuheng@gmail.com javascript: a écrit : I tried to run ./elasticsearch --node.name=esmaster -Xmx=2G -Xms=2G. But it gives me the error msg: Invalid maximum heap size: -Xmx=2G, How

Re: Need help/suggestion for the massive queries user case

://twitter.com/elasticsearchfr Le 2 septembre 2014 à 16:14:31, Yuheng Du (yuheng@gmail.com javascript:) a écrit: I tired 2g, It only worked when I use ./elasticsearch -Xmx2g -Xms2g. Currently some of my shards are stated as unassigned in my kopf web interface. It happened after I started 3

Re: Need help/suggestion for the massive queries user case

#_environment_variables -- *David Pilato* | *Technical Advocate* | *Elasticsearch.com* @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr Le 2 septembre 2014 à 16:14:31, Yuheng Du (yuheng@gmail.com javascript:) a écrit: I tired 2g, It only worked when I use

Re: Need help/suggestion for the massive queries user case

are incorrect as we can see with heap_max -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 2 sept. 2014 à 20:37, Yuheng Du yuheng@gmail.com javascript: a écrit : BTW, the node stats info shows the jvm usage info as follows: jvm : { timestamp : 1409682903048

Re: Need help/suggestion for the massive queries user case

/error? Thanks. On Tuesday, September 2, 2014 3:25:30 PM UTC-4, David Pilato wrote: You don't have enough memory available on your laptop I guess... -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 2 sept. 2014 à 21:05, Yuheng Du yuheng@gmail.com javascript

Re: Need help/suggestion for the massive queries user case

* | *Technical Advocate* | *Elasticsearch.com* @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr Le 2 septembre 2014 à 22:46:15, Yuheng Du (yuheng@gmail.com javascript:) a écrit: Tried to increase the memory for the VM, now ES runs ok, but still

Warn/Error message of Elasticsearch perl client

Hi Guys, I have been using the Elasticsearch's perl client for query, it gives me the following warning/Error messages: https://lh6.googleusercontent.com/-F6fChujEweg/VAYuWDn7_JI/AOw/lIBv0d7Coqo/s1600/no_nodes.jpg while I was running a perl program which uses ES perl client. ES still

extended stats aggregation on array

Hi, I have a field called 'readings' in my logstash messages which is an array consists of 10 float point numbers. I want to calculate the stats for each individual slots in those arrays. For example if I have three readings : [0,0,0, 1935.25,0,0,0,0,-1235.5, 0] [0,0,0,

Re: Aggregation

I am using: https://lh4.googleusercontent.com/-cJH7ZK_Aw_I/U-4rNlfDRwI/ANA/tMq8twaPRcw/s1600/12.jpg and I got the following errors: https://lh5.googleusercontent.com/-lQYfexkUZ2U/U-4rqz__L8I/ANI/SNisnl0duhc/s1600/34.jpg can anyone tell me what is going

restore data on disk

Hi guys, I am new to elastic search. I found that some indexes from the logstash were missing this morning. So I looked at the '$ES_Home/data/elasticsearch/nodes/0/indices/' directory: https://lh3.googleusercontent.com/-2B9ZkpRhj0Y/U-4tZ2MRLUI/ANQ/2I3oBgTlh8E/s1600/56.jpg

Re: restore data on disk

typo: the second image shows the directory at '$ES_Home/data/elasticsearch/nodes/1/indices/' -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to

Aggregation

Does perl module of elasticsearch allows Aggregation syntax? I run a few tests but it failed. -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and stop receiving emails from it, send an email to

Debug message of Elasticsearch when running

Hi guys, I am running a single node Elasticsearch instance, connected to two rabbitmq queues as input using logstash. I kept getting debug messages in ES terminal: [2014-08-13 10:26:13,867][DEBUG][action.search.type ] [Jebediah Guthrie] [vehicles][0], node[9BIZ4GpLQYu8933RiTs3DQ], [P],

Re: ElasticSearch and RabbitMQ as data source

Hi All, I am using the rabbitmq-river plugin for elasticsearch. My configuration for the river is as follows: curl -XPUT 'localhost:9200/_river/rabbit_river/_meta' -d '{ type : rabbitmq, rabbitmq : { host : lbha1.ir.clemson.edu, port : 5672, user : guest,