Re: Add elastic search in my php application

On local disk on which elasticsearch is running. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 26 déc. 2014 à 08:14, publichealth...@gmail.com a écrit : > > In elasticsearch, where the data is stored? I saw the localhost url with port > 9200. What is it mean? > > >>

Re: Add elastic search in my php application

In elasticsearch, where the data is stored? I saw the localhost url with port 9200. What is it mean? On Thursday, December 25, 2014 1:24:13 PM UTC+5:30, Jason Zhang wrote: > > Here's the official Elasticsearch PHP client > > http://www.elasticsearch.org/guide/en/elasticsearch/client/php-api/cur

Re: Data is not saved equally in each datanode

So you have 16 shards (8 primary and 8 replicas). On a 5 nodes cluster, this should rebalance automatically. Are you sure your 5th node actually joined the cluster ? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 26 déc. 2014 à 07:21, Michael deMan (ES) a écrit > :

Re: Data is not saved equally in each datanode

I don’t know. > On Dec 25, 2014, at 10:19 PM, Xiaoliang Tian wrote: > > Thanks,And M using 0.9.13.can it enable auto-balancing manually? > > 2014-12-26 14:17 GMT+08:00 Michael deMan (ES) >: > http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/

Elasticsearch gets unresponsive with logstash

Hello, we use a two node elasticsearch (version 1.1.1) cluster in combination with logstash to centralize our log management. We currently facing the problem that the cluster gets unusable unresponsive after a couple of hours. The "head" plugin doesn't get any data as well as the Kibana web-int

Re: Mapping problem, date and range filter.

Yeah. You should reindex. You could use scan&scroll API to read your index and then write results in another one. IIRC there are some scripts and plugins on internet. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs > Le 26 déc. 2014 à 00:50, Finn Poitier a écrit : > > When

Re: Data is not saved equally in each datanode

Thanks,And M using 0.9.13.can it enable auto-balancing manually? 2014-12-26 14:17 GMT+08:00 Michael deMan (ES) : > > http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html > > I can’t remember when auto-balancing got enabled by default, I think maybe > 1.3.4. >

Re: Data is not saved equally in each datanode

http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/cluster-reroute.html I can’t remember when auto-balancing got enabled by default, I think maybe 1.3.4. you can find out via api. ht

Re: Data is not saved equally in each datanode

which version? and what is the API url exactly 2014-12-26 12:44 GMT+08:00 Michael deMan (ES) : > Also, higher shards will help with the new indexes but not the existing > ones. > You can use the API to force ES to move shards off your ‘full’ disk over > to the new one. > Auto-balancing for data s

Re: Data is not saved equally in each datanode

Also, higher shards will help with the new indexes but not the existing ones. You can use the API to force ES to move shards off your ‘full’ disk over to the new one. Auto-balancing for data size should be on by default if you are running a newer version of ES. > On Dec 25, 2014, at 8:13 PM, Mic

Re: Data is not saved equally in each datanode

Try increasing the number of shards - maybe to 20 or 40. > On Dec 25, 2014, at 8:10 PM, Xiaoliang Tian wrote: > > index number depend on how many days past,the index name is the day epoch. > because we use elasticseach for log storage > shard number is 8 > replica is 1 > > 2014-12-25 15:49 GM

Re: Data is not saved equally in each datanode

index number depend on how many days past,the index name is the day epoch. because we use elasticseach for log storage shard number is 8 replica is 1 2014-12-25 15:49 GMT+08:00 David Pilato : > How many index/shards/replicas do you have? > > -- > David ;-) > Twitter : @dadoonet / @elasticsearchf

Re: Cascading cluster failure

3 million requests a second! Can you provide some details on your cluster, ie node type count? On 26 December 2014 at 05:14, vineeth mohan wrote: > Hi , > > That could be a good reason. > But then it wont happen without you change the threadpool settings for > index. > If there is load more tha

Mapping problem, date and range filter.

When I have a wrong mapping (type = string, not date) like this one created_at: { type: string } and the entries look like: Sun Oct 05 23:15:22 + 2014 I guess I can't use the range query to get documents for a certain time span? It would work to search for a string, such as "Sun Oct 05" t

Announcment: elasticsearch-sql release version 1.2

elasticsearch-sql release version 1.2 You can check it out here: https://github.com/NLPchina/elasticsearch-sql -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to e

Re: Cascading cluster failure

Hi , That could be a good reason. But then it wont happen without you change the threadpool settings for index. If there is load more than it can process , it will go to the queue. And the queue is by default 20 per node also goes full the requests get rejected. Can you see if there is any rejecte

Re: Cascading cluster failure

Thanks Vineeth. I was thinking about that but these merge errors were also happening before the outage. Also the elasticsearch process was never dead. Also I was wondering at the time of outage we had about 3 million requests per second. Just the large number of requests caused the network layer

Re: Cascading cluster failure

Hello Abhishek , Can you try to correlate merge operation of shards and this time of cascading failures ? I feel there is a correlation between both. If so , we can do some optimization on that side. Thanks Vineeth On Thu, Dec 25, 2014 at 8:53 AM, Abhishek Andhavarapu wrote: > Mark,

Storm Integration - EsBolt configuration to set Tokenizer

Hi I am using EsBolt to index a map with key and value in string. When I index the map and then further run the query feom ElasticSearch web UI, I got to know that I am not indexing my fields properly as I am not able to perform case-sensitive search. For eg. my map contained a value 'John'. W

Re: elasticsearch index plan

It depends on the power of the indexer program you want to use, you should benchmark this for yourself. If you index valuable data, one machine is not enough for fault tolerance. Jörg On Thu, Dec 25, 2014 at 3:26 PM, Wang wrote: > Dear all, > I am trying index 7000 messages per second which ea

elasticsearch index plan

Dear all, I am trying index 7000 messages per second which each message is 1kbyte. No analyzer and no ttl. I have a machine with 2.0G 24 core cup, 380g memory, and 300g sas *8. Is this machine powerful enough for this? Thanks and happy holiday! Alan -- You received this message because you are

Re: Startup issues with ES 1.3.5

We might have faced similar problem with ES 1.3.6. The reason we found was might be due to concurrent merges. These settings have helped us in fixing the issue. merge: policy: max_merge_at_once: 5 reclaim_deletes_weight: 4.0 segments_per_tier: 5 indices: store: throttle:

Re: Add elastic search in my php application

If you need an example CirrusSearch is the name of the plugin that uses elasticsearch for MediaWiki. I can't attest to the code quality but it certainly gets the job done. Nik On Dec 25, 2014 2:54 AM, "Jason Zhang" wrote: > Here's the official Elasticsearch PHP client > > http://www.elasticsearc

Re: Optimizing prefix search

Hey, Billy. Did you mean http://www.elasticsearch.org/guide/en/elasticsearch/reference/current/query-dsl-query-string-query.html ? Could you point me in the direction which parameters to look for? On Thursday, December 25, 2014 10:05:17 AM UTC+6, BillyEm wrote: > > You're trying, I think, to d