Unassigned Shards Of A Newer Elasticsearh Version

2014-12-01 Thread Umutcan
Hi, When I was doing some experiments on my Elasticsearch cluster, I found that cluster cannot assign replicas of a shards on the node which have a new version of Elasticsearch (1.4.1). I have seen this before and I can fix this by upgrading old nodes. But, I am wondering that if there is a

Re: Unassigned Shards Of A Newer Elasticsearh Version

2014-12-01 Thread David Pilato
Are you sure you are not running low on disk space? If you have less than 15% free, elasticsearch won’t allocate replicas. -- David Pilato | Technical Advocate | Elasticsearch.com @dadoonet https://twitter.com/dadoonet | @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs

Unassigned Shards and Upgrading Elasticsearch

2014-11-06 Thread Umutcan
Hi, Yesterday, I have added a new node to my ES cluster and after that some of the shards started to remain unassigned. These shards are the replicas of the shards on the new node. When I inspected the reason, I found out that this new node has a different ES version. The new one is 1.3.4

Re: Unassigned Shards and Upgrading Elasticsearch

2014-11-06 Thread Mark Walkom
You shouldn't run multiple versions unless you are upgrading, so it would make sense to upgrade the other nodes ASAP. The logs on your nodes should also shed some more light on the problem. On 6 November 2014 19:29, Umutcan umut...@gamegos.com wrote: Hi, Yesterday, I have added a new node to

Re: list Unassigned shards by index by node

2014-10-13 Thread PrasathRajan
Try this... curl localhost:9200/_cat/shards -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/list-Unassigned-shards-by-index-by-node-tp4037162p4064803.html Sent from the ElasticSearch Users mailing list archive at Nabble.com. -- You received this message

Indexing stops when too many unassigned shards

2014-10-11 Thread Veselin Kantsev
Hello, I have a test cluster of 2 ES nodes (Elasticsearch 1.1.1-1). I've noticed that whenever the number of unassigned shards increases past a threshold, the cluster stops accepting Write operations. *Example1*: nodes: 2 primary shards: 6 replicas: 1 The cluster works as expected

Unassigned shards after updating # of replica

2014-08-12 Thread Yaniv Yancovich
unassigned shards). After few hours it became green. Most of the time it became green, but from time few time it is stacked on 2 unassigned shards. From the logs: [index.shard.service ] [es2-s01] [ds7][3] suspect illegal state: trying to move shard from primary mode to replica mode [2014

Re: Red status unassigned shards help

2014-06-03 Thread Jason Weber
several times and I believe its collecting the correct data now. I still show 520 unassigned shards, but its collecting all my logs now. Is this something I can use the redirect command for to assign it to a new index? Jason On Tuesday, May 27, 2014 11:39:49 AM UTC-4, Jason Weber wrote: Could

Re: Red status unassigned shards help

2014-05-30 Thread Jason Weber
email: ma...@campaignmonitor.com javascript: web: www.campaignmonitor.com On 29 May 2014 23:45, Jason Weber dave...@gmail.com javascript: wrote: I rebooted several times and I believe its collecting the correct data now. I still show 520 unassigned shards, but its collecting all my logs

Re: Red status unassigned shards help

2014-05-30 Thread Mark Walkom
Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 29 May 2014 23:45, Jason Weber dave...@gmail.com wrote: I rebooted several times and I believe its collecting the correct data now. I still show 520 unassigned shards, but its collecting all my logs now

Re: Red status unassigned shards help

2014-05-29 Thread Jason Weber
I rebooted several times and I believe its collecting the correct data now. I still show 520 unassigned shards, but its collecting all my logs now. Is this something I can use the redirect command for to assign it to a new index? Jason On Tuesday, May 27, 2014 11:39:49 AM UTC-4, Jason Weber

Re: Red status unassigned shards help

2014-05-29 Thread Mark Walkom
the correct data now. I still show 520 unassigned shards, but its collecting all my logs now. Is this something I can use the redirect command for to assign it to a new index? Jason On Tuesday, May 27, 2014 11:39:49 AM UTC-4, Jason Weber wrote: Could someone walk me through getting my cluster up

Re: Red status unassigned shards help

2014-05-29 Thread Pawan Sharma
and I believe its collecting the correct data now. I still show 520 unassigned shards, but its collecting all my logs now. Is this something I can use the redirect command for to assign it to a new index? Jason On Tuesday, May 27, 2014 11:39:49 AM UTC-4, Jason Weber wrote: Could someone walk me

Re: Red status unassigned shards help

2014-05-29 Thread Mark Walkom
, Jason Weber davev...@gmail.com wrote: I rebooted several times and I believe its collecting the correct data now. I still show 520 unassigned shards, but its collecting all my logs now. Is this something I can use the redirect command for to assign it to a new index? Jason On Tuesday, May 27

Red status unassigned shards help

2014-05-27 Thread Jason Weber
Could someone walk me through getting my cluster up and running. Came in from long weekend and my cluster was red status, I am showing a lot of unassigned shards. jmweber@MIDLOG01:/var/log/logstash$ curl localhost:9200/_cluster/health?pretty { cluster_name : midlogcluster, status : red

Re: Unassigned Shards Problem

2014-05-23 Thread Brian Wilkins
I removed all the extra allocation stuff. When I did that, the shards were all propogated. Health is green again. On Thursday, May 22, 2014 6:56:24 PM UTC-4, Brian Wilkins wrote: Went back and read the page again. So I made one master, workhorse, and balancer with rackid of rack_two for

Unassigned Shards Problem

2014-05-22 Thread Brian Wilkins
, but not anymore. I deleted all my data, Cluster health goes GREEN. However, as soon as data is sent from logstash - redis - elasticsearch, my cluster health goes RED. I end up with unassigned shards. In my /var/log/elasticsearch/logstash.log on my master, I see this in the log: [2014-05-22 12

Re: Unassigned Shards Problem

2014-05-22 Thread Mark Walkom
. However, as soon as data is sent from logstash - redis - elasticsearch, my cluster health goes RED. I end up with unassigned shards. In my /var/log/elasticsearch/logstash.log on my master, I see this in the log: [2014-05-22 12:03:20,599][INFO ][cluster.metadata ] [Bora] [logstash

Re: Unassigned Shards Problem

2014-05-22 Thread Brian Wilkins
, but not anymore. I deleted all my data, Cluster health goes GREEN. However, as soon as data is sent from logstash - redis - elasticsearch, my cluster health goes RED. I end up with unassigned shards. In my /var/log/elasticsearch/logstash.log on my master, I see this in the log: [2014-05-22 12:03

Re: Unassigned Shards Problem

2014-05-22 Thread Brian Wilkins
Went back and read the page again. So I made one master, workhorse, and balancer with rackid of rack_two for testing. One master shows rackid of rack_one. All nodes were restarted. The shards are still unassigned. Also,the indices in ElasticHQ are empty. -- You received this message because

Re: Unassigned shards, v2

2014-05-20 Thread abr
: { state: UNASSIGNED primary: false node: null relocating_node: null shard: 3 index: mytest } Any idea? logstash and ES version V1-1-1 Antoine Brun -- View this message in context: http://elasticsearch-users.115913.n3.nabble.com/Unassigned-shards-v2-tp4046370p4056142.html

elasticsearch always leaves unassigned shards on startup

2014-05-19 Thread f13ts
Hi, Just getting started with ES. I'm integrating it into my Play! 2 application using the scalastic scala wrapper for the java API. I can happily index retrieve documents, but ONLY if I delete and recreate my index every time the application starts, which is pretty useless. I have a Gist

restart leave unassigned shards

2014-04-21 Thread suleman mubarik
Hi we have 5 data nodes and 3 master in cluster and we are on ES 1.0 2 week ago when we restarted the it leave 1 shard unassigned for some indices. We check the Lucien index and they are fine. We create a test index and copy the Lucien index to that and it came back. But the we don’t know

restart leave unassigned shards

2014-04-08 Thread suleman mubarik
Hi I have to restart elasticsearch cluster nodes because of some timeout exceptions I did restart the nodes one by one there are 5 data nodes in cluster But when I did that it leave some shards unassigned and I have no replicas There is nothing help full in logs. Can I get some help to know

permanent unassigned shards in latest logstash index

2014-04-03 Thread Alexander Gray II
We have a 3 node m1.large ES/logstash cluster with version 0.90.3. Everything has been running fine for a very long time. We needed to upgrade our cluster to use m2.xlarge, so we killed a node and brought up a new brand new m2.xlarge machine and let the cluster go from yellow to green. But

Re: permanent unassigned shards in latest logstash index

2014-04-03 Thread Mark Walkom
If it has data you're ok with losing, just delete the index and let it get recreated automatically. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 4 April 2014 13:45, Alexander Gray II gray...@gmail.com wrote: We

Re: permanent unassigned shards in latest logstash index

2014-04-03 Thread Mohit Anchlia
Is there a way to fix this type of issue without having to delete an index? On Thu, Apr 3, 2014 at 7:46 PM, Mark Walkom ma...@campaignmonitor.comwrote: If it has data you're ok with losing, just delete the index and let it get recreated automatically. Regards, Mark Walkom Infrastructure

Re: permanent unassigned shards in latest logstash index

2014-04-03 Thread Alexander Gray II
No love. I deleted the index via the head plugin, but the index is still there, and the shards are still unassigned. Nothing in the logs showed any errors either. Maybe this is not the proper way to delete an index? (or maybe it got deleted and re-created so fast that I missed it...) -- You

Re: permanent unassigned shards in latest logstash index

2014-04-03 Thread Mark Walkom
is doing. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 4 April 2014 14:01, Alexander Gray II gray...@gmail.com wrote: Maybe I have to do this? http://stackoverflow.com/questions/19967472/elasticsearch-unassigned

Re: permanent unassigned shards in latest logstash index

2014-04-03 Thread Alexander Gray II
I installed elastichq. Interestingly enough, it doesn't even show that index, but head/paramedic/bigdesk does. weird. All the diagnostics of elastichq shows mostly green. There are few yellows under Index Activity for Get Total, but it doesn't strike me as something that is related to this.

Re: permanent unassigned shards in latest logstash index

2014-04-03 Thread Alexander Gray II
ok. i stopped the entire cluster and started one ES node at a time, and that seemed to do the trick, even though that's one of the first things I did when things went ary. I have no idea how it could have gotten into that state to begin with, but it's all good now. We lost a ton of logs, but it

Re: Unassigned shards

2014-02-19 Thread Itamar Syn-Hershko
There's a lot of info missing: how many servers, indexes, shards and replicas do you have? have you made sure to set all the configurations correctly (quorum size, expected number of nodes etc)? You may be experiencing a split-brain situation (if your cluster state is red) or just a temporary

Re: Unassigned Shards

2013-12-20 Thread Eric Luellen
and every time I do, it completely breaks things. Once it starts back up it doesn't continue to show the logs in Kibana correctly and when I run a health check, it says there are unassigned shards. I've not been able to fix this and in the past I've always just had to delete them and start

Re: Unassigned Shards

2013-12-20 Thread Eric Luellen
I got the initial issue fixed of me getting data back again. However I still don't understand how to fix the unassigned shards issue and how to properly restart elasticsearch without it complaining. On Friday, December 20, 2013 9:28:53 AM UTC-5, Eric Luellen wrote: Mark, I used the rpm

Re: Unassigned Shards

2013-12-19 Thread Mark Walkom
can do to make sure elasticsearch/KIbana is keeping up? 2. I've had to restart elasticsearch a few times and every time I do, it completely breaks things. Once it starts back up it doesn't continue to show the logs in Kibana correctly and when I run a health check, it says there are unassigned