HI, That sounds like a very large amount of shards for a node that size, and this is most likely the source of your problems. Each shard in Elasticsearch corresponds to a Lucene instance and carries with it a certain amount of overhead. You therefore do not want your shards to be too small. For logging use cases a common shard size at least a few GB.
If you are using daily indices and the default 5 shards per index, you may want to consider reducing the shard count for each of your indices and/or switch to weekly or perhaps monthly indices in order to reduce the number of shards created each day and increase the average shard size going forward. In order to get the instance working again you may also need to start closing the older insides in order to bring down the number of active shards and/or upgrade the node to get more RAM. Best regards, Christian On Monday, April 20, 2015 at 4:38:53 PM UTC+1, Don Pich wrote: > > Hey Christian, > > 8 gigs of ram > -Xms6g -Xmx6g > > Don Pich | Jedi Master (aka System Administrator 2) | O: 701-952-5925 > > 3320 Westrac Drive South, Suite A * Fargo, ND 58103 > > Facebook <http://www.facebook.com/RealTruck> | Youtube > <http://www.youtube.com/realtruckcom>| Twitter > <http://twitter.com/realtruck> | Google+ <https://google.com/+Realtruck> > | Instagram <http://instagram.com/realtruckcom> | Linkedin > <http://www.linkedin.com/company/realtruck> | Our Guiding Principles > <http://www.realtruck.com/our-guiding-principles/> > “If it goes on a truck we got it, if it’s fun we do it” – RealTruck.com > <http://realtruck.com/> > > On Mon, Apr 20, 2015 at 10:29 AM, <christian...@elasticsearch.com > <javascript:>> wrote: > >> Hi, >> >> Having read through the thread it sounds like your configuration has been >> working in the past. Is that correct? >> >> If this is the case I would reiterate David's initial questions about >> your node's RAM and heap size as the number of shards look quite large for >> a single node. Could you please provide information about this? >> >> Best regards, >> >> Christian >> >> >> >> On Sunday, April 19, 2015 at 8:08:05 PM UTC+1, dp...@realtruck.com wrote: >>> >>> I am new to elasticsearch and have a problem. I have 5 indicies. At >>> first all of them were running without issue. However, over the last 2 >>> weeks, all but one have stopped generating data. I have run a tcpdump on >>> the logstash server and confirmed that logging packets are getting to the >>> server. I have looked into the servers health. I have issued the >>> following to check on the cluster: >>> >>> root@logstash:/# curl -XGET 'localhost:9200/_cluster/health?pretty=true' >>> { >>> "cluster_name" : "es-logstash", >>> "status" : "yellow", >>> "timed_out" : false, >>> "number_of_nodes" : 1, >>> "number_of_data_nodes" : 1, >>> "active_primary_shards" : 2791, >>> "active_shards" : 2791, >>> "relocating_shards" : 0, >>> "initializing_shards" : 0, >>> "unassigned_shards" : 2791 >>> } >>> root@logstash:/# >>> >>> >>> Can some one please point me in the right direction on troubleshooting >>> this? >>> >> -- >> You received this message because you are subscribed to a topic in the >> Google Groups "elasticsearch" group. >> To unsubscribe from this topic, visit >> https://groups.google.com/d/topic/elasticsearch/0GEaRABjLQY/unsubscribe. >> To unsubscribe from this group and all its topics, send an email to >> elasticsearc...@googlegroups.com <javascript:>. >> To view this discussion on the web visit >> https://groups.google.com/d/msgid/elasticsearch/2a4d7543-b110-499b-a8d3-ccfa19284617%40googlegroups.com >> >> <https://groups.google.com/d/msgid/elasticsearch/2a4d7543-b110-499b-a8d3-ccfa19284617%40googlegroups.com?utm_medium=email&utm_source=footer> >> . >> >> For more options, visit https://groups.google.com/d/optout. >> > > -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send an email to elasticsearch+unsubscr...@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/elasticsearch/b7853329-aa6b-4cd5-b8e6-dfb30d779509%40googlegroups.com. For more options, visit https://groups.google.com/d/optout.
