You are correct about that Lennart, I have put the ES_HEAP_SIZE into /etc/init.d/elasticsearch, and now is is fine.
It is a mismatch in ES I guess. I have installed it thru RPM. On Thursday, September 25, 2014 10:16:37 AM UTC+2, lennart wrote: > > "989.8mb". That looks like your change to 8g did not take effect. Can > you double check how you start the server and that the ENV variables > are actually taken into account? > > On Wed, Sep 24, 2014 at 11:16 PM, Arie <satya...@gmail.com <javascript:>> > wrote: > > > > heap_max = 989.8mb > > > > > > > > On Wednesday, September 24, 2014 11:05:20 PM UTC+2, lennart wrote: > >> > >> Can you checkt that the change actually took effect by querying ES > >> directly? > >> > >> curl -XGET http://localhost:9200/_nodes/stats/jvm?pretty=true > >> ... > >> "heap_max" : "990.7mb" > >> > >> Thanks, > >> Lennart > >> > >> On Wed, Sep 24, 2014 at 10:27 PM, Arie <satya...@gmail.com> wrote: > >> > Hi Lennart > >> > > >> > in the yml file there is 8192m configured for ES_HEAP_SIZE. at first > i > >> > have > >> > foregotten the "m", > >> > but now it is there and I can recalculated 4 out of 14 indices. Stil > it > >> > goes > >> > out-of-memory tho. > >> > > >> > The server has 16GB, and no problem there. > >> > > >> > > >> > > >> > On Wednesday, September 24, 2014 9:53:36 PM UTC+2, lennart wrote: > >> >> > >> >> Hey Arie, > >> >> > >> >> loos like your ElasticSearch process is running out of memory. How > >> >> much heap space did you allocate to it? > >> >> > >> >> Thanks, > >> >> Lennart > >> >> > >> >> On Wed, Sep 24, 2014 at 9:34 PM, Arie <satya...@gmail.com> wrote: > >> >> > And ther is this error in ther server logfile for some indices: > >> >> > > >> >> > 2014-09-24T21:07:15.736+02:00 INFO [RebuildIndexRangesJob] Could > not > >> >> > calculate range of index [graylog2_12]. Skipping. > >> >> > org.elasticsearch.action.search.SearchPhaseExecutionException: > Failed > >> >> > to > >> >> > execute phase [query_fetch], all shards failed; shardFailures > >> >> > {[eUTBQqseT1mfR9rhU3OSRg][graylog2_12][0]: > >> >> > > >> >> > > >> >> > > RemoteTransportException[[Graylog2-test][inet[/10.64.91.14:9300]][search/phase/query+fetch]]; > > > >> >> > nested: QueryPhaseExecutionException[[graylog2_12][0]: > >> >> > > query[ConstantScore(*:*)],from[0],size[1],sort[<custom:"timestamp": > >> >> > > >> >> > > >> >> > > org.elasticsearch.index.fielddata.fieldcomparator.LongValuesComparatorSource@46977d73>!]: > > > >> >> > Query Failed [Failed to execute main query]]; nested: > >> >> > ElasticSearchException[java.lang.OutOfMemoryError: Java heap > space]; > >> >> > nested: > >> >> > ExecutionError[java.lang.OutOfMemoryError: Java heap space]; > nested: > >> >> > OutOfMemoryError[Java heap space]; } > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.onFirstPhaseResult(TransportSearchTypeAction.java:272) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$3.onFailure(TransportSearchTypeAction.java:224) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.search.action.SearchServiceTransportAction$7.handleException(SearchServiceTransportAction.java:324) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.transport.netty.MessageChannelHandler.handleException(MessageChannelHandler.java:181) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:123) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) > > > >> >> > at > >> >> > > >> >> > > >> >> > > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) > > > >> >> > at > >> >> > > >> >> > > >> >> > > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > > > >> >> > at > >> >> > > >> >> > > >> >> > > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > > > >> >> > at java.lang.Thread.run(Thread.java:745) > >> >> > 2014-09-24T21:07:15.739+02:00 INFO [RebuildIndexRangesJob] Done > >> >> > calculating > >> >> > index ranges for 15 indices. Took 132244ms. > >> >> > > >> >> > -- > >> >> > You received this message because you are subscribed to the Google > >> >> > Groups > >> >> > "graylog2" group. > >> >> > To unsubscribe from this group and stop receiving emails from it, > >> >> > send > >> >> > an > >> >> > email to graylog2+u...@googlegroups.com. > >> >> > For more options, visit https://groups.google.com/d/optout. > >> > > >> > -- > >> > You received this message because you are subscribed to the Google > >> > Groups > >> > "graylog2" group. > >> > To unsubscribe from this group and stop receiving emails from it, > send > >> > an > >> > email to graylog2+u...@googlegroups.com. > >> > For more options, visit https://groups.google.com/d/optout. > > > > -- > > You received this message because you are subscribed to the Google > Groups > > "graylog2" group. > > To unsubscribe from this group and stop receiving emails from it, send > an > > email to graylog2+u...@googlegroups.com <javascript:>. > > For more options, visit https://groups.google.com/d/optout. > -- You received this message because you are subscribed to the Google Groups "graylog2" group. To unsubscribe from this group and stop receiving emails from it, send an email to graylog2+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
