"989.8mb". That looks like your change to 8g did not take effect. Can you double check how you start the server and that the ENV variables are actually taken into account?
On Wed, Sep 24, 2014 at 11:16 PM, Arie <satyava...@gmail.com> wrote: > > heap_max = 989.8mb > > > > On Wednesday, September 24, 2014 11:05:20 PM UTC+2, lennart wrote: >> >> Can you checkt that the change actually took effect by querying ES >> directly? >> >> curl -XGET http://localhost:9200/_nodes/stats/jvm?pretty=true >> ... >> "heap_max" : "990.7mb" >> >> Thanks, >> Lennart >> >> On Wed, Sep 24, 2014 at 10:27 PM, Arie <satya...@gmail.com> wrote: >> > Hi Lennart >> > >> > in the yml file there is 8192m configured for ES_HEAP_SIZE. at first i >> > have >> > foregotten the "m", >> > but now it is there and I can recalculated 4 out of 14 indices. Stil it >> > goes >> > out-of-memory tho. >> > >> > The server has 16GB, and no problem there. >> > >> > >> > >> > On Wednesday, September 24, 2014 9:53:36 PM UTC+2, lennart wrote: >> >> >> >> Hey Arie, >> >> >> >> loos like your ElasticSearch process is running out of memory. How >> >> much heap space did you allocate to it? >> >> >> >> Thanks, >> >> Lennart >> >> >> >> On Wed, Sep 24, 2014 at 9:34 PM, Arie <satya...@gmail.com> wrote: >> >> > And ther is this error in ther server logfile for some indices: >> >> > >> >> > 2014-09-24T21:07:15.736+02:00 INFO [RebuildIndexRangesJob] Could not >> >> > calculate range of index [graylog2_12]. Skipping. >> >> > org.elasticsearch.action.search.SearchPhaseExecutionException: Failed >> >> > to >> >> > execute phase [query_fetch], all shards failed; shardFailures >> >> > {[eUTBQqseT1mfR9rhU3OSRg][graylog2_12][0]: >> >> > >> >> > >> >> > RemoteTransportException[[Graylog2-test][inet[/10.64.91.14:9300]][search/phase/query+fetch]]; >> >> > nested: QueryPhaseExecutionException[[graylog2_12][0]: >> >> > query[ConstantScore(*:*)],from[0],size[1],sort[<custom:"timestamp": >> >> > >> >> > >> >> > org.elasticsearch.index.fielddata.fieldcomparator.LongValuesComparatorSource@46977d73>!]: >> >> > Query Failed [Failed to execute main query]]; nested: >> >> > ElasticSearchException[java.lang.OutOfMemoryError: Java heap space]; >> >> > nested: >> >> > ExecutionError[java.lang.OutOfMemoryError: Java heap space]; nested: >> >> > OutOfMemoryError[Java heap space]; } >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction.onFirstPhaseResult(TransportSearchTypeAction.java:272) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.action.search.type.TransportSearchTypeAction$BaseAsyncAction$3.onFailure(TransportSearchTypeAction.java:224) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.search.action.SearchServiceTransportAction$7.handleException(SearchServiceTransportAction.java:324) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.transport.netty.MessageChannelHandler.handleException(MessageChannelHandler.java:181) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.transport.netty.MessageChannelHandler.handlerResponseError(MessageChannelHandler.java:171) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.transport.netty.MessageChannelHandler.messageReceived(MessageChannelHandler.java:123) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.DefaultChannelPipeline$DefaultChannelHandlerContext.sendUpstream(DefaultChannelPipeline.java:791) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:296) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.unfoldAndFireMessageReceived(FrameDecoder.java:462) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.callDecode(FrameDecoder.java:443) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.handler.codec.frame.FrameDecoder.messageReceived(FrameDecoder.java:303) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.SimpleChannelUpstreamHandler.handleUpstream(SimpleChannelUpstreamHandler.java:70) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:564) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.DefaultChannelPipeline.sendUpstream(DefaultChannelPipeline.java:559) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:268) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.Channels.fireMessageReceived(Channels.java:255) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.read(NioWorker.java:88) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.process(AbstractNioWorker.java:108) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioSelector.run(AbstractNioSelector.java:318) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.socket.nio.AbstractNioWorker.run(AbstractNioWorker.java:89) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.channel.socket.nio.NioWorker.run(NioWorker.java:178) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.util.ThreadRenamingRunnable.run(ThreadRenamingRunnable.java:108) >> >> > at >> >> > >> >> > >> >> > org.elasticsearch.common.netty.util.internal.DeadLockProofWorker$1.run(DeadLockProofWorker.java:42) >> >> > at >> >> > >> >> > >> >> > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) >> >> > at >> >> > >> >> > >> >> > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) >> >> > at java.lang.Thread.run(Thread.java:745) >> >> > 2014-09-24T21:07:15.739+02:00 INFO [RebuildIndexRangesJob] Done >> >> > calculating >> >> > index ranges for 15 indices. Took 132244ms. >> >> > >> >> > -- >> >> > You received this message because you are subscribed to the Google >> >> > Groups >> >> > "graylog2" group. >> >> > To unsubscribe from this group and stop receiving emails from it, >> >> > send >> >> > an >> >> > email to graylog2+u...@googlegroups.com. >> >> > For more options, visit https://groups.google.com/d/optout. >> > >> > -- >> > You received this message because you are subscribed to the Google >> > Groups >> > "graylog2" group. >> > To unsubscribe from this group and stop receiving emails from it, send >> > an >> > email to graylog2+u...@googlegroups.com. >> > For more options, visit https://groups.google.com/d/optout. > > -- > You received this message because you are subscribed to the Google Groups > "graylog2" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to graylog2+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "graylog2" group. To unsubscribe from this group and stop receiving emails from it, send an email to graylog2+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
