2 xmx does not make sense, Your heap seems unusual large usually your heap should be much smaller than available memory so solr can use it for index caching which is off-heap
> Am 30.07.2019 um 13:25 schrieb Rodrigo Oliveira > <adamantina.rodr...@gmail.com>: > > Hi, > > My environment have 5 servers with solr + zookeeper in the same hosts. > > However, I've had 48 RAM each servers (solr - xms 28 gb and xmx - 32 gb). > > Looking for my servers and process, in zookeepers has xmx 1000 mb and xmx > 4096 mb (last item, was change for me). > > Why 2 values for xmx? > > Regards, > > Em ter, 30 de jul de 2019 04:44, Dominique Bejean <dominique.bej...@eolya.fr> > escreveu: > >> Hi, >> >> I don’t find any documentation about the parameter >> zookeeper_server_java_heaps >> in zoo.cfg. >> The way to control java heap size is either the java.env file of the >> zookeeper-env.sh file. In zookeeper-env.sh >> SERVER_JVMFLAGS="-Xmx=512m" >> >> How many RAM on your server ? >> >> Regards >> >> Dominique >> >> >> >> >> Le lun. 29 juil. 2019 à 20:35, Rodrigo Oliveira < >> adamantina.rodr...@gmail.com> a écrit : >> >>> Hi, >>> >>> After 3 days running, my zookeeper showing this error. >>> >>> 2019-07-29 15:10:41,906 [myid:1] - WARN >>> [RecvWorker:4332550065071534382:QuorumCnxManager$RecvWorker@1176] - >>> Connection broken for id 4332550065071534382, my id = 1, error = >>> java.io.IOException: Received packet with invalid packet: 824196618 >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1163) >>> 2019-07-29 15:10:41,906 [myid:1] - WARN >>> [RecvWorker:4332550065071534382:QuorumCnxManager$RecvWorker@1179] - >>> Interrupting SendWorker >>> 2019-07-29 15:10:41,907 [myid:1] - WARN >>> [SendWorker:4332550065071534382:QuorumCnxManager$SendWorker@1092] - >>> Interrupted while waiting for message on queue >>> java.lang.InterruptedException >>> at >>> >>> >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) >>> at >>> >>> >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) >>> at >>> java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:1243) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager.access$700(QuorumCnxManager.java:78) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:1080) >>> 2019-07-29 15:10:41,907 [myid:1] - WARN >>> [SendWorker:4332550065071534382:QuorumCnxManager$SendWorker@1102] - >> Send >>> worker leaving thread id 4332550065071534382 my id = 1 >>> 2019-07-29 15:10:41,917 [myid:1] - INFO [/177.55.55.152:3888 >>> :QuorumCnxManager$Listener@888] - Received connection request / >>> 177.55.55.63:53972 >>> 2019-07-29 15:10:41,920 [myid:1] - WARN >>> [RecvWorker:4332550065071534382:QuorumCnxManager$RecvWorker@1176] - >>> Connection broken for id 4332550065071534382, my id = 1, error = >>> java.io.IOException: Received packet with invalid packet: 840973834 >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1163) >>> 2019-07-29 15:10:41,921 [myid:1] - WARN >>> [RecvWorker:4332550065071534382:QuorumCnxManager$RecvWorker@1179] - >>> Interrupting SendWorker >>> 2019-07-29 15:10:41,922 [myid:1] - WARN >>> [SendWorker:4332550065071534382:QuorumCnxManager$SendWorker@1092] - >>> Interrupted while waiting for message on queue >>> java.lang.InterruptedException >>> at >>> >>> >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) >>> at >>> >>> >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) >>> at >>> java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:1243) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager.access$700(QuorumCnxManager.java:78) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:1080) >>> 2019-07-29 15:10:41,922 [myid:1] - WARN >>> [SendWorker:4332550065071534382:QuorumCnxManager$SendWorker@1102] - >> Send >>> worker leaving thread id 4332550065071534382 my id = 1 >>> 2019-07-29 15:10:41,932 [myid:1] - INFO [/177.55.55.152:3888 >>> :QuorumCnxManager$Listener@888] - Received connection request / >>> 177.55.55.63:38633 >>> 2019-07-29 15:10:41,933 [myid:1] - WARN >>> [RecvWorker:4332550065071534638:QuorumCnxManager$RecvWorker@1176] - >>> Connection broken for id 4332550065071534638, my id = 1, error = >>> java.io.IOException: Received packet with invalid packet: 807419402 >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1163) >>> 2019-07-29 15:10:41,933 [myid:1] - WARN >>> [RecvWorker:4332550065071534638:QuorumCnxManager$RecvWorker@1179] - >>> Interrupting SendWorker >>> 2019-07-29 15:10:41,934 [myid:1] - WARN >>> [SendWorker:4332550065071534638:QuorumCnxManager$SendWorker@1092] - >>> Interrupted while waiting for message on queue >>> java.lang.InterruptedException >>> at >>> >>> >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.reportInterruptAfterWait(AbstractQueuedSynchronizer.java:2014) >>> at >>> >>> >> java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2088) >>> at >>> java.util.concurrent.ArrayBlockingQueue.poll(ArrayBlockingQueue.java:418) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager.pollSendQueue(QuorumCnxManager.java:1243) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager.access$700(QuorumCnxManager.java:78) >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager$SendWorker.run(QuorumCnxManager.java:1080) >>> 2019-07-29 15:10:41,935 [myid:1] - WARN >>> [SendWorker:4332550065071534638:QuorumCnxManager$SendWorker@1102] - >> Send >>> worker leaving thread id 4332550065071534638 my id = 1 >>> 2019-07-29 15:10:41,981 [myid:1] - WARN >>> [NIOWorkerThread-6:NIOServerCnxn@370] - Exception causing close of >>> session >>> 0x0: Len error 1008750420 >>> 2019-07-29 15:10:41,987 [myid:1] - WARN >>> [NIOWorkerThread-7:NIOServerCnxn@370] - Exception causing close of >>> session >>> 0x0: Len error 1008750420 >>> 2019-07-29 15:10:41,992 [myid:1] - WARN >>> [NIOWorkerThread-1:NIOServerCnxn@370] - Exception causing close of >>> session >>> 0x0: Len error 1008750420 >>> 2019-07-29 15:10:42,008 [myid:1] - WARN >>> [NIOWorkerThread-3:NIOServerCnxn@370] - Exception causing close of >>> session >>> 0x0: Len error 1008750420 >>> 2019-07-29 15:10:45,375 [myid:1] - WARN >>> [NIOWorkerThread-11:NIOServerCnxn@366] - Unable to read additional data >>> from client sessionid 0x400044d531804b6, likely client has closed socket >>> 2019-07-29 15:10:46,062 [myid:1] - WARN >>> [NIOWorkerThread-4:NIOServerCnxn@366] - Unable to read additional data >>> from client sessionid 0x300044d504c0471, likely client has closed socket >>> 2019-07-29 15:11:12,965 [myid:1] - WARN [qtp1789550256-23:URIUtil@396] >> - >>> >>> >> /%c0%ae%c0%ae/%c0%ae%c0%ae/%c0%ae%c0%ae/%c0%ae%c0%ae/%c0%ae%c0%ae/%c0%ae%c0%ae/etc/passwd >>> org.eclipse.jetty.util.Utf8Appendable$NotUtf8Exception: Not valid UTF8! >>> byte C0 in state 0 >>> 2019-07-29 15:11:17,588 [myid:1] - INFO [/177.153.44.152:3888 >>> :QuorumCnxManager$Listener@888] - Received connection request / >>> 177.55.55.63:33721 >>> java.lang.OutOfMemoryError: Java heap space >>> Dumping heap to java_pid97598.hprof ... >>> 2019-07-29 15:11:17,590 [myid:1] - WARN >>> [RecvWorker:1:QuorumCnxManager$RecvWorker@1176] - Connection broken for >>> id >>> 1, my id = 1, error = >>> java.io.IOException: Received packet with invalid packet: 1966420818 >>> at >>> >>> >> org.apache.zookeeper.server.quorum.QuorumCnxManager$RecvWorker.run(QuorumCnxManager.java:1163) >>> 2019-07-29 15:11:19,452 [myid:1] - WARN >>> [RecvWorker:1:QuorumCnxManager$RecvWorker@1179] - Interrupting >> SendWorker >>> Heap dump file created [638922790 bytes in 3,132 secs] >>> # >>> # java.lang.OutOfMemoryError: Java heap space >>> # -XX:OnOutOfMemoryError="kill -9 %p" >>> # Executing /bin/sh -c "kill -9 97598"... >>> >>> That's right. Any tips ou tricks to workaround this error? How to >> increase >>> the memory in Zookeeper? >>> >>> Look my zoo.conf. >>> >>> [15:30:09] root@eddison0001:/zoop/conf$ cat zoo.cfg >>> # The number of milliseconds of each tick >>> tickTime=2000 >>> # The number of ticks that the initial >>> # synchronization phase can take >>> initLimit=10 >>> # The number of ticks that can pass between >>> # sending a request and getting an acknowledgement >>> syncLimit=5 >>> # the directory where the snapshot is stored. >>> # do not use /tmp for storage, /tmp here is just >>> # example sakes. >>> dataDir=/zoop/zookeeperdata >>> # the port at which the clients will connect >>> clientPort=2181 >>> # the maximum number of client connections. >>> # increase this if you need to handle more clients >>> #maxClientCnxns=60 >>> # >>> # Be sure to read the maintenance section of the >>> # administrator guide before turning on autopurge. >>> # >>> # >>> >> http://zookeeper.apache.org/doc/current/zookeeperAdmin.html#sc_maintenance >>> # >>> # The number of snapshots to retain in dataDir >>> #autopurge.snapRetainCount=3 >>> # Purge task interval in hours >>> # Set to "0" to disable auto purge feature >>> #autopurge.purgeInterval=1 >>> oom_heap_dump_dir=/tmp >>> zookeeper_server_java_heaps=4G >>> >>> server.1=177.55.55.152:2888:3888 >>> server.2=177.55.55.153:2888:3888 >>> server.3=177.55.55.154:2888:3888 >>> server.4=177.55.55.155:2888:3888 >>> server.5=177.55.55.156:2888:3888 >>> >>> Any workaround? >>> >>> Regards, >>> >>
