[jira] Commented: (ZOOKEEPER-828) BookKeeper client: Out of memory error

[Flavio Junqueira (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12895427#action_12895427
 ] 

Flavio Junqueira commented on ZOOKEEPER-828:


It seems that after some sequence of events (unknown to me) corresponding to 
taking bookies up and down, a client does not receive responses and accumulate 
them, causing the out-of-memory issue I mentioned above. There are really two 
problems here:

# The client for some reason is not receiving responses after the 
aforementioned sequence of events. I need to find a way of reproducing the 
problem;
# Throttling is not working correctly for reads, and for that I'll propose a 
fix in a separate jira. 
 

 BookKeeper client: Out of memory error
 --

 Key: ZOOKEEPER-828
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-828
 Project: Zookeeper
  Issue Type: Bug
  Components: contrib-bookkeeper
Affects Versions: 3.3.1
Reporter: Flavio Junqueira
Assignee: Flavio Junqueira

 Error while reading a large number of entries.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Commented: (ZOOKEEPER-828) BookKeeper client: Out of memory error

[Flavio Paiva Junqueira (JIRA)]

[ 
https://issues.apache.org/jira/browse/ZOOKEEPER-828?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=12891988#action_12891988
 ] 

Flavio Paiva Junqueira commented on ZOOKEEPER-828:
--

This is what I got while reading 10M 1k-byte entries from a 4-2 bookie 
configuration:

{noformat}
Jul 24, 2010 7:33:18 AM org.jboss.netty.channel.DefaultChannelFuture
WARNING: An exception was thrown by ChannelFutureListener.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Jul 24, 2010 7:33:22 AM org.jboss.netty.channel.socket.nio.NioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Jul 24, 2010 7:33:36 AM org.jboss.netty.channel.socket.nio.NioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Jul 24, 2010 7:33:41 AM org.jboss.netty.channel.socket.nio.NioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Jul 24, 2010 7:33:57 AM org.jboss.netty.channel.socket.nio.NioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Exception in thread NIOServerFactory java.lang.OutOfMemoryError: GC overhead 
limit exceeded
at java.util.Arrays.copyOfRange(Arrays.java:3209)
at java.lang.String.init(String.java:216)
at java.lang.StringBuilder.toString(StringBuilder.java:430)
at 
org.apache.bookkeeper.proto.BookieServer.processPacket(BookieServer.java:182)
at 
org.apache.bookkeeper.proto.NIOServerFactory$Cnxn.readRequest(NIOServerFactory.java:306)
at 
org.apache.bookkeeper.proto.NIOServerFactory$Cnxn.doIO(NIOServerFactory.java:204)
at 
org.apache.bookkeeper.proto.NIOServerFactory.run(NIOServerFactory.java:114)
ERROR - [main-SendThread(wilbur1:2181):clientcnx...@419] - from 
main-SendThread(wilbur1:2181)
java.lang.OutOfMemoryError: GC overhead limit exceeded
at java.util.HashMap.newKeyIterator(HashMap.java:839)
at java.util.HashMap$KeySet.iterator(HashMap.java:873)
at java.util.HashSet.iterator(HashSet.java:153)
at sun.nio.ch.SelectorImpl.processDeregisterQueue(SelectorImpl.java:127)
at sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:69)
at sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:69)
at sun.nio.ch.SelectorImpl.select(SelectorImpl.java:80)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1066)
Jul 24, 2010 7:38:38 AM org.jboss.netty.channel.socket.nio.NioWorker
WARNING: Unexpected exception in the selector loop.
java.lang.OutOfMemoryError: GC overhead limit exceeded
Jul 24, 2010 7:38:38 AM org.jboss.netty.channel.socket.nio.NioWorker
{noformat}

 BookKeeper client: Out of memory error
 --

 Key: ZOOKEEPER-828
 URL: https://issues.apache.org/jira/browse/ZOOKEEPER-828
 Project: Zookeeper
  Issue Type: Bug
  Components: contrib-bookkeeper
Affects Versions: 3.3.1
Reporter: Flavio Paiva Junqueira

 Error while reading a large number of entries.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.