[jira] [Commented] (HBASE-5362) ZK connection leak
[ https://issues.apache.org/jira/browse/HBASE-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13397565#comment-13397565 ] Ionut Ignatescu commented on HBASE-5362: Any update on this?Any fix? ZK connection leak -- Key: HBASE-5362 URL: https://issues.apache.org/jira/browse/HBASE-5362 Project: HBase Issue Type: Bug Components: mapreduce Affects Versions: 0.90.3 Reporter: Ionut Ignatescu I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list. I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92. To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call. Also, the initTableMapperJob was overwritten. I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792 Regards, Ionut I. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5362) ZK connection leak
[ https://issues.apache.org/jira/browse/HBASE-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13204666#comment-13204666 ] Zhihong Yu commented on HBASE-5362: --- HBASE-4508 was integrated into 0.90.5 Can you perform your test using 0.90.5 ? Thanks ZK connection leak -- Key: HBASE-5362 URL: https://issues.apache.org/jira/browse/HBASE-5362 Project: HBase Issue Type: Bug Components: mapreduce Affects Versions: 0.90.3 Reporter: Ionut Ignatescu I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list. I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92. To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call. Also, the initTableMapperJob was overwritten. I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792 Regards, Ionut I. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5362) ZK connection leak
[ https://issues.apache.org/jira/browse/HBASE-5362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13204823#comment-13204823 ] Ionut Ignatescu commented on HBASE-5362: No,I can't. We have a different version deployed on our Hadoop cluster, so it's almost impossible to perform this test. Anyway, thanks for your suggestion, I'll look into source to check. ZK connection leak -- Key: HBASE-5362 URL: https://issues.apache.org/jira/browse/HBASE-5362 Project: HBase Issue Type: Bug Components: mapreduce Affects Versions: 0.90.3 Reporter: Ionut Ignatescu I have an application like a scheduler that starts periodically some MR jobs that reads from one HBase table and write in more tables, changing the row key and the columns list. I have encounted a problem with this: after each MR job, I have +1 connections open to ZK and after a period of time, I have received IOException. I saw that I am not the first that had had this problem, but I didn't see any fix. No in HBase 0.90.4, nor in HBase 0.92. To fix this issue I wrote a custom TableInputFormat that forces to close the connection to ZK after each getSplits call. Also, the initTableMapperJob was overwritten. I found an open JIRA issue here: https://issues.apache.org/jira/browse/HBASE-3792 Regards, Ionut I. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira
