[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2014-03-14 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13935377#comment-13935377 ] Thejas M Nair commented on HIVE-4501: - The changes in HIVE-6312 (in 0.13) should fix th

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2014-02-19 Thread Abin Shahab (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13905687#comment-13905687 ] Abin Shahab commented on HIVE-4501: --- What is the progress on this issue? > HS2 memory le

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-30 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782669#comment-13782669 ] Thejas M Nair commented on HIVE-4501: - bq. The change in TUGIContainingProcessor will j

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-30 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782668#comment-13782668 ] Thejas M Nair commented on HIVE-4501: - bq. Are you saying that the same FS ref. can be

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-30 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782632#comment-13782632 ] Konstantin Boudnik commented on HIVE-4501: -- bq. This is not the case, same thread

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-30 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13782587#comment-13782587 ] Thejas M Nair commented on HIVE-4501: - I reviewed the patch. The patch seems to make an

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780697#comment-13780697 ] Hive QA commented on HIVE-4501: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-27 Thread Hive QA (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780649#comment-13780649 ] Hive QA commented on HIVE-4501: --- {color:red}Overall{color}: -1 no tests executed Here are

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-27 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780531#comment-13780531 ] Konstantin Boudnik commented on HIVE-4501: -- bq. I believe the lease checker thread

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-27 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780368#comment-13780368 ] Thejas M Nair commented on HIVE-4501: - I will review it today. Closing the fs is certa

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-27 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780343#comment-13780343 ] Konstantin Boudnik commented on HIVE-4501: -- So, shall we have committed it to the

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-27 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13780156#comment-13780156 ] Kousuke Saruta commented on HIVE-4501: -- Hi [~apivovarov] I revased your patch and foun

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-26 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13779135#comment-13779135 ] Alexander Pivovarov commented on HIVE-4501: --- I did the fix which solves the probl

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778256#comment-13778256 ] Konstantin Boudnik commented on HIVE-4501: -- But it essentially prevents auth mecha

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Henry Wang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778247#comment-13778247 ] Henry Wang commented on HIVE-4501: -- Setting hive.server2.enable.doAs to false is a workaro

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778217#comment-13778217 ] Alexander Pivovarov commented on HIVE-4501: --- Probably we can set ctx.setHDFSClean

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778060#comment-13778060 ] Kousuke Saruta commented on HIVE-4501: -- I think we need to close FileSystem object pro

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778019#comment-13778019 ] Alexander Pivovarov commented on HIVE-4501: --- if cache is enabled then only one Fi

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13778006#comment-13778006 ] Thejas M Nair commented on HIVE-4501: - I have corrected the description to say that the

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777991#comment-13777991 ] Alexander Pivovarov commented on HIVE-4501: --- if cache is disabled then 4 lease ch

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777903#comment-13777903 ] Thejas M Nair commented on HIVE-4501: - [~cos] Can you please elaborate ? The problem is

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-25 Thread Konstantin Boudnik (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777816#comment-13777816 ] Konstantin Boudnik commented on HIVE-4501: -- Provided patch doesn't solve the probl

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-24 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13777022#comment-13777022 ] Kousuke Saruta commented on HIVE-4501: -- Sorry, I think that we use FileSystem.closeAll

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-24 Thread Kousuke Saruta (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776963#comment-13776963 ] Kousuke Saruta commented on HIVE-4501: -- Hi [~thejas] Now, I try to address the issue H

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-23 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13776008#comment-13776008 ] Alexander Pivovarov commented on HIVE-4501: --- After set them to false I see 4 Leas

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-23 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13775968#comment-13775968 ] Thejas M Nair commented on HIVE-4501: - [~apivovarov] Sorry about that, the patch shoul

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-09-23 Thread Alexander Pivovarov (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13775756#comment-13775756 ] Alexander Pivovarov commented on HIVE-4501: --- Thejas, I'm confused patch sets fs.h

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-05-05 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649543#comment-13649543 ] Thejas M Nair commented on HIVE-4501: - I have updated hiveserver2 setup instructions to

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-05-05 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649542#comment-13649542 ] Thejas M Nair commented on HIVE-4501: - [~clarkyzl] Yes, HIVE-3098 and HIVE-3155 are rel

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-05-05 Thread Zhuoluo (Clark) Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649529#comment-13649529 ] Zhuoluo (Clark) Yang commented on HIVE-4501: I think HS1 has similar problems..

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-05-05 Thread Zhuoluo (Clark) Yang (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649528#comment-13649528 ] Zhuoluo (Clark) Yang commented on HIVE-4501: Is this issue related to HIVE-3098

[jira] [Commented] (HIVE-4501) HS2 memory leak - FileSystem objects in FileSystem.CACHE

2013-05-05 Thread Thejas M Nair (JIRA)
[ https://issues.apache.org/jira/browse/HIVE-4501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13649519#comment-13649519 ] Thejas M Nair commented on HIVE-4501: - It would better to call shim.closeAllForUGI to