[jira] [Commented] (HDFS-5517) Lower the default maximum number of blocks per file

2013-11-14 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823344#comment-13823344 ] Uma Maheswara Rao G commented on HDFS-5517: --- +1 for lowering the value. Thanks Aa

[jira] [Updated] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5502: - Attachment: HDFS-5502.005.patch > Fix HTTPS support in HsftpFileSystem > -

[jira] [Commented] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823298#comment-13823298 ] Arpit Agarwal commented on HDFS-5515: - {quote} I think #1 fix the TestDFSStartupVersion

[jira] [Resolved] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5515. - Resolution: Fixed Thanks Junping! I committed this to branch HDFS-2832. > Fix TestDFSStartupVersi

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823294#comment-13823294 ] Hadoop QA commented on HDFS-1386: - {color:green}+1 overall{color}. Here are the results of

[jira] [Commented] (HDFS-5514) FSNamesystem's fsLock should allow custom implementation

2013-11-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823259#comment-13823259 ] Jonathan Eagles commented on HDFS-5514: --- Hi, Daryn. I like what is going on here. One

[jira] [Commented] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823253#comment-13823253 ] Hadoop QA commented on HDFS-5502: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823237#comment-13823237 ] Hadoop QA commented on HDFS-2832: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-5489) Use TokenAspect in WebHDFSFileSystem

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823232#comment-13823232 ] Hudson commented on HDFS-5489: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4746 (See [https:

[jira] [Commented] (HDFS-5194) Robust support for alternate FsDatasetSpi implementations

2013-11-14 Thread Eli Collins (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823226#comment-13823226 ] Eli Collins commented on HDFS-5194: --- Since some replies just came in today and no one day

[jira] [Updated] (HDFS-5489) Use TokenAspect in WebHDFSFileSystem

2013-11-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5489: Resolution: Fixed Fix Version/s: 2.3.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Created] (HDFS-5517) Lower the default maximum number of blocks per file

2013-11-14 Thread Aaron T. Myers (JIRA)
Aaron T. Myers created HDFS-5517: Summary: Lower the default maximum number of blocks per file Key: HDFS-5517 URL: https://issues.apache.org/jira/browse/HDFS-5517 Project: Hadoop HDFS Issue T

[jira] [Updated] (HDFS-5489) Use TokenAspect in WebHDFSFileSystem

2013-11-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5489: Summary: Use TokenAspect in WebHDFSFileSystem (was: Use TokenAspect in WebHDFS) > Use TokenAspect in WebHD

[jira] [Commented] (HDFS-5489) Use TokenAspect in WebHDFS

2013-11-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823206#comment-13823206 ] Jing Zhao commented on HDFS-5489: - +1. The failed test is unrelated. I will commit the patc

[jira] [Commented] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823193#comment-13823193 ] Junping Du commented on HDFS-5515: -- +1 patch looks good. I think #1 fix the TestDFSStartup

[jira] [Commented] (HDFS-5510) Fix a findbug warning in DataStorage.java on HDFS-2832 branch

2013-11-14 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823181#comment-13823181 ] Junping Du commented on HDFS-5510: -- Thanks Arpit for review! > Fix a findbug warning in D

[jira] [Updated] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5502: - Attachment: HDFS-5502.004.patch > Fix HTTPS support in HsftpFileSystem > -

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823177#comment-13823177 ] Hadoop QA commented on HDFS-1386: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5502: - Attachment: HDFS-5502.003.patch > Fix HTTPS support in HsftpFileSystem > -

[jira] [Commented] (HDFS-5514) FSNamesystem's fsLock should allow custom implementation

2013-11-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823172#comment-13823172 ] Chris Nauroth commented on HDFS-5514: - Hi, Daryn. It looks like a good change. A coup

[jira] [Updated] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5515: Attachment: h5515.04.patch > Fix TestDFSStartupVersions for HDFS-2832 >

[jira] [Commented] (HDFS-5461) fallback to non-ssr(local short circuit reads) while oom detected

2013-11-14 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823157#comment-13823157 ] Colin Patrick McCabe commented on HDFS-5461: bq. We will have to add this catch

[jira] [Updated] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-2832: Attachment: h2832_20131114.patch > Enable support for heterogeneous storages in HDFS > -

[jira] [Updated] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5515: Attachment: h5515.03.patch Using Jira to sneak in timeout annotations on unrelated test {{TestListC

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823122#comment-13823122 ] Hadoop QA commented on HDFS-5428: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5502: - Attachment: HDFS-5502.002.patch > Fix HTTPS support in HsftpFileSystem > -

[jira] [Commented] (HDFS-5461) fallback to non-ssr(local short circuit reads) while oom detected

2013-11-14 Thread stack (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5461?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823107#comment-13823107 ] stack commented on HDFS-5461: - Nice patch (caveat the Colin comments). It looks like we run in

[jira] [Updated] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5515: Attachment: h5515.02.patch # Add DatanodeUuid initialization in {{UpgradeUtilities#createDataNodeVe

[jira] [Updated] (HDFS-5515) Fix TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-5515: Component/s: datanode Summary: Fix TestDFSStartupVersions for HDFS-2832 (was: Update TestDF

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823032#comment-13823032 ] Jonathan Eagles commented on HDFS-1386: --- While this fix is listed as part of HADOOP-6

[jira] [Updated] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-1386: -- Attachment: HDFS-1386.patch > TestJMXGet fails in jdk7 > > >

[jira] [Updated] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-1386: -- Fix Version/s: (was: 0.22.0) Labels: java7 (was: ) Target Version/s: 3.

[jira] [Commented] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13823021#comment-13823021 ] Jonathan Eagles commented on HDFS-1386: --- Upon MiniDFSCluster shutdown it is found tha

[jira] [Updated] (HDFS-1386) TestJMXGet fails in jdk7

2013-11-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles updated HDFS-1386: -- Summary: TestJMXGet fails in jdk7 (was: unregister namenode datanode info MXBean) > TestJMXGet

[jira] [Reopened] (HDFS-1386) unregister namenode datanode info MXBean

2013-11-14 Thread Jonathan Eagles (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jonathan Eagles reopened HDFS-1386: --- Assignee: Jonathan Eagles (was: Tanping Wang) Reopening this issue since this has been caus

[jira] [Commented] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822937#comment-13822937 ] Hadoop QA commented on HDFS-5502: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5428: Attachment: HDFS-5428.003.patch Thanks Vinay for the review! Update the patch to address the comments. bq.

[jira] [Commented] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822862#comment-13822862 ] Hudson commented on HDFS-5438: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4742 (See [https:

[jira] [Commented] (HDFS-5514) FSNamesystem's fsLock should allow custom implementation

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822860#comment-13822860 ] Hadoop QA commented on HDFS-5514: - {color:green}+1 overall{color}. Here are the results of

[jira] [Updated] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5438: - Resolution: Fixed Fix Version/s: 0.23.10 2.3.0 3.0.0 Hado

[jira] [Commented] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822843#comment-13822843 ] Hadoop QA commented on HDFS-5438: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Updated] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-5438: - Attachment: HDFS-5438-4.branch-0.23.patch Attaching the branch-0.23 version of the patch. It needs a separ

[jira] [Updated] (HDFS-5506) Use URLConnectionFactory in DelegationTokenFetcher

2013-11-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5506: Resolution: Fixed Fix Version/s: 2.3.0 Hadoop Flags: Reviewed Status: Resolved (was:

[jira] [Work started] (HDFS-5516) WebHDFS does not require user name when anonymous http requests are disallowed.

2013-11-14 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5516?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5516 started by Chris Nauroth. > WebHDFS does not require user name when anonymous http requests are > disallowed. >

[jira] [Created] (HDFS-5516) WebHDFS does not require user name when anonymous http requests are disallowed.

2013-11-14 Thread Chris Nauroth (JIRA)
Chris Nauroth created HDFS-5516: --- Summary: WebHDFS does not require user name when anonymous http requests are disallowed. Key: HDFS-5516 URL: https://issues.apache.org/jira/browse/HDFS-5516 Project: Ha

[jira] [Updated] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5502: - Attachment: HDFS-5502.001.patch Rebase on trunk. > Fix HTTPS support in HsftpFileSystem > ---

[jira] [Updated] (HDFS-5502) Fix HTTPS support in HsftpFileSystem

2013-11-14 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5502?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-5502: - Status: Patch Available (was: Open) > Fix HTTPS support in HsftpFileSystem >

[jira] [Commented] (HDFS-5506) Use URLConnectionFactory in DelegationTokenFetcher

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822753#comment-13822753 ] Hudson commented on HDFS-5506: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4740 (See [https:

[jira] [Commented] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822752#comment-13822752 ] Daryn Sharp commented on HDFS-5438: --- +1 Makes sense to me. > Flaws in block report proce

[jira] [Commented] (HDFS-5242) Reduce contention on DatanodeInfo instances

2013-11-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822750#comment-13822750 ] Daryn Sharp commented on HDFS-5242: --- If one thread calls get concurrently with another th

[jira] [Work started] (HDFS-5515) Update TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-5515 started by Arpit Agarwal. > Update TestDFSStartupVersions for HDFS-2832 > --- > > Key: HDFS-5515

[jira] [Created] (HDFS-5515) Update TestDFSStartupVersions for HDFS-2832

2013-11-14 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-5515: --- Summary: Update TestDFSStartupVersions for HDFS-2832 Key: HDFS-5515 URL: https://issues.apache.org/jira/browse/HDFS-5515 Project: Hadoop HDFS Issue Type: Sub-t

[jira] [Commented] (HDFS-5506) Use URLConnectionFactory in DelegationTokenFetcher

2013-11-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822731#comment-13822731 ] Jing Zhao commented on HDFS-5506: - +1. I will commit the patch shortly. > Use URLConnectio

[jira] [Updated] (HDFS-5514) FSNamesystem's fsLock should allow custom implementation

2013-11-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-5514: -- Status: Patch Available (was: Open) > FSNamesystem's fsLock should allow custom implementation > --

[jira] [Resolved] (HDFS-5510) Fix a findbug warning in DataStorage.java on HDFS-2832 branch

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5510?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal resolved HDFS-5510. - Resolution: Fixed Fix Version/s: Heterogeneous Storage (HDFS-2832) Hadoop Flags: Review

[jira] [Commented] (HDFS-5510) Fix a findbug warning in DataStorage.java on HDFS-2832 branch

2013-11-14 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5510?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822705#comment-13822705 ] Arpit Agarwal commented on HDFS-5510: - +1 for the patch. I will commit it shortly. > F

[jira] [Updated] (HDFS-5514) FSNamesystem's fsLock should allow custom implementation

2013-11-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daryn Sharp updated HDFS-5514: -- Attachment: HDFS-5514.patch Trivial change to lay groundwork for fine grain locking. > FSNamesystem's f

[jira] [Created] (HDFS-5514) FSNamesystem's fsLock should allow custom implementation

2013-11-14 Thread Daryn Sharp (JIRA)
Daryn Sharp created HDFS-5514: - Summary: FSNamesystem's fsLock should allow custom implementation Key: HDFS-5514 URL: https://issues.apache.org/jira/browse/HDFS-5514 Project: Hadoop HDFS Issue Ty

[jira] [Updated] (HDFS-4995) Make getContentSummary() less expensive

2013-11-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-4995: - Resolution: Fixed Fix Version/s: 0.23.10 2.3.0 3.0.0 Hado

[jira] [Commented] (HDFS-5453) Support fine grain locking in FSNamesystem

2013-11-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822613#comment-13822613 ] Daryn Sharp commented on HDFS-5453: --- I've got an implementation of fine grain fsn locking

[jira] [Commented] (HDFS-4995) Make getContentSummary() less expensive

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822608#comment-13822608 ] Hudson commented on HDFS-4995: -- SUCCESS: Integrated in Hadoop-trunk-Commit #4736 (See [https:

[jira] [Commented] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822581#comment-13822581 ] Kihwal Lee commented on HDFS-5438: -- The top level data structure is still {{SortedMap}}. S

[jira] [Commented] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822544#comment-13822544 ] Daryn Sharp commented on HDFS-5438: --- One question: In {{CorruptReplicasMap}}, the {{Sorte

[jira] [Commented] (HDFS-4995) Make getContentSummary() less expensive

2013-11-14 Thread Daryn Sharp (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4995?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822535#comment-13822535 ] Daryn Sharp commented on HDFS-4995: --- +1 Not yielding in snapshots might need to be revisi

[jira] [Updated] (HDFS-3970) BlockPoolSliceStorage#doRollback(..) should use BlockPoolSliceStorage instead of DataStorage to read prev version file.

2013-11-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-3970: - Fix Version/s: 0.23.10 3.0.0 > BlockPoolSliceStorage#doRollback(..) should use BlockPoo

[jira] [Commented] (HDFS-5438) Flaws in block report processing can cause data loss

2013-11-14 Thread Kihwal Lee (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822527#comment-13822527 ] Kihwal Lee commented on HDFS-5438: -- The unit test failure is not related to the patch. It

[jira] [Commented] (HDFS-5444) Choose default web UI based on browser capabilities

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822446#comment-13822446 ] Hudson commented on HDFS-5444: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5504) In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822435#comment-13822435 ] Hudson commented on HDFS-5504: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5474) Deletesnapshot can make Namenode in safemode on NN restarts.

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822433#comment-13822433 ] Hudson commented on HDFS-5474: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5487) Introduce unit test for TokenAspect

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822434#comment-13822434 ] Hudson commented on HDFS-5487: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5366) recaching improvements

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822440#comment-13822440 ] Hudson commented on HDFS-5366: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5325) Remove WebHdfsFileSystem#ConnRunner

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822444#comment-13822444 ] Hudson commented on HDFS-5325: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5075) httpfs-config.sh calls out incorrect env script name

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822439#comment-13822439 ] Hudson commented on HDFS-5075: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5488) Clean up TestHftpURLTimeout

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822432#comment-13822432 ] Hudson commented on HDFS-5488: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5440) Extract the logic of handling delegation tokens in HftpFileSystem to the TokenAspect class

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822431#comment-13822431 ] Hudson commented on HDFS-5440: -- SUCCESS: Integrated in Hadoop-Hdfs-trunk #1582 (See [https://

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822423#comment-13822423 ] Vinay commented on HDFS-5428: - Test failures are related to this line addition {noformat}

[jira] [Commented] (HDFS-5504) In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822410#comment-13822410 ] Hudson commented on HDFS-5504: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5325) Remove WebHdfsFileSystem#ConnRunner

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822419#comment-13822419 ] Hudson commented on HDFS-5325: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5444) Choose default web UI based on browser capabilities

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822421#comment-13822421 ] Hudson commented on HDFS-5444: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5488) Clean up TestHftpURLTimeout

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822407#comment-13822407 ] Hudson commented on HDFS-5488: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5440) Extract the logic of handling delegation tokens in HftpFileSystem to the TokenAspect class

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822406#comment-13822406 ] Hudson commented on HDFS-5440: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5487) Introduce unit test for TokenAspect

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822409#comment-13822409 ] Hudson commented on HDFS-5487: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5474) Deletesnapshot can make Namenode in safemode on NN restarts.

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822408#comment-13822408 ] Hudson commented on HDFS-5474: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5366) recaching improvements

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822415#comment-13822415 ] Hudson commented on HDFS-5366: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5075) httpfs-config.sh calls out incorrect env script name

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822414#comment-13822414 ] Hudson commented on HDFS-5075: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #1608 (See [htt

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822369#comment-13822369 ] Hadoop QA commented on HDFS-5428: - {color:red}-1 overall{color}. Here are the results of t

[jira] [Commented] (HDFS-2832) Enable support for heterogeneous storages in HDFS

2013-11-14 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-2832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822352#comment-13822352 ] Konstantin Shvachko commented on HDFS-2832: --- > The probability of no collision i

[jira] [Commented] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Vinay (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822342#comment-13822342 ] Vinay commented on HDFS-5428: - Patch looks pretty good. Anyway I did not observe the mentioned

[jira] [Commented] (HDFS-5075) httpfs-config.sh calls out incorrect env script name

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5075?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822323#comment-13822323 ] Hudson commented on HDFS-5075: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5366) recaching improvements

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822324#comment-13822324 ] Hudson commented on HDFS-5366: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5444) Choose default web UI based on browser capabilities

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822330#comment-13822330 ] Hudson commented on HDFS-5444: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5488) Clean up TestHftpURLTimeout

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822316#comment-13822316 ] Hudson commented on HDFS-5488: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5474) Deletesnapshot can make Namenode in safemode on NN restarts.

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5474?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822317#comment-13822317 ] Hudson commented on HDFS-5474: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5487) Introduce unit test for TokenAspect

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5487?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822318#comment-13822318 ] Hudson commented on HDFS-5487: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5504) In HA mode, OP_DELETE_SNAPSHOT is not decrementing the safemode threshold, leads to NN safemode.

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5504?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822319#comment-13822319 ] Hudson commented on HDFS-5504: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5440) Extract the logic of handling delegation tokens in HftpFileSystem to the TokenAspect class

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822315#comment-13822315 ] Hudson commented on HDFS-5440: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Commented] (HDFS-5325) Remove WebHdfsFileSystem#ConnRunner

2013-11-14 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5325?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13822328#comment-13822328 ] Hudson commented on HDFS-5325: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #391 (See [https://b

[jira] [Updated] (HDFS-5428) under construction files deletion after snapshot+checkpoint+nn restart leads nn safemode

2013-11-14 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-5428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-5428: Attachment: HDFS-5428.002.patch Update the patch. I tried to solve the following issue in the patch: bq. (F