[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15026984#comment-15026984 ] Wei-Chiu Chuang commented on HDFS-9451: --- Most failures are due to file permission issue: Error while

[jira] [Updated] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9451: -- Attachment: HDFS-9451.004.patch exit code 137 implies the processes are killed with SIGKILL. So

[jira] [Commented] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027139#comment-15027139 ] Hadoop QA commented on HDFS-9452: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9117) Config file reader / options classes for libhdfs++

2015-11-25 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9117: -- Resolution: Fixed Status: Resolved (was: Patch Available) Committed to HDFS-8707.

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9438: Hadoop Flags: Reviewed > TestPipelinesFailover assumes Linux ifconfig >

[jira] [Commented] (HDFS-4861) BlockPlacementPolicyDefault does not consider decommissioning racks

2015-11-25 Thread Rushabh S Shah (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-4861?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027204#comment-15027204 ] Rushabh S Shah commented on HDFS-4861: -- Recently we this bug in one of our production cluster. We

[jira] [Updated] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wei-Chiu Chuang updated HDFS-9451: -- Attachment: (was: HDFS-9451.004.patch) > TestFsPermission#testDeprecatedUmask is broken >

[jira] [Updated] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-25 Thread James Clampffer (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] James Clampffer updated HDFS-9452: -- Attachment: HDFS-9452.HDFS-8707.001.patch New patch to use std::tuple in the synchronized

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027002#comment-15027002 ] Hudson commented on HDFS-9438: -- FAILURE: Integrated in Hadoop-trunk-Commit #8885 (See

[jira] [Commented] (HDFS-9451) TestFsPermission#testDeprecatedUmask is broken

2015-11-25 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027076#comment-15027076 ] Wei-Chiu Chuang commented on HDFS-9451: --- I am not seeing these test failures locally, by the way. >

[jira] [Commented] (HDFS-6694) TestPipelinesFailover.testPipelineRecoveryStress tests fail intermittently with various symptoms

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6694?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027123#comment-15027123 ] Hudson commented on HDFS-6694: -- FAILURE: Integrated in Hadoop-trunk-Commit #8889 (See

[jira] [Updated] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-25 Thread Yongjun Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yongjun Zhang updated HDFS-9438: Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available)

[jira] [Commented] (HDFS-9429) Tests in TestDFSAdminWithHA intermittently fail with EOFException

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027138#comment-15027138 ] Xiao Chen commented on HDFS-9429: - The test failures are not related - TestPermission is being addressed in

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2015-11-25 Thread Uma Maheswara Rao G (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027721#comment-15027721 ] Uma Maheswara Rao G commented on HDFS-9381: --- Thanks Jing for taking a look. {quote} In case we

[jira] [Commented] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027760#comment-15027760 ] Hudson commented on HDFS-9459: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2666 (See

[jira] [Commented] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027840#comment-15027840 ] Hudson commented on HDFS-8512: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #724 (See

[jira] [Commented] (HDFS-9451) Clean up depreated umasks and related unit tests

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027841#comment-15027841 ] Hudson commented on HDFS-9451: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #724 (See

[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-11-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027846#comment-15027846 ] Andrew Wang commented on HDFS-9273: --- FWIW I think it's a long-standing bug. > ACLs on root directory may

[jira] [Created] (HDFS-9470) EncryptionZone on rootDir missing after NNrestart

2015-11-25 Thread Xiao Chen (JIRA)
Xiao Chen created HDFS-9470: --- Summary: EncryptionZone on rootDir missing after NNrestart Key: HDFS-9470 URL: https://issues.apache.org/jira/browse/HDFS-9470 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027916#comment-15027916 ] Xiao Chen commented on HDFS-9273: - Thanks Andrew for identifying this. Also thanks Chirs and Andrew for the

[jira] [Commented] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027726#comment-15027726 ] Hudson commented on HDFS-8512: -- FAILURE: Integrated in Hadoop-trunk-Commit #8893 (See

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027727#comment-15027727 ] Hudson commented on HDFS-9467: -- FAILURE: Integrated in Hadoop-trunk-Commit #8893 (See

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027728#comment-15027728 ] Hudson commented on HDFS-9407: -- FAILURE: Integrated in Hadoop-trunk-Commit #8893 (See

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027725#comment-15027725 ] Mingliang Liu commented on HDFS-9467: - Thank you for reviewing this patch again and committing it. >

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027805#comment-15027805 ] BELUGA BEHR commented on HDFS-9457: --- I updated to include all areas and to make use of SLF4J place

[jira] [Commented] (HDFS-9451) Clean up depreated umasks and related unit tests

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027829#comment-15027829 ] Hudson commented on HDFS-9451: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #735 (See

[jira] [Commented] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027828#comment-15027828 ] Hudson commented on HDFS-8512: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #735 (See

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-11-25 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9273: -- Target Version/s: 2.7.2, 2.6.3 bq. Should this fix be included in the 2.6 / 2.7

[jira] [Updated] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-11-25 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinod Kumar Vavilapalli updated HDFS-9273: -- Priority: Critical (was: Major) > ACLs on root directory may be lost after NN

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

2015-11-25 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027859#comment-15027859 ] Vinod Kumar Vavilapalli commented on HDFS-9426: --- [~vinayrpet], can you look at [~kihwal]'s

[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-11-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027857#comment-15027857 ] Chris Nauroth commented on HDFS-9273: - Yes, it's long-standing, so good to bring it into the

[jira] [Updated] (HDFS-9079) Erasure coding: preallocate multiple generation stamps and serialize updates from data streamers

2015-11-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9079?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9079: Attachment: HDFS-9079.14.patch Updating patch to fix a trivial NPE bug and the block token test failure. So

[jira] [Updated] (HDFS-9470) EncryptionZone on rootDir missing after NNrestart

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9470: Priority: Critical (was: Major) > EncryptionZone on rootDir missing after NNrestart >

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027925#comment-15027925 ] Hudson commented on HDFS-9467: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2667 (See

[jira] [Commented] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027923#comment-15027923 ] Hudson commented on HDFS-8512: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2667 (See

[jira] [Commented] (HDFS-9451) Clean up depreated umasks and related unit tests

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027924#comment-15027924 ] Hudson commented on HDFS-9451: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2667 (See

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027926#comment-15027926 ] Hudson commented on HDFS-9407: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2667 (See

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027245#comment-15027245 ] Hudson commented on HDFS-9438: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk #2664 (See

[jira] [Commented] (HDFS-9438) TestPipelinesFailover assumes Linux ifconfig

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027342#comment-15027342 ] Hudson commented on HDFS-9438: -- FAILURE: Integrated in Hadoop-Yarn-trunk #1454 (See

[jira] [Commented] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-25 Thread Chris Nauroth (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027376#comment-15027376 ] Chris Nauroth commented on HDFS-9459: - [~wheat9], thanks for the commit. > hadoop-hdfs-native-client

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027736#comment-15027736 ] Hadoop QA commented on HDFS-9210: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9457: -- Attachment: (was: Logging.diff) > Datanode Logging Improvement > > >

[jira] [Commented] (HDFS-9273) ACLs on root directory may be lost after NN restart

2015-11-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027833#comment-15027833 ] Andrew Wang commented on HDFS-9273: --- Should this fix be included in the 2.6 / 2.7 maintenance releases?

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027834#comment-15027834 ] Mingliang Liu commented on HDFS-9457: - Thanks for updating the patch. Please refer to page at:

[jira] [Commented] (HDFS-9445) Deadlock in datanode

2015-11-25 Thread Vinod Kumar Vavilapalli (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027854#comment-15027854 ] Vinod Kumar Vavilapalli commented on HDFS-9445: --- [~kihwal] / [~walter.k.su], I am holding off

[jira] [Commented] (HDFS-6363) Improve concurrency while checking inclusion and exclusion of datanodes

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027856#comment-15027856 ] Hadoop QA commented on HDFS-6363: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-11-25 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9214: Attachment: HDFS-9214.003.patch Thanks for [~arpitagarwal]'s reviews. I posted v003 patch to address

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027905#comment-15027905 ] Hadoop QA commented on HDFS-9381: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-11-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027787#comment-15027787 ] Andrew Wang commented on HDFS-9210: --- LGTM +1, though aren't {{lineSeparator}} and {{"%n"}} the same?

[jira] [Commented] (HDFS-9210) Fix some misuse of %n in VolumeScanner#printStats

2015-11-25 Thread Daniel Templeton (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9210?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027804#comment-15027804 ] Daniel Templeton commented on HDFS-9210: They are, but {{line separator()}} doesn't require string

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9457: -- Attachment: logging.patch > Datanode Logging Improvement > > >

[jira] [Commented] (HDFS-7435) PB encoding of block reports is very inefficient

2015-11-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027910#comment-15027910 ] Konstantin Shvachko commented on HDFS-7435: --- I agree this broke

[jira] [Commented] (HDFS-6363) Improve concurrency while checking inclusion and exclusion of datanodes

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6363?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027921#comment-15027921 ] Mingliang Liu commented on HDFS-6363: - +1 (non-binding) > Improve concurrency while checking inclusion

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027884#comment-15027884 ] Hudson commented on HDFS-9407: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1456 (See

[jira] [Commented] (HDFS-9451) Clean up depreated umasks and related unit tests

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027882#comment-15027882 ] Hudson commented on HDFS-9451: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1456 (See

[jira] [Commented] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027881#comment-15027881 ] Hudson commented on HDFS-8512: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1456 (See

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027883#comment-15027883 ] Hudson commented on HDFS-9467: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #1456 (See

[jira] [Commented] (HDFS-9381) When same block came for replication for Striped mode, we can move that block to PendingReplications

2015-11-25 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9381?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027903#comment-15027903 ] Zhe Zhang commented on HDFS-9381: - I agree that the scenario of _a new recovery task waiting for previous

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027919#comment-15027919 ] Mingliang Liu commented on HDFS-9214: - Overall looks good. Minor comments: # Any logging when

[jira] [Commented] (HDFS-9470) EncryptionZone on rootDir missing after NNrestart

2015-11-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027935#comment-15027935 ] Andrew Wang commented on HDFS-9470: --- Hi Xiao, thanks for picking this up, overall looks good. Only a few

[jira] [Commented] (HDFS-9470) EncryptionZone on rootDir missing after NNrestart

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027936#comment-15027936 ] Xiao Chen commented on HDFS-9470: - Figured I should also ping [~vinodkv] and [~sjlee0] like [~andrew.wang]

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027931#comment-15027931 ] Konstantin Shvachko commented on HDFS-9436: --- In {{BlockReportStats}} - {{numOpsRequired}} means

[jira] [Updated] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

2015-11-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-9470: -- Affects Version/s: 2.6.0 Summary: Encryption zone on root not loaded from fsimage after NN

[jira] [Updated] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9470: Attachment: HDFS-9470.002.patch > Encryption zone on root not loaded from fsimage after NN restart >

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9457: -- Attachment: logging.patch > Datanode Logging Improvement > > >

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9457: -- Attachment: (was: logging.patch) > Datanode Logging Improvement > > >

[jira] [Updated] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiao Chen updated HDFS-9470: Status: Patch Available (was: Open) > Encryption zone on root not loaded from fsimage after NN restart >

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

2015-11-25 Thread Andrew Wang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027989#comment-15027989 ] Andrew Wang commented on HDFS-9470: --- +1 LGTM pending jenkins > Encryption zone on root not loaded from

[jira] [Updated] (HDFS-9426) Rollingupgrade finalization is not backward compatible

2015-11-25 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9426: Resolution: Fixed Assignee: Kihwal Lee Hadoop Flags: Reviewed Fix Version/s:

[jira] [Commented] (HDFS-9214) Reconfigure DN concurrent move on the fly

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028131#comment-15028131 ] Hadoop QA commented on HDFS-9214: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-25 Thread Konstantin Shvachko (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Konstantin Shvachko updated HDFS-9436: -- Target Version/s: 2.8.0 Fix Version/s: (was: 2.8.0) > Make

[jira] [Commented] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027969#comment-15027969 ] Hudson commented on HDFS-8512: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #644 (See

[jira] [Commented] (HDFS-9451) Clean up depreated umasks and related unit tests

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027970#comment-15027970 ] Hudson commented on HDFS-9451: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #644 (See

[jira] [Updated] (HDFS-9445) Deadlock in datanode

2015-11-25 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9445: Attachment: HDFS-9445.01.patch Sorry for late update. Let's get it done. {code} // If a DFSClient has the

[jira] [Updated] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-11-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Trezzo updated HDFS-8791: --- Attachment: 32x32DatanodeLayoutTesting-v2.pdf > block ID-based DN storage layout can be very slow for

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9457: -- Attachment: logging.patch > Datanode Logging Improvement > > >

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027949#comment-15027949 ] Xiao Chen commented on HDFS-9470: - Thanks a lot [~andrew.wang] for the review and setting target versions.

[jira] [Updated] (HDFS-9129) Move the safemode block count into BlockManager

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9129?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-9129: Attachment: HDFS-9129.024.patch Per offline discussion with [~jingzhao], the v24 patch removes the

[jira] [Updated] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] BELUGA BEHR updated HDFS-9457: -- Attachment: (was: logging.patch) > Datanode Logging Improvement > > >

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027985#comment-15027985 ] Hudson commented on HDFS-9467: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #725 (See

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027986#comment-15027986 ] Hudson commented on HDFS-9407: -- FAILURE: Integrated in Hadoop-Mapreduce-trunk-Java8 #725 (See

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

2015-11-25 Thread Chris Trezzo (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027993#comment-15027993 ] Chris Trezzo commented on HDFS-8791: Thanks all for the comments. [~cmccabe] bq. how long did these

[jira] [Commented] (HDFS-9436) Make NNThroughputBenchmark$BlockReportStats run with 10 datanodes by default

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027999#comment-15027999 ] Mingliang Liu commented on HDFS-9436: - Thank you very much for the detailed explanation. This is very

[jira] [Updated] (HDFS-9445) Deadlock in datanode

2015-11-25 Thread Walter Su (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Walter Su updated HDFS-9445: Status: Patch Available (was: Open) > Deadlock in datanode > > > Key:

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028042#comment-15028042 ] Hudson commented on HDFS-9467: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #736 (See

[jira] [Commented] (HDFS-9470) Encryption zone on root not loaded from fsimage after NN restart

2015-11-25 Thread Xiao Chen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9470?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028064#comment-15028064 ] Xiao Chen commented on HDFS-9470: - Thanks Andrew. Also answering the question asked in HDFS-9273: this one

[jira] [Commented] (HDFS-9449) DiskBalancer : Add connectors

2015-11-25 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9449?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028071#comment-15028071 ] Hadoop QA commented on HDFS-9449: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9426) Rollingupgrade finalization is not backward compatible

2015-11-25 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9426?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028130#comment-15028130 ] Vinayakumar B commented on HDFS-9426: - +1 for the patch, Committing > Rollingupgrade finalization is

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027958#comment-15027958 ] BELUGA BEHR commented on HDFS-9457: --- New patch supplied. Sorry. I am aware of the feature, however, the

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread BELUGA BEHR (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027957#comment-15027957 ] BELUGA BEHR commented on HDFS-9457: --- New patch supplied. Sorry. I am aware of the feature, however, the

[jira] [Commented] (HDFS-9457) Datanode Logging Improvement

2015-11-25 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9457?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027972#comment-15027972 ] Mingliang Liu commented on HDFS-9457: - Instead of deleting the previous patch and upload a new one with

[jira] [Commented] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027971#comment-15027971 ] Hudson commented on HDFS-9459: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #644 (See

[jira] [Commented] (HDFS-9451) Clean up depreated umasks and related unit tests

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028030#comment-15028030 ] Hudson commented on HDFS-9451: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2581 (See

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028033#comment-15028033 ] Hudson commented on HDFS-9407: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2581 (See

[jira] [Commented] (HDFS-9467) Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028032#comment-15028032 ] Hudson commented on HDFS-9467: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2581 (See

[jira] [Commented] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028031#comment-15028031 ] Hudson commented on HDFS-9459: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2581 (See

[jira] [Commented] (HDFS-8512) WebHDFS : GETFILESTATUS should return LocatedBlock with storage type info

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028029#comment-15028029 ] Hudson commented on HDFS-8512: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2581 (See

[jira] [Commented] (HDFS-9407) TestFileTruncate fails with BindException

2015-11-25 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15028043#comment-15028043 ] Hudson commented on HDFS-9407: -- FAILURE: Integrated in Hadoop-Yarn-trunk-Java8 #736 (See

[jira] [Updated] (HDFS-9459) hadoop-hdfs-native-client fails test build on Windows after transition to ctest.

2015-11-25 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9459?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9459: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9452) libhdfs++ Fix memory stomp in OpenFileForRead.

2015-11-25 Thread Bob Hansen (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15027329#comment-15027329 ] Bob Hansen commented on HDFS-9452: -- +1 If we want to extract all the elements at once, std::tie is a nice

  1   2   >