[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150051#comment-15150051 ] Hadoop QA commented on HDFS-9349: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9819) FsVolume should tolerate few times check-dir failed due to deletion by mistake

2016-02-16 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9819: Status: Patch Available (was: Open) Attach a initial patch. Add a failed count in fsVolume, default

[jira] [Updated] (HDFS-9819) FsVolume should tolerate few times check-dir failed due to deletion by mistake

2016-02-16 Thread Lin Yiqun (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lin Yiqun updated HDFS-9819: Attachment: HDFS-9819.001.patch > FsVolume should tolerate few times check-dir failed due to deletion by

[jira] [Created] (HDFS-9819) FsVolume should tolerate few times check-dir failed due to deletion by mistake

2016-02-16 Thread Lin Yiqun (JIRA)
Lin Yiqun created HDFS-9819: --- Summary: FsVolume should tolerate few times check-dir failed due to deletion by mistake Key: HDFS-9819 URL: https://issues.apache.org/jira/browse/HDFS-9819 Project: Hadoop

[jira] [Assigned] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2016-02-16 Thread Manjunath Ballur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manjunath Ballur reassigned HDFS-6832: -- Assignee: Manjunath Ballur (was: skrho) > Fix the usage of 'hdfs namenode' command >

[jira] [Commented] (HDFS-8564) BlockPoolSlice.checkDirs() will trigger excessive IO while traversing all sub-directories under finalizedDir

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8564?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150020#comment-15150020 ] Vinayakumar B commented on HDFS-8564: - Since HDFS-8845 is in, which actually addresses solution #1 in

[jira] [Commented] (HDFS-8845) DiskChecker should not traverse the entire tree

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8845?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15150018#comment-15150018 ] Vinayakumar B commented on HDFS-8845: - Do any body thinks this should be merged to 2.7 and 2.6? cc.

[jira] [Commented] (HDFS-6795) docs update for -format command for namenode for Federation ( HDFS-1394 )

2016-02-16 Thread Manjunath Ballur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6795?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149976#comment-15149976 ] Manjunath Ballur commented on HDFS-6795: The documentation here:

[jira] [Commented] (HDFS-9710) Change DN to send block receipt IBRs in batches

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149917#comment-15149917 ] Hadoop QA commented on HDFS-9710: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-02-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149902#comment-15149902 ] Xiaobing Zhou commented on HDFS-9349: - Posted patch V003. Thanks [~liuml07]. > Support reconfiguring

[jira] [Updated] (HDFS-9349) Support reconfiguring fs.protected.directories without NN restart

2016-02-16 Thread Xiaobing Zhou (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaobing Zhou updated HDFS-9349: Attachment: HDFS-9349-HDFS-9000.003.patch > Support reconfiguring fs.protected.directories without

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149898#comment-15149898 ] Hudson commented on HDFS-9787: -- FAILURE: Integrated in Hadoop-trunk-Commit #9310 (See

[jira] [Updated] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9787: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 3.0.0 Status: Resolved

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149865#comment-15149865 ] Vinayakumar B commented on HDFS-9787: - Will commit the latest patch soon. > SNNs stop uploading

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149861#comment-15149861 ] Vinayakumar B commented on HDFS-9787: - :) > SNNs stop uploading FSImage to ANN once

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149822#comment-15149822 ] Vinayakumar B commented on HDFS-9395: - Thanks [~kshukla]. I got the Chris` point. We can skip success

[jira] [Updated] (HDFS-9456) BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement

2016-02-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junping Du updated HDFS-9456: - Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.8.0 Status: Resolved

[jira] [Commented] (HDFS-9456) BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement

2016-02-16 Thread Hudson (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149755#comment-15149755 ] Hudson commented on HDFS-9456: -- FAILURE: Integrated in Hadoop-trunk-Commit #9308 (See

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-02-16 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149710#comment-15149710 ] Kai Zheng commented on HDFS-9603: - bq. So could you check it when you are available? Kai Sasaki, thanks for

[jira] [Commented] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149700#comment-15149700 ] Hadoop QA commented on HDFS-9805: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149691#comment-15149691 ] Rui Li commented on HDFS-9816: -- Thanks Zhe for the review. {{TestLeaseRecoveryStriped}} failed because of

[jira] [Updated] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-9818: Attachment: HDFS-9818.000.patch Upload a preliminary patch. Still need to add several unit tests. >

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-02-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149672#comment-15149672 ] Jing Zhao commented on HDFS-9603: - Thanks for volunteering on the hflush/hsync work, [~lewuathe]! So far we

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

2016-02-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149668#comment-15149668 ] Arpit Agarwal commented on HDFS-9817: - Hi [~jojochuang], this was just for fixing new classes added as

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-02-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149666#comment-15149666 ] Kai Sasaki commented on HDFS-9603: -- I can help hflush/hsync task if necessary. All tasks about

[jira] [Commented] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9818?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149664#comment-15149664 ] Jing Zhao commented on HDFS-9818: - After debugging the issue, the {{HadoopIllegalArgumentException}} was

[jira] [Created] (HDFS-9818) Correctly handle EC reconstruction work caused by not enough racks

2016-02-16 Thread Jing Zhao (JIRA)
Jing Zhao created HDFS-9818: --- Summary: Correctly handle EC reconstruction work caused by not enough racks Key: HDFS-9818 URL: https://issues.apache.org/jira/browse/HDFS-9818 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9817) Use SLF4J in new classes

2016-02-16 Thread Wei-Chiu Chuang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149645#comment-15149645 ] Wei-Chiu Chuang commented on HDFS-9817: --- Hi [~arpitagarwal] thanks for proposing this. I have one

[jira] [Commented] (HDFS-3447) StandbyException should not be logged at ERROR level on server

2016-02-16 Thread Lei (Eddy) Xu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-3447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149614#comment-15149614 ] Lei (Eddy) Xu commented on HDFS-3447: - Hi, [~daryn] Any updates on this? > StandbyException should

[jira] [Updated] (HDFS-8020) Erasure Coding: constructing and mapping BlockGroup info to utilize and call ErasureCoder API

2016-02-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8020: - Status: Open (was: Patch Available) > Erasure Coding: constructing and mapping BlockGroup info to utilize

[jira] [Updated] (HDFS-8020) Erasure Coding: constructing and mapping BlockGroup info to utilize and call ErasureCoder API

2016-02-16 Thread Kai Sasaki (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Sasaki updated HDFS-8020: - Status: Patch Available (was: Open) > Erasure Coding: constructing and mapping BlockGroup info to utilize

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-02-16 Thread Kai Zheng (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149586#comment-15149586 ] Kai Zheng commented on HDFS-9603: - bq. Agreed that checksum is an important perspective before release.

[jira] [Comment Edited] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-02-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149570#comment-15149570 ] Arpit Agarwal edited comment on HDFS-9671 at 2/17/16 12:29 AM: --- Hi [~anu], my

[jira] [Commented] (HDFS-9671) DiskBalancer : SubmitPlan implementation

2016-02-16 Thread Arpit Agarwal (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149570#comment-15149570 ] Arpit Agarwal commented on HDFS-9671: - Hi [~anu], my apologies for the late review. #

[jira] [Commented] (HDFS-9810) Allow support for more than one block replica per datanode

2016-02-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149565#comment-15149565 ] Zhe Zhang commented on HDFS-9810: - Thanks clarifying this Chris. Makes sense to me. > Allow support for

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

2016-02-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149554#comment-15149554 ] Zhe Zhang commented on HDFS-9603: - Thanks for the update [~drankye]. I think we are on the same page that

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149553#comment-15149553 ] Hadoop QA commented on HDFS-9816: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149539#comment-15149539 ] Zhe Zhang commented on HDFS-9816: - Thanks Rui for the work. The patch LGTM overall. Pinging [~walter.k.su]

[jira] [Commented] (HDFS-9810) Allow support for more than one block replica per datanode

2016-02-16 Thread Chris Douglas (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149475#comment-15149475 ] Chris Douglas commented on HDFS-9810: - Agreed, HDFS-9806 will have a feature branch. This was raised a

[jira] [Created] (HDFS-9817) Use SLF4J in new classes

2016-02-16 Thread Arpit Agarwal (JIRA)
Arpit Agarwal created HDFS-9817: --- Summary: Use SLF4J in new classes Key: HDFS-9817 URL: https://issues.apache.org/jira/browse/HDFS-9817 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-9710) Change DN to send block receipt IBRs in batches

2016-02-16 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9710: -- Description: When a DN has received a block, it immediately sends a block receipt IBR

[jira] [Updated] (HDFS-9710) Change DN to send block receipt IBRs in batches

2016-02-16 Thread Tsz Wo Nicholas Sze (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9710: -- Attachment: h9710_20160216b.patch h9710_20160216b.patch: fixes a bug. > Change DN to

[jira] [Commented] (HDFS-7955) Improve naming of classes, methods, and variables related to block replication and recovery

2016-02-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7955?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149406#comment-15149406 ] Zhe Zhang commented on HDFS-7955: - Thanks Rakesh for taking the lead. I took a look at the {{Replication}}

[jira] [Commented] (HDFS-7964) Add support for async edit logging

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149395#comment-15149395 ] Hadoop QA commented on HDFS-7964: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-16 Thread Jesse Yates (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149389#comment-15149389 ] Jesse Yates commented on HDFS-9787: --- Yeah, that's fine. As long as the committer is happy, I'm happy. >

[jira] [Commented] (HDFS-9787) SNNs stop uploading FSImage to ANN once isPrimaryCheckPointer changed to false.

2016-02-16 Thread Inigo Goiri (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9787?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149368#comment-15149368 ] Inigo Goiri commented on HDFS-9787: --- The latest version looks good to me. I agree with [~vinayrpet] on

[jira] [Updated] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-9816: Status: Patch Available (was: Open) > Erasure Coding: allow to use multiple EC policies in striping related

[jira] [Commented] (HDFS-9796) Add throttler for datanode bandwidth

2016-02-16 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149353#comment-15149353 ] Guocui Mi commented on HDFS-9796: - We need a protection mechanism to avoid overloading DNs. Canceled the

[jira] [Updated] (HDFS-9796) Add throttler for datanode bandwidth

2016-02-16 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guocui Mi updated HDFS-9796: Status: Open (was: Patch Available) > Add throttler for datanode bandwidth >

[jira] [Commented] (HDFS-9796) Add throttler for datanode bandwidth

2016-02-16 Thread Guocui Mi (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149347#comment-15149347 ] Guocui Mi commented on HDFS-9796: - Thanks Haohui, will test if HDFS 7270 can solve our issue. > Add

[jira] [Commented] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149336#comment-15149336 ] Hadoop QA commented on HDFS-9521: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-02-16 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Helmling updated HDFS-9805: Status: Patch Available (was: Open) > TCP_NODELAY not set before SASL handshake in data transfer

[jira] [Updated] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-02-16 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gary Helmling updated HDFS-9805: Attachment: HDFS-9805.001.patch Attaching a very simple patch for trunk, which always sets

[jira] [Commented] (HDFS-9805) TCP_NODELAY not set before SASL handshake in data transfer pipeline

2016-02-16 Thread Gary Helmling (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9805?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149314#comment-15149314 ] Gary Helmling commented on HDFS-9805: - In trunk, it looks like there is an additional location where

[jira] [Commented] (HDFS-9810) Allow support for more than one block replica per datanode

2016-02-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9810?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149232#comment-15149232 ] Zhe Zhang commented on HDFS-9810: - [~chris.douglas] / [~virajith] I had a similar confusion when seeing

[jira] [Commented] (HDFS-9803) Proactively refresh ShortCircuitCache entries to avoid latency spikes

2016-02-16 Thread Colin Patrick McCabe (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9803?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149160#comment-15149160 ] Colin Patrick McCabe commented on HDFS-9803: Hmm, interesting. Why do we need a background

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

2016-02-16 Thread Haohui Mai (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149137#comment-15149137 ] Haohui Mai commented on HDFS-7766: -- Sorry for the confusion. In your patch the POST request will be

[jira] [Updated] (HDFS-8763) After file closed, a race condition between IBR of 3rd replica of lastBlock and ReplicationMonitor

2016-02-16 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-8763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8763: --- Description: - For our cluster, the NameNode is always very busy, so for every incremental block

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-16 Thread Mingliang Liu (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149102#comment-15149102 ] Mingliang Liu commented on HDFS-9815: - The change is straightforward for me to +1 (non-binding). >

[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

2016-02-16 Thread Zhe Zhang (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149097#comment-15149097 ] Zhe Zhang commented on HDFS-9799: - Thanks [~xyao] for the discussion. {{FSNamesystem#getEZForPath}} gets

[jira] [Updated] (HDFS-7964) Add support for async edit logging

2016-02-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7964?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7964: Attachment: HDFS-7964-rebase.patch There are actually another "//if(LOG.isDebugEnabled)" in the patch.

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

2016-02-16 Thread Ravi Prakash (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149066#comment-15149066 ] Ravi Prakash commented on HDFS-7766: Thanks for your comment Haohui! bq. the new behavior might block

[jira] [Commented] (HDFS-9711) Integrate CSRF prevention filter in WebHDFS.

2016-02-16 Thread Jing Zhao (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9711?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15149046#comment-15149046 ] Jing Zhao commented on HDFS-9711: - Thanks for working on this, [~cnauroth]! The patch looks good to me. +1

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-02-16 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-9521: --- Status: Patch Available (was: In Progress) > TransferFsImage.receiveFile should

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-02-16 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-9521: --- Attachment: HDFS-9521-3.patch Removed the new line on the log message. Inserting the

[jira] [Updated] (HDFS-9521) TransferFsImage.receiveFile should account and log separate times for image download and fsync to disk

2016-02-16 Thread Wellington Chevreuil (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil updated HDFS-9521: --- Status: In Progress (was: Patch Available) > TransferFsImage.receiveFile should

[jira] [Updated] (HDFS-1644) HDFS Client initialize SecurityAudit.audit log file

2016-02-16 Thread David McWhorter (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David McWhorter updated HDFS-1644: -- Assignee: (was: David McWhorter) > HDFS Client initialize SecurityAudit.audit log file >

[jira] [Assigned] (HDFS-1644) HDFS Client initialize SecurityAudit.audit log file

2016-02-16 Thread David McWhorter (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-1644?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David McWhorter reassigned HDFS-1644: - Assignee: David McWhorter > HDFS Client initialize SecurityAudit.audit log file >

[jira] [Commented] (HDFS-9395) Make HDFS audit logging consistant

2016-02-16 Thread Kuhu Shukla (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148769#comment-15148769 ] Kuhu Shukla commented on HDFS-9395: --- [~kihwal], [~cnauroth], [~vinayrpet], Requesting for comments on

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148649#comment-15148649 ] Hadoop QA commented on HDFS-9815: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-6832) Fix the usage of 'hdfs namenode' command

2016-02-16 Thread Manjunath Ballur (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-6832?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148573#comment-15148573 ] Manjunath Ballur commented on HDFS-6832: I checked the code in trunk. This has been fixed, except

[jira] [Commented] (HDFS-9456) BlockPlacementPolicyWithNodeGroup should override verifyBlockPlacement

2016-02-16 Thread Junping Du (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9456?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148467#comment-15148467 ] Junping Du commented on HDFS-9456: -- Thanks [~xiaobingo] for updating the patch. The patch looks pretty

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9815: Status: Patch Available (was: Open) > Move o.a.h.fs.Hdfs to hadoop-hdfs-client >

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-9815: Attachment: HDFS-9815-01.patch Attaching patch for moving all AbstractFileSystem impls > Move

[jira] [Commented] (HDFS-7452) Can we skip getCorruptFiles() call for standby NameNode..?

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-7452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148399#comment-15148399 ] Vinayakumar B commented on HDFS-7452: - Patch seems to be Okay, except the checkstyle comment. +1 once

[jira] [Commented] (HDFS-9425) Expose number of blocks per volume as a metric

2016-02-16 Thread Vinayakumar B (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148395#comment-15148395 ] Vinayakumar B commented on HDFS-9425: - +1 for latest patch. Will commit later tomorrow if no comments

[jira] [Updated] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

2016-02-16 Thread Rui Li (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9816?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Li updated HDFS-9816: - Attachment: HDFS-9816.1.patch {{TestStripedINodeFile}} and {{TestFSImage}} don't have all the changes in

[jira] [Commented] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

2016-02-16 Thread Hadoop QA (JIRA)
[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15148246#comment-15148246 ] Hadoop QA commented on HDFS-9733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||