[jira] [Commented] (HDFS-9799) Reimplement getCurrentTrashDir to remove incompatibility

[ https://issues.apache.org/jira/browse/HDFS-9799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148193#comment-15148193 ] Xiaoyu Yao commented on HDFS-9799: -- Thanks [~zhz] for reporting the issue and working on t

[jira] [Created] (HDFS-9816) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3]

Rui Li created HDFS-9816: Summary: Erasure Coding: allow to use multiple EC policies in striping related tests [Part 3] Key: HDFS-9816 URL: https://issues.apache.org/jira/browse/HDFS-9816 Project: Hadoop HDFS

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148176#comment-15148176 ] Hadoop QA commented on HDFS-9734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-9815: - Priority: Blocker (was: Major) > Move o.a.h.fs.Hdfs to hadoop-hdfs-client > --

[jira] [Commented] (HDFS-9812) Streamer threads leak if failure happens when closing the dfsoutputstream

[ https://issues.apache.org/jira/browse/HDFS-9812?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148131#comment-15148131 ] Lin Yiqun commented on HDFS-9812: - All the test are passed, the fix looks fine to the curre

[jira] [Commented] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-9815?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148132#comment-15148132 ] Haohui Mai commented on HDFS-9815: -- Marking this as a blocker of 2.8.0 as it prevents down

[jira] [Created] (HDFS-9815) Move o.a.h.fs.Hdfs to hadoop-hdfs-client

Haohui Mai created HDFS-9815: Summary: Move o.a.h.fs.Hdfs to hadoop-hdfs-client Key: HDFS-9815 URL: https://issues.apache.org/jira/browse/HDFS-9815 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-9603) Erasure Coding: Use ErasureCoder to encode/decode a block group

[ https://issues.apache.org/jira/browse/HDFS-9603?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148127#comment-15148127 ] Kai Zheng commented on HDFS-9603: - Thanks for the discussion, [~zhz] and [~kaisasak]! bq. C

[jira] [Commented] (HDFS-7766) Add a flag to WebHDFS op=CREATE to not respond with a 307 redirect

[ https://issues.apache.org/jira/browse/HDFS-7766?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148122#comment-15148122 ] Haohui Mai commented on HDFS-7766: -- Uploading the files to HDFS is a valid use case. Wha

[jira] [Updated] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9733: Attachment: HDFS-9733-v3.patch Updated the patch to address some reported issues. > Refactor DFSClient#getFi

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HDFS-9734-v6.patch Fixed one minor check style. > Refactoring of checksum failure report related

[jira] [Commented] (HDFS-9755) Erasure Coding: allow to use multiple EC policies in striping related tests [Part 2]

[ https://issues.apache.org/jira/browse/HDFS-9755?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15148010#comment-15148010 ] Rui Li commented on HDFS-9755: -- Thanks Zhe for reviewing and committing the patch. > Erasure

[jira] [Commented] (HDFS-9710) Change DN to send block receipt IBRs in batches

[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147876#comment-15147876 ] Hadoop QA commented on HDFS-9710: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9671) DiskBalancer : SubmitPlan implementation

[ https://issues.apache.org/jira/browse/HDFS-9671?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147838#comment-15147838 ] Lei (Eddy) Xu commented on HDFS-9671: - +1. Thanks [~anu]! > DiskBalancer : SubmitPlan

[jira] [Commented] (HDFS-9607) Advance Hadoop Architecture (AHA) - HDFS Update (write-in-place)

[ https://issues.apache.org/jira/browse/HDFS-9607?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147788#comment-15147788 ] Dinesh S. Atreya commented on HDFS-9607: Recording that the implementation in HDFS-

[jira] [Commented] (HDFS-9814) Advance Hadoop Architecture (AHA) - HDFS Block Level Leases (Locks)

[ https://issues.apache.org/jira/browse/HDFS-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147782#comment-15147782 ] Dinesh S. Atreya commented on HDFS-9814: Recording that the implementation in HDFS

[jira] [Commented] (HDFS-5477) Block manager as a service

[ https://issues.apache.org/jira/browse/HDFS-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147778#comment-15147778 ] Dinesh S. Atreya commented on HDFS-5477: Note that *HDFS Block Level Leases (Locks)

[jira] [Commented] (HDFS-9814) Advance Hadoop Architecture (AHA) - HDFS Block Level Leases (Locks)

[ https://issues.apache.org/jira/browse/HDFS-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147775#comment-15147775 ] Dinesh S. Atreya commented on HDFS-9814: Having Block Level Leases functionality w

[jira] [Commented] (HDFS-9814) Advance Hadoop Architecture (AHA) - HDFS Block Level Leases (Locks)

[ https://issues.apache.org/jira/browse/HDFS-9814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147769#comment-15147769 ] Dinesh S. Atreya commented on HDFS-9814: This depends on Block Manager as a Servic

[jira] [Created] (HDFS-9814) Advance Hadoop Architecture (AHA) - HDFS Block Level Leases (Locks)

Dinesh S. Atreya created HDFS-9814: -- Summary: Advance Hadoop Architecture (AHA) - HDFS Block Level Leases (Locks) Key: HDFS-9814 URL: https://issues.apache.org/jira/browse/HDFS-9814 Project: Hadoop H

[jira] [Commented] (HDFS-9796) Add throttler for datanode bandwidth

[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147737#comment-15147737 ] Inigo Goiri commented on HDFS-9796: --- As [~wheat9] points out, It looks like this approach

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147731#comment-15147731 ] Hadoop QA commented on HDFS-8578: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9549) TestCacheDirectives#testExceedsCapacity is flaky

[ https://issues.apache.org/jira/browse/HDFS-9549?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147688#comment-15147688 ] Xiao Chen commented on HDFS-9549: - Thank you for the comment, and nicely summarizing the ro

[jira] [Commented] (HDFS-9796) Add throttler for datanode bandwidth

[ https://issues.apache.org/jira/browse/HDFS-9796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147648#comment-15147648 ] Arpit Agarwal commented on HDFS-9796: - Can you help explain the use case? Also please h

[jira] [Commented] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147560#comment-15147560 ] Hadoop QA commented on HDFS-9733: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Updated] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8578: -- Attachment: h8578_20160216.patch h8578_20160216.patch: sync'ed with trunk. > On upgrade,

[jira] [Commented] (HDFS-8578) On upgrade, Datanode should process all storage/data dirs in parallel

[ https://issues.apache.org/jira/browse/HDFS-8578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147551#comment-15147551 ] Tsz Wo Nicholas Sze commented on HDFS-8578: --- > ... we change the order of executi

[jira] [Updated] (HDFS-9710) Change DN to send block receipt IBRs in batches

[ https://issues.apache.org/jira/browse/HDFS-9710?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-9710: -- Attachment: h9710_20160216.patch Many existing tests assume that datanodes send block rec

[jira] [Commented] (HDFS-8791) block ID-based DN storage layout can be very slow for datanode on ext4

[ https://issues.apache.org/jira/browse/HDFS-8791?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147523#comment-15147523 ] Allen Wittenauer commented on HDFS-8791: bq. Attaching a patch that includes the ta

[jira] [Commented] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147409#comment-15147409 ] Hadoop QA commented on HDFS-9734: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9556) libhdfs++: pull Options from default configs by default

[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147402#comment-15147402 ] Hadoop QA commented on HDFS-9556: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Commented] (HDFS-9792) libhdfs++: EACCES not setting errno correctly

[ https://issues.apache.org/jira/browse/HDFS-9792?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147398#comment-15147398 ] Hadoop QA commented on HDFS-9792: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||

[jira] [Assigned] (HDFS-9791) libhfds++: ConfigurationLoader throws parse_exception on invalid input

[ https://issues.apache.org/jira/browse/HDFS-9791?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-9791: Assignee: Bob Hansen > libhfds++: ConfigurationLoader throws parse_exception on invalid input >

[jira] [Updated] (HDFS-9792) libhdfs++: EACCES not setting errno correctly

[ https://issues.apache.org/jira/browse/HDFS-9792?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9792: - Attachment: HDFS-9792.HDFS-8707.000.patch Resubmitting; I suspect the previous failure was spurious. > lib

[jira] [Updated] (HDFS-9556) libhdfs++: pull Options from default configs by default

[ https://issues.apache.org/jira/browse/HDFS-9556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen updated HDFS-9556: - Attachment: HDFS-9556.HDFS-8707.002.patch Implements gluing Configs to Options in the builder. Note that t

[jira] [Assigned] (HDFS-8707) Implement an async pure c++ HDFS client

[ https://issues.apache.org/jira/browse/HDFS-8707?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bob Hansen reassigned HDFS-8707: Assignee: Bob Hansen (was: Xiaobing Zhou) > Implement an async pure c++ HDFS client > -

[jira] [Commented] (HDFS-8509) Move to tomcat 8.0.21 to support different passwords for key and keystore on HTTPFS using SSL

[ https://issues.apache.org/jira/browse/HDFS-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147288#comment-15147288 ] Steve Loughran commented on HDFS-8509: -- Wellington, Updating versions of things is so

[jira] [Commented] (HDFS-8509) Move to tomcat 8.0.21 to support different passwords for key and keystore on HTTPFS using SSL

[ https://issues.apache.org/jira/browse/HDFS-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147282#comment-15147282 ] Steve Loughran commented on HDFS-8509: -- Linking to HADOOP-9991 and especially the HADO

[jira] [Updated] (HDFS-8509) Move to tomcat 8.0.21 to support different passwords for key and keystore on HTTPFS using SSL

[ https://issues.apache.org/jira/browse/HDFS-8509?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Steve Loughran updated HDFS-8509: - Component/s: build Summary: Move to tomcat 8.0.21 to support different passwords for key an

[jira] [Updated] (HDFS-9733) Refactor DFSClient#getFileChecksum and DataXceiver#blockChecksum

[ https://issues.apache.org/jira/browse/HDFS-9733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9733: Attachment: HDFS-9733-v2.patch Updated the patch adding missed files. > Refactor DFSClient#getFileChecksum a

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HDFS-9734-v5.patch Uploaded HDFS-9734-v5.patch using the correct issue ID. > Refactoring of chec

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: (was: HADOOP-12744-v3.patch) > Refactoring of checksum failure report related codes > ---

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HADOOP-12744-v3.patch > Refactoring of checksum failure report related codes > --

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: (was: HADOOP-12744-v2.patch) > Refactoring of checksum failure report related codes > ---

[jira] [Updated] (HDFS-9734) Refactoring of checksum failure report related codes

[ https://issues.apache.org/jira/browse/HDFS-9734?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-9734: Attachment: HADOOP-12744-v2.patch Thanks Zhe for the review. Updated the patch accordingly. > Refactoring of

[jira] [Commented] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147164#comment-15147164 ] Hudson commented on HDFS-9765: -- FAILURE: Integrated in Hadoop-trunk-Commit #9306 (See [https:

[jira] [Updated] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akira AJISAKA updated HDFS-9765: Resolution: Fixed Hadoop Flags: Reviewed Fix Version/s: 2.7.3 2.8.0

[jira] [Commented] (HDFS-9765) TestBlockScanner#testVolumeIteratorWithCaching fails intermittently

[ https://issues.apache.org/jira/browse/HDFS-9765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147139#comment-15147139 ] Masatake Iwasaki commented on HDFS-9765: +1. {{TestBlockScanner#testVolumeIteratorW

[jira] [Commented] (HDFS-9476) TestDFSUpgradeFromImage#testUpgradeFromRel1BBWImage occasionally fail

[ https://issues.apache.org/jira/browse/HDFS-9476?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15147079#comment-15147079 ] Hadoop QA commented on HDFS-9476: - | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote ||