[jira] [Updated] (HDFS-8201) Add an end to end test for stripping file writing and reading

[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8201: -- Status: Patch Available (was: In Progress) > Add an end to end test for stripping file writing and readi

[jira] [Updated] (HDFS-8202) Improve end to end stirpping file test to add erasure recovering test

[ https://issues.apache.org/jira/browse/HDFS-8202?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8202: -- Attachment: HDFS-8202.002.patch Update patch with the latest branch-7285. > Improve end to end stirpping

[jira] [Commented] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539391#comment-14539391 ] Kai Zheng commented on HDFS-8294: - Would be good to have a more review from other guy and g

[jira] [Updated] (HDFS-8201) Add an end to end test for stripping file writing and reading

[ https://issues.apache.org/jira/browse/HDFS-8201?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-8201: -- Attachment: HDFS-8201-HDFS-7285.004.patch Update patch with the latest branch-7285. > Add an end to end

[jira] [Commented] (HDFS-8062) Remove hard-coded values in favor of EC schema

[ https://issues.apache.org/jira/browse/HDFS-8062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539372#comment-14539372 ] Kai Zheng commented on HDFS-8062: - Looks like even we have HDFS-8367, the left work here ma

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539370#comment-14539370 ] Hudson commented on HDFS-8362: -- FAILURE: Integrated in Hadoop-trunk-Commit #7802 (See [https:

[jira] [Updated] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8362: Resolution: Fixed Hadoop Flags: Reviewed Status: Resolved (was: Patch Available) Com

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539365#comment-14539365 ] Kai Sasaki commented on HDFS-8367: -- Thank you for quick response. I'll check [HDFS-8347|h

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539358#comment-14539358 ] Kai Zheng commented on HDFS-8367: - Hi [~kaisasak], I'm sorry on this. As there is some on

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539354#comment-14539354 ] Vinayakumar B commented on HDFS-8362: - +1 on latest patch to just to rename the package

[jira] [Commented] (HDFS-8193) Add the ability to delay replica deletion for a period of time

[ https://issues.apache.org/jira/browse/HDFS-8193?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539355#comment-14539355 ] Zhe Zhang commented on HDFS-8193: - bq. I have seen many customers running at 90% plus and s

[jira] [Updated] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java

[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-8362: Summary: Java Compilation Error in TestHdfsConfigFields.java (was: Java Compilation Error in TestHdf

[jira] [Commented] (HDFS-8367) BlockInfoStriped can also receive schema at its creation

[ https://issues.apache.org/jira/browse/HDFS-8367?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539350#comment-14539350 ] Kai Sasaki commented on HDFS-8367: -- [~drankye] Could you check this patch? > BlockInfoSt

[jira] [Commented] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539339#comment-14539339 ] Takanobu Asanuma commented on HDFS-8238: Thank you very much for your support, [~w

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539298#comment-14539298 ] Vinayakumar B commented on HDFS-8347: - bq. as cellSize can be set per file opposed to E

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539295#comment-14539295 ] Vinayakumar B commented on HDFS-8347: - Created two subtasks HDFS-8374 and HDFS-8375.

[jira] [Created] (HDFS-8375) Add cellSize as an XAttr to ECZone

Vinayakumar B created HDFS-8375: --- Summary: Add cellSize as an XAttr to ECZone Key: HDFS-8375 URL: https://issues.apache.org/jira/browse/HDFS-8375 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539288#comment-14539288 ] Kai Zheng commented on HDFS-8347: - Thanks [~vinayrpet] for the comments! bq. cellsize has t

[jira] [Commented] (HDFS-8361) Choose SSD over DISK in block placement

[ https://issues.apache.org/jira/browse/HDFS-8361?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539290#comment-14539290 ] Joe Pallas commented on HDFS-8361: -- There's a typo in the test name. The test verifies th

[jira] [Created] (HDFS-8374) Remove chunkSize from ECSchema as its not required for coders

Vinayakumar B created HDFS-8374: --- Summary: Remove chunkSize from ECSchema as its not required for coders Key: HDFS-8374 URL: https://issues.apache.org/jira/browse/HDFS-8374 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539281#comment-14539281 ] Vinayakumar B commented on HDFS-8347: - I understand from the above discussion that {{ch

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java and TestMapreduceConfigFields.java

[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539265#comment-14539265 ] Vinayakumar B commented on HDFS-8362: - HDFS-8371 is the result of the test. (which is w

[jira] [Commented] (HDFS-8255) Rename getBlockReplication to getPreferredBlockReplication

[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539259#comment-14539259 ] Yi Liu commented on HDFS-8255: -- Thanks Zhe for rebase, I will commit after passing a fresh Jen

[jira] [Updated] (HDFS-8255) Rename getBlockReplication to getPreferredBlockReplication

[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8255: Attachment: HDFS-8255.002.patch Thanks Yi for reviewing! Attaching rebased 002 patch. > Rename getBlockRepli

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaoyu Yao updated HDFS-7608: - Labels: (was: BB2015-05-TBR patch) > hdfs dfsclient newConnectedPeer has no write timeout >

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539239#comment-14539239 ] Xiaoyu Yao commented on HDFS-7608: -- I agree with Chris on this one. We need to address the

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chris Nauroth updated HDFS-7608: Status: Open (was: Patch Available) [~esteban], thank you for rebasing, but this patch cannot be com

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539209#comment-14539209 ] Tsz Wo Nicholas Sze commented on HDFS-8143: --- I see. But putting them as static i

[jira] [Updated] (HDFS-8255) Rename getBlockReplication to getPreferredBlockReplication

[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8255: Summary: Rename getBlockReplication to getPreferredBlockReplication (was: Rename getBlockReplication to getP

[jira] [Commented] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539202#comment-14539202 ] Hadoop QA commented on HDFS-7608: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Resolved] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality (pread)

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-7678. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > Erasure coding: DFSInputStr

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality (pread)

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539199#comment-14539199 ] Zhe Zhang commented on HDFS-7678: - Thanks Jing for reviewing again! I just committed the pa

[jira] [Commented] (HDFS-7687) Change fsck to support EC files

[ https://issues.apache.org/jira/browse/HDFS-7687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539187#comment-14539187 ] Tsz Wo Nicholas Sze commented on HDFS-7687: --- - ECResult and Result have a lot of

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539185#comment-14539185 ] Walter Su commented on HDFS-8220: - Minor tips. I don't get expected Exception running test.

[jira] [Updated] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8323: -- Attachment: h8323_20150511b.patch h8323_20150511b.patch: adds back the killed check. > B

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539168#comment-14539168 ] surendra singh lilhore commented on HDFS-8143: -- Thanks [~szetszwo] for comment

[jira] [Commented] (HDFS-8267) Erasure Coding: Test of Namenode with EC files

[ https://issues.apache.org/jira/browse/HDFS-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539154#comment-14539154 ] Rakesh R commented on HDFS-8267: OK, Thats Great! IMO NN restart case is depending on the

[jira] [Updated] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8220: --- Attachment: HDFS-8220-HDFS-7285.007.patch Seems test failures are unrelated. Attaching the previous patch to ge

[jira] [Updated] (HDFS-8366) Erasure Coding: Make the timeout parameter of polling blocking queue configurable in DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8366: Description: The timeout of getting striped or ended block in {{DFSStripedOutputStream#Coodinator}} should be configu

[jira] [Updated] (HDFS-8366) Erasure Coding: Make the timeout parameter of polling blocking queue configurable in DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Li Bo updated HDFS-8366: Attachment: HDFS-8366-001.patch > Erasure Coding: Make the timeout parameter of polling blocking queue > configurabl

[jira] [Commented] (HDFS-7820) Client Write fails after rolling upgrade rollback with " already exist in finalized state"

[ https://issues.apache.org/jira/browse/HDFS-7820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539133#comment-14539133 ] J.Andreina commented on HDFS-7820: -- Any updates on this issue ? . > Client Write fails af

[jira] [Updated] (HDFS-8373) Ec files can't be deleted into Trash because of that Trash isn't EC zone.

[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-8373: -- Issue Type: Sub-task (was: Bug) Parent: HDFS-7285 > Ec files can't be deleted into Trash because of that

[jira] [Commented] (HDFS-8373) Ec files can't be deleted into Trash because of that Trash isn't EC zone.

[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539117#comment-14539117 ] GAO Rui commented on HDFS-8373: --- [~brahmareddy] Thank you for picking up this Jira. Please fe

[jira] [Assigned] (HDFS-8267) Erasure Coding: Test of Namenode with EC files

[ https://issues.apache.org/jira/browse/HDFS-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui reassigned HDFS-8267: - Assignee: Rakesh R > Erasure Coding: Test of Namenode with EC files >

[jira] [Commented] (HDFS-8267) Erasure Coding: Test of Namenode with EC files

[ https://issues.apache.org/jira/browse/HDFS-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539116#comment-14539116 ] GAO Rui commented on HDFS-8267: --- Sorry, I made a mistake about Jira number. The Umbrella jira

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539115#comment-14539115 ] jack liuquan commented on HDFS-8347: Hi Kai, bq.do you think this design change works f

[jira] [Commented] (HDFS-8267) Erasure Coding: Test of Namenode with EC files

[ https://issues.apache.org/jira/browse/HDFS-8267?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539112#comment-14539112 ] GAO Rui commented on HDFS-8267: --- [~rakeshr]Thank you very much for picking this up. Sorry for

[jira] [Updated] (HDFS-8347) Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding

[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kai Zheng updated HDFS-8347: Summary: Erasure Coding: whether to use the same chunkSize in decoding with the value in encoding (was: Eras

[jira] [Commented] (HDFS-8347) Erasure Coding: whether to use chunkSize as the to decode buffersize for Datanode striped block reconstruction.

[ https://issues.apache.org/jira/browse/HDFS-8347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539108#comment-14539108 ] Kai Zheng commented on HDFS-8347: - Having a detailed discussion with [~zhz], [~hitliuyi] an

[jira] [Updated] (HDFS-8323) Bump GenerationStamp for write faliure in DFSStripedOutputStream

[ https://issues.apache.org/jira/browse/HDFS-8323?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8323: -- Attachment: h8323_20150511.patch h8323_20150511.patch: 1st patch. TestDFSStripedOutputSt

[jira] [Updated] (HDFS-8373) Ec files can't be deleted into {{Trash}} because of that {{Trash}} isn't EC zone.

[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-8373: -- Description: When EC files were deleted, they would be moved into {{Trash}} directory. But, EC files can only be

[jira] [Updated] (HDFS-8373) Ec files can't be deleted into Trash because of that Trash isn't EC zone.

[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] GAO Rui updated HDFS-8373: -- Summary: Ec files can't be deleted into Trash because of that Trash isn't EC zone. (was: Ec files can't be delet

[jira] [Assigned] (HDFS-8373) Ec files can't be deleted into [[Trash]] because of that [[Trash]] isn't EC zone.

[ https://issues.apache.org/jira/browse/HDFS-8373?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Brahma Reddy Battula reassigned HDFS-8373: -- Assignee: Brahma Reddy Battula > Ec files can't be deleted into [[Trash]] becaus

[jira] [Created] (HDFS-8373) Ec files can't be deleted into [[Trash]] because of that [[Trash]] isn't EC zone.

GAO Rui created HDFS-8373: - Summary: Ec files can't be deleted into [[Trash]] because of that [[Trash]] isn't EC zone. Key: HDFS-8373 URL: https://issues.apache.org/jira/browse/HDFS-8373 Project: Hadoop HDFS

[jira] [Commented] (HDFS-8255) Rename getBlockReplication to getPreferredBlockStorageNum

[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539083#comment-14539083 ] Yi Liu commented on HDFS-8255: -- Zhe, found conflict when committing, do you mind to rebase? >

[jira] [Commented] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539071#comment-14539071 ] Hadoop QA commented on HDFS-8238: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8255) Rename getBlockReplication to getPreferredBlockStorageNum

[ https://issues.apache.org/jira/browse/HDFS-8255?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539070#comment-14539070 ] Yi Liu commented on HDFS-8255: -- Thanks Zhe for the patch, it looks good to me. +1. Also thanks

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality (pread)

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539068#comment-14539068 ] Jing Zhao commented on HDFS-7678: - Thanks for updating the patch, Zhe! +1 for the 014 patch

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14539058#comment-14539058 ] Hadoop QA commented on HDFS-8243: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7966) New Data Transfer Protocol via HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-7966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qianqian Shi updated HDFS-7966: --- Attachment: GSoC2015_Proposal.pdf > New Data Transfer Protocol via HTTP/2 > ---

[jira] [Updated] (HDFS-7608) hdfs dfsclient newConnectedPeer has no write timeout

[ https://issues.apache.org/jira/browse/HDFS-7608?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Esteban Gutierrez updated HDFS-7608: Attachment: HDFS-7608.2.patch attached new patch rebased to trunk. cc:[~xyao] > hdfs dfsclie

[jira] [Commented] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538920#comment-14538920 ] Hadoop QA commented on HDFS-8372: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538912#comment-14538912 ] Ravi Prakash commented on HDFS-8344: I guess the question is when do we consider data t

[jira] [Commented] (HDFS-8286) Scaling out the namespace using KV store

[ https://issues.apache.org/jira/browse/HDFS-8286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538884#comment-14538884 ] Haohui Mai commented on HDFS-8286: -- Sorry for the late reply. bq. what is the exact goal

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality (pread)

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.014.patch Thanks Jing for reviewing and Kai for the comments on codec! Attac

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538851#comment-14538851 ] Ravi Prakash commented on HDFS-8344: At the time that a client is streaming data to a p

[jira] [Commented] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538811#comment-14538811 ] Ruth Wisniewski commented on HDFS-8243: --- Thank you for your feedback, Arpit Agarwal!

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538810#comment-14538810 ] Hadoop QA commented on HDFS-8344: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8243) Files written by TestHostsFiles and TestNameNodeMXBean are causing Release Audit Warnings.

[ https://issues.apache.org/jira/browse/HDFS-8243?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruth Wisniewski updated HDFS-8243: -- Attachment: HDFS-8243.002.patch > Files written by TestHostsFiles and TestNameNodeMXBean are caus

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538749#comment-14538749 ] Jesse Yates commented on HDFS-6440: --- {quote} Right, I get that, but what I was pointing o

[jira] [Updated] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8372: Attachment: HDFS-8372-HDFS-7285.0.patch This patch merged the changes from HDFS-8327 for storage space calcul

[jira] [Updated] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8372: Status: Patch Available (was: In Progress) > Erasure coding: compute storage type quotas for striped files,

[jira] [Updated] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8238: - Attachment: HDFS-8238.000.patch > Move ClientProtocol to the hdfs-client >

[jira] [Updated] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8238: - Attachment: (was: HDFS-8238.000.patch) > Move ClientProtocol to the hdfs-client > -

[jira] [Commented] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538700#comment-14538700 ] Haohui Mai commented on HDFS-8238: -- Upload my initial patch > Move ClientProtocol to the

[jira] [Updated] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8238: - Status: Patch Available (was: Open) > Move ClientProtocol to the hdfs-client > ---

[jira] [Updated] (HDFS-8238) Move ClientProtocol to the hdfs-client

[ https://issues.apache.org/jira/browse/HDFS-8238?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8238: - Attachment: HDFS-8238.000.patch > Move ClientProtocol to the hdfs-client >

[jira] [Commented] (HDFS-8143) HDFS Mover tool should exit after some retry when failed to move blocks.

[ https://issues.apache.org/jira/browse/HDFS-8143?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538654#comment-14538654 ] Tsz Wo Nicholas Sze commented on HDFS-8143: --- - Rename the new conf "dfs.mover.fai

[jira] [Updated] (HDFS-8372) Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327

[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8372: Summary: Erasure coding: compute storage type quotas for striped files, to be consistent with HDFS-8327 (was

[jira] [Commented] (HDFS-8327) Simplify quota calculations for snapshots and truncate

[ https://issues.apache.org/jira/browse/HDFS-8327?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538636#comment-14538636 ] Zhe Zhang commented on HDFS-8327: - Minor issue: the git commit message is different from JI

[jira] [Commented] (HDFS-8371) Fix test failure in TestHdfsConfigFields for spanreceiver properties

[ https://issues.apache.org/jira/browse/HDFS-8371?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538626#comment-14538626 ] Hadoop QA commented on HDFS-8371: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8341) HDFS mover stuck in loop after failing to move block, doesn't move rest of blocks, can't get data back off decommissioning external storage tier as a result

[ https://issues.apache.org/jira/browse/HDFS-8341?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538625#comment-14538625 ] Tsz Wo Nicholas Sze commented on HDFS-8341: --- > ... If replica scheduled successfu

[jira] [Commented] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538617#comment-14538617 ] Kihwal Lee commented on HDFS-8344: -- bq. I'm completely open on how long we want to wait as

[jira] [Updated] (HDFS-8344) NameNode doesn't recover lease for files with missing blocks

[ https://issues.apache.org/jira/browse/HDFS-8344?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-8344: --- Attachment: HDFS-8344.02.patch Thanks for your review [~kihwal] . I'm sorry [that change|https://issue

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538535#comment-14538535 ] Rushabh S Shah commented on HDFS-7916: -- Thanks [~kihwal] for reviewing and committing.

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538530#comment-14538530 ] Hadoop QA commented on HDFS-7916: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538523#comment-14538523 ] Hudson commented on HDFS-7916: -- FAILURE: Integrated in Hadoop-trunk-Commit #7798 (See [https:

[jira] [Updated] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kihwal Lee updated HDFS-7916: - Resolution: Fixed Fix Version/s: 2.7.1 Status: Resolved (was: Patch Available) Committed

[jira] [Work started] (HDFS-8372) Erasure coding: simplify snapshots and truncate quota calculations for striped files, to be consistent with HDFS-8327

[ https://issues.apache.org/jira/browse/HDFS-8372?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8372 started by Zhe Zhang. --- > Erasure coding: simplify snapshots and truncate quota calculations for > striped files, t

[jira] [Commented] (HDFS-7936) Erasure coding: resolving conflicts in the branch when merging trunk changes.

[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538489#comment-14538489 ] Zhe Zhang commented on HDFS-7936: - Major conflicts with HDFS-8327 and HDFS-8357 in this wee

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538482#comment-14538482 ] Kihwal Lee commented on HDFS-7916: -- The patch didn't cause any test failures. - TestHdfsCo

[jira] [Created] (HDFS-8372) Erasure coding: simplify snapshots and truncate quota calculations for striped files, to be consistent with HDFS-8327

Zhe Zhang created HDFS-8372: --- Summary: Erasure coding: simplify snapshots and truncate quota calculations for striped files, to be consistent with HDFS-8327 Key: HDFS-8372 URL: https://issues.apache.org/jira/browse/HDFS

[jira] [Updated] (HDFS-7936) Erasure coding: resolving conflicts in the branch when merging trunk changes.

[ https://issues.apache.org/jira/browse/HDFS-7936?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7936: Description: This will be used to track and resolve conflicts when merging trunk changes. Below is a list o

[jira] [Commented] (HDFS-7916) 'reportBadBlocks' from datanodes to standby Node BPServiceActor goes for infinite loop

[ https://issues.apache.org/jira/browse/HDFS-7916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538443#comment-14538443 ] Hadoop QA commented on HDFS-7916: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8220) Erasure Coding: StripedDataStreamer fails to handle the blocklocations which doesn't satisfy BlockGroupSize

[ https://issues.apache.org/jira/browse/HDFS-8220?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538448#comment-14538448 ] Hadoop QA commented on HDFS-8220: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8370) Erasure Coding: TestRecoverStripedFile#testRecoverOneParityBlock is failing

[ https://issues.apache.org/jira/browse/HDFS-8370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538444#comment-14538444 ] Rakesh R commented on HDFS-8370: Thanks [~drankye] for taking care encode/decode logic. Yes

[jira] [Commented] (HDFS-8358) TestTraceAdmin fails

[ https://issues.apache.org/jira/browse/HDFS-8358?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538433#comment-14538433 ] Masatake Iwasaki commented on HDFS-8358: The failure of TestHdfsConfigFields will b

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java and TestMapreduceConfigFields.java

[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538434#comment-14538434 ] Ray Chiang commented on HDFS-8362: -- I'm fine with integrating HDFS-8371 into this patch an

[jira] [Commented] (HDFS-4185) Add a metric for number of active leases

[ https://issues.apache.org/jira/browse/HDFS-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538387#comment-14538387 ] Rakesh R commented on HDFS-4185: Oh, HDFS-6757 has completely re-factored the {{LeaseManage

[jira] [Commented] (HDFS-8362) Java Compilation Error in TestHdfsConfigFields.java and TestMapreduceConfigFields.java

[ https://issues.apache.org/jira/browse/HDFS-8362?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14538349#comment-14538349 ] Ray Chiang commented on HDFS-8362: -- Thanks for finding this error. Two comments: 1) I'm

  1   2   >