[jira] [Updated] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8294: --- Status: Patch Available (was: Open) > Erasure Coding: Fix Findbug warnings present in erasure coding > ---

[jira] [Updated] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8294: --- Attachment: HDFS-8294-HDFS-7285.00.patch > Erasure Coding: Fix Findbug warnings present in erasure coding > ---

[jira] [Commented] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521002#comment-14521002 ] Zhe Zhang commented on HDFS-8178: - Thanks ATM for the helpful review! After looking at HDFS

[jira] [Commented] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521005#comment-14521005 ] Zhe Zhang commented on HDFS-8178: - Oops last paragraph was added by mistake, please ignore

[jira] [Commented] (HDFS-5574) Remove buffer copy in BlockReader.skip

[ https://issues.apache.org/jira/browse/HDFS-5574?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14521004#comment-14521004 ] Akira AJISAKA commented on HDFS-5574: - Looks like jenkins ran the tests in hadoop-hdfs

[jira] [Updated] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8282: Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed Status: Resolved (wa

[jira] [Commented] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520994#comment-14520994 ] Zhe Zhang commented on HDFS-8282: - Thanks Yi for reviewing again! I just committed it to th

[jira] [Updated] (HDFS-7859) Erasure Coding: Persist EC schemas in NameNode

[ https://issues.apache.org/jira/browse/HDFS-7859?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xinwei Qin updated HDFS-7859: -- Attachment: HDFS-7859-HDFS-7285.003.patch > Erasure Coding: Persist EC schemas in NameNode >

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520990#comment-14520990 ] Chris Nauroth commented on HDFS-8290: - The Findbugs warning is in an unrelated part of

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520986#comment-14520986 ] Chris Nauroth commented on HDFS-8283: - These test failures might be related too: https

[jira] [Commented] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520989#comment-14520989 ] Yi Liu commented on HDFS-8282: -- yes, +1 > Erasure coding: move striped reading logic to Strip

[jira] [Updated] (HDFS-8178) QJM doesn't move aside stale inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8178: Summary: QJM doesn't move aside stale inprogress edits files (was: QJM doesn't purge empty and corrupt inpro

[jira] [Updated] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8178: Description: When a QJM crashes, the in-progress edit log file at that time remains in the file system. When

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520951#comment-14520951 ] Li Bo commented on HDFS-7348: - bq. We can do local writing and local reading logics as follow-o

[jira] [Updated] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8282: Attachment: HDFS-8282-HDFS-7285.01.patch Attaching a dup patch to trigger Jenkins again. > Erasure coding: m

[jira] [Commented] (HDFS-8283) DataStreamer cleanup and some minor improvement

[ https://issues.apache.org/jira/browse/HDFS-8283?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520934#comment-14520934 ] Chris Nauroth commented on HDFS-8283: - It seems this patch introduced a findbugs warnin

[jira] [Commented] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520937#comment-14520937 ] Hadoop QA commented on HDFS-8282: - (!) The patch artifact directory on has been removed! T

[jira] [Commented] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520920#comment-14520920 ] Hadoop QA commented on HDFS-8078: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520910#comment-14520910 ] Zhe Zhang commented on HDFS-7348: - bq. Currently the default cell size is 256KB, it's not a

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520899#comment-14520899 ] Zhe Zhang commented on HDFS-7348: - Thanks Yi for the explanation. bq. Current implementat

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520895#comment-14520895 ] J.Andreina commented on HDFS-8270: -- Thanks [~jingzhao] for your suggestion. *But I have o

[jira] [Commented] (HDFS-8251) Move the synthetic load generator into its own package

[ https://issues.apache.org/jira/browse/HDFS-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520880#comment-14520880 ] J.Andreina commented on HDFS-8251: -- Attached an initial patch . Please review. > Move th

[jira] [Commented] (HDFS-8249) Separate HdfsConstants into the client and the server side class

[ https://issues.apache.org/jira/browse/HDFS-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520877#comment-14520877 ] Hadoop QA commented on HDFS-8249: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8251) Move the synthetic load generator into its own package

[ https://issues.apache.org/jira/browse/HDFS-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina updated HDFS-8251: - Attachment: HDFS-8251.1.patch > Move the synthetic load generator into its own package > --

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520874#comment-14520874 ] Zhe Zhang commented on HDFS-7578: - The patch does apply and build successfully on my local

[jira] [Updated] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8282: Attachment: HDFS-8282-HDFS-7285.01.patch Thanks Yi for reviewing. I forgot to add changes to a test class ({

[jira] [Commented] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520834#comment-14520834 ] Arpit Agarwal commented on HDFS-8276: - Thanks for fixing this [~surendrasingh]. Just a

[jira] [Updated] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arpit Agarwal updated HDFS-8276: Status: Patch Available (was: Open) > LazyPersistFileScrubber should be disabled if scrubber interva

[jira] [Commented] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

[ https://issues.apache.org/jira/browse/HDFS-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520826#comment-14520826 ] Rakesh R commented on HDFS-8288: Thanks [~szetszwo] for the patch. IIUC name something like

[jira] [Updated] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

[ https://issues.apache.org/jira/browse/HDFS-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8288: --- Target Version/s: HDFS-7285 > Refactor DFSStripedOutputStream and StripedDataStreamer > ---

[jira] [Commented] (HDFS-8276) LazyPersistFileScrubber should be disabled if scrubber interval configured zero

[ https://issues.apache.org/jira/browse/HDFS-8276?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520817#comment-14520817 ] surendra singh lilhore commented on HDFS-8276: -- [~arpitagarwal] Please can you

[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520816#comment-14520816 ] surendra singh lilhore commented on HDFS-8229: -- Thanks, yes I will update the

[jira] [Commented] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520814#comment-14520814 ] Tsz Wo Nicholas Sze commented on HDFS-8281: --- - Please add javadoc for the new cop

[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520813#comment-14520813 ] Arpit Agarwal commented on HDFS-8229: - Thanks you are right. I missed that part. +1 for

[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520811#comment-14520811 ] surendra singh lilhore commented on HDFS-8229: -- Thanks [~arpitagarwal] for rev

[jira] [Commented] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

[ https://issues.apache.org/jira/browse/HDFS-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520803#comment-14520803 ] Hadoop QA commented on HDFS-8288: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Assigned] (HDFS-6697) Make NN lease soft and hard limits configurable

[ https://issues.apache.org/jira/browse/HDFS-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] J.Andreina reassigned HDFS-6697: Assignee: J.Andreina > Make NN lease soft and hard limits configurable > ---

[jira] [Commented] (HDFS-6697) Make NN lease soft and hard limits configurable

[ https://issues.apache.org/jira/browse/HDFS-6697?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520802#comment-14520802 ] J.Andreina commented on HDFS-6697: -- HDFS-8270 is been linked to this in making the values

[jira] [Updated] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

[ https://issues.apache.org/jira/browse/HDFS-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8288: -- Status: Patch Available (was: Open) > Refactor DFSStripedOutputStream and StripedDataStr

[jira] [Updated] (HDFS-8288) Refactor DFSStripedOutputStream and StripedDataStreamer

[ https://issues.apache.org/jira/browse/HDFS-8288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz Wo Nicholas Sze updated HDFS-8288: -- Attachment: h8288_20150429.patch h8288_20150429.patch: adds Coordinator and CellBuffers.

[jira] [Updated] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

[ https://issues.apache.org/jira/browse/HDFS-8294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8294: --- Description: Following are the findbug warnings :- # Possible null pointer dereference of arr$ in org.apache.

[jira] [Created] (HDFS-8294) Erasure Coding: Fix Findbug warnings present in erasure coding

Rakesh R created HDFS-8294: -- Summary: Erasure Coding: Fix Findbug warnings present in erasure coding Key: HDFS-8294 URL: https://issues.apache.org/jira/browse/HDFS-8294 Project: Hadoop HDFS Issue T

[jira] [Commented] (HDFS-8290) WebHDFS calls before namesystem initialization can cause NullPointerException.

[ https://issues.apache.org/jira/browse/HDFS-8290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520731#comment-14520731 ] Hadoop QA commented on HDFS-8290: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520686#comment-14520686 ] Yi Liu commented on HDFS-7348: -- Thanks Bo and Zhe, for the discussion. {quote} On the write p

[jira] [Commented] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520683#comment-14520683 ] Hadoop QA commented on HDFS-8282: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Patch Available (was: Open) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520668#comment-14520668 ] Hadoop QA commented on HDFS-6757: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Attachment: HDFS-8078.7.patch "ipaddr == null ? ... : ..." seems to have run afoul of checkstyle... > HDFS c

[jira] [Updated] (HDFS-8078) HDFS client gets errors trying to to connect to IPv6 DataNode

[ https://issues.apache.org/jira/browse/HDFS-8078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nate Edel updated HDFS-8078: Status: Open (was: Patch Available) > HDFS client gets errors trying to to connect to IPv6 DataNode > --

[jira] [Commented] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520661#comment-14520661 ] Jing Zhao commented on HDFS-8281: - Thanks for the comment, Zhe! One scenario this stripe bu

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Attachment: HDFS-6757.010.patch > Simplify lease manager with INodeID > ---

[jira] [Commented] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520640#comment-14520640 ] Yi Liu commented on HDFS-8282: -- +1, thanks Zhe. > Erasure coding: move striped reading logic

[jira] [Commented] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520639#comment-14520639 ] Zhe Zhang commented on HDFS-8281: - Thanks for the patch Jing! I haven't read it in details

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520637#comment-14520637 ] Hadoop QA commented on HDFS-7578: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520633#comment-14520633 ] Jing Zhao commented on HDFS-8272: - Yeah, I just created HDFS-8293 to track the test. > Era

[jira] [Commented] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520634#comment-14520634 ] Hadoop QA commented on HDFS-6757: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Created] (HDFS-8293) Erasure Coding: test the retry logic of DFSStripedInputStream

Jing Zhao created HDFS-8293: --- Summary: Erasure Coding: test the retry logic of DFSStripedInputStream Key: HDFS-8293 URL: https://issues.apache.org/jira/browse/HDFS-8293 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-7578) NFS WRITE and COMMIT responses should always use the channel pipeline

[ https://issues.apache.org/jira/browse/HDFS-7578?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520631#comment-14520631 ] Zhe Zhang commented on HDFS-7578: - The patch looks good to me and I don't see an easy way t

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520630#comment-14520630 ] Hudson commented on HDFS-8214: -- FAILURE: Integrated in Hadoop-trunk-Commit #7703 (See [https:

[jira] [Updated] (HDFS-8281) Erasure Coding: implement parallel stateful reading for striped layout

[ https://issues.apache.org/jira/browse/HDFS-8281?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-8281: Attachment: HDFS-8281.000.patch Upload the initial patch for review. Still need to add more tests. The basic

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520627#comment-14520627 ] Zhe Zhang commented on HDFS-8272: - Sounds good. I guess we can mock returning a bad token /

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520624#comment-14520624 ] Andrew Wang commented on HDFS-8214: --- Ah, I see the JIRA has been created, thanks. I'll re

[jira] [Updated] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andrew Wang updated HDFS-8214: -- Resolution: Fixed Fix Version/s: 2.8.0 Status: Resolved (was: Patch Available) Committ

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520616#comment-14520616 ] Andrew Wang commented on HDFS-8214: --- OK, I'll commit this shortly. Thanks for looking at

[jira] [Commented] (HDFS-8178) QJM doesn't purge empty and corrupt inprogress edits files

[ https://issues.apache.org/jira/browse/HDFS-8178?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520617#comment-14520617 ] Aaron T. Myers commented on HDFS-8178: -- Hi Zhe, thanks a lot for posting this patch. I

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520613#comment-14520613 ] Charles Lamb commented on HDFS-8214: I created HDFS-8292 for this. > Secondary NN Web

[jira] [Created] (HDFS-8292) Move conditional in fmt_time from dfs-dust.js to status.html

Charles Lamb created HDFS-8292: -- Summary: Move conditional in fmt_time from dfs-dust.js to status.html Key: HDFS-8292 URL: https://issues.apache.org/jira/browse/HDFS-8292 Project: Hadoop HDFS I

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520607#comment-14520607 ] Jing Zhao commented on HDFS-8272: - So far I do not know any specific tests for the retry lo

[jira] [Commented] (HDFS-7342) Lease Recovery doesn't happen some times

[ https://issues.apache.org/jira/browse/HDFS-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520605#comment-14520605 ] Ravi Prakash commented on HDFS-7342: I checked with 2 datanodes, and the correct thing

[jira] [Commented] (HDFS-8214) Secondary NN Web UI shows wrong date for Last Checkpoint

[ https://issues.apache.org/jira/browse/HDFS-8214?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520603#comment-14520603 ] Charles Lamb commented on HDFS-8214: [~wheat9], I'll make the change in a followup-jir

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520600#comment-14520600 ] Zhe Zhang commented on HDFS-8272: - Sorry to post this thought I had while reviewing the pat

[jira] [Commented] (HDFS-7281) Missing block is marked as corrupted block

[ https://issues.apache.org/jira/browse/HDFS-7281?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520594#comment-14520594 ] Hadoop QA commented on HDFS-7281: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7348) Erasure Coding: striped block recovery

[ https://issues.apache.org/jira/browse/HDFS-7348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520589#comment-14520589 ] Zhe Zhang commented on HDFS-7348: - Thanks for the discussion Yi and Bo. On the write path:

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Status: Patch Available (was: Open) > Simplify lease manager with INodeID > --

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Status: Open (was: Patch Available) > Simplify lease manager with INodeID > --

[jira] [Updated] (HDFS-8249) Separate HdfsConstants into the client and the server side class

[ https://issues.apache.org/jira/browse/HDFS-8249?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-8249: - Attachment: HDFS-8249.002.patch > Separate HdfsConstants into the client and the server side class > --

[jira] [Updated] (HDFS-6757) Simplify lease manager with INodeID

[ https://issues.apache.org/jira/browse/HDFS-6757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Haohui Mai updated HDFS-6757: - Attachment: HDFS-6757.009.patch > Simplify lease manager with INodeID > ---

[jira] [Commented] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520558#comment-14520558 ] Hadoop QA commented on HDFS-7678: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-7847) Modify NNThroughputBenchmark to be able to operate on a remote NameNode

[ https://issues.apache.org/jira/browse/HDFS-7847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7847: --- Affects Version/s: (was: HDFS-7836) 2.8.0 > Modify NNThrough

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.004.patch > Erasure coding: DFSInputStream with decode functionality > --

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: (was: HDFS-7678-HDFS-7285.004.patch) > Erasure coding: DFSInputStream with decode functionali

[jira] [Updated] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8282: Attachment: HDFS-8282-HDFS-7285.00.patch [~hitliuyi] Could you take a look when you have a chance? I didn't

[jira] [Updated] (HDFS-8282) Erasure coding: move striped reading logic to StripedBlockUtil

[ https://issues.apache.org/jira/browse/HDFS-8282?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8282: Status: Patch Available (was: In Progress) > Erasure coding: move striped reading logic to StripedBlockUtil

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.004.patch Rebased after the changes of HDFS-8272. > Erasure coding: DFSInput

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Charles Lamb updated HDFS-7923: --- Attachment: HDFS-7923.002.patch Thanks for the review and comments [~cmccabe]. {code} public static

[jira] [Resolved] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang resolved HDFS-8272. - Resolution: Fixed Fix Version/s: HDFS-7285 Hadoop Flags: Reviewed > Erasure Coding: simplify th

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520458#comment-14520458 ] Zhe Zhang commented on HDFS-8272: - The rest of the patch LGTM, +1 and thanks Jing for the c

[jira] [Commented] (HDFS-8174) Update replication count to live rep count in fsck report

[ https://issues.apache.org/jira/browse/HDFS-8174?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520453#comment-14520453 ] Ming Ma commented on HDFS-8174: --- Thanks [~andreina]. LGTM. > Update replication count to liv

[jira] [Commented] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520448#comment-14520448 ] Hadoop QA commented on HDFS-8291: - \\ \\ | (/) *{color:green}+1 overall{color}* | \\ \\ ||

[jira] [Updated] (HDFS-7678) Erasure coding: DFSInputStream with decode functionality

[ https://issues.apache.org/jira/browse/HDFS-7678?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-7678: Attachment: HDFS-7678-HDFS-7285.003.patch Attaching new patch which based on Andrew's comments. # An overall

[jira] [Updated] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongyi Xie updated HDFS-8291: -- Attachment: HDFS-8291.001.patch the code currently divides file size by 1024 which means the sizes are e

[jira] [Updated] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongyi Xie updated HDFS-8291: -- Status: Patch Available (was: Open) > Modify NN WebUI to display correct unit > ---

[jira] [Updated] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongyi Xie updated HDFS-8291: -- Status: Open (was: Patch Available) > Modify NN WebUI to display correct unit > ---

[jira] [Updated] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhongyi Xie updated HDFS-8291: -- Status: Patch Available (was: In Progress) Update the capacity unit > Modify NN WebUI to display correc

[jira] [Work started] (HDFS-8291) Modify NN WebUI to display correct unit

[ https://issues.apache.org/jira/browse/HDFS-8291?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-8291 started by Zhongyi Xie. - > Modify NN WebUI to display correct unit > >

[jira] [Commented] (HDFS-8229) LAZY_PERSIST file gets deleted after NameNode restart.

[ https://issues.apache.org/jira/browse/HDFS-8229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520407#comment-14520407 ] Arpit Agarwal commented on HDFS-8229: - Thanks for the update [~surendrasingh]. We shoul

[jira] [Commented] (HDFS-8272) Erasure Coding: simplify the retry logic in DFSStripedInputStream (stateful read)

[ https://issues.apache.org/jira/browse/HDFS-8272?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520406#comment-14520406 ] Zhe Zhang commented on HDFS-8272: - Thanks Jing for the update. I agree about removing {{see

[jira] [Updated] (HDFS-7342) Lease Recovery doesn't happen some times

[ https://issues.apache.org/jira/browse/HDFS-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7342: --- Status: Open (was: Patch Available) > Lease Recovery doesn't happen some times > -

[jira] [Updated] (HDFS-7342) Lease Recovery doesn't happen some times

[ https://issues.apache.org/jira/browse/HDFS-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Prakash updated HDFS-7342: --- Target Version/s: 2.8.0 (was: 2.6.1) > Lease Recovery doesn't happen some times >

[jira] [Commented] (HDFS-7342) Lease Recovery doesn't happen some times

[ https://issues.apache.org/jira/browse/HDFS-7342?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14520401#comment-14520401 ] Ravi Prakash commented on HDFS-7342: I found another\(?) instance in which the lease is

  1   2   >