[jira] [Assigned] (HDFS-253) Method to retrieve all quotas active on HDFS

[ https://issues.apache.org/jira/browse/HDFS-253?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] surendra singh lilhore reassigned HDFS-253: --- Assignee: surendra singh lilhore > Method to retrieve all quotas active on HDFS

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565822#comment-14565822 ] Hadoop QA commented on HDFS-8481: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Updated] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8489: Attachment: HDFS-8489.04.patch Both {{TestFileTruncate}} and {{TestAppendSnapshotTruncate}} pass locally. Up

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565813#comment-14565813 ] Rakesh R commented on HDFS-8450: [~drankye] I hope I've addressed your comments. Could you

[jira] [Updated] (HDFS-8420) Erasure Coding: ECZoneManager#getECZoneInfo is not resolving the path properly if zone dir itself is the snapshottable dir

[ https://issues.apache.org/jira/browse/HDFS-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8420: --- Resolution: Duplicate Status: Resolved (was: Patch Available) > Erasure Coding: ECZoneManager#getECZon

[jira] [Commented] (HDFS-8420) Erasure Coding: ECZoneManager#getECZoneInfo is not resolving the path properly if zone dir itself is the snapshottable dir

[ https://issues.apache.org/jira/browse/HDFS-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565806#comment-14565806 ] Rakesh R commented on HDFS-8420: bq. Seems the change is already included in HDFS-8408 Tha

[jira] [Commented] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565794#comment-14565794 ] Hadoop QA commented on HDFS-8489: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565784#comment-14565784 ] Hadoop QA commented on HDFS-7923: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565770#comment-14565770 ] Hadoop QA commented on HDFS-8489: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8254) In StripedDataStreamer, it is hard to tolerate datanode failure in the leading streamer

[ https://issues.apache.org/jira/browse/HDFS-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565722#comment-14565722 ] Zhe Zhang commented on HDFS-8254: - bq. I think it won't be an issue. Cause MultipleBlocking

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565721#comment-14565721 ] Kai Zheng commented on HDFS-8481: - bq. To address the GC issue we should also avoid filling

[jira] [Commented] (HDFS-8420) Erasure Coding: ECZoneManager#getECZoneInfo is not resolving the path properly if zone dir itself is the snapshottable dir

[ https://issues.apache.org/jira/browse/HDFS-8420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565716#comment-14565716 ] Zhe Zhang commented on HDFS-8420: - Seems the change is already included in HDFS-8408 > Era

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565708#comment-14565708 ] Kai Zheng commented on HDFS-8481: - bq. it is beneficial to accumulate multiple of them befo

[jira] [Updated] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8481: Attachment: HDFS-8481-HDFS-7285.04.patch Thanks Kai for verifying this. I'm attaching 04 patch to address min

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565691#comment-14565691 ] Kai Zheng commented on HDFS-8481: - Good discussion here, thanks! bq. In that case we cannot

[jira] [Commented] (HDFS-8322) Display warning if defaultFs is not set when running dfs commands.

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565684#comment-14565684 ] Lei (Eddy) Xu commented on HDFS-8322: - [~andrew.wang] I think {{TestWebDelegationToken}

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565672#comment-14565672 ] Andrew Wang commented on HDFS-7923: --- Nits: * Should the checkLease logs be done to the b

[jira] [Commented] (HDFS-8322) Display warning if defaultFs is not set when running dfs commands.

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565664#comment-14565664 ] Hadoop QA commented on HDFS-8322: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565649#comment-14565649 ] Juan Yu commented on HDFS-8409: --- If it happens at retry, not the initial call. For example, t

[jira] [Commented] (HDFS-8409) HDFS client RPC call throws "java.lang.IllegalStateException"

[ https://issues.apache.org/jira/browse/HDFS-8409?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565605#comment-14565605 ] Andrew Wang commented on HDFS-8409: --- Hey Juan, when would an exception before creation of

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Target Version/s: 2.8.0 Affects Version/s: 2.8.0 Status: Patch Avail

[jira] [Updated] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin Patrick McCabe updated HDFS-7923: --- Attachment: HDFS-7923.004.patch > The DataNodes should rate-limit their full block repo

[jira] [Updated] (HDFS-8487) Merge BlockInfo-related code changes from HDFS-7285 into trunk

[ https://issues.apache.org/jira/browse/HDFS-8487?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8487: Description: Per offline discussion with [~andrew.wang], for easier and cleaner reviewing, we should probabl

[jira] [Created] (HDFS-8499) Merge BlockInfoUnderConstruction into trunk

Zhe Zhang created HDFS-8499: --- Summary: Merge BlockInfoUnderConstruction into trunk Key: HDFS-8499 URL: https://issues.apache.org/jira/browse/HDFS-8499 Project: Hadoop HDFS Issue Type: Sub-task

[jira] [Updated] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8489: Attachment: HDFS-8489.03.patch Thanks Jing for the comment! Yes the {{replaceBlock}} logic is also different

[jira] [Commented] (HDFS-7923) The DataNodes should rate-limit their full block reports by asking the NN on heartbeat messages

[ https://issues.apache.org/jira/browse/HDFS-7923?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565561#comment-14565561 ] Colin Patrick McCabe commented on HDFS-7923: bq. Missing config key documentati

[jira] [Commented] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565556#comment-14565556 ] Jing Zhao commented on HDFS-8489: - Thanks for working on this, Zhe. Yes, addStorage, remove

[jira] [Updated] (HDFS-8322) Display warning if defaultFs is not set when running dfs commands.

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: HDFS-8322.006.patch Good findings, [~andrew.wang]. Updated accordingly. > Display warnin

[jira] [Commented] (HDFS-8322) Display warning if defaultFs is not set when running dfs commands.

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565546#comment-14565546 ] Andrew Wang commented on HDFS-8322: --- I noticed you changed the name of the config paramet

[jira] [Updated] (HDFS-8322) Display warning if defaultFs is not set when running dfs commands.

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: HDFS-8322.005.patch Address checkstyle warning. The test failure is not relevant. > Dis

[jira] [Updated] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Zhang updated HDFS-8489: Attachment: HDFS-8489.02.patch Updating the patch to remove redundant logic between {{BlockInfo}} and {{Bloc

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565456#comment-14565456 ] Zhe Zhang commented on HDFS-8481: - I agree; the GC issue for wide stripes is more serious.

[jira] [Commented] (HDFS-8463) Calling DFSInputStream.seekToNewSource just after stream creation causes NullPointerException

[ https://issues.apache.org/jira/browse/HDFS-8463?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565454#comment-14565454 ] Kihwal Lee commented on HDFS-8463: -- It might be better to simply call {{blockSeekTo(target

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565447#comment-14565447 ] Jing Zhao commented on HDFS-8481: - Yes, to have this kind of accumulation will be great. Bu

[jira] [Commented] (HDFS-8322) Display warning if defaultFs is not set when running dfs commands.

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565408#comment-14565408 ] Hadoop QA commented on HDFS-8322: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565353#comment-14565353 ] Ming Ma commented on HDFS-7609: --- Thanks Jing and all other folks. > Avoid retry cache collis

[jira] [Commented] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565335#comment-14565335 ] Hudson commented on HDFS-7609: -- FAILURE: Integrated in Hadoop-trunk-Commit #7926 (See [https:

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565259#comment-14565259 ] Zhe Zhang commented on HDFS-8481: - Thanks for the comment Jing. I guess need some smart pol

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565224#comment-14565224 ] Jing Zhao commented on HDFS-8481: - Thanks for working on this, Zhe! I agree that we should

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7609: Labels: (was: BB2015-05-RFC) > Avoid retry cache collision when Standby NameNode loading edits > --

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7609: Priority: Critical (was: Major) > Avoid retry cache collision when Standby NameNode loading edits >

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7609: Issue Type: Bug (was: Improvement) > Avoid retry cache collision when Standby NameNode loading edits > -

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7609: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved (was: P

[jira] [Updated] (HDFS-7609) Avoid retry cache collision when Standby NameNode loading edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jing Zhao updated HDFS-7609: Summary: Avoid retry cache collision when Standby NameNode loading edits (was: startup used too much time to

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565161#comment-14565161 ] Jing Zhao commented on HDFS-7609: - The 03 patch looks good to me. +1. I will commit it shor

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565137#comment-14565137 ] Jesse Yates commented on HDFS-6440: --- Failed tests pass locally. Missed a whitespace in Te

[jira] [Commented] (HDFS-8460) Erasure Coding: stateful read result doesn't match data occasionally because of flawed test

[ https://issues.apache.org/jira/browse/HDFS-8460?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14565129#comment-14565129 ] Jing Zhao commented on HDFS-8460: - We can use {{DataNodeTestUtil#setHeartbeatsDisabledForTe

[jira] [Updated] (HDFS-8322) Display warning if defaultFs is not set when running dfs commands.

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Summary: Display warning if defaultFs is not set when running dfs commands. (was: Display warning if

[jira] [Updated] (HDFS-8322) Display warning if hadoop fs -ls is showing the local filesystem

[ https://issues.apache.org/jira/browse/HDFS-8322?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Lei (Eddy) Xu updated HDFS-8322: Attachment: HDFS-8322.004.patch Thanks a lot, [~andrew.wang]. It is a great suggestion. I have modifi

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564971#comment-14564971 ] Kai Zheng commented on HDFS-8481: - Thanks Walter for the good ideas and Zhe for the update!

[jira] [Commented] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564957#comment-14564957 ] Hudson commented on HDFS-8429: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #210 (See

[jira] [Commented] (HDFS-7401) Add block info to DFSInputStream' WARN message when it adds node to deadNodes

[ https://issues.apache.org/jira/browse/HDFS-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564953#comment-14564953 ] Hudson commented on HDFS-7401: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #210 (See

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564954#comment-14564954 ] Hudson commented on HDFS-8443: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #210 (See

[jira] [Commented] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564956#comment-14564956 ] Hudson commented on HDFS-8407: -- SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #210 (See

[jira] [Created] (HDFS-8498) Blocks can be committed with wrong size

Daryn Sharp created HDFS-8498: - Summary: Blocks can be committed with wrong size Key: HDFS-8498 URL: https://issues.apache.org/jira/browse/HDFS-8498 Project: Hadoop HDFS Issue Type: Bug

[jira] [Commented] (HDFS-7401) Add block info to DFSInputStream' WARN message when it adds node to deadNodes

[ https://issues.apache.org/jira/browse/HDFS-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564908#comment-14564908 ] Hudson commented on HDFS-7401: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #201 (See [htt

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564909#comment-14564909 ] Hudson commented on HDFS-8443: -- FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #201 (See [htt

[jira] [Updated] (HDFS-8471) Implement read block over HTTP/2

[ https://issues.apache.org/jira/browse/HDFS-8471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HDFS-8471: Attachment: HDFS-8471.1.patch Add checksum support. Introduce a ReadBlockHandler. Add a testcase to test blo

[jira] [Commented] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564757#comment-14564757 ] Hudson commented on HDFS-8429: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2140 (See [https://

[jira] [Commented] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564756#comment-14564756 ] Hudson commented on HDFS-8407: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2140 (See [https://

[jira] [Commented] (HDFS-7401) Add block info to DFSInputStream' WARN message when it adds node to deadNodes

[ https://issues.apache.org/jira/browse/HDFS-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564749#comment-14564749 ] Hudson commented on HDFS-7401: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2140 (See [https://

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564753#comment-14564753 ] Hudson commented on HDFS-8443: -- FAILURE: Integrated in Hadoop-Hdfs-trunk #2140 (See [https://

[jira] [Commented] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564656#comment-14564656 ] Hudson commented on HDFS-8429: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #942 (See [https://b

[jira] [Commented] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564655#comment-14564655 ] Hudson commented on HDFS-8407: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #942 (See [https://b

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564653#comment-14564653 ] Hudson commented on HDFS-8443: -- SUCCESS: Integrated in Hadoop-Yarn-trunk #942 (See [https://b

[jira] [Commented] (HDFS-8256) "-storagepolicies , -blockId ,-replicaDetails " options are missed out in usage and from documentation

[ https://issues.apache.org/jira/browse/HDFS-8256?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564646#comment-14564646 ] Vinayakumar B commented on HDFS-8256: - Seems patch not applying on latest trunk. Needs

[jira] [Commented] (HDFS-8429) Avoid stuck threads if there is an error in DomainSocketWatcher that stops the thread

[ https://issues.apache.org/jira/browse/HDFS-8429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564633#comment-14564633 ] Hudson commented on HDFS-8429: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #212 (See [htt

[jira] [Commented] (HDFS-8443) Document dfs.namenode.service.handler.count in hdfs-site.xml

[ https://issues.apache.org/jira/browse/HDFS-8443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564630#comment-14564630 ] Hudson commented on HDFS-8443: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #212 (See [htt

[jira] [Commented] (HDFS-8407) hdfsListDirectory must set errno to 0 on success

[ https://issues.apache.org/jira/browse/HDFS-8407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564632#comment-14564632 ] Hudson commented on HDFS-8407: -- SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #212 (See [htt

[jira] [Commented] (HDFS-7240) Object store in HDFS

[ https://issues.apache.org/jira/browse/HDFS-7240?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564618#comment-14564618 ] kanaka kumar avvaru commented on HDFS-7240: --- Very interesting to follow [~jnp], w

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564597#comment-14564597 ] Hadoop QA commented on HDFS-8450: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-6775) Users may see TrashPolicy if hdfs dfs -rm is run

[ https://issues.apache.org/jira/browse/HDFS-6775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564594#comment-14564594 ] Vinayakumar B commented on HDFS-6775: - +1, LGTM. Committing soon > Users may see Trash

[jira] [Commented] (HDFS-7401) Add block info to DFSInputStream' WARN message when it adds node to deadNodes

[ https://issues.apache.org/jira/browse/HDFS-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564590#comment-14564590 ] Hudson commented on HDFS-7401: -- FAILURE: Integrated in Hadoop-trunk-Commit #7924 (See [https:

[jira] [Commented] (HDFS-3716) Purger should remove stale fsimage ckpt files

[ https://issues.apache.org/jira/browse/HDFS-3716?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564582#comment-14564582 ] Vinayakumar B commented on HDFS-3716: - change looks fine to me. I think you can add one

[jira] [Updated] (HDFS-7401) Add block info to DFSInputStream' WARN message when it adds node to deadNodes

[ https://issues.apache.org/jira/browse/HDFS-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vinayakumar B updated HDFS-7401: Resolution: Fixed Fix Version/s: 2.8.0 Hadoop Flags: Reviewed Status: Resolved

[jira] [Commented] (HDFS-8254) In StripedDataStreamer, it is hard to tolerate datanode failure in the leading streamer

[ https://issues.apache.org/jira/browse/HDFS-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564572#comment-14564572 ] Walter Su commented on HDFS-8254: - This case failed. {code} @Test(timeout=12) publi

[jira] [Commented] (HDFS-7401) Add block info to DFSInputStream' WARN message when it adds node to deadNodes

[ https://issues.apache.org/jira/browse/HDFS-7401?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564571#comment-14564571 ] Vinayakumar B commented on HDFS-7401: - +1 for the patch. Will commit soon > Add block

[jira] [Commented] (HDFS-8251) Move the synthetic load generator into its own package

[ https://issues.apache.org/jira/browse/HDFS-8251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564552#comment-14564552 ] Vinayakumar B commented on HDFS-8251: - bq. hadoop-test-tool seems very generic to me. I

[jira] [Commented] (HDFS-8496) Calling stopWriter() with FSDatasetImpl lock held may block other threads

[ https://issues.apache.org/jira/browse/HDFS-8496?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564543#comment-14564543 ] Hadoop QA commented on HDFS-8496: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8270) create() always retried with hardcoded timeout when file already exists

[ https://issues.apache.org/jira/browse/HDFS-8270?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564534#comment-14564534 ] Vinayakumar B commented on HDFS-8270: - Seems like default retries also got removed. Cl

[jira] [Commented] (HDFS-8481) Erasure coding: remove workarounds in client side stripped blocks recovering

[ https://issues.apache.org/jira/browse/HDFS-8481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564474#comment-14564474 ] Hadoop QA commented on HDFS-8481: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8254) In StripedDataStreamer, it is hard to tolerate datanode failure in the leading streamer

[ https://issues.apache.org/jira/browse/HDFS-8254?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564433#comment-14564433 ] Walter Su commented on HDFS-8254: - This case passed. {code} @Test(timeout=12) publi

[jira] [Updated] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rakesh R updated HDFS-8450: --- Attachment: HDFS-8450-HDFS-7285-03.patch > Erasure Coding: Consolidate erasure coding zone related implementati

[jira] [Commented] (HDFS-8450) Erasure Coding: Consolidate erasure coding zone related implementation into a single class

[ https://issues.apache.org/jira/browse/HDFS-8450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564425#comment-14564425 ] Rakesh R commented on HDFS-8450: Attached another patch addressing [~drankye] comments. >

[jira] [Commented] (HDFS-8328) Follow-on to update decode for DataNode striped blocks reconstruction

[ https://issues.apache.org/jira/browse/HDFS-8328?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564392#comment-14564392 ] Yi Liu commented on HDFS-8328: -- Thanks Kai for comments. {quote} {{minRequiredSources}} looks

[jira] [Commented] (HDFS-6974) MiniHDFScluster breaks if there is an out of date hadoop.lib on the lib path

[ https://issues.apache.org/jira/browse/HDFS-6974?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564384#comment-14564384 ] Michael Schmeißer commented on HDFS-6974: - The existence of this ticket helped to t

[jira] [Commented] (HDFS-8489) Subclass BlockInfo to represent contiguous blocks

[ https://issues.apache.org/jira/browse/HDFS-8489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564381#comment-14564381 ] Hadoop QA commented on HDFS-8489: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8490) Typo in trace enabled log in WebHDFS exception handler

[ https://issues.apache.org/jira/browse/HDFS-8490?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564343#comment-14564343 ] Hadoop QA commented on HDFS-8490: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-7609) startup used too much time to load edits

[ https://issues.apache.org/jira/browse/HDFS-7609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564340#comment-14564340 ] Hadoop QA commented on HDFS-7609: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo

[jira] [Commented] (HDFS-8497) ErasureCodingWorker fails to do decode work

[ https://issues.apache.org/jira/browse/HDFS-8497?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564334#comment-14564334 ] Yi Liu commented on HDFS-8497: -- Hi Bo, the decode workaround is removed in HDFS-8328. > Erasu

[jira] [Commented] (HDFS-6440) Support more than 2 NameNodes

[ https://issues.apache.org/jira/browse/HDFS-6440?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14564317#comment-14564317 ] Hadoop QA commented on HDFS-6440: - \\ \\ | (x) *{color:red}-1 overall{color}* | \\ \\ || Vo