[jira] [Commented] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-01 Thread Xiaoqiao He (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123392#comment-17123392 ] Xiaoqiao He commented on HDFS-15382: Thanks [~Aiphag0] for your proposal here. The pe

[jira] [Updated] (HDFS-15382) Split FsDatasetImpl from blockpool lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Summary: Split FsDatasetImpl from blockpool lock to blockpool volume lock (was: Split DataNode FsDatasetImp

[jira] [Commented] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123379#comment-17123379 ] Aiphago commented on HDFS-15382: After improve our du in cache copy time is very low.And

[jira] [Commented] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123372#comment-17123372 ] Aiphago commented on HDFS-15382: Now we deploy in our produce cluster use this patch for

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: image-2020-06-02-1.png > Split DataNode FsDatasetImpl lock to blockpool volume lock > --

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Affects Version/s: (was: 3.2.1) (was: 2.9.2) > Split DataNode FsDatasetImpl lo

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Target Version/s: (was: 3.2.0, 2.9.2) > Split DataNode FsDatasetImpl lock to blockpool volume lock > -

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: (was: image-2020-06-02.png) > Split DataNode FsDatasetImpl lock to blockpool volume lock > -

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Attachment: image-2020-06-02.png > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Work started] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HDFS-15382 started by Aiphago. -- > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Affects Version/s: 2.9.2 3.2.1 > Split DataNode FsDatasetImpl lock to blockpool volume

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Fix Version/s: 2.9.2 3.2.1 > Split DataNode FsDatasetImpl lock to blockpool volume lock >

[jira] [Updated] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aiphago updated HDFS-15382: --- Fix Version/s: (was: 2.9.2) > Split DataNode FsDatasetImpl lock to blockpool volume lock > -

[jira] [Created] (HDFS-15382) Split DataNode FsDatasetImpl lock to blockpool volume lock

2020-06-01 Thread Aiphago (Jira)
Aiphago created HDFS-15382: -- Summary: Split DataNode FsDatasetImpl lock to blockpool volume lock Key: HDFS-15382 URL: https://issues.apache.org/jira/browse/HDFS-15382 Project: Hadoop HDFS Issue Ty

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17123340#comment-17123340 ] Hadoop QA commented on HDFS-15379: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.005.patch > RBF: DistCpFedBalance implementation > ---

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: HDFS-15346.005.patch > RBF: DistCpFedBalance implementation > ---

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jinglun updated HDFS-15346: --- Attachment: (was: HDFS-15346.005.patch) > RBF: DistCpFedBalance implementation >

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Jinglun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17121517#comment-17121517 ] Jinglun commented on HDFS-15346: Hi [~linyiqun], thanks your great comments ! Yes it is a

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Status: Open (was: Patch Available) > DataStreamer should reset thread interrupted state in createBlockOutputStr

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.004.patch Target Version/s: (was: 3.3.0) Status: Patch Available

[jira] [Commented] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

2020-06-01 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17121283#comment-17121283 ] Simbarashe Dzinamarira commented on HDFS-14773: --- [~zhaoyim] so I encountere

[jira] [Updated] (HDFS-14773) SWEBHDFS closes the connection before a client can read the error response for a DSQuotaExceededException

2020-06-01 Thread Simbarashe Dzinamarira (Jira)
[ https://issues.apache.org/jira/browse/HDFS-14773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Simbarashe Dzinamarira updated HDFS-14773: -- Affects Version/s: 2.7.0 > SWEBHDFS closes the connection before a client can r

[jira] [Commented] (HDFS-15321) Make DFSAdmin tool to work with ViewFSOverloadScheme

2020-06-01 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15321?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17121179#comment-17121179 ] Uma Maheswara Rao G commented on HDFS-15321: I have updated the PR for review

[jira] [Commented] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17121054#comment-17121054 ] Hadoop QA commented on HDFS-15377: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Fix Version/s: (was: 3.3.0) > DataStreamer should reset thread interrupted state in createBlockOutputStream >

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.003.patch Status: Patch Available (was: Open) > DataStreamer should reset thread

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Target Version/s: 3.3.0 (was: 3.1.3) Status: Open (was: Patch Available) > DataStreamer should re

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Fix Version/s: (was: 3.1.3) 3.3.0 > DataStreamer should reset thread interrupted state in

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120991#comment-17120991 ] Hadoop QA commented on HDFS-15379: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120981#comment-17120981 ] Yiqun Lin edited comment on HDFS-15346 at 6/1/20, 12:23 PM: H

[jira] [Commented] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120981#comment-17120981 ] Yiqun Lin commented on HDFS-15346: -- Hi [~LiJinglun] , some initial review comments from

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.002.patch Status: Patch Available (was: Open) > DataStreamer should reset thread

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Status: Open (was: Patch Available) > DataStreamer should reset thread interrupted state in createBlockOutputStr

[jira] [Commented] (HDFS-15370) listStatus and getFileStatus behave inconsistent in the case of ViewFs implementation for isDirectory

2020-06-01 Thread Srinivasu Majeti (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120934#comment-17120934 ] Srinivasu Majeti commented on HDFS-15370: - Thank you for the quick clarification

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

2020-06-01 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Status: Open (was: Patch Available) > BlockScanner scans one part per round, expect full scans after sever

[jira] [Updated] (HDFS-15377) BlockScanner scans one part per round, expect full scans after several rounds

2020-06-01 Thread Yang Yun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15377?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yang Yun updated HDFS-15377: Attachment: HDFS-15377.004.patch Status: Patch Available (was: Open) > BlockScanner scans one part

[jira] [Commented] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120881#comment-17120881 ] Hadoop QA commented on HDFS-15379: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Comment Edited] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120133#comment-17120133 ] ludun edited comment on HDFS-15379 at 6/1/20, 8:42 AM: --- [~brahmared

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: HDFS-15379.001.patch Fix Version/s: 3.1.3 Status: Patch Available (was: Open) > Da

[jira] [Updated] (HDFS-15379) DataStreamer should reset thread interrupted state in createBlockOutputStream

2020-06-01 Thread ludun (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15379?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ludun updated HDFS-15379: - Attachment: (was: HDFS-15379.001.patch) > DataStreamer should reset thread interrupted state in createBlockOu

[jira] [Commented] (HDFS-15359) EC: Allow closing a file with committed blocks

2020-06-01 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15359?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17120816#comment-17120816 ] Ayush Saxena commented on HDFS-15359: - Test Failures not related. the Xmits ones fail

[jira] [Updated] (HDFS-15374) RBF: Add documentation for fedbalance tool

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15374?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15374: - Summary: RBF: Add documentation for fedbalance tool (was: Add documentation for command `fedbalance`) >

[jira] [Updated] (HDFS-15346) RBF: DistCpFedBalance implementation

2020-06-01 Thread Yiqun Lin (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15346?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yiqun Lin updated HDFS-15346: - Summary: RBF: DistCpFedBalance implementation (was: RBF: Balance data across federation namespaces with