[jira] [Created] (HDFS-15454) ViewFsOverloadScheme should not display error message with "viewfs://" even when it's initialized with other fs.

2020-07-04 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15454: -- Summary: ViewFsOverloadScheme should not display error message with "viewfs://" even when it's initialized with other fs. Key: HDFS-15454 URL:

[jira] [Created] (HDFS-15453) Implement ViewFsAdmin to list the mount points, target fs for path etc.

2020-07-04 Thread Uma Maheswara Rao G (Jira)
Uma Maheswara Rao G created HDFS-15453: -- Summary: Implement ViewFsAdmin to list the mount points, target fs for path etc. Key: HDFS-15453 URL: https://issues.apache.org/jira/browse/HDFS-15453

[jira] [Updated] (HDFS-15450) Fix NN trash emptier to work if ViewFSOveroadScheme enabled

2020-07-04 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15450: --- Component/s: viewfsOverloadScheme namenode > Fix NN trash emptier

[jira] [Commented] (HDFS-15450) Fix NN trash emptier to work if ViewFSOveroadScheme enabled

2020-07-04 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151424#comment-17151424 ] Hudson commented on HDFS-15450: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18408 (See

[jira] [Updated] (HDFS-15450) Fix NN trash emptier to work in HA mode if ViewFSOveroadScheme enabled

2020-07-04 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15450: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Updated] (HDFS-15450) Fix NN trash emptier to work if ViewFSOveroadScheme enabled

2020-07-04 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15450?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15450: --- Summary: Fix NN trash emptier to work if ViewFSOveroadScheme enabled (was: Fix NN

[jira] [Commented] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151394#comment-17151394 ] AMC-team commented on HDFS-15438: - I added a patch to change the while loop condition to adapt that max

[jira] [Commented] (HDFS-15439) Setting dfs.mover.retry.max.attempts to negative value will retry forever.

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151393#comment-17151393 ] AMC-team commented on HDFS-15439: - I added a patch to change the if condition, thus handling negative

[jira] [Updated] (HDFS-15439) Setting dfs.mover.retry.max.attempts to negative value will retry forever.

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15439: Attachment: HDFS-15439.000.patch > Setting dfs.mover.retry.max.attempts to negative value will retry

[jira] [Updated] (HDFS-15439) Setting dfs.mover.retry.max.attempts to negative value will retry forever.

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15439: Description: Configuration parameter "dfs.mover.retry.max.attempts" is to define the maximum number of

[jira] [Updated] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15438: Attachment: HDFS-15438.000.patch > Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

[jira] [Updated] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15438: Summary: Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy (was:

[jira] [Commented] (HDFS-15443) Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure.

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151386#comment-17151386 ] AMC-team commented on HDFS-15443: - [~jianghuazhu], [~elgoiri] I added a simple patch to do the sanity

[jira] [Updated] (HDFS-15443) Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure.

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15443: Attachment: HDFS-15443.000.patch > Setting dfs.datanode.max.transfer.threads to a very small value can

[jira] [Updated] (HDFS-15443) Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure.

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15443: Attachment: (was: HDFS-15443.000.patch) > Setting dfs.datanode.max.transfer.threads to a very small

[jira] [Updated] (HDFS-15443) Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure.

2020-07-04 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] AMC-team updated HDFS-15443: Attachment: HDFS-15443.000.patch > Setting dfs.datanode.max.transfer.threads to a very small value can

[jira] [Comment Edited] (HDFS-15452) Dynamically initialize the capacity of BlocksMap

2020-07-04 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151327#comment-17151327 ] jianghua zhu edited comment on HDFS-15452 at 7/4/20, 1:25 PM: -- We can use a

[jira] [Commented] (HDFS-15452) Dynamically initialize the capacity of BlocksMap

2020-07-04 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15452?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151327#comment-17151327 ] jianghua zhu commented on HDFS-15452: - We can use a variable configuration in hdfs-default.xml to

[jira] [Assigned] (HDFS-15452) Dynamically initialize the capacity of BlocksMap

2020-07-04 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu reassigned HDFS-15452: --- Assignee: jianghua zhu > Dynamically initialize the capacity of BlocksMap >

[jira] [Updated] (HDFS-15452) Dynamically initialize the capacity of BlocksMap

2020-07-04 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15452: Description: The default value for initializing BlocksMap in the BlockManager class is 2. This

[jira] [Updated] (HDFS-15452) Dynamically initialize the capacity of BlocksMap

2020-07-04 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jianghua zhu updated HDFS-15452: Description: The default value for initializing BlocksMap in the BlockManager class is 2. This

[jira] [Created] (HDFS-15452) Dynamically initialize the capacity of BlocksMap

2020-07-04 Thread jianghua zhu (Jira)
jianghua zhu created HDFS-15452: --- Summary: Dynamically initialize the capacity of BlocksMap Key: HDFS-15452 URL: https://issues.apache.org/jira/browse/HDFS-15452 Project: Hadoop HDFS Issue

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-07-04 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151223#comment-17151223 ] Hudson commented on HDFS-15446: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18406 (See

[jira] [Updated] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-07-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena updated HDFS-15446: Fix Version/s: 3.1.5 3.4.0 3.3.1 3.2.2

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-07-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151215#comment-17151215 ] Ayush Saxena commented on HDFS-15446: - Committed to trunk,branch-3.3,3.2,3.1 Thanx [~sodonnell] for

[jira] [Commented] (HDFS-15430) create should work when parent dir is internalDir and fallback configured.

2020-07-04 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151210#comment-17151210 ] Hudson commented on HDFS-15430: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #18405 (See

[jira] [Updated] (HDFS-15430) create should work when parent dir is internalDir and fallback configured.

2020-07-04 Thread Uma Maheswara Rao G (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15430?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Uma Maheswara Rao G updated HDFS-15430: --- Fix Version/s: 3.4.0 Hadoop Flags: Reviewed Resolution: Fixed

[jira] [Commented] (HDFS-15446) CreateSnapshotOp fails during edit log loading for /.reserved/raw/path with error java.io.FileNotFoundException: Directory does not exist: /.reserved/raw/path

2020-07-04 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15446?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17151201#comment-17151201 ] Ayush Saxena commented on HDFS-15446: - v003 LGTM +1 > CreateSnapshotOp fails during edit log loading