[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Description: HDFS-15488 adds a cmd to list all snapshots for a given snapshottable d

[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Attachment: HDFS-15498.000.patch > Show snapshots deletion status in snapList cmd > -

[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Description: HDFS-15488 adds a cmd to list all snapshots for a given snapshottable di

[jira] [Updated] (HDFS-15498) Show snapshots deletion status in snapList cmd

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Summary: Show snapshots deletion status in snapList cmd (was: Add an option in snapL

[jira] [Updated] (HDFS-15498) Add an option in snapList cmd to show snapshots deletion status

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Summary: Add an option in snapList cmd to show snapshots deletion status (was: Add a

[jira] [Assigned] (HDFS-15496) Add UI for deleted snapshots

[ https://issues.apache.org/jira/browse/HDFS-15496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh reassigned HDFS-15496: Assignee: Vivek Ratnavel Subramanian > Add UI for deleted snapshots >

[jira] [Created] (HDFS-15501) Update Apache documentation for new ordered snapshot deletion feature

Mukul Kumar Singh created HDFS-15501: Summary: Update Apache documentation for new ordered snapshot deletion feature Key: HDFS-15501 URL: https://issues.apache.org/jira/browse/HDFS-15501 Project:

[jira] [Created] (HDFS-15500) Add more assertions about ordered deletion of snapshot

Mukul Kumar Singh created HDFS-15500: Summary: Add more assertions about ordered deletion of snapshot Key: HDFS-15500 URL: https://issues.apache.org/jira/browse/HDFS-15500 Project: Hadoop HDFS

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-15492: - Parent: HDFS-15477 Issue Type: Sub-task (was: Improvement) > Make trash root ins

[jira] [Comment Edited] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167604#comment-17167604 ] Chengwei Wang edited comment on HDFS-15493 at 7/30/20, 3:01 AM: ---

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167604#comment-17167604 ] Chengwei Wang commented on HDFS-15493: -- Hi [~sodonnell]，sorry for missing some messa

[jira] [Updated] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs pom.xml

[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Summary: Exclude aws-java-sdk-bundle from httpfs pom.xml (was: Exclude aws-java-sdk-bundle from

[jira] [Updated] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs

[ https://issues.apache.org/jira/browse/HDFS-15499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mingliang Liu updated HDFS-15499: - Description: In [HADOOP-14040] we use shaded aws-sdk uber-JAR for instead of s3 jar in hadoop-pro

[jira] [Created] (HDFS-15499) Exclude aws-java-sdk-bundle from httpfs

Mingliang Liu created HDFS-15499: Summary: Exclude aws-java-sdk-bundle from httpfs Key: HDFS-15499 URL: https://issues.apache.org/jira/browse/HDFS-15499 Project: Hadoop HDFS Issue Type: Bug

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Description: We have seen FSImage corruption cases (e.g. HDFS-13101) where files inside one snapshotta

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167526#comment-17167526 ] Siyao Meng edited comment on HDFS-15495 at 7/29/20, 10:20 PM: -

[jira] [Updated] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15495: -- Description: Originally discovered in patched CDH 6.2.1 (with a bunch of EC fixes: HDFS-14699, HDFS-14

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167526#comment-17167526 ] Siyao Meng commented on HDFS-15495: --- Awesome! Thanks [~sodonnell] for the writeup and u

[jira] [Commented] (HDFS-15329) Provide FileContext based ViewFSOverloadScheme implementation

[ https://issues.apache.org/jira/browse/HDFS-15329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167508#comment-17167508 ] Uma Maheswara Rao G commented on HDFS-15329: HI [~abhishekd], sorry for late

[jira] [Commented] (HDFS-15444) mkdir should not create dir in fallback if the dir already in mount Path

[ https://issues.apache.org/jira/browse/HDFS-15444?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167506#comment-17167506 ] Uma Maheswara Rao G commented on HDFS-15444: [~jianghuazhu], thanks you for t

[jira] [Updated] (HDFS-15498) Add an option in snapList cmd to show snapshots which are marked deleted

[ https://issues.apache.org/jira/browse/HDFS-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15498: --- Description: HDFS-15488 adds a cmd to list all snapshots for a given snapshottable di

[jira] [Created] (HDFS-15498) Add an option in snapList cmd to show snapshots which are marked deleted

Shashikant Banerjee created HDFS-15498: -- Summary: Add an option in snapList cmd to show snapshots which are marked deleted Key: HDFS-15498 URL: https://issues.apache.org/jira/browse/HDFS-15498 Pr

[jira] [Commented] (HDFS-15014) RBF: WebHdfs chooseDatanode shouldn't call getDatanodeReport

[ https://issues.apache.org/jira/browse/HDFS-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167374#comment-17167374 ] Chao Sun commented on HDFS-15014: - Thanks [~fengnanli]. Closing this as duplicate. > RBF

[jira] [Resolved] (HDFS-15014) RBF: WebHdfs chooseDatanode shouldn't call getDatanodeReport

[ https://issues.apache.org/jira/browse/HDFS-15014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chao Sun resolved HDFS-15014. - Resolution: Duplicate > RBF: WebHdfs chooseDatanode shouldn't call getDatanodeReport > -

[jira] [Commented] (HDFS-15488) Add a command to list all snapshots for a snaphottable root with snapshot Ids

[ https://issues.apache.org/jira/browse/HDFS-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167343#comment-17167343 ] Hudson commented on HDFS-15488: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167341#comment-17167341 ] Stephen O'Donnell commented on HDFS-15495: -- Here is a unit test which can be add

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167200#comment-17167200 ] Stephen O'Donnell edited comment on HDFS-15495 at 7/29/20, 4:12 PM: ---

[jira] [Comment Edited] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167200#comment-17167200 ] Stephen O'Donnell edited comment on HDFS-15495 at 7/29/20, 4:12 PM: ---

[jira] [Updated] (HDFS-15488) Add a command to list all snapshots for a snaphottable root with snapshot Ids

[ https://issues.apache.org/jira/browse/HDFS-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15488: --- Fix Version/s: 3.4.0 Resolution: Fixed Status: Resolved (was: Patch

[jira] [Reopened] (HDFS-13934) Multipart uploaders to be created through API call to FileSystem/FileContext, not service loader

[ https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ayush Saxena reopened HDFS-13934: - > Multipart uploaders to be created through API call to FileSystem/FileContext, > not service loader

[jira] [Commented] (HDFS-15484) Add option in enum Rename to suport batch rename

[ https://issues.apache.org/jira/browse/HDFS-15484?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167208#comment-17167208 ] Steve Loughran commented on HDFS-15484: --- # make the new interface one in hadoop-co

[jira] [Commented] (HDFS-15495) Decommissioning a DataNode with corrupted EC files should not be blocked indefinitely

[ https://issues.apache.org/jira/browse/HDFS-15495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167200#comment-17167200 ] Stephen O'Donnell commented on HDFS-15495: -- There are a few things to think abou

[jira] [Commented] (HDFS-15493) Update block map and name cache in parallel while loading fsimage.

[ https://issues.apache.org/jira/browse/HDFS-15493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167143#comment-17167143 ] Stephen O'Donnell commented on HDFS-15493: -- {quote} I had tested loading the cac

[jira] [Updated] (HDFS-15483) Ordered snapshot deletion: Disallow rename between two snapshottable directories

[ https://issues.apache.org/jira/browse/HDFS-15483?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-15483: - Status: Patch Available (was: Open) > Ordered snapshot deletion: Disallow rename between

[jira] [Commented] (HDFS-13934) Multipart uploaders to be created through API call to FileSystem/FileContext, not service loader

[ https://issues.apache.org/jira/browse/HDFS-13934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167094#comment-17167094 ] Ayush Saxena commented on HDFS-13934: - Hi [~ste...@apache.org], [~fabbri] This tend

[jira] [Updated] (HDFS-15497) Make snapshot limit on global as well per snapshot root directory configurable

[ https://issues.apache.org/jira/browse/HDFS-15497?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Shashikant Banerjee updated HDFS-15497: --- Attachment: HDFS-15497.000.patch > Make snapshot limit on global as well per snapshot

[jira] [Commented] (HDFS-15438) Setting dfs.disk.balancer.max.disk.errors = 0 will fail the block copy

[ https://issues.apache.org/jira/browse/HDFS-15438?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167085#comment-17167085 ] Ayush Saxena commented on HDFS-15438: - Can you check the test failures, Couple of the

[jira] [Commented] (HDFS-15229) Truncate info should be logged at INFO level

[ https://issues.apache.org/jira/browse/HDFS-15229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17167044#comment-17167044 ] Hadoop QA commented on HDFS-15229: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote

[jira] [Created] (HDFS-15497) Make snapshot limit on global as well per snapshot root directory configurable

Shashikant Banerjee created HDFS-15497: -- Summary: Make snapshot limit on global as well per snapshot root directory configurable Key: HDFS-15497 URL: https://issues.apache.org/jira/browse/HDFS-15497