[jira] [Commented] (HDFS-15482) Ordered snapshot deletion: hide the deleted snapshots from users

2020-07-23 Thread jianghua zhu (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164078#comment-17164078 ] jianghua zhu commented on HDFS-15482: - For users, snapshots that have been deleted should not be

[jira] [Commented] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17164004#comment-17164004 ] Tsz-wo Sze commented on HDFS-15479: --- [~ayushtkn], I also notice the failure recently. I am going to

[jira] [Commented] (HDFS-15479) Ordered snapshot deletion: make it a configurable feature

2020-07-23 Thread Ayush Saxena (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163977#comment-17163977 ] Ayush Saxena commented on HDFS-15479: - Hi everyone Seems this breaks,

[jira] [Commented] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163975#comment-17163975 ] Hadoop QA commented on HDFS-15481: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Commented] (HDFS-15439) Setting dfs.mover.retry.max.attempts to negative value will retry forever.

2020-07-23 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15439?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163974#comment-17163974 ] AMC-team commented on HDFS-15439: - Thanks [~ayushtkn] for the great suggestion! That's actually what I

[jira] [Commented] (HDFS-15443) Setting dfs.datanode.max.transfer.threads to a very small value can cause strange failure.

2020-07-23 Thread AMC-team (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15443?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163966#comment-17163966 ] AMC-team commented on HDFS-15443: - Sure But before that, I'm thinking that can we fall back the

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: (was: h15481_20200723b.patch) > Ordered snapshot deletion: garbage collect deleted

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: h15481_20200723b.patch > Ordered snapshot deletion: garbage collect deleted snapshots >

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: h15481_20200723b.patch > Ordered snapshot deletion: garbage collect deleted snapshots >

[jira] [Commented] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163841#comment-17163841 ] Tsz-wo Sze commented on HDFS-15481: --- h15481_20200723b.patch: Fix checkstyle and move the private confs

[jira] [Commented] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163816#comment-17163816 ] Tsz-wo Sze commented on HDFS-15481: --- https://github.com/apache/hadoop/pull/2165 > Ordered snapshot

[jira] [Updated] (HDFS-15488) Add a command to list all snapshots for a snaphottable root with snapshot Ids

2020-07-23 Thread Mukul Kumar Singh (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15488?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mukul Kumar Singh updated HDFS-15488: - Status: Patch Available (was: Open) > Add a command to list all snapshots for a

[jira] [Commented] (HDFS-15473) Add listSnapshots command to list all snapshots

2020-07-23 Thread Hemanth Boyina (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163808#comment-17163808 ] Hemanth Boyina commented on HDFS-15473: --- thanks for the review [~weichiu] {quote}We don't have a

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Affects Version/s: 3.2.1 > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Target Version/s: 3.3.1 > Make trash root inside each snapshottable directory >

[jira] [Updated] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15492?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siyao Meng updated HDFS-15492: -- Component/s: hdfs-client hdfs > Make trash root inside each snapshottable directory >

[jira] [Created] (HDFS-15492) Make trash root inside each snapshottable directory

2020-07-23 Thread Siyao Meng (Jira)
Siyao Meng created HDFS-15492: - Summary: Make trash root inside each snapshottable directory Key: HDFS-15492 URL: https://issues.apache.org/jira/browse/HDFS-15492 Project: Hadoop HDFS Issue

[jira] [Comment Edited] (HDFS-15473) Add listSnapshots command to list all snapshots

2020-07-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163753#comment-17163753 ] Wei-Chiu Chuang edited comment on HDFS-15473 at 7/23/20, 4:41 PM: -- bq.

[jira] [Commented] (HDFS-15473) Add listSnapshots command to list all snapshots

2020-07-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163753#comment-17163753 ] Wei-Chiu Chuang commented on HDFS-15473: bq. Also, can you add a metrics for the number of total

[jira] [Commented] (HDFS-15473) Add listSnapshots command to list all snapshots

2020-07-23 Thread Wei-Chiu Chuang (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163723#comment-17163723 ] Wei-Chiu Chuang commented on HDFS-15473: Ideally, you want to use an iterator to return partial

[jira] [Commented] (HDFS-13596) NN restart fails after RollingUpgrade from 2.x to 3.x

2020-07-23 Thread Fei Hui (Jira)
[ https://issues.apache.org/jira/browse/HDFS-13596?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163518#comment-17163518 ] Fei Hui commented on HDFS-13596: [~fengwu99] You are right! Failed is related to HDFS-8791. > NN

[jira] [Commented] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Hadoop QA (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17163444#comment-17163444 ] Hadoop QA commented on HDFS-15481: -- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem ||

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Status: Patch Available (was: Open) h15481_20200723.patch: add a gc thread to check and gc

[jira] [Updated] (HDFS-15481) Ordered snapshot deletion: garbage collect deleted snapshots

2020-07-23 Thread Tsz-wo Sze (Jira)
[ https://issues.apache.org/jira/browse/HDFS-15481?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tsz-wo Sze updated HDFS-15481: -- Attachment: h15481_20200723.patch > Ordered snapshot deletion: garbage collect deleted snapshots >