[jira] [Commented] (HDFS-14975) Add CR for SetECPolicyCommand usage
[
https://issues.apache.org/jira/browse/HDFS-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971340#comment-16971340
]
Fei Hui commented on HDFS-14975:
[~aajisaka] Thanks
Commit message should be changed to LF
> Add CR for SetECPolicyCommand usage
> ---
>
> Key: HDFS-14975
> URL: https://issues.apache.org/jira/browse/HDFS-14975
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 3.3.0
>Reporter: Fei Hui
>Assignee: Fei Hui
>Priority: Trivial
> Fix For: 3.3.0
>
> Attachments: HDFS-14975.001.patch
>
>
> *bin/hdfs ec -help* output the following message
> {quote}
> [-listPolicies]
> Get the list of all erasure coding policies.
> [-addPolicies -policyFile ]
> Add a list of user defined erasure coding policies.
> The path of the xml file which defines the EC policies to add
> [-getPolicy -path ]
> Get the erasure coding policy of a file/directory.
> The path of the file/directory for getting the erasure coding policy
> [-removePolicy -policy ]
> Remove an user defined erasure coding policy.
> The name of the erasure coding policy
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will
> be
> unset.
>
> [-listCodecs]
> Get the list of supported erasure coding codecs and coders.
> A coder is an implementation of a codec. A codec can have different
> implementations, thus different coders.
> The coders for a codec are listed in a fall back order.
> [-enablePolicy -policy ]
> Enable the erasure coding policy.
> The name of the erasure coding policy
> [-disablePolicy -policy ]
> Disable the erasure coding policy.
> The name of the erasure coding policy
> [-verifyClusterSetup [-policy ...]]
> Verify if the cluster setup can support all enabled erasure coding policies.
> If optional parameter -policy is specified, verify if the cluster setup can
> support the given policy.
> {quote}
> The output format is not so good to users
> We should add CR between SetECPolicyCommand and UnsetECPolicyCommand like
> other commands
> {quote}
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> -here-
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will be
> unset.
> {quote}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14975) Add CR for SetECPolicyCommand usage
[
https://issues.apache.org/jira/browse/HDFS-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971331#comment-16971331
]
Akira Ajisaka commented on HDFS-14975:
--
Thanks [~ferhui] and [~ayushtkn] for the fix.
Note that the commit log is confusing. Actually LF ('\n') has been added
instead of CR.
> Add CR for SetECPolicyCommand usage
> ---
>
> Key: HDFS-14975
> URL: https://issues.apache.org/jira/browse/HDFS-14975
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 3.3.0
>Reporter: Fei Hui
>Assignee: Fei Hui
>Priority: Trivial
> Fix For: 3.3.0
>
> Attachments: HDFS-14975.001.patch
>
>
> *bin/hdfs ec -help* output the following message
> {quote}
> [-listPolicies]
> Get the list of all erasure coding policies.
> [-addPolicies -policyFile ]
> Add a list of user defined erasure coding policies.
> The path of the xml file which defines the EC policies to add
> [-getPolicy -path ]
> Get the erasure coding policy of a file/directory.
> The path of the file/directory for getting the erasure coding policy
> [-removePolicy -policy ]
> Remove an user defined erasure coding policy.
> The name of the erasure coding policy
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will
> be
> unset.
>
> [-listCodecs]
> Get the list of supported erasure coding codecs and coders.
> A coder is an implementation of a codec. A codec can have different
> implementations, thus different coders.
> The coders for a codec are listed in a fall back order.
> [-enablePolicy -policy ]
> Enable the erasure coding policy.
> The name of the erasure coding policy
> [-disablePolicy -policy ]
> Disable the erasure coding policy.
> The name of the erasure coding policy
> [-verifyClusterSetup [-policy ...]]
> Verify if the cluster setup can support all enabled erasure coding policies.
> If optional parameter -policy is specified, verify if the cluster setup can
> support the given policy.
> {quote}
> The output format is not so good to users
> We should add CR between SetECPolicyCommand and UnsetECPolicyCommand like
> other commands
> {quote}
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> -here-
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will be
> unset.
> {quote}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14975) Add CR for SetECPolicyCommand usage
[
https://issues.apache.org/jira/browse/HDFS-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971327#comment-16971327
]
Hudson commented on HDFS-14975:
---
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #17625 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/17625/])
HDFS-14975. Add CR for SetECPolicyCommand usage. Contributed by Fei Hui.
(ayushsaxena: rev 77934bc07b9bef3e129826e93e1c1e8a47c00c95)
* (edit)
hadoop-hdfs-project/hadoop-hdfs/src/main/java/org/apache/hadoop/hdfs/tools/ECAdmin.java
> Add CR for SetECPolicyCommand usage
> ---
>
> Key: HDFS-14975
> URL: https://issues.apache.org/jira/browse/HDFS-14975
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 3.3.0
>Reporter: Fei Hui
>Assignee: Fei Hui
>Priority: Trivial
> Fix For: 3.3.0
>
> Attachments: HDFS-14975.001.patch
>
>
> *bin/hdfs ec -help* output the following message
> {quote}
> [-listPolicies]
> Get the list of all erasure coding policies.
> [-addPolicies -policyFile ]
> Add a list of user defined erasure coding policies.
> The path of the xml file which defines the EC policies to add
> [-getPolicy -path ]
> Get the erasure coding policy of a file/directory.
> The path of the file/directory for getting the erasure coding policy
> [-removePolicy -policy ]
> Remove an user defined erasure coding policy.
> The name of the erasure coding policy
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will
> be
> unset.
>
> [-listCodecs]
> Get the list of supported erasure coding codecs and coders.
> A coder is an implementation of a codec. A codec can have different
> implementations, thus different coders.
> The coders for a codec are listed in a fall back order.
> [-enablePolicy -policy ]
> Enable the erasure coding policy.
> The name of the erasure coding policy
> [-disablePolicy -policy ]
> Disable the erasure coding policy.
> The name of the erasure coding policy
> [-verifyClusterSetup [-policy ...]]
> Verify if the cluster setup can support all enabled erasure coding policies.
> If optional parameter -policy is specified, verify if the cluster setup can
> support the given policy.
> {quote}
> The output format is not so good to users
> We should add CR between SetECPolicyCommand and UnsetECPolicyCommand like
> other commands
> {quote}
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> -here-
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will be
> unset.
> {quote}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14975) Add CR for SetECPolicyCommand usage
[
https://issues.apache.org/jira/browse/HDFS-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16971320#comment-16971320
]
Ayush Saxena commented on HDFS-14975:
-
+1
> Add CR for SetECPolicyCommand usage
> ---
>
> Key: HDFS-14975
> URL: https://issues.apache.org/jira/browse/HDFS-14975
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 3.3.0
>Reporter: Fei Hui
>Assignee: Fei Hui
>Priority: Trivial
> Attachments: HDFS-14975.001.patch
>
>
> *bin/hdfs ec -help* output the following message
> {quote}
> [-listPolicies]
> Get the list of all erasure coding policies.
> [-addPolicies -policyFile ]
> Add a list of user defined erasure coding policies.
> The path of the xml file which defines the EC policies to add
> [-getPolicy -path ]
> Get the erasure coding policy of a file/directory.
> The path of the file/directory for getting the erasure coding policy
> [-removePolicy -policy ]
> Remove an user defined erasure coding policy.
> The name of the erasure coding policy
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will
> be
> unset.
>
> [-listCodecs]
> Get the list of supported erasure coding codecs and coders.
> A coder is an implementation of a codec. A codec can have different
> implementations, thus different coders.
> The coders for a codec are listed in a fall back order.
> [-enablePolicy -policy ]
> Enable the erasure coding policy.
> The name of the erasure coding policy
> [-disablePolicy -policy ]
> Disable the erasure coding policy.
> The name of the erasure coding policy
> [-verifyClusterSetup [-policy ...]]
> Verify if the cluster setup can support all enabled erasure coding policies.
> If optional parameter -policy is specified, verify if the cluster setup can
> support the given policy.
> {quote}
> The output format is not so good to users
> We should add CR between SetECPolicyCommand and UnsetECPolicyCommand like
> other commands
> {quote}
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> -here-
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will be
> unset.
> {quote}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-14975) Add CR for SetECPolicyCommand usage
[
https://issues.apache.org/jira/browse/HDFS-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970900#comment-16970900
]
Hadoop QA commented on HDFS-14975:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 1m
37s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} trunk Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 20m
5s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
59s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
43s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
7s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
14m 28s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
16s{color} | {color:green} trunk passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
15s{color} | {color:green} trunk passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
1s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
38s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
13m 37s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
22s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
10s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:green}+1{color} | {color:green} unit {color} | {color:green} 99m
28s{color} | {color:green} hadoop-hdfs in the patch passed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
33s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}163m 10s{color} |
{color:black} {color} |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=19.03.4 Server=19.03.4 Image:yetus/hadoop:104ccca9169 |
| JIRA Issue | HDFS-14975 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12985425/HDFS-14975.001.patch |
| Optional Tests | dupname asflicense compile javac javadoc mvninstall
mvnsite unit shadedclient findbugs checkstyle |
| uname | Linux 7128cd6bc9ad 4.15.0-66-generic #75-Ubuntu SMP Tue Oct 1
05:24:09 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | trunk / 3d24930 |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_222 |
| findbugs | v3.1.0-RC1 |
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/28284/testReport/ |
| Max. process+thread count | 2686 (vs. ulimit of 5500) |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U:
hadoop-hdfs-project/hadoop-hdfs |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/28284/console |
| Powered by | Apache Yetus 0.8.0 http://yetus.apache.org |
This message was automatically generated.
> Add CR for SetECPolicyCommand usage
>
[jira] [Commented] (HDFS-14975) Add CR for SetECPolicyCommand usage
[
https://issues.apache.org/jira/browse/HDFS-14975?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16970832#comment-16970832
]
Fei Hui commented on HDFS-14975:
Upload the simple patch
> Add CR for SetECPolicyCommand usage
> ---
>
> Key: HDFS-14975
> URL: https://issues.apache.org/jira/browse/HDFS-14975
> Project: Hadoop HDFS
> Issue Type: Improvement
>Affects Versions: 3.3.0
>Reporter: Fei Hui
>Assignee: Fei Hui
>Priority: Trivial
> Attachments: HDFS-14975.001.patch
>
>
> *bin/hdfs ec -help* output the following message
> {quote}
> [-listPolicies]
> Get the list of all erasure coding policies.
> [-addPolicies -policyFile ]
> Add a list of user defined erasure coding policies.
> The path of the xml file which defines the EC policies to add
> [-getPolicy -path ]
> Get the erasure coding policy of a file/directory.
> The path of the file/directory for getting the erasure coding policy
> [-removePolicy -policy ]
> Remove an user defined erasure coding policy.
> The name of the erasure coding policy
> [-setPolicy -path [-policy ] [-replicate]]
> Set the erasure coding policy for a file/directory.
> The path of the file/directory to set the erasure coding policy
> The name of the erasure coding policy
> -replicate force 3x replication scheme on the directory
> -replicate and -policy are optional arguments. They cannot been used at the
> same time
> [-unsetPolicy -path ]
> Unset the erasure coding policy for a directory.
> The path of the directory from which the erasure coding policy will
> be
> unset.
>
> [-listCodecs]
> Get the list of supported erasure coding codecs and coders.
> A coder is an implementation of a codec. A codec can have different
> implementations, thus different coders.
> The coders for a codec are listed in a fall back order.
> [-enablePolicy -policy ]
> Enable the erasure coding policy.
> The name of the erasure coding policy
> [-disablePolicy -policy ]
> Disable the erasure coding policy.
> The name of the erasure coding policy
> [-verifyClusterSetup [-policy ...]]
> Verify if the cluster setup can support all enabled erasure coding policies.
> If optional parameter -policy is specified, verify if the cluster setup can
> support the given policy.
> {quote}
> The output format is not so good to users
> We should add CR between SetECPolicyCommand and UnsetECPolicyCommand like
> other commands
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
