[jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
[
https://issues.apache.org/jira/browse/HDFS-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14601000#comment-14601000
]
Hadoop QA commented on HDFS-5277:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 17m 3s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 7m 50s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 0s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 21s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 1m 5s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 33s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 52s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | common tests | 21m 53s | Tests failed in
hadoop-common. |
| | | 62m 14s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.ipc.TestRPC |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12741824/HDFS-5277.3.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / a815cc1 |
| hadoop-common test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11486/artifact/patchprocess/testrun_hadoop-common.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11486/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11486/console |
This message was automatically generated.
hadoop fs -expunge does not work for federated namespace
-
Key: HDFS-5277
URL: https://issues.apache.org/jira/browse/HDFS-5277
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 2.0.5-alpha
Reporter: Vrushali C
Assignee: J.Andreina
Attachments: HDFS-5277.1.patch, HDFS-5277.2.patch, HDFS-5277.3.patch
We noticed that hadoop fs -expunge command does not work across federated
namespace. This seems to look at only /user/username/.Trash instead of
traversing all available namespace and expunging from individual namespace.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Auto-Re: [jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
您的邮件已收到！谢谢！
Auto-Re: [jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
您的邮件已收到！谢谢！
[jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
[
https://issues.apache.org/jira/browse/HDFS-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600773#comment-14600773
]
Hadoop QA commented on HDFS-5277:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 16m 52s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 7m 46s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 10m 4s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 22s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 1m 9s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 39s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 32s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 56s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | common tests | 24m 17s | Tests failed in
hadoop-common. |
| | | 64m 40s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests |
hadoop.security.token.delegation.web.TestWebDelegationToken |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12741789/HDFS-5277.2.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / a815cc1 |
| hadoop-common test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11482/artifact/patchprocess/testrun_hadoop-common.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11482/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf904.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11482/console |
This message was automatically generated.
hadoop fs -expunge does not work for federated namespace
-
Key: HDFS-5277
URL: https://issues.apache.org/jira/browse/HDFS-5277
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 2.0.5-alpha
Reporter: Vrushali C
Assignee: J.Andreina
Attachments: HDFS-5277.1.patch, HDFS-5277.2.patch
We noticed that hadoop fs -expunge command does not work across federated
namespace. This seems to look at only /user/username/.Trash instead of
traversing all available namespace and expunging from individual namespace.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
[
https://issues.apache.org/jira/browse/HDFS-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14600898#comment-14600898
]
Vinayakumar B commented on HDFS-5277:
-
Source Fix looks good.
But in test, test failure is actually not fixed. Its just not using {{TestLFS}}
which have the different home directory.
Since {{LocalFileSystem}} have {{RawLocalFileSystem}} as a child fs, Overriding
the home directory required in child also during creation. This can be done as
below.
{code}
}
-TestLFS(Path home) {
- super();
+
+TestLFS(final Path home) {
+ super(new RawLocalFileSystem() {
+@Override
+protected Path getInitialWorkingDirectory() {
+ return makeQualified(home);
+}
+
+@Override
+public Path getHomeDirectory() {
+ return makeQualified(home);
+}
+ });
this.home = home;
}{code}
hadoop fs -expunge does not work for federated namespace
-
Key: HDFS-5277
URL: https://issues.apache.org/jira/browse/HDFS-5277
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 2.0.5-alpha
Reporter: Vrushali C
Assignee: J.Andreina
Attachments: HDFS-5277.1.patch, HDFS-5277.2.patch
We noticed that hadoop fs -expunge command does not work across federated
namespace. This seems to look at only /user/username/.Trash instead of
traversing all available namespace and expunging from individual namespace.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Auto-Re: [jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
您的邮件已收到！谢谢！
Auto-Re: [jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
您的邮件已收到！谢谢！
[jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
[
https://issues.apache.org/jira/browse/HDFS-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14599800#comment-14599800
]
Hadoop QA commented on HDFS-5277:
-
\\
\\
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 16m 39s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:red}-1{color} | tests included | 0m 0s | The patch doesn't appear
to include any new or modified tests. Please justify why no new tests are
needed for this patch. Also please list what manual steps were performed to
verify this patch. |
| {color:green}+1{color} | javac | 7m 36s | There were no new javac warning
messages. |
| {color:green}+1{color} | javadoc | 9m 40s | There were no new javadoc
warning messages. |
| {color:green}+1{color} | release audit | 0m 24s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 1m 6s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 37s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 34s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 1m 51s | The patch does not introduce
any new Findbugs (version 3.0.0) warnings. |
| {color:red}-1{color} | common tests | 21m 36s | Tests failed in
hadoop-common. |
| | | 61m 8s | |
\\
\\
|| Reason || Tests ||
| Failed unit tests | hadoop.fs.TestTrash |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12741639/HDFS-5277.1.patch |
| Optional Tests | javadoc javac unit findbugs checkstyle |
| git revision | trunk / 8d58512 |
| hadoop-common test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11465/artifact/patchprocess/testrun_hadoop-common.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11465/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf900.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11465/console |
This message was automatically generated.
hadoop fs -expunge does not work for federated namespace
-
Key: HDFS-5277
URL: https://issues.apache.org/jira/browse/HDFS-5277
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 2.0.5-alpha
Reporter: Vrushali C
Assignee: J.Andreina
Attachments: HDFS-5277.1.patch
We noticed that hadoop fs -expunge command does not work across federated
namespace. This seems to look at only /user/username/.Trash instead of
traversing all available namespace and expunging from individual namespace.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
Auto-Re: [jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
您的邮件已收到！谢谢！
[jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
[ https://issues.apache.org/jira/browse/HDFS-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14598858#comment-14598858 ] J.Andreina commented on HDFS-5277: -- I would like to work on this issue . [~vrushalic] , if you are working on this please reassign to you. hadoop fs -expunge does not work for federated namespace - Key: HDFS-5277 URL: https://issues.apache.org/jira/browse/HDFS-5277 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 2.0.5-alpha Reporter: Vrushali C We noticed that hadoop fs -expunge command does not work across federated namespace. This seems to look at only /user/username/.Trash instead of traversing all available namespace and expunging from individual namespace. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
[ https://issues.apache.org/jira/browse/HDFS-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13786626#comment-13786626 ] Joep Rottinghuis commented on HDFS-5277: Interestingly enough there is a workaround for the expunge by passing the URL to the fs command. The help (boths docs and when typing hdfs dfs does not seem to show that additional optional argument. w/o looking at the code users won't know about this workaround. hadoop fs -expunge does not work for federated namespace - Key: HDFS-5277 URL: https://issues.apache.org/jira/browse/HDFS-5277 Project: Hadoop HDFS Issue Type: Bug Affects Versions: 2.0.5-alpha Reporter: Vrushali C We noticed that hadoop fs -expunge command does not work across federated namespace. This seems to look at only /user/username/.Trash instead of traversing all available namespace and expunging from individual namespace. -- This message was sent by Atlassian JIRA (v6.1#6144)
[jira] [Commented] (HDFS-5277) hadoop fs -expunge does not work for federated namespace
[
https://issues.apache.org/jira/browse/HDFS-5277?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13782046#comment-13782046
]
Vrushali C commented on HDFS-5277:
--
Trying to expose federated namespace from within FSShell to get expunge working
might be tricky and not very clean. Passing a filesystem argument to the
expunge works and results in creating a timestamp-named directory inside trash
and moves the contents under current to that dir.
For example, if one of the namespaces is called namespace1 in the cluster, a
command like the following will work:
{noformat}
$hadoop fs -fs hdfs://namespace1/ -expunge
13/09/27 23:07:06 INFO fs.TrashPolicyDefault: Created trash checkpoint:
/user/hadoop/.Trash/130927230706
$ hadoop fs -ls hdfs://namespace1/user/hadoop/.Trash
Found 1 items
drwx-- - hadoop hadoop 0 2013-09-27 22:59
hdfs://namespace1/user/hadoop/.Trash/130927230706
$
{noformat}
hadoop fs -expunge does not work for federated namespace
-
Key: HDFS-5277
URL: https://issues.apache.org/jira/browse/HDFS-5277
Project: Hadoop HDFS
Issue Type: Bug
Affects Versions: 2.0.5-alpha
Reporter: Vrushali C
We noticed that hadoop fs -expunge command does not work across federated
namespace. This seems to look at only /user/username/.Trash instead of
traversing all available namespace and expunging from individual namespace.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
