[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15002396#comment-15002396
]
Yongjun Zhang commented on HDFS-8412:
-
Hi [~umamaheswararao],
Thanks for your earlier work here. It seems you only committed to trunk but not
branch-2, may I know if there is any concern so it's not done? I can
cherry-pick to branch-2 if there is no concern. Thanks.
> Fix the test failures in HTTPFS: In some tests setReplication called after fs
> close.
>
>
> Key: HDFS-8412
> URL: https://issues.apache.org/jira/browse/HDFS-8412
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: fs
>Reporter: Uma Maheswara Rao G
>Assignee: Uma Maheswara Rao G
> Fix For: 3.0.0
>
> Attachments: HDFS-8412-0.patch
>
>
> Currently 2 HTTFS test cases failing due to filesystem open check in fs
> operations
> This is the JIRA fix these failures.
> Failure seems like
> test case is closing fs first and then doing operation. Ideally such test
> could pas earlier as dfsClient was just contacting with NN directly. But that
> particular closed client will not be useful for any other ops like
> read/write. So, usage should be corrected here IMO.
> {code}
> fs.close();
> fs.setReplication(path, (short) 2);
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550277#comment-14550277
]
Hudson commented on HDFS-8412:
--
FAILURE: Integrated in Hadoop-Yarn-trunk #932 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk/932/])
HDFS-8412. Fix the test failures in HTTPFS: In some tests setReplication called
after fs close. Contributed by Uma Maheswara Rao G. (umamahesh: rev
a6af0248e9ec75e8e46ac96593070e0c9841a660)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
Fix the test failures in HTTPFS: In some tests setReplication called after fs
close.
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550307#comment-14550307
]
Hudson commented on HDFS-8412:
--
SUCCESS: Integrated in Hadoop-Yarn-trunk-Java8 #201 (See
[https://builds.apache.org/job/Hadoop-Yarn-trunk-Java8/201/])
HDFS-8412. Fix the test failures in HTTPFS: In some tests setReplication called
after fs close. Contributed by Uma Maheswara Rao G. (umamahesh: rev
a6af0248e9ec75e8e46ac96593070e0c9841a660)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
Fix the test failures in HTTPFS: In some tests setReplication called after fs
close.
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550508#comment-14550508
]
Hudson commented on HDFS-8412:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk #2130 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk/2130/])
HDFS-8412. Fix the test failures in HTTPFS: In some tests setReplication called
after fs close. Contributed by Uma Maheswara Rao G. (umamahesh: rev
a6af0248e9ec75e8e46ac96593070e0c9841a660)
*
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
Fix the test failures in HTTPFS: In some tests setReplication called after fs
close.
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550538#comment-14550538
]
Hudson commented on HDFS-8412:
--
FAILURE: Integrated in Hadoop-Hdfs-trunk-Java8 #190 (See
[https://builds.apache.org/job/Hadoop-Hdfs-trunk-Java8/190/])
HDFS-8412. Fix the test failures in HTTPFS: In some tests setReplication called
after fs close. Contributed by Uma Maheswara Rao G. (umamahesh: rev
a6af0248e9ec75e8e46ac96593070e0c9841a660)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
Fix the test failures in HTTPFS: In some tests setReplication called after fs
close.
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550634#comment-14550634
]
Hudson commented on HDFS-8412:
--
FAILURE: Integrated in Hadoop-Mapreduce-trunk #2148 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk/2148/])
HDFS-8412. Fix the test failures in HTTPFS: In some tests setReplication called
after fs close. Contributed by Uma Maheswara Rao G. (umamahesh: rev
a6af0248e9ec75e8e46ac96593070e0c9841a660)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
Fix the test failures in HTTPFS: In some tests setReplication called after fs
close.
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14550597#comment-14550597
]
Hudson commented on HDFS-8412:
--
SUCCESS: Integrated in Hadoop-Mapreduce-trunk-Java8 #200 (See
[https://builds.apache.org/job/Hadoop-Mapreduce-trunk-Java8/200/])
HDFS-8412. Fix the test failures in HTTPFS: In some tests setReplication called
after fs close. Contributed by Uma Maheswara Rao G. (umamahesh: rev
a6af0248e9ec75e8e46ac96593070e0c9841a660)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
Fix the test failures in HTTPFS: In some tests setReplication called after fs
close.
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS: In some tests setReplication called after fs close.
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14548055#comment-14548055
]
Hudson commented on HDFS-8412:
--
FAILURE: Integrated in Hadoop-trunk-Commit #7851 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/7851/])
HDFS-8412. Fix the test failures in HTTPFS: In some tests setReplication called
after fs close. Contributed by Uma Maheswara Rao G. (umamahesh: rev
a6af0248e9ec75e8e46ac96593070e0c9841a660)
* hadoop-hdfs-project/hadoop-hdfs/CHANGES.txt
*
hadoop-hdfs-project/hadoop-hdfs-httpfs/src/test/java/org/apache/hadoop/fs/http/client/BaseTestHttpFSWith.java
Fix the test failures in HTTPFS: In some tests setReplication called after fs
close.
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Fix For: 3.0.0
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14547432#comment-14547432
]
Yi Liu commented on HDFS-8412:
--
+1, thanks Uma.
Fix the test failures in HTTPFS
---
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14545314#comment-14545314
]
Uma Maheswara Rao G commented on HDFS-8412:
---
{noformat}
Running org.apache.hadoop.fs.http.client.TestHttpFSFWithSWebhdfsFileSystem
Tests run: 46, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 42.801 sec
FAILURE! - in org.apache.hadoop.fs.http.client.TestHttpFSFWithSWebhdfsFileSystem
testOperation[14](org.apache.hadoop.fs.http.client.TestHttpFSFWithSWebhdfsFileSy
stem) Time elapsed: 0.43 sec ERROR!
java.io.IOException: Filesystem closed
at org.apache.hadoop.hdfs.DFSClient.checkOpen(DFSClient.java:458)
at org.apache.hadoop.hdfs.DFSClient.setReplication(DFSClient.java:1549)
at org.apache.hadoop.hdfs.DistributedFileSystem$9.doCall(DistributedFile
System.java:519)
at org.apache.hadoop.hdfs.DistributedFileSystem$9.doCall(DistributedFile
System.java:515)
at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkRes
olver.java:81)
at org.apache.hadoop.hdfs.DistributedFileSystem.setReplication(Distribut
edFileSystem.java:515)
at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith.testSetReplicatio
n(BaseTestHttpFSWith.java:469)
at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith.operation(BaseTes
tHttpFSWith.java:865)
at org.apache.hadoop.fs.http.client.BaseTestHttpFSWith.testOperation(Bas
eTestHttpFSWith.java:917)
{noformat}
Fix the test failures in HTTPFS
---
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14545433#comment-14545433
]
Hadoop QA commented on HDFS-8412:
-
\\
\\
| (/) *{color:green}+1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | pre-patch | 5m 8s | Pre-patch trunk compilation is
healthy. |
| {color:green}+1{color} | @author | 0m 0s | The patch does not contain any
@author tags. |
| {color:green}+1{color} | tests included | 0m 0s | The patch appears to
include 1 new or modified test files. |
| {color:green}+1{color} | javac | 7m 23s | There were no new javac warning
messages. |
| {color:green}+1{color} | release audit | 0m 19s | The applied patch does
not increase the total number of release audit warnings. |
| {color:green}+1{color} | checkstyle | 0m 27s | There were no new checkstyle
issues. |
| {color:green}+1{color} | whitespace | 0m 0s | The patch has no lines that
end in whitespace. |
| {color:green}+1{color} | install | 1m 32s | mvn install still works. |
| {color:green}+1{color} | eclipse:eclipse | 0m 31s | The patch built with
eclipse:eclipse. |
| {color:green}+1{color} | findbugs | 0m 39s | The patch does not introduce
any new Findbugs (version 2.0.3) warnings. |
| {color:green}+1{color} | native | 1m 9s | Pre-build of native portion |
| {color:green}+1{color} | hdfs tests | 3m 34s | Tests passed in
hadoop-hdfs-httpfs. |
| | | 20m 45s | |
\\
\\
|| Subsystem || Report/Notes ||
| Patch URL |
http://issues.apache.org/jira/secure/attachment/12733116/HDFS-8412-0.patch |
| Optional Tests | javac unit findbugs checkstyle |
| git revision | trunk / 1ea9014 |
| hadoop-hdfs-httpfs test log |
https://builds.apache.org/job/PreCommit-HDFS-Build/11003/artifact/patchprocess/testrun_hadoop-hdfs-httpfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/11003/testReport/ |
| Java | 1.7.0_55 |
| uname | Linux asf906.gq1.ygridcore.net 3.13.0-36-lowlatency #63-Ubuntu SMP
PREEMPT Wed Sep 3 21:56:12 UTC 2014 x86_64 x86_64 x86_64 GNU/Linux |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/11003/console |
This message was automatically generated.
Fix the test failures in HTTPFS
---
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Commented] (HDFS-8412) Fix the test failures in HTTPFS
[
https://issues.apache.org/jira/browse/HDFS-8412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14545437#comment-14545437
]
Sean Busbey commented on HDFS-8412:
---
+1 (non-binding)
Fix the test failures in HTTPFS
---
Key: HDFS-8412
URL: https://issues.apache.org/jira/browse/HDFS-8412
Project: Hadoop HDFS
Issue Type: Bug
Components: fs
Reporter: Uma Maheswara Rao G
Assignee: Uma Maheswara Rao G
Attachments: HDFS-8412-0.patch
Currently 2 HTTFS test cases failing due to filesystem open check in fs
operations
This is the JIRA fix these failures.
Failure seems like
test case is closing fs first and then doing operation. Ideally such test
could pas earlier as dfsClient was just contacting with NN directly. But that
particular closed client will not be useful for any other ops like
read/write. So, usage should be corrected here IMO.
{code}
fs.close();
fs.setReplication(path, (short) 2);
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
