[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455164#comment-16455164 ] Hudson commented on HDFS-12167: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14070 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14070/]) HDFS-12167. Ozone: Intermittent failure (omalley: rev b00830142be2e9b7b25f71fbbcafcd09d32907fa) * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/ozone/container/common/impl/TestContainerPersistence.java > Ozone: Intermittent failure TestContainerPersistence#testListKey > > > Key: HDFS-12167 > URL: https://issues.apache.org/jira/browse/HDFS-12167 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone, test >Affects Versions: HDFS-7240 >Reporter: Weiwei Yang >Assignee: Surendra Singh Lilhore >Priority: Minor > Fix For: HDFS-7240 > > Attachments: HDFS-12167-HDFS-7240.001.patch > > > TestContainerPersistence#listKeys seems to fail intermittently. It looks > like it was failing because some unexpected format of container name. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16450913#comment-16450913 ] Hudson commented on HDFS-12167: --- SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14057 (See [https://builds.apache.org/job/Hadoop-trunk-Commit/14057/]) HDFS-12167. Ozone: Intermittent failure (wwei: rev c539095200142b1c448c06584f757be0a335bee6) * (edit) hadoop-hdfs-project/hadoop-hdfs/src/test/java/org/apache/hadoop/ozone/container/common/impl/TestContainerPersistence.java > Ozone: Intermittent failure TestContainerPersistence#testListKey > > > Key: HDFS-12167 > URL: https://issues.apache.org/jira/browse/HDFS-12167 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone, test >Affects Versions: HDFS-7240 >Reporter: Weiwei Yang >Assignee: Surendra Singh Lilhore >Priority: Minor > Fix For: HDFS-7240 > > Attachments: HDFS-12167-HDFS-7240.001.patch > > > TestContainerPersistence#listKeys seems to fail intermittently. It looks > like it was failing because some unexpected format of container name. -- This message was sent by Atlassian JIRA (v7.6.3#76005) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097706#comment-16097706 ] Surendra Singh Lilhore commented on HDFS-12167: --- Thanks [~cheersyang] for review and commit. Thanks [~anu] > Ozone: Intermittent failure TestContainerPersistence#testListKey > > > Key: HDFS-12167 > URL: https://issues.apache.org/jira/browse/HDFS-12167 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone, test >Affects Versions: HDFS-7240 >Reporter: Weiwei Yang >Assignee: Surendra Singh Lilhore >Priority: Minor > Fix For: HDFS-7240 > > Attachments: HDFS-12167-HDFS-7240.001.patch > > > TestContainerPersistence#listKeys seems to fail intermittently. It looks > like it was failing because some unexpected format of container name. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097393#comment-16097393 ] Anu Engineer commented on HDFS-12167: - [~surendrasingh] Welcome to Ozone !, Thank you for the contribution. > Ozone: Intermittent failure TestContainerPersistence#testListKey > > > Key: HDFS-12167 > URL: https://issues.apache.org/jira/browse/HDFS-12167 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone, test >Affects Versions: HDFS-7240 >Reporter: Weiwei Yang >Assignee: Surendra Singh Lilhore >Priority: Minor > Fix For: HDFS-7240 > > Attachments: HDFS-12167-HDFS-7240.001.patch > > > TestContainerPersistence#listKeys seems to fail intermittently. It looks > like it was failing because some unexpected format of container name. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097342#comment-16097342 ] Weiwei Yang commented on HDFS-12167: I have committed this to the feature branch, thanks [~surendrasingh] for the contribution! > Ozone: Intermittent failure TestContainerPersistence#testListKey > > > Key: HDFS-12167 > URL: https://issues.apache.org/jira/browse/HDFS-12167 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone, test >Affects Versions: HDFS-7240 >Reporter: Weiwei Yang >Assignee: Surendra Singh Lilhore >Priority: Minor > Fix For: HDFS-7240 > > Attachments: HDFS-12167-HDFS-7240.001.patch > > > TestContainerPersistence#listKeys seems to fail intermittently. It looks > like it was failing because some unexpected format of container name. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[ https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097336#comment-16097336 ] Weiwei Yang commented on HDFS-12167: Thanks [~surendrasingh] for fixing this issue, the change looks good to me, I am going to commit this shortly. > Ozone: Intermittent failure TestContainerPersistence#testListKey > > > Key: HDFS-12167 > URL: https://issues.apache.org/jira/browse/HDFS-12167 > Project: Hadoop HDFS > Issue Type: Sub-task > Components: ozone, test >Reporter: Weiwei Yang >Assignee: Surendra Singh Lilhore >Priority: Minor > Attachments: HDFS-12167-HDFS-7240.001.patch > > > TestContainerPersistence#listKeys seems to fail intermittently. It looks > like it was failing because some unexpected format of container name. -- This message was sent by Atlassian JIRA (v6.4.14#64029) - To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[
https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16097224#comment-16097224
]
Hadoop QA commented on HDFS-12167:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
10s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:green}+1{color} | {color:green} test4tests {color} | {color:green} 0m
0s{color} | {color:green} The patch appears to include 1 new or modified test
files. {color} |
|| || || || {color:brown} HDFS-7240 Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 15m
4s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 1m
5s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
42s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
15s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
13s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
57s{color} | {color:green} HDFS-7240 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
8s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
57s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
57s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} checkstyle {color} | {color:green} 0m
36s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} findbugs {color} | {color:green} 2m
6s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
50s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red} 78m 41s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
23s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}108m 29s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure080 |
| | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailureReporting |
| | hadoop.hdfs.server.datanode.TestDataNodeVolumeFailure |
| | hadoop.hdfs.server.datanode.fsdataset.impl.TestLazyPersistReplicaRecovery
|
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Image:yetus/hadoop:14b5c93 |
| JIRA Issue | HDFS-12167 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12878462/HDFS-12167-HDFS-7240.001.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit findbugs checkstyle |
| uname | Linux 4b5b91f3bb80 3.13.0-123-generic #172-Ubuntu SMP Mon Jun 26
18:04:35 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/hadoop/patchprocess/precommit/personality/provided.sh
|
| git revision | HDFS-7240 / 63e211f |
| Default Java | 1.8.0_131 |
| findbugs | v3.1.0-RC1 |
| unit |
https://builds.apache.org/job/PreCommit-HDFS-Build/20390/artifact/patchprocess/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
|
| Test Results |
https://builds.apache.org/job/PreCommit-HDFS-Build/20390/testReport/ |
| modules | C: hadoop-hdfs-project/hadoop-hdfs U:
hadoop-hdfs-project/hadoop-hdfs |
| Console output |
https://builds.apache.org/job/PreCommit-HDFS-Build/20390/console |
| Powered by | Apache Yetus 0.6.0-SNAPSHOT http://yetus.apache.org |
This message was automatically generated.
> Ozone: Intermittent failure TestContainerPersistence#testListKey
>
>
> Key: HDFS-12167
> URL:
[jira] [Commented] (HDFS-12167) Ozone: Intermittent failure TestContainerPersistence#testListKey
[
https://issues.apache.org/jira/browse/HDFS-12167?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16094728#comment-16094728
]
Weiwei Yang commented on HDFS-12167:
See error message
{noformat}
Error Message
Unable to find the container. Name: c0@]=[3/~C"8
Stacktrace
org.apache.hadoop.scm.container.common.helpers.StorageContainerException:
Unable to find the container. Name: c0@]=[3/~C"8
at
org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.readContainer(ContainerManagerImpl.java:486)
at
org.apache.hadoop.ozone.container.common.impl.ChunkManagerImpl.writeChunk(ChunkManagerImpl.java:80)
at
org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.writeChunkHelper(TestContainerPersistence.java:373)
at
org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.writeKeyHelper(TestContainerPersistence.java:809)
at
org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.testListKey(TestContainerPersistence.java:825)
Standard Output
2017-07-20 10:02:34,116 [Thread-13] INFO impl.ContainerManagerImpl
(ContainerManagerImpl.java:init(149)) - Loading containers under
[DISK]file:/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/4/TestContainerPersistence/tmp/ozone/repository
2017-07-20 10:02:34,122 [Thread-13] WARN fs.CachingGetSpaceUsed
(DU.java:refresh(55)) - Could not get disk usage information for path
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/4/dfs/data
java.io.IOException: Expecting a line not the end of stream
at org.apache.hadoop.fs.DU$DUShell.parseExecResult(DU.java:79)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:980)
at org.apache.hadoop.util.Shell.run(Shell.java:887)
at org.apache.hadoop.fs.DU$DUShell.startRefresh(DU.java:62)
at org.apache.hadoop.fs.DU.refresh(DU.java:53)
at
org.apache.hadoop.fs.CachingGetSpaceUsed.init(CachingGetSpaceUsed.java:87)
at
org.apache.hadoop.fs.GetSpaceUsed$Builder.build(GetSpaceUsed.java:166)
at
org.apache.hadoop.ozone.container.common.impl.ContainerStorageLocation.(ContainerStorageLocation.java:73)
at
org.apache.hadoop.ozone.container.common.impl.ContainerLocationManagerImpl.(ContainerLocationManagerImpl.java:67)
at
org.apache.hadoop.ozone.container.common.impl.ContainerManagerImpl.init(ContainerManagerImpl.java:168)
at
org.apache.hadoop.ozone.container.common.impl.TestContainerPersistence.setupPaths(TestContainerPersistence.java:146)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
at
org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
at
org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
at
org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24)
at
org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27)
at
org.junit.rules.ExpectedException$ExpectedExceptionStatement.evaluate(ExpectedException.java:168)
at
org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
2017-07-20 10:02:34,132 [Thread-13] INFO impl.TestContainerPersistence
(TestContainerPersistence.java:cleanupDir(152)) - Deletting
/testptch/hadoop/hadoop-hdfs-project/hadoop-hdfs/target/test/data/4/TestContainerPersistence/tmp/ozone
{noformat}
[https://builds.apache.org/job/PreCommit-HDFS-Build/20346/testReport/org.apache.hadoop.ozone.container.common.impl/TestContainerPersistence/testListKey/]
> Ozone: Intermittent failure TestContainerPersistence#testListKey
>
>
> Key: HDFS-12167
> URL: https://issues.apache.org/jira/browse/HDFS-12167
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone, test
>Reporter: Weiwei Yang
>Priority: Minor
>
> TestContainerPersistence#listKeys seems to fail intermittently. It looks
> like it was failing because some unexpected format of container name.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
