[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently
[
https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16455338#comment-16455338
]
Hudson commented on HDFS-12867:
---
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14070 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/14070/])
HDFS-12867. Ozone: TestOzoneConfigurationFields fails consistently. (omalley:
rev 85ec48a6463ca2396d2376271fc336bbe30dd85f)
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/ozone-default.xml
> Ozone: TestOzoneConfigurationFields fails consistently
> --
>
> Key: HDFS-12867
> URL: https://issues.apache.org/jira/browse/HDFS-12867
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone, test
>Affects Versions: HDFS-7240
>Reporter: Yiqun Lin
>Assignee: Yiqun Lin
>Priority: Major
> Fix For: HDFS-7240
>
> Attachments: HDFS-12867-HDFS-7240.001.patch,
> HDFS-12867-HDFS-7240.002.patch
>
>
> The unit test TestOzoneConfigurationFields fails consistently because of 2
> config entries missing in ozone-default file. The stack trace:
> {noformat}
> java.lang.AssertionError: class org.apache.hadoop.ozone.OzoneConfigKeys class
> org.apache.hadoop.scm.ScmConfigKeys class
> org.apache.hadoop.ozone.ksm.KSMConfigKeys class
> org.apache.hadoop.cblock.CBlockConfigKeys has 2 variables missing in
> ozone-default.xml Entries: ozone.rest.client.port ozone.rest.servers
> expected:<0> but was:<2>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at
> org.apache.hadoop.conf.TestConfigurationFieldsBase.testCompareConfigurationClassAgainstXml(TestConfigurationFieldsBase.java:493)
> {noformat}
> The config {{ozone.rest.client.port}}, {{ozone.rest.servers}} were introduced
> in HDFS-12549 but missing to documented. This leads the failure.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently
[
https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16451126#comment-16451126
]
Hudson commented on HDFS-12867:
---
SUCCESS: Integrated in Jenkins build Hadoop-trunk-Commit #14057 (See
[https://builds.apache.org/job/Hadoop-trunk-Commit/14057/])
HDFS-12867. Ozone: TestOzoneConfigurationFields fails consistently. (xyao: rev
76b8ba737f017efbd19109408c2c81ae8b3b886a)
* (edit) hadoop-hdfs-project/hadoop-hdfs/src/main/resources/ozone-default.xml
> Ozone: TestOzoneConfigurationFields fails consistently
> --
>
> Key: HDFS-12867
> URL: https://issues.apache.org/jira/browse/HDFS-12867
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone, test
>Affects Versions: HDFS-7240
>Reporter: Yiqun Lin
>Assignee: Yiqun Lin
>Priority: Major
> Fix For: HDFS-7240
>
> Attachments: HDFS-12867-HDFS-7240.001.patch,
> HDFS-12867-HDFS-7240.002.patch
>
>
> The unit test TestOzoneConfigurationFields fails consistently because of 2
> config entries missing in ozone-default file. The stack trace:
> {noformat}
> java.lang.AssertionError: class org.apache.hadoop.ozone.OzoneConfigKeys class
> org.apache.hadoop.scm.ScmConfigKeys class
> org.apache.hadoop.ozone.ksm.KSMConfigKeys class
> org.apache.hadoop.cblock.CBlockConfigKeys has 2 variables missing in
> ozone-default.xml Entries: ozone.rest.client.port ozone.rest.servers
> expected:<0> but was:<2>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at
> org.apache.hadoop.conf.TestConfigurationFieldsBase.testCompareConfigurationClassAgainstXml(TestConfigurationFieldsBase.java:493)
> {noformat}
> The config {{ozone.rest.client.port}}, {{ozone.rest.servers}} were introduced
> in HDFS-12549 but missing to documented. This leads the failure.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently
[
https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270703#comment-16270703
]
genericqa commented on HDFS-12867:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
38s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} HDFS-7240 Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 16m
37s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
58s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
59s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
28m 34s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} HDFS-7240 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
2s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
54s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
2s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
10m 52s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 0m
59s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}140m 47s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
25s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}187m 16s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests |
hadoop.hdfs.server.balancer.TestBalancerWithSaslDataTransfer |
| | hadoop.hdfs.TestDistributedFileSystemWithECFileWithRandomECPolicy |
| | hadoop.hdfs.TestDecommissionWithStriped |
| | hadoop.fs.TestUnbuffer |
| | hadoop.hdfs.web.TestWebHdfsTimeouts |
| | hadoop.ozone.web.client.TestKeys |
| | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure |
| | hadoop.cblock.TestBufferManager |
| | hadoop.hdfs.TestReadStripedFileWithMissingBlocks |
| | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure130 |
| | hadoop.ozone.client.rpc.TestOzoneRpcClient |
| | hadoop.hdfs.TestUnsetAndChangeDirectoryEcPolicy |
| | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure030 |
| | hadoop.ozone.web.client.TestKeysRatis |
| | hadoop.hdfs.TestParallelUnixDomainRead |
| | hadoop.hdfs.server.balancer.TestBalancerRPCDelay |
| | hadoop.hdfs.TestDFSClientRetries |
| | hadoop.cblock.TestCBlockReadWrite |
| | hadoop.hdfs.TestDistributedFileSystemWithECFile |
| | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure100 |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:d11161b |
| JIRA Issue | HDFS-12867 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12899789/HDFS-12867-HDFS-7240.002.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient xml |
| uname | Linux 9a3c4c453da0 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20
11:50:30 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build
[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently
[
https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270503#comment-16270503
]
Yiqun Lin commented on HDFS-12867:
--
Thanks for the quick reviews, [~anu] and [~nandakumar131].
Attach the updated patch for addressing comment.
> Ozone: TestOzoneConfigurationFields fails consistently
> --
>
> Key: HDFS-12867
> URL: https://issues.apache.org/jira/browse/HDFS-12867
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone, test
>Affects Versions: HDFS-7240
>Reporter: Yiqun Lin
>Assignee: Yiqun Lin
> Attachments: HDFS-12867-HDFS-7240.001.patch
>
>
> The unit test TestOzoneConfigurationFields fails consistently because of 2
> config entries missing in ozone-default file. The stack trace:
> {noformat}
> java.lang.AssertionError: class org.apache.hadoop.ozone.OzoneConfigKeys class
> org.apache.hadoop.scm.ScmConfigKeys class
> org.apache.hadoop.ozone.ksm.KSMConfigKeys class
> org.apache.hadoop.cblock.CBlockConfigKeys has 2 variables missing in
> ozone-default.xml Entries: ozone.rest.client.port ozone.rest.servers
> expected:<0> but was:<2>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at
> org.apache.hadoop.conf.TestConfigurationFieldsBase.testCompareConfigurationClassAgainstXml(TestConfigurationFieldsBase.java:493)
> {noformat}
> The config {{ozone.rest.client.port}}, {{ozone.rest.servers}} were introduced
> in HDFS-12549 but missing to documented. This leads the failure.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently
[
https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270475#comment-16270475
]
genericqa commented on HDFS-12867:
--
| (x) *{color:red}-1 overall{color}* |
\\
\\
|| Vote || Subsystem || Runtime || Comment ||
| {color:blue}0{color} | {color:blue} reexec {color} | {color:blue} 0m
19s{color} | {color:blue} Docker mode activated. {color} |
|| || || || {color:brown} Prechecks {color} ||
| {color:green}+1{color} | {color:green} @author {color} | {color:green} 0m
0s{color} | {color:green} The patch does not contain any @author tags. {color} |
| {color:red}-1{color} | {color:red} test4tests {color} | {color:red} 0m
0s{color} | {color:red} The patch doesn't appear to include any new or modified
tests. Please justify why no new tests are needed for this patch. Also please
list what manual steps were performed to verify this patch. {color} |
|| || || || {color:brown} HDFS-7240 Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 17m
0s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
57s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 1m
2s{color} | {color:green} HDFS-7240 passed {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
29m 45s{color} | {color:green} branch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
1s{color} | {color:green} HDFS-7240 passed {color} |
|| || || || {color:brown} Patch Compile Tests {color} ||
| {color:green}+1{color} | {color:green} mvninstall {color} | {color:green} 1m
0s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} compile {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} javac {color} | {color:green} 0m
55s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} mvnsite {color} | {color:green} 0m
58s{color} | {color:green} the patch passed {color} |
| {color:green}+1{color} | {color:green} whitespace {color} | {color:green} 0m
0s{color} | {color:green} The patch has no whitespace issues. {color} |
| {color:green}+1{color} | {color:green} xml {color} | {color:green} 0m
1s{color} | {color:green} The patch has no ill-formed XML file. {color} |
| {color:green}+1{color} | {color:green} shadedclient {color} | {color:green}
11m 40s{color} | {color:green} patch has no errors when building and testing
our client artifacts. {color} |
| {color:green}+1{color} | {color:green} javadoc {color} | {color:green} 1m
2s{color} | {color:green} the patch passed {color} |
|| || || || {color:brown} Other Tests {color} ||
| {color:red}-1{color} | {color:red} unit {color} | {color:red}132m 56s{color}
| {color:red} hadoop-hdfs in the patch failed. {color} |
| {color:green}+1{color} | {color:green} asflicense {color} | {color:green} 0m
21s{color} | {color:green} The patch does not generate ASF License warnings.
{color} |
| {color:black}{color} | {color:black} {color} | {color:black}181m 16s{color} |
{color:black} {color} |
\\
\\
|| Reason || Tests ||
| Failed junit tests | hadoop.hdfs.qjournal.server.TestJournalNodeSync |
| | hadoop.fs.TestUnbuffer |
| | hadoop.hdfs.web.TestWebHdfsTimeouts |
| | hadoop.ozone.web.client.TestKeys |
| | hadoop.ozone.scm.TestAllocateContainer |
| | hadoop.hdfs.TestDFSStripedOutputStreamWithFailure |
| | hadoop.cblock.TestBufferManager |
| | hadoop.ozone.client.rpc.TestOzoneRpcClient |
| | hadoop.hdfs.server.balancer.TestBalancerWithEncryptedTransfer |
| | hadoop.ozone.web.client.TestKeysRatis |
| | hadoop.hdfs.server.balancer.TestBalancerRPCDelay |
| | hadoop.cblock.TestCBlockReadWrite |
| | hadoop.hdfs.server.balancer.TestBalancerWithMultipleNameNodes |
\\
\\
|| Subsystem || Report/Notes ||
| Docker | Client=17.05.0-ce Server=17.05.0-ce Image:yetus/hadoop:d11161b |
| JIRA Issue | HDFS-12867 |
| JIRA Patch URL |
https://issues.apache.org/jira/secure/attachment/12899759/HDFS-12867-HDFS-7240.001.patch
|
| Optional Tests | asflicense compile javac javadoc mvninstall mvnsite
unit shadedclient xml |
| uname | Linux 8dd046cf377d 4.4.0-64-generic #85-Ubuntu SMP Mon Feb 20
11:50:30 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux |
| Build tool | maven |
| Personality | /testptch/patchprocess/precommit/personality/provided.sh |
| git revision | HDFS-7240 / ac9cc8a |
| maven | version: Apache Maven 3.3.9 |
| Default Java | 1.8.0_151 |
| unit |
https://builds.apache.org/job/PreCommit-HDFS-Build/22217/artifact/out/patch-unit-hadoop-hdfs-project_hadoop-hdfs.txt
|
| Test Results |
[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently
[
https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270387#comment-16270387
]
Nanda kumar commented on HDFS-12867:
Thanks [~linyiqun] for reporting and working on this.
One minor comment, can we elaborate the description a bit:
{{ozone.rest.servers}} -> {{The REST server hostnames to connect, comma
separated list of host (typically datanodes) where Ozone REST handler are
running.}}
{{ozone.rest.client.port}} -> {{Port used by client to connect to Ozone REST
server. When a datanode is configured to run Ozone REST handler this port
typically points to datanode info port.}}
> Ozone: TestOzoneConfigurationFields fails consistently
> --
>
> Key: HDFS-12867
> URL: https://issues.apache.org/jira/browse/HDFS-12867
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone, test
>Affects Versions: HDFS-7240
>Reporter: Yiqun Lin
>Assignee: Yiqun Lin
> Attachments: HDFS-12867-HDFS-7240.001.patch
>
>
> The unit test TestOzoneConfigurationFields fails consistently because of 2
> config entries missing in ozone-default file. The stack trace:
> {noformat}
> java.lang.AssertionError: class org.apache.hadoop.ozone.OzoneConfigKeys class
> org.apache.hadoop.scm.ScmConfigKeys class
> org.apache.hadoop.ozone.ksm.KSMConfigKeys class
> org.apache.hadoop.cblock.CBlockConfigKeys has 2 variables missing in
> ozone-default.xml Entries: ozone.rest.client.port ozone.rest.servers
> expected:<0> but was:<2>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at
> org.apache.hadoop.conf.TestConfigurationFieldsBase.testCompareConfigurationClassAgainstXml(TestConfigurationFieldsBase.java:493)
> {noformat}
> The config {{ozone.rest.client.port}}, {{ozone.rest.servers}} were introduced
> in HDFS-12549 but missing to documented. This leads the failure.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
[jira] [Commented] (HDFS-12867) Ozone: TestOzoneConfigurationFields fails consistently
[
https://issues.apache.org/jira/browse/HDFS-12867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16270234#comment-16270234
]
Anu Engineer commented on HDFS-12867:
-
Thanks for taking care of this, +1, pending Jenkins.
cc: [~nandakumar131], [~xyao]
> Ozone: TestOzoneConfigurationFields fails consistently
> --
>
> Key: HDFS-12867
> URL: https://issues.apache.org/jira/browse/HDFS-12867
> Project: Hadoop HDFS
> Issue Type: Sub-task
> Components: ozone, test
>Affects Versions: HDFS-7240
>Reporter: Yiqun Lin
>Assignee: Yiqun Lin
> Attachments: HDFS-12867-HDFS-7240.001.patch
>
>
> The unit test TestOzoneConfigurationFields fails consistently because of 2
> config entries missing in ozone-default file. The stack trace:
> {noformat}
> java.lang.AssertionError: class org.apache.hadoop.ozone.OzoneConfigKeys class
> org.apache.hadoop.scm.ScmConfigKeys class
> org.apache.hadoop.ozone.ksm.KSMConfigKeys class
> org.apache.hadoop.cblock.CBlockConfigKeys has 2 variables missing in
> ozone-default.xml Entries: ozone.rest.client.port ozone.rest.servers
> expected:<0> but was:<2>
> at org.junit.Assert.fail(Assert.java:88)
> at org.junit.Assert.failNotEquals(Assert.java:743)
> at org.junit.Assert.assertEquals(Assert.java:118)
> at org.junit.Assert.assertEquals(Assert.java:555)
> at
> org.apache.hadoop.conf.TestConfigurationFieldsBase.testCompareConfigurationClassAgainstXml(TestConfigurationFieldsBase.java:493)
> {noformat}
> The config {{ozone.rest.client.port}}, {{ozone.rest.servers}} were introduced
> in HDFS-12549 but missing to documented. This leads the failure.
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
-
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org
