[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17066901#comment-17066901
]
ASF GitHub Bot commented on KAFKA-9573:
---
ijuma commented on pull request #8138: KAFKA-9573: Fix JVM options to run early
versions of Kafka on the latest JVMs
URL: https://github.com/apache/kafka/pull/8138
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> TestUpgrade system test failed on Java11.
> -
>
> Key: KAFKA-9573
> URL: https://issues.apache.org/jira/browse/KAFKA-9573
> Project: Kafka
> Issue Type: Improvement
>Reporter: Nikolay Izhikov
>Assignee: Nikolay Izhikov
>Priority: Major
>
> Test was runed on Jdk11
> Test result:
> {noformat}
>
> test_id:
> kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
> status: FAIL
> run time: 1 minute 28.387 seconds
> Kafka server didn't finish startup in 60 seconds
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 132, in run
> data = self.run_test()
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 189, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
> 428, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 133,
> in test_upgrade
> self.kafka.start()
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 242, in
> start
> Service.start(self)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/services/service.py",
> line 234, in start
> self.start_node(node)
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 357, in
> start_node
> err_msg="Kafka server didn't finish startup in %d seconds" % timeout_sec)
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/cluster/remoteaccount.py",
> line 705, in wait_until
> allow_fail=True) == 0, **kwargs)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
> 41, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
> TimeoutError: Kafka server didn't finish startup in 60 seconds
> {noformat}
> Detailed output:
> {noformat}
> [0.001s][warning][gc] -Xloggc is deprecated. Will use
> -Xlog:gc:/opt/kafka-0.9.0.1/bin/../logs/kafkaServer-gc.log instead.
> Unrecognized VM option 'PrintGCDateStamps'
> Error: Could not create the Java Virtual Machine.
> Error: A fatal exception has occurred. Program will exit.
> ~
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17060926#comment-17060926
]
Nikolay Izhikov commented on KAFKA-9573:
{noformat}
SESSION REPORT (ALL TESTS)
ducktape version: 0.7.6
session_id: 2020-03-17--013
run time: 48 minutes 46.092 seconds
tests run:30
passed: 29
failed: 1
ignored: 0
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.none
status: PASS
run time: 1 minute 12.994 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 12.255 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
status: PASS
run time: 12.643 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 12.346 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 12.346 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.1.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 12.349 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.1.1.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 12.391 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=0.10.2.2.compression_types=.snappy
status: PASS
run time: 12.487 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=0.9.0.1.compression_types=.none
status: PASS
run time: 1 minute 12.844 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 12.272 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=None.compression_types=.none
status: PASS
run time: 1 minute 12.922 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.11.0.3.to_message_format_version=None.compression_types=.gzip
status: PASS
run time: 12.405 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.11.0.3.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 12.328 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=0.9.0.1.compression_types=.lz4
status: PASS
run time: 12.252 seconds
test_id:
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048715#comment-17048715
]
ASF GitHub Bot commented on KAFKA-9573:
---
ijuma commented on pull request #8197: KAFKA-9573: Fix VerifiableProducer and
VerifiableConsumer to work with older Kafka versions
URL: https://github.com/apache/kafka/pull/8197
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> TestUpgrade system test failed on Java11.
> -
>
> Key: KAFKA-9573
> URL: https://issues.apache.org/jira/browse/KAFKA-9573
> Project: Kafka
> Issue Type: Improvement
>Reporter: Nikolay Izhikov
>Assignee: Nikolay Izhikov
>Priority: Major
>
> Test was runed on Jdk11
> Test result:
> {noformat}
>
> test_id:
> kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
> status: FAIL
> run time: 1 minute 28.387 seconds
> Kafka server didn't finish startup in 60 seconds
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 132, in run
> data = self.run_test()
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 189, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
> 428, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 133,
> in test_upgrade
> self.kafka.start()
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 242, in
> start
> Service.start(self)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/services/service.py",
> line 234, in start
> self.start_node(node)
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 357, in
> start_node
> err_msg="Kafka server didn't finish startup in %d seconds" % timeout_sec)
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/cluster/remoteaccount.py",
> line 705, in wait_until
> allow_fail=True) == 0, **kwargs)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
> 41, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
> TimeoutError: Kafka server didn't finish startup in 60 seconds
> {noformat}
> Detailed output:
> {noformat}
> [0.001s][warning][gc] -Xloggc is deprecated. Will use
> -Xlog:gc:/opt/kafka-0.9.0.1/bin/../logs/kafkaServer-gc.log instead.
> Unrecognized VM option 'PrintGCDateStamps'
> Error: Could not create the Java Virtual Machine.
> Error: A fatal exception has occurred. Program will exit.
> ~
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048475#comment-17048475
]
ASF GitHub Bot commented on KAFKA-9573:
---
nizhikov commented on pull request #8197: KAFKA-9573: Fix java code to run
`upgrade_test.py` tests for the versions before 0.11.0.0.
URL: https://github.com/apache/kafka/pull/8197
This PR is the part of https://github.com/apache/kafka/pull/8138
It contains changes in the java code to fix `upgrade_test.py` for the
versions before 0.11.0.0
0.11.0.0 introduced `Exit` class. The earlier version doesn't have it.
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> TestUpgrade system test failed on Java11.
> -
>
> Key: KAFKA-9573
> URL: https://issues.apache.org/jira/browse/KAFKA-9573
> Project: Kafka
> Issue Type: Improvement
>Reporter: Nikolay Izhikov
>Assignee: Nikolay Izhikov
>Priority: Major
>
> Test was runed on Jdk11
> Test result:
> {noformat}
>
> test_id:
> kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
> status: FAIL
> run time: 1 minute 28.387 seconds
> Kafka server didn't finish startup in 60 seconds
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 132, in run
> data = self.run_test()
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 189, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
> 428, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 133,
> in test_upgrade
> self.kafka.start()
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 242, in
> start
> Service.start(self)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/services/service.py",
> line 234, in start
> self.start_node(node)
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 357, in
> start_node
> err_msg="Kafka server didn't finish startup in %d seconds" % timeout_sec)
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/cluster/remoteaccount.py",
> line 705, in wait_until
> allow_fail=True) == 0, **kwargs)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
> 41, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
> TimeoutError: Kafka server didn't finish startup in 60 seconds
> {noformat}
> Detailed output:
> {noformat}
> [0.001s][warning][gc] -Xloggc is deprecated. Will use
> -Xlog:gc:/opt/kafka-0.9.0.1/bin/../logs/kafkaServer-gc.log instead.
> Unrecognized VM option 'PrintGCDateStamps'
> Error: Could not create the Java Virtual Machine.
> Error: A fatal exception has occurred. Program will exit.
> ~
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17044913#comment-17044913
]
Nikolay Izhikov commented on KAFKA-9573:
There was some merge conflicts after
[9d53ad794de45739093070306f44df2a2f31e9e4|https://github.com/apache/kafka/commit/9d53ad794de45739093070306f44df2a2f31e9e4].
I resolve it and rerun {{upgrade_test.py}}.
Results still the same(2 fails)
{noformat}
SESSION REPORT (ALL TESTS)
ducktape version: 0.7.6
session_id: 2020-02-25--001
run time: 120 minutes 48.504 seconds
tests run:31
passed: 29
failed: 2
ignored: 0
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.none
status: PASS
run time: 5 minutes 52.846 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 3 minutes 42.862 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
status: PASS
run time: 5 minutes 48.920 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 3 minutes 52.226 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 3 minutes 55.741 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.1.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 3 minutes 56.117 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.1.1.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 4 minutes 0.577 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=0.10.2.2.compression_types=.snappy
status: PASS
run time: 3 minutes 52.603 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=0.9.0.1.compression_types=.none
status: FAIL
run time: 1 minute 20.193 seconds
Kafka server didn't finish startup in 60 seconds
Traceback (most recent call last):
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
132, in run
data = self.run_test()
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
189, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
428, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 133,
in test_upgrade
self.kafka.start()
File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 250, in
start
Service.start(self)
File "/usr/local/lib/python2.7/dist-packages/ducktape/services/service.py",
line 234, in start
self.start_node(node)
File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 372, in
start_node
err_msg="Kafka server didn't finish startup in %d seconds" % timeout_sec)
File
"/usr/local/lib/python2.7/dist-packages/ducktape/cluster/remoteaccount.py",
line 705, in wait_until
allow_fail=True) == 0, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
41, in wait_until
raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042126#comment-17042126
]
Nikolay Izhikov commented on KAFKA-9573:
Error for {{test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=2.0.1.to_message_format_version=None.compression_types=.none}}
{noformat}
[2020-02-21 16:02:23,887] DEBUG Ignoring exception during shutdown input
(org.apache.zookeeper.ClientCnxnSocketNIO)
java.net.SocketException: Socket is not connected
at java.base/sun.nio.ch.Net.translateToSocketException(Net.java:162)
at java.base/sun.nio.ch.Net.translateException(Net.java:196)
at java.base/sun.nio.ch.Net.translateException(Net.java:202)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:400)
at
org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:200)
at
org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1250)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1186)
Caused by: java.nio.channels.NotYetConnectedException
at
java.base/sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:917)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:398)
... 3 more
[2020-02-21 16:02:23,890] DEBUG Ignoring exception during shutdown output
(org.apache.zookeeper.ClientCnxnSocketNIO)
java.net.SocketException: Socket is not connected
at java.base/sun.nio.ch.Net.translateToSocketException(Net.java:162)
at java.base/sun.nio.ch.Net.translateException(Net.java:196)
at java.base/sun.nio.ch.Net.translateException(Net.java:202)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:408)
at
org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:207)
at
org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1250)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1186)
Caused by: java.nio.channels.NotYetConnectedException
at
java.base/sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:934)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:406)
... 3 more
[2020-02-21 16:02:23,992] DEBUG Disconnecting client for session: 0x0
(org.apache.zookeeper.ClientCnxn)
[2020-02-21 16:02:23,992] INFO Session: 0x0 closed
(org.apache.zookeeper.ZooKeeper)
[2020-02-21 16:02:23,994] INFO EventThread shut down for session: 0x0
(org.apache.zookeeper.ClientCnxn)
[2020-02-21 16:02:23,995] DEBUG Shutting down task scheduler.
(kafka.utils.KafkaScheduler)
[2020-02-21 16:02:23,996] INFO [ZooKeeperClient] Closed.
(kafka.zookeeper.ZooKeeperClient)
[2020-02-21 16:02:23,999] ERROR Fatal error during KafkaServer startup. Prepare
to shutdown (kafka.server.KafkaServer)
kafka.zookeeper.ZooKeeperClientTimeoutException: Timed out waiting for
connection while in state: CONNECTING
at
kafka.zookeeper.ZooKeeperClient.$anonfun$waitUntilConnected$3(ZooKeeperClient.scala:230)
at
scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:12)
at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:251)
at
kafka.zookeeper.ZooKeeperClient.waitUntilConnected(ZooKeeperClient.scala:226)
at kafka.zookeeper.ZooKeeperClient.(ZooKeeperClient.scala:95)
at kafka.zk.KafkaZkClient$.apply(KafkaZkClient.scala:1588)
at kafka.server.KafkaServer.createZkClient$1(KafkaServer.scala:348)
at kafka.server.KafkaServer.initZkClient(KafkaServer.scala:372)
at kafka.server.KafkaServer.startup(KafkaServer.scala:202)
at
kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
at kafka.Kafka$.main(Kafka.scala:75)
at kafka.Kafka.main(Kafka.scala)
[2020-02-21 16:02:24,000] INFO shutting down (kafka.server.KafkaServer)
[2020-02-21 16:02:24,002] WARN (kafka.utils.CoreUtils$)
java.lang.NullPointerException
at kafka.server.KafkaServer.$anonfun$shutdown$6(KafkaServer.scala:579)
at kafka.utils.CoreUtils$.swallow(CoreUtils.scala:86)
at kafka.server.KafkaServer.shutdown(KafkaServer.scala:579)
at kafka.server.KafkaServer.startup(KafkaServer.scala:329)
at
kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:38)
at kafka.Kafka$.main(Kafka.scala:75)
at kafka.Kafka.main(Kafka.scala)
{noformat}
> TestUpgrade system test failed on Java11.
> -
>
> Key: KAFKA-9573
> URL: https://issues.apache.org/jira/browse/KAFKA-9573
> Project: Kafka
> Issue Type: Improvement
>Reporter: Nikolay Izhikov
>Assignee: Nikolay Izhikov
>Priority: Major
>
> Test was runed on Jdk11
> Test result:
> {noformat}
>
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042123#comment-17042123
]
Nikolay Izhikov commented on KAFKA-9573:
Error for {{test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=0.9.0.1.compression_types=.none}}
{noformat}
[2020-02-21 15:14:05,356] DEBUG Ignoring exception during shutdown input
(org.apache.zookeeper.ClientCnxnSocketNIO)
java.net.SocketException: Socket is not connected
at java.base/sun.nio.ch.Net.translateToSocketException(Net.java:162)
at java.base/sun.nio.ch.Net.translateException(Net.java:196)
at java.base/sun.nio.ch.Net.translateException(Net.java:202)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:400)
at
org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:200)
at
org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1246)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1182)
Caused by: java.nio.channels.NotYetConnectedException
at
java.base/sun.nio.ch.SocketChannelImpl.shutdownInput(SocketChannelImpl.java:917)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownInput(SocketAdaptor.java:398)
... 3 more
[2020-02-21 15:14:05,359] DEBUG Ignoring exception during shutdown output
(org.apache.zookeeper.ClientCnxnSocketNIO)
java.net.SocketException: Socket is not connected
at java.base/sun.nio.ch.Net.translateToSocketException(Net.java:162)
at java.base/sun.nio.ch.Net.translateException(Net.java:196)
at java.base/sun.nio.ch.Net.translateException(Net.java:202)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:408)
at
org.apache.zookeeper.ClientCnxnSocketNIO.cleanup(ClientCnxnSocketNIO.java:207)
at
org.apache.zookeeper.ClientCnxn$SendThread.cleanup(ClientCnxn.java:1246)
at org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1182)
Caused by: java.nio.channels.NotYetConnectedException
at
java.base/sun.nio.ch.SocketChannelImpl.shutdownOutput(SocketChannelImpl.java:934)
at
java.base/sun.nio.ch.SocketAdaptor.shutdownOutput(SocketAdaptor.java:406)
... 3 more
[2020-02-21 15:14:05,461] DEBUG Disconnecting client for session: 0x0
(org.apache.zookeeper.ClientCnxn)
[2020-02-21 15:14:05,462] INFO Session: 0x0 closed
(org.apache.zookeeper.ZooKeeper)
[2020-02-21 15:14:05,462] DEBUG Closing ZkClient...done
(org.I0Itec.zkclient.ZkClient)
[2020-02-21 15:14:05,463] FATAL Fatal error during KafkaServer startup. Prepare
to shutdown (kafka.server.KafkaServer)
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to
zookeeper server 'ducker14:2181' with timeout of 2000 ms
at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1233)
at org.I0Itec.zkclient.ZkClient.(ZkClient.java:157)
at org.I0Itec.zkclient.ZkClient.(ZkClient.java:131)
at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:106)
at kafka.utils.ZkUtils$.apply(ZkUtils.scala:88)
at kafka.server.KafkaServer.initZk(KafkaServer.scala:326)
at kafka.server.KafkaServer.startup(KafkaServer.scala:187)
at
kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:39)
at kafka.Kafka$.main(Kafka.scala:67)
at kafka.Kafka.main(Kafka.scala)
[2020-02-21 15:14:05,464] INFO EventThread shut down for session: 0x0
(org.apache.zookeeper.ClientCnxn)
[2020-02-21 15:14:05,464] INFO shutting down (kafka.server.KafkaServer)
[2020-02-21 15:14:05,468] DEBUG Shutting down task scheduler.
(kafka.utils.KafkaScheduler)
[2020-02-21 15:14:05,471] INFO shut down completed (kafka.server.KafkaServer)
[2020-02-21 15:14:05,471] FATAL Fatal error during KafkaServerStartable
startup. Prepare to shutdown (kafka.server.KafkaServerStartable)
org.I0Itec.zkclient.exception.ZkTimeoutException: Unable to connect to
zookeeper server 'ducker14:2181' with timeout of 2000 ms
at org.I0Itec.zkclient.ZkClient.connect(ZkClient.java:1233)
at org.I0Itec.zkclient.ZkClient.(ZkClient.java:157)
at org.I0Itec.zkclient.ZkClient.(ZkClient.java:131)
at kafka.utils.ZkUtils$.createZkClientAndConnection(ZkUtils.scala:106)
at kafka.utils.ZkUtils$.apply(ZkUtils.scala:88)
at kafka.server.KafkaServer.initZk(KafkaServer.scala:326)
at kafka.server.KafkaServer.startup(KafkaServer.scala:187)
at
kafka.server.KafkaServerStartable.startup(KafkaServerStartable.scala:39)
at kafka.Kafka$.main(Kafka.scala:67)
at kafka.Kafka.main(Kafka.scala)
[2020-02-21 15:14:05,472] INFO shutting down (kafka.server.KafkaServer)
{noformat
> TestUpgrade system test failed on Java11.
> -
>
> Key: KAFKA-9573
>
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17042121#comment-17042121
]
Nikolay Izhikov commented on KAFKA-9573:
test_upgrade.py resutls for the latest changes on JDK11.
{noformat}
SESSION REPORT (ALL TESTS)
ducktape version: 0.7.6
session_id: 2020-02-21--020
run time: 118 minutes 33.284 seconds
tests run:31
passed: 29
failed: 2
ignored: 0
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.none
status: PASS
run time: 3 minutes 41.135 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 3 minutes 41.480 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
status: PASS
run time: 5 minutes 48.151 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 3 minutes 57.576 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 3 minutes 55.763 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.1.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 3 minutes 54.443 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.1.1.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 3 minutes 55.950 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=0.10.2.2.compression_types=.snappy
status: PASS
run time: 3 minutes 51.277 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.2.2.to_message_format_version=0.9.0.1.compression_types=.none
status: FAIL
run time: 1 minute 20.028 seconds
Kafka server didn't finish startup in 60 seconds
Traceback (most recent call last):
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
132, in run
data = self.run_test()
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
189, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
428, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 133,
in test_upgrade
self.kafka.start()
File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 248, in
start
Service.start(self)
File "/usr/local/lib/python2.7/dist-packages/ducktape/services/service.py",
line 234, in start
self.start_node(node)
File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 370, in
start_node
err_msg="Kafka server didn't finish startup in %d seconds" % timeout_sec)
File
"/usr/local/lib/python2.7/dist-packages/ducktape/cluster/remoteaccount.py",
line 705, in wait_until
allow_fail=True) == 0, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
41, in wait_until
raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
TimeoutError: Kafka server didn't finish startup in 60 seconds
test_id:
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17041847#comment-17041847
]
Nikolay Izhikov commented on KAFKA-9573:
{noformat}
SESSION REPORT (ALL TESTS)
ducktape version: 0.7.6
session_id: 2020-02-21--019
run time: 114 minutes 40.193 seconds
tests run:31
passed: 27
failed: 4
ignored: 0
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.none
status: FAIL
run time: 1 minute 28.397 seconds
Producer failed to produce messages for 20s.
Traceback (most recent call last):
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
132, in run
data = self.run_test()
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
189, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
428, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 154,
in test_upgrade
self.run_produce_consume_validate(core_test_action=lambda:
self.perform_upgrade(from_kafka_version,
File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line
97, in run_produce_consume_validate
self.start_producer_and_consumer()
File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line
66, in start_producer_and_consumer
self.producer_start_timeout_sec)
File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
41, in wait_until
raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
TimeoutError: Producer failed to produce messages for 20s.
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.8.2.2.to_message_format_version=None.compression_types=.snappy
status: FAIL
run time: 1 minute 28.083 seconds
Producer failed to produce messages for 20s.
Traceback (most recent call last):
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
132, in run
data = self.run_test()
File
"/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py", line
189, in run_test
return self.test_context.function(self.test)
File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
428, in wrapper
return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 154,
in test_upgrade
self.run_produce_consume_validate(core_test_action=lambda:
self.perform_upgrade(from_kafka_version,
File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line
97, in run_produce_consume_validate
self.start_producer_and_consumer()
File "/opt/kafka-dev/tests/kafkatest/tests/produce_consume_validate.py", line
66, in start_producer_and_consumer
self.producer_start_timeout_sec)
File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
41, in wait_until
raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
TimeoutError: Producer failed to produce messages for 20s.
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
status: PASS
run time: 5 minutes 55.928 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 3 minutes 51.973 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.0.1.to_message_format_version=None.compression_types=.snappy
status: PASS
run time: 3 minutes 57.000 seconds
test_id:
kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.10.1.1.to_message_format_version=None.compression_types=.lz4
status: PASS
run time: 3 minutes 54.720 seconds
[jira] [Commented] (KAFKA-9573) TestUpgrade system test failed on Java11.
[
https://issues.apache.org/jira/browse/KAFKA-9573?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17040133#comment-17040133
]
ASF GitHub Bot commented on KAFKA-9573:
---
nizhikov commented on pull request #8138: KAFKA-9573: Fix JVM options to run
early versions of Kafka on the latest JVMs
URL: https://github.com/apache/kafka/pull/8138
Startup scripts for the early version of Kafka contain removed JVM options
like `-XX:+PrintGCDateStamps` or `-XX:UseParNewGC`.
When system tests run on JVM that doesn't support these options we should
set up environment variables with correct options.
### Committer Checklist (excluded from commit message)
- [ ] Verify design and implementation
- [ ] Verify test coverage and CI build status
- [ ] Verify documentation (including upgrade notes)
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
> TestUpgrade system test failed on Java11.
> -
>
> Key: KAFKA-9573
> URL: https://issues.apache.org/jira/browse/KAFKA-9573
> Project: Kafka
> Issue Type: Improvement
>Reporter: Nikolay Izhikov
>Assignee: Nikolay Izhikov
>Priority: Major
>
> Test was runed on Jdk11
> Test result:
> {noformat}
>
> test_id:
> kafkatest.tests.core.upgrade_test.TestUpgrade.test_upgrade.from_kafka_version=0.9.0.1.to_message_format_version=None.security_protocol=SASL_SSL.compression_types=.none
> status: FAIL
> run time: 1 minute 28.387 seconds
> Kafka server didn't finish startup in 60 seconds
> Traceback (most recent call last):
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 132, in run
> data = self.run_test()
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/tests/runner_client.py",
> line 189, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/mark/_mark.py", line
> 428, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File "/opt/kafka-dev/tests/kafkatest/tests/core/upgrade_test.py", line 133,
> in test_upgrade
> self.kafka.start()
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 242, in
> start
> Service.start(self)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/services/service.py",
> line 234, in start
> self.start_node(node)
> File "/opt/kafka-dev/tests/kafkatest/services/kafka/kafka.py", line 357, in
> start_node
> err_msg="Kafka server didn't finish startup in %d seconds" % timeout_sec)
> File
> "/usr/local/lib/python2.7/dist-packages/ducktape/cluster/remoteaccount.py",
> line 705, in wait_until
> allow_fail=True) == 0, **kwargs)
> File "/usr/local/lib/python2.7/dist-packages/ducktape/utils/util.py", line
> 41, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg)
> TimeoutError: Kafka server didn't finish startup in 60 seconds
> {noformat}
> Detailed output:
> {noformat}
> [0.001s][warning][gc] -Xloggc is deprecated. Will use
> -Xlog:gc:/opt/kafka-0.9.0.1/bin/../logs/kafkaServer-gc.log instead.
> Unrecognized VM option 'PrintGCDateStamps'
> Error: Could not create the Java Virtual Machine.
> Error: A fatal exception has occurred. Program will exit.
> ~
> {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
