[
https://issues.apache.org/jira/browse/KAFKA-16960?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855162#comment-17855162
]
Matthias J. Sax edited comment on KAFKA-16960 at 6/15/24 1:13 AM:
------------------------------------------------------------------
I looked into the test run and found
{code:java}
java.lang.UnsatisfiedLinkError: /tmp/librocksdbjni1194554696184035298.so:
/tmp/librocksdbjni1194554696184035298.so: cannot open shared object file: No
such file or directory (Possible cause: can't load AMD 64-bit .so on a
AARCH64-bit platform) {code}
Seems it was an env issue?
What the test does is, to start 3 KS instances, and upgrade them one-by-one. We
see the error when starting the KS apps using 2.2/2.3/2.4/2.5 version, so the
test did not even "bootstrap" correctly, as it fails before we enter the
actually upgrade step.
Also could not run the test locally, as the build failed with compile error
(think this is already known... I can try again after the fix was merged). But
I think we can close this ticket as "not a bug" maybe even w/o trying to run
locally?
was (Author: mjsax):
I looked into the test run and found
{code:java}
java.lang.UnsatisfiedLinkError: /tmp/librocksdbjni1194554696184035298.so:
/tmp/librocksdbjni1194554696184035298.so: cannot open shared object file: No
such file or directory (Possible cause: can't load AMD 64-bit .so on a
AARCH64-bit platform) {code}
Seems it was an env issue?
What the test does is, to start 3 KS instances, and upgrade them one-by-one. We
see the error when starting the KS apps using 2.2 version, so the test did not
even "bootstrap" correctly, as it fails before we enter the actually upgrade
step.
Also could not run the test locally, as the build failed with compile error
(think this is already known... I can try again after the fix was merged). But
I think we can close this ticket as "not a bug" maybe even w/o trying to run
locally?
> StreamsUpgradeTest system tests fail in v3.7.1 RC1
> --------------------------------------------------
>
> Key: KAFKA-16960
> URL: https://issues.apache.org/jira/browse/KAFKA-16960
> Project: Kafka
> Issue Type: Improvement
> Reporter: Luke Chen
> Assignee: Matthias J. Sax
> Priority: Major
>
> logs:
> https://www.dropbox.com/scl/fi/ihairvyzudrm5vppu9l9x/2024-06-14-002.zip?rlkey=tn4sesl4g8fj5l4jylccno604&e=1&st=zjavznyb&dl=0
> {code:java}
> ================================================================================
> SESSION REPORT (ALL TESTS)
> ducktape version: 0.11.4
> session_id: 2024-06-14--002
> run time: 32 minutes 6.131 seconds
> tests run: 14
> passed: 10
> flaky: 0
> failed: 4
> ignored: 0
> ================================================================================
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.2.2.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: FAIL
> run time: 5 minutes 2.298 seconds
> TimeoutError("Did expect to read 'processed [0-9]* records' from
> ducker@ducker05")
> Traceback (most recent call last):
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 186, in _do_run
> data = self.run_test()
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 246, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
> 433, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 101, in test_app_upgrade
> self.start_all_nodes_with(from_version)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 157, in start_all_nodes_with
> self.wait_for_verification(self.processor1, self.processed_msg,
> self.processor1.STDOUT_FILE)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 209, in wait_for_verification
> wait_until(lambda: self.verify_from_file(processor, message, file) >=
> num_lines,
> File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line
> 58, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from
> last_exception
> ducktape.errors.TimeoutError: Did expect to read 'processed [0-9]* records'
> from
> ducker@ducker05--------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.3.1.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: FAIL
> run time: 4 minutes 37.443 seconds
> TimeoutError("Did expect to read 'SMOKE-TEST-CLIENT-STARTED' from
> ducker@ducker11")
> Traceback (most recent call last):
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 186, in _do_run
> data = self.run_test()
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 246, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
> 433, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 101, in test_app_upgrade
> self.start_all_nodes_with(from_version)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 152, in start_all_nodes_with
> self.wait_for_verification(self.processor1, "SMOKE-TEST-CLIENT-STARTED",
> self.processor1.STDOUT_FILE)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 209, in wait_for_verification
> wait_until(lambda: self.verify_from_file(processor, message, file) >=
> num_lines,
> File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line
> 58, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from
> last_exception
> ducktape.errors.TimeoutError: Did expect to read 'SMOKE-TEST-CLIENT-STARTED'
> from
> ducker@ducker11--------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.4.1.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: FAIL
> run time: 4 minutes 41.172 seconds
> TimeoutError("Did expect to read 'SMOKE-TEST-CLIENT-STARTED' from
> ducker@ducker04")
> Traceback (most recent call last):
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 186, in _do_run
> data = self.run_test()
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 246, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
> 433, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 101, in test_app_upgrade
> self.start_all_nodes_with(from_version)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 152, in start_all_nodes_with
> self.wait_for_verification(self.processor1, "SMOKE-TEST-CLIENT-STARTED",
> self.processor1.STDOUT_FILE)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 209, in wait_for_verification
> wait_until(lambda: self.verify_from_file(processor, message, file) >=
> num_lines,
> File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line
> 58, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from
> last_exception
> ducktape.errors.TimeoutError: Did expect to read 'SMOKE-TEST-CLIENT-STARTED'
> from
> ducker@ducker04--------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.5.1.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: FAIL
> run time: 5 minutes 1.811 seconds
> TimeoutError("Did expect to read 'processed [0-9]* records' from
> ducker@ducker10")
> Traceback (most recent call last):
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 186, in _do_run
> data = self.run_test()
> File
> "/usr/local/lib/python3.9/dist-packages/ducktape/tests/runner_client.py",
> line 246, in run_test
> return self.test_context.function(self.test)
> File "/usr/local/lib/python3.9/dist-packages/ducktape/mark/_mark.py", line
> 433, in wrapper
> return functools.partial(f, *args, **kwargs)(*w_args, **w_kwargs)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 101, in test_app_upgrade
> self.start_all_nodes_with(from_version)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 157, in start_all_nodes_with
> self.wait_for_verification(self.processor1, self.processed_msg,
> self.processor1.STDOUT_FILE)
> File
> "/opt/kafka-dev/tests/kafkatest/tests/streams/streams_application_upgrade_test.py",
> line 209, in wait_for_verification
> wait_until(lambda: self.verify_from_file(processor, message, file) >=
> num_lines,
> File "/usr/local/lib/python3.9/dist-packages/ducktape/utils/util.py", line
> 58, in wait_until
> raise TimeoutError(err_msg() if callable(err_msg) else err_msg) from
> last_exception
> ducktape.errors.TimeoutError: Did expect to read 'processed [0-9]* records'
> from
> ducker@ducker10--------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.6.3.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 18.426 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.7.2.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 9.421 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=2.8.2.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 14.776 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.0.2.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 17.446 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.1.2.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 14.404 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.2.3.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 13.951 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.3.2.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 20.795 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.4.1.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 16.313 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.5.2.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 17.429 seconds
> --------------------------------------------------------------------------------
> test_id:
> kafkatest.tests.streams.streams_application_upgrade_test.StreamsUpgradeTest.test_app_upgrade.from_version=3.6.1.to_version=3.7.1-SNAPSHOT.bounce_type=full
> status: PASS
> run time: 1 minute 20.143 seconds
> --------------------------------------------------------------------------------
> ================================================================================
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
