Ganesh Murthy created DISPATCH-2179:
---------------------------------------
Summary: Some system tests relating to TLS are failing due to
changes in proton master
Key: DISPATCH-2179
URL: https://issues.apache.org/jira/browse/DISPATCH-2179
Project: Qpid Dispatch
Issue Type: Test
Reporter: Ganesh Murthy
Steps to reproduce -
Check out to commit 605bc58009549dff2678961455a7ec86b0acede4 on proton master
and compile.
Compile dispatch using the above proton and run the dispatch test suite. You
will see 4 tests that fail -
{noformat}
31 - system_tests_qdstat (Failed)
33 - system_tests_user_id (Failed)
44 - system_tests_authz_service_plugin (Timeout)
54 - system_tests_ssl (Failed) {noformat}
{noformat}
54: Test command: /usr/bin/python3.9
"/home/gmurthy/opensource/qpid-dispatch/build/tests/run.py" "-m" "unittest"
"-v" "system_tests_ssl"
54: Test timeout computed to be: 600
54: test_ssl_invalid (system_tests_ssl.RouterTestSslClient)
54: Expects connection is rejected as SSL is no longer supported ... ok
54: test_ssl_sasl_client_invalid (system_tests_ssl.RouterTestSslClient)
54: Attempts to connect a Proton client using a valid SASL authentication info
... ok
54: test_ssl_sasl_client_valid (system_tests_ssl.RouterTestSslClient)
54: Attempts to connect a Proton client using a valid SASL authentication info
... FAIL
54: test_tls11_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1.1 only is allowed ... ok
54: test_tls11_tls12_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1.1 and TLSv1.2 only are allowed ... FAIL
54: test_tls12_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1.2 only is allowed ... FAIL
54: test_tls13_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1.3 only is allowed ... FAIL
54: test_tls1_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1 only is allowed ... ok
54: test_tls1_tls11_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1 and TLSv1.1 only are allowed ... ok
54: test_tls1_tls12_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1 and TLSv1.2 only are allowed ... FAIL
54: test_tls_all (system_tests_ssl.RouterTestSslClient)
54: Expects all supported versions: TLSv1, TLSv1.1, TLSv1.2 and TLSv1.3 to be
allowed ... FAIL
54: test_connected_tls_sasl_routers (system_tests_ssl.RouterTestSslInterRouter)
54: Validates if all expected routers are connected in the network ... ok
54: test_invalid_ca_path
(system_tests_ssl.RouterTestSslInterRouterWithInvalidPathToCA)
54: Prove sslProfile with invalid path to CA prevents the router from joining
the network ... ok
54: test_mismatched_ca_and_no_hostname_verification
(system_tests_ssl.RouterTestSslInterRouterWithoutHostnameVerificationAndMismatchedCA)
54: Prove that improperly configured ssl-enabled connector prevents the router
... ok
54:
54: ======================================================================
54: FAIL: test_ssl_sasl_client_valid (system_tests_ssl.RouterTestSslClient)
54: Attempts to connect a Proton client using a valid SASL authentication info
54: ----------------------------------------------------------------------
54: Traceback (most recent call last):
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_test.py", line
924, in wrap
54: return f(*args, **kwargs)
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_ssl.py",
line 539, in test_ssl_sasl_client_valid
54: self.assertEqual(exp_tls_results[2],
self.is_ssl_sasl_client_accepted(self.PORT_TLS_SASL, "TLSv1.2"))
54: AssertionError: True != False
54:
54: ======================================================================
54: FAIL: test_tls11_tls12_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1.1 and TLSv1.2 only are allowed
54: ----------------------------------------------------------------------
54: Traceback (most recent call last):
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_test.py", line
924, in wrap
54: return f(*args, **kwargs)
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_ssl.py",
line 508, in test_tls11_tls12_only
54: self.assertEqual(self.get_expected_tls_result([False, True, True,
False]),
54: AssertionError: Lists differ: [False, False, True, False] != [False, False,
False, False]
54:
54: First differing element 2:
54: True
54: False
54:
54: - [False, False, True, False]
54: ? ^^^
54:
54: + [False, False, False, False]
54: ? ^^^^
54:
54:
54: ======================================================================
54: FAIL: test_tls12_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1.2 only is allowed
54: ----------------------------------------------------------------------
54: Traceback (most recent call last):
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_test.py", line
924, in wrap
54: return f(*args, **kwargs)
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_ssl.py",
line 476, in test_tls12_only
54: self.assertEqual(self.get_expected_tls_result([False, False, True,
False]),
54: AssertionError: Lists differ: [False, False, True, False] != [False, False,
False, False]
54:
54: First differing element 2:
54: True
54: False
54:
54: - [False, False, True, False]
54: ? ^^^
54:
54: + [False, False, False, False]
54: ? ^^^^
54:
54:
54: ======================================================================
54: FAIL: test_tls13_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1.3 only is allowed
54: ----------------------------------------------------------------------
54: Traceback (most recent call last):
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_test.py", line
924, in wrap
54: return f(*args, **kwargs)
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_ssl.py",
line 484, in test_tls13_only
54: self.assertEqual(self.get_expected_tls_result([False, False, False,
True]),
54: AssertionError: Lists differ: [False, False, False, True] != [False, False,
False, False]
54:
54: First differing element 3:
54: True
54: False
54:
54: - [False, False, False, True]
54: ? ^^^
54:
54: + [False, False, False, False]
54: ? ^^^^
54:
54:
54: ======================================================================
54: FAIL: test_tls1_tls12_only (system_tests_ssl.RouterTestSslClient)
54: Expects TLSv1 and TLSv1.2 only are allowed
54: ----------------------------------------------------------------------
54: Traceback (most recent call last):
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_test.py", line
924, in wrap
54: return f(*args, **kwargs)
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_ssl.py",
line 500, in test_tls1_tls12_only
54: self.assertEqual(self.get_expected_tls_result([True, False, True,
False]),
54: AssertionError: Lists differ: [False, False, True, False] != [False, False,
False, False]
54:
54: First differing element 2:
54: True
54: False
54:
54: - [False, False, True, False]
54: ? ^^^
54:
54: + [False, False, False, False]
54: ? ^^^^
54:
54:
54: ======================================================================
54: FAIL: test_tls_all (system_tests_ssl.RouterTestSslClient)
54: Expects all supported versions: TLSv1, TLSv1.1, TLSv1.2 and TLSv1.3 to be
allowed
54: ----------------------------------------------------------------------
54: Traceback (most recent call last):
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_test.py", line
924, in wrap
54: return f(*args, **kwargs)
54: File "/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_ssl.py",
line 516, in test_tls_all
54: self.assertEqual(self.get_expected_tls_result([True, True, True, True]),
54: AssertionError: Lists differ: [False, False, True, True] != [False, False,
False, False]
54:
54: First differing element 2:
54: True
54: False
54:
54: - [False, False, True, True]
54: + [False, False, False, False]
54:
54: ----------------------------------------------------------------------
54: Ran 14 tests in 66.961s
54:
54: FAILED (failures=6)
54: TLSV1_3? Proton has: True, OpenSSL has: True
1/1 Test #54: system_tests_ssl .................***Failed 67.13 sec0% tests
passed, 1 tests failed out of 1Total Test time (real) = 67.13 secThe following
tests FAILED:
54 - system_tests_ssl (Failed)
Errors while running CTest33: Test command: /usr/bin/python3.9
"/home/gmurthy/opensource/qpid-dispatch/build/tests/run.py" "-m" "unittest"
"-v" "system_tests_user_id"
33: Test timeout computed to be: 600
33: test_ssl_user_id (system_tests_user_id.QdSSLUseridTest) ... ERROR
33:
33: ======================================================================
33: ERROR: test_ssl_user_id (system_tests_user_id.QdSSLUseridTest)
33: ----------------------------------------------------------------------
33: Traceback (most recent call last):
33: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_user_id.py", line
319, in test_ssl_user_id
33: node = Node.connect(addr)
33: File
"/home/gmurthy/opensource/qpid-dispatch/python/qpid_dispatch/management/client.py",
line 130, in connect
33: return Node(Node.connection(url, router, timeout, ssl_domain, sasl,
33: File
"/home/gmurthy/opensource/qpid-dispatch/python/qpid_dispatch/management/client.py",
line 103, in connection
33: return BlockingConnection(url,
33: File
"/opt/qpid-proton/qpid-proton/lib64/proton/bindings/python/proton/_utils.py",
line 373, in __init__
33: self.wait(lambda: not (self.conn.state & Endpoint.REMOTE_UNINIT),
33: File
"/opt/qpid-proton/qpid-proton/lib64/proton/bindings/python/proton/_utils.py",
line 510, in wait
33: raise ConnectionException(
33: proton._exceptions.ConnectionException: Connection amqps://0.0.0.0:26942
disconnected: Condition('amqp:connection:framing-error', 'SSL Failure:
error:1416F086:SSL routines:tls_process_server_certificate:certificate verify
failed')
33:
33: ----------------------------------------------------------------------
33: Ran 1 test in 0.582s
33:
33: FAILED (errors=1)
1/2 Test #33: system_tests_user_id .............***Failed 0.71 sec
31: ======================================================================
31: FAIL: test_ssl_cert_explicit_external_to_auth
(system_tests_qdstat.QdstatSslTest)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
831, in test_ssl_cert_explicit_external_to_auth
31: self.ssl_test('auth_s', ['sasl_external', 'client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25314 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_cert_to_auth (system_tests_qdstat.QdstatSslTest)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
822, in test_ssl_cert_to_auth
31: self.ssl_test('auth_s', ['client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25314 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_cert_to_strict (system_tests_qdstat.QdstatSslTest)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
799, in test_ssl_cert_to_strict
31: self.ssl_test('strict_s', ['client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25312 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_cert_to_unsecured (system_tests_qdstat.QdstatSslTest)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
842, in test_ssl_cert_to_unsecured
31: self.ssl_test('unsecured_s', ['client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25313 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_schema_to_strict (system_tests_qdstat.QdstatSslTest)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
796, in test_ssl_schema_to_strict
31: self.ssl_test('strict_s', [])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25312 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_schema_to_unsecured (system_tests_qdstat.QdstatSslTest)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
839, in test_ssl_schema_to_unsecured
31: self.ssl_test('unsecured_s', [])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25313 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_cert_explicit_external_to_auth
(system_tests_qdstat.QdstatSslTestSslPasswordFile)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
831, in test_ssl_cert_explicit_external_to_auth
31: self.ssl_test('auth_s', ['sasl_external', 'client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25318 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_cert_to_auth
(system_tests_qdstat.QdstatSslTestSslPasswordFile)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
822, in test_ssl_cert_to_auth
31: self.ssl_test('auth_s', ['client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25318 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_cert_to_strict
(system_tests_qdstat.QdstatSslTestSslPasswordFile)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
799, in test_ssl_cert_to_strict
31: self.ssl_test('strict_s', ['client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25316 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_cert_to_unsecured
(system_tests_qdstat.QdstatSslTestSslPasswordFile)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
842, in test_ssl_cert_to_unsecured
31: self.ssl_test('unsecured_s', ['client_cert_all'])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25317 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_schema_to_strict
(system_tests_qdstat.QdstatSslTestSslPasswordFile)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
796, in test_ssl_schema_to_strict
31: self.ssl_test('strict_s', [])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25316 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ======================================================================
31: FAIL: test_ssl_schema_to_unsecured
(system_tests_qdstat.QdstatSslTestSslPasswordFile)
31: ----------------------------------------------------------------------
31: Traceback (most recent call last):
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
839, in test_ssl_schema_to_unsecured
31: self.ssl_test('unsecured_s', [])
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
774, in ssl_test
31: self.run_qdstat(['--general'] + sum([args[n] for n in arg_names], []),
31: File
"/home/gmurthy/opensource/qpid-dispatch/tests/system_tests_qdstat.py", line
747, in run_qdstat
31: assert p.returncode == 0, \
31: AssertionError: qdstat exit status 1, output:
31: ConnectionException: Connection amqps://0.0.0.0:25317 disconnected:
Condition('amqp:connection:framing-error', 'SSL Failure: error:1416F086:SSL
routines:tls_process_server_certificate:certificate verify failed')
31:
31:
31: ----------------------------------------------------------------------
31: Ran 85 tests in 104.856s
31:
31: FAILED (failures=12)
31:
1/1 Test #31: system_tests_qdstat ..............***Failed 105.02 sec0% tests
passed, 1 tests failed out of 1Total Test time (real) = 105.02 secThe following
tests FAILED:
31 - system_tests_qdstat (Failed)
I {noformat}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org
