Re: [VOTE] Release Qpid Dispatch Router 1.10.0 (RC2)

[Ganesh Murthy]

On Mon, Dec 16, 2019 at 2:28 PM Ken Giusti  wrote:

> -1
>
> I found a problem with qdstat on 1.10.0-rc2
>
> qdstat fails when querying links (-l) against the previous version of the
> router (1.9.0).
> The failure occurs when running qdstat with a python3 interpreter - it does
> not fail for python2.
>
> See DISPATCH-1525 
> for
> details.  I've already pushed a patch to master.
>
Current qdstat must be  compatible with a previously released version of
the router.
I am canceling this vote and will put up an RC3 vote shortly. Third time's
a charm hopefully.
Thanks.

>
> -K
>
> On Sat, Dec 14, 2019 at 11:16 PM Ganesh Murthy  wrote:
>
> > Hello All,
> >
> >  Please cast your vote on this thread to release RC2 as the
> > official Qpid Dispatch Router version  1.10.0.
> >
> > RC2 of Qpid Dispatch Router version 1.10.0 can be found here:
> >
> > https://dist.apache.org/repos/dist/dev/qpid/dispatch/1.10.0-rc2/
> >
> > The following features, improvements, and bug fixes are introduced in
> > 1.10.0:
> >
> > Features -
> > DISPATCH-1441 - optparse python library deprecated, migrate to
> argparse
> > DISPATCH-1442 - Add a metadata field to the router management entity
> > DISPATCH-1463 - Detect deliveries that are stuck in the router for
> > a long time
> > DISPATCH-1467 - Add build option to enable Address Sanitizer build
> > (ASAN)
> >
> > Improvements -
> > DISPATCH-1186 - qdstat to include csv output format
> > DISPATCH-1358 - Port console to patternfly 4 / React
> > DISPATCH-1369 - Update console dependencies to avoid npm security
> > warnings
> > DISPATCH-1399 - Allow arrows on console's topology page to be
> disabled
> > DISPATCH-1409 - Update qdstat -l output to include the current credit
> > DISPATCH-1411 - Add timestamp and router name to header of qdstat
> > output
> > DISPATCH-1412 - Policy C code performance issue:  reload python
> > module for each call
> > DISPATCH-1416 - Policy log could include denial counts on connection
> > close
> > DISPATCH-1419 - Add status to connector mgmt schema
> > DISPATCH-1427 - Allow policy to define user (group) specific
> > connection limits
> > DISPATCH-1434 - Add new attribute saslPasswordFile to the connector
> > entity
> > DISPATCH-1438 - Have ctest parse the routers debug dump files for
> > memory pool leaks
> > DISPATCH-1439 - Expose create time/last transfer time through the
> > Connection management entity
> > DISPATCH-1440 - Deprecate the passwordFile field in sslProfile and
> > consolidate all password scenarios to use  the password field
> > DISPATCH-1445 - Update saslPassword attribute in connector entity
> > to use openssl style prefixes
> > DISPATCH-1446 - system_tests_qdmanage failing on test_get_log
> > DISPATCH-1450 - Add build option to enable thread sanitizer build
> > DISPATCH-1454 - system_tests_one_router failing due to changes in
> > qpid-proton
> > DISPATCH-1455 - Two system tests failing after optparse to
> > argparse migration
> > DISPATCH-1465 - system_tests_policy.test_verify_z_connection_stats
> > fails
> > DISPATCH-1466 - flake8 errors in system_test.py
> > DISPATCH-1471 - [test] When string comparison asserts fail the
> > strings are not printed
> > DISPATCH-1480 - Address Sanitizer leak in system_tests_multi_phase
> > DISPATCH-1491 - bottleneck adding or removing addresses in mobile
> > address engine
> > DISPATCH-1500 - inefficiencies in handling large MAU messages
> > DISPATCH-1507 - Don't collapse small number of edge routers and
> > clients into single circle
> > DISPATCH-1516 - Trace log the peer delivery id and link id when
> > linking and unlinking peers
> >
> > Bug fixes -
> > DISPATCH-1172 - Link routes and auto links activated on wrong
> > connections if many route-container conns exist
> > DISPATCH-1258 - Crash executing http test
> > DISPATCH-1377 - system_tests_topology_disposition failing on
> > machine with python3 only
> > DISPATCH-1418 - The default forwarding treatment is not overridden
> > by the treatment in the address configuration
> > DISPATCH-1421 - Attaching link to unavailable address sets source
> > address to null in attach reply
> > DISPATCH-1423 - Multicast sender with no receiver has first 250
> > messages released
> > DISPATCH-1426 - Repetitive receiver fail over causes memory leak
> > DISPATCH-1428 - route connection not indexed by 'connection' field
> > of connector
> > DISPATCH-1431 - system_tests_one_router_failing on
> > test_19_semantics_multicast
> > DISPATCH-1433 - system_tests_delivery_abort failing due to
> > receiver connecting late
> > DISPATCH-1443 - Unable to run ctest on Centos 8
> > DISPATCH-1453 - Adding "defaultDistribution: unavailable"
> > overrides the regular handling of transaction coordinator link refusal
> > DISPATCH-1460 - Router control messages 

Re: [VOTE] Release Qpid Dispatch Router 1.10.0 (RC2)

[Ken Giusti]

-1

I found a problem with qdstat on 1.10.0-rc2

qdstat fails when querying links (-l) against the previous version of the
router (1.9.0).
The failure occurs when running qdstat with a python3 interpreter - it does
not fail for python2.

See DISPATCH-1525  for
details.  I've already pushed a patch to master.

-K

On Sat, Dec 14, 2019 at 11:16 PM Ganesh Murthy  wrote:

> Hello All,
>
>  Please cast your vote on this thread to release RC2 as the
> official Qpid Dispatch Router version  1.10.0.
>
> RC2 of Qpid Dispatch Router version 1.10.0 can be found here:
>
> https://dist.apache.org/repos/dist/dev/qpid/dispatch/1.10.0-rc2/
>
> The following features, improvements, and bug fixes are introduced in
> 1.10.0:
>
> Features -
> DISPATCH-1441 - optparse python library deprecated, migrate to argparse
> DISPATCH-1442 - Add a metadata field to the router management entity
> DISPATCH-1463 - Detect deliveries that are stuck in the router for
> a long time
> DISPATCH-1467 - Add build option to enable Address Sanitizer build
> (ASAN)
>
> Improvements -
> DISPATCH-1186 - qdstat to include csv output format
> DISPATCH-1358 - Port console to patternfly 4 / React
> DISPATCH-1369 - Update console dependencies to avoid npm security
> warnings
> DISPATCH-1399 - Allow arrows on console's topology page to be disabled
> DISPATCH-1409 - Update qdstat -l output to include the current credit
> DISPATCH-1411 - Add timestamp and router name to header of qdstat
> output
> DISPATCH-1412 - Policy C code performance issue:  reload python
> module for each call
> DISPATCH-1416 - Policy log could include denial counts on connection
> close
> DISPATCH-1419 - Add status to connector mgmt schema
> DISPATCH-1427 - Allow policy to define user (group) specific
> connection limits
> DISPATCH-1434 - Add new attribute saslPasswordFile to the connector
> entity
> DISPATCH-1438 - Have ctest parse the routers debug dump files for
> memory pool leaks
> DISPATCH-1439 - Expose create time/last transfer time through the
> Connection management entity
> DISPATCH-1440 - Deprecate the passwordFile field in sslProfile and
> consolidate all password scenarios to use  the password field
> DISPATCH-1445 - Update saslPassword attribute in connector entity
> to use openssl style prefixes
> DISPATCH-1446 - system_tests_qdmanage failing on test_get_log
> DISPATCH-1450 - Add build option to enable thread sanitizer build
> DISPATCH-1454 - system_tests_one_router failing due to changes in
> qpid-proton
> DISPATCH-1455 - Two system tests failing after optparse to
> argparse migration
> DISPATCH-1465 - system_tests_policy.test_verify_z_connection_stats
> fails
> DISPATCH-1466 - flake8 errors in system_test.py
> DISPATCH-1471 - [test] When string comparison asserts fail the
> strings are not printed
> DISPATCH-1480 - Address Sanitizer leak in system_tests_multi_phase
> DISPATCH-1491 - bottleneck adding or removing addresses in mobile
> address engine
> DISPATCH-1500 - inefficiencies in handling large MAU messages
> DISPATCH-1507 - Don't collapse small number of edge routers and
> clients into single circle
> DISPATCH-1516 - Trace log the peer delivery id and link id when
> linking and unlinking peers
>
> Bug fixes -
> DISPATCH-1172 - Link routes and auto links activated on wrong
> connections if many route-container conns exist
> DISPATCH-1258 - Crash executing http test
> DISPATCH-1377 - system_tests_topology_disposition failing on
> machine with python3 only
> DISPATCH-1418 - The default forwarding treatment is not overridden
> by the treatment in the address configuration
> DISPATCH-1421 - Attaching link to unavailable address sets source
> address to null in attach reply
> DISPATCH-1423 - Multicast sender with no receiver has first 250
> messages released
> DISPATCH-1426 - Repetitive receiver fail over causes memory leak
> DISPATCH-1428 - route connection not indexed by 'connection' field
> of connector
> DISPATCH-1431 - system_tests_one_router_failing on
> test_19_semantics_multicast
> DISPATCH-1433 - system_tests_delivery_abort failing due to
> receiver connecting late
> DISPATCH-1443 - Unable to run ctest on Centos 8
> DISPATCH-1453 - Adding "defaultDistribution: unavailable"
> overrides the regular handling of transaction coordinator link refusal
> DISPATCH-1460 - Router control messages for local subscribers hang
> in Q2 holdoff
> DISPATCH-1461 - Crashed router due to terminus address overflow
> DISPATCH-1462 - [policy] Test for IPv6 leaves socket open
> DISPATCH-1468 - out-of-bounds array access in
> qd_entity_refresh_connector
> DISPATCH-1473 - [test] test_command fail on python 2.7
> DISPATCH-1474 - Console message path skips one router hop
> DISPATCH-1475 - Seg fault in qdr_link_cleanup_CT after 

Re: [VOTE] Release Qpid Dispatch Router 1.10.0 (RC2)

[Michael Goulish]

*+ 1*

I did a 2-million link test, i.e. 1 million in, 1 million out, spread
evenly over 100 connections -- on a single router, coming from a single
client -- using Gordon's python client made for this purpose -- and nothing
blew up or melted down. And it did not use an exorbitant amount of memory
like it used to before Gordon's fix, nor did it slow down linearly as the
number of links increased.

NOTE that the router does become unresponsive while all those links are
being torn down -- i.e. it does not respond to qdstat calls -- but that is
not a regression and the fix is believed to be in Proton code, not in the
router.
This is significant, because it is easy for the user to conclude that the
router has simply crashed while it is not responding.
A fix for this issue will hopefully be in the next release.







On Sat, Dec 14, 2019 at 11:16 PM Ganesh Murthy  wrote:

> Hello All,
>
>  Please cast your vote on this thread to release RC2 as the
> official Qpid Dispatch Router version  1.10.0.
>
> RC2 of Qpid Dispatch Router version 1.10.0 can be found here:
>
> https://dist.apache.org/repos/dist/dev/qpid/dispatch/1.10.0-rc2/
>
> The following features, improvements, and bug fixes are introduced in
> 1.10.0:
>
> Features -
> DISPATCH-1441 - optparse python library deprecated, migrate to argparse
> DISPATCH-1442 - Add a metadata field to the router management entity
> DISPATCH-1463 - Detect deliveries that are stuck in the router for
> a long time
> DISPATCH-1467 - Add build option to enable Address Sanitizer build
> (ASAN)
>
> Improvements -
> DISPATCH-1186 - qdstat to include csv output format
> DISPATCH-1358 - Port console to patternfly 4 / React
> DISPATCH-1369 - Update console dependencies to avoid npm security
> warnings
> DISPATCH-1399 - Allow arrows on console's topology page to be disabled
> DISPATCH-1409 - Update qdstat -l output to include the current credit
> DISPATCH-1411 - Add timestamp and router name to header of qdstat
> output
> DISPATCH-1412 - Policy C code performance issue:  reload python
> module for each call
> DISPATCH-1416 - Policy log could include denial counts on connection
> close
> DISPATCH-1419 - Add status to connector mgmt schema
> DISPATCH-1427 - Allow policy to define user (group) specific
> connection limits
> DISPATCH-1434 - Add new attribute saslPasswordFile to the connector
> entity
> DISPATCH-1438 - Have ctest parse the routers debug dump files for
> memory pool leaks
> DISPATCH-1439 - Expose create time/last transfer time through the
> Connection management entity
> DISPATCH-1440 - Deprecate the passwordFile field in sslProfile and
> consolidate all password scenarios to use  the password field
> DISPATCH-1445 - Update saslPassword attribute in connector entity
> to use openssl style prefixes
> DISPATCH-1446 - system_tests_qdmanage failing on test_get_log
> DISPATCH-1450 - Add build option to enable thread sanitizer build
> DISPATCH-1454 - system_tests_one_router failing due to changes in
> qpid-proton
> DISPATCH-1455 - Two system tests failing after optparse to
> argparse migration
> DISPATCH-1465 - system_tests_policy.test_verify_z_connection_stats
> fails
> DISPATCH-1466 - flake8 errors in system_test.py
> DISPATCH-1471 - [test] When string comparison asserts fail the
> strings are not printed
> DISPATCH-1480 - Address Sanitizer leak in system_tests_multi_phase
> DISPATCH-1491 - bottleneck adding or removing addresses in mobile
> address engine
> DISPATCH-1500 - inefficiencies in handling large MAU messages
> DISPATCH-1507 - Don't collapse small number of edge routers and
> clients into single circle
> DISPATCH-1516 - Trace log the peer delivery id and link id when
> linking and unlinking peers
>
> Bug fixes -
> DISPATCH-1172 - Link routes and auto links activated on wrong
> connections if many route-container conns exist
> DISPATCH-1258 - Crash executing http test
> DISPATCH-1377 - system_tests_topology_disposition failing on
> machine with python3 only
> DISPATCH-1418 - The default forwarding treatment is not overridden
> by the treatment in the address configuration
> DISPATCH-1421 - Attaching link to unavailable address sets source
> address to null in attach reply
> DISPATCH-1423 - Multicast sender with no receiver has first 250
> messages released
> DISPATCH-1426 - Repetitive receiver fail over causes memory leak
> DISPATCH-1428 - route connection not indexed by 'connection' field
> of connector
> DISPATCH-1431 - system_tests_one_router_failing on
> test_19_semantics_multicast
> DISPATCH-1433 - system_tests_delivery_abort failing due to
> receiver connecting late
> DISPATCH-1443 - Unable to run ctest on Centos 8
> DISPATCH-1453 - Adding "defaultDistribution: unavailable"
> overrides the regular handling of transaction coordinator link refusal
> DISPATCH-1460 - Router control 

[VOTE] Release Qpid Dispatch Router 1.10.0 (RC2)

[Ganesh Murthy]

Hello All,

 Please cast your vote on this thread to release RC2 as the
official Qpid Dispatch Router version  1.10.0.

RC2 of Qpid Dispatch Router version 1.10.0 can be found here:

https://dist.apache.org/repos/dist/dev/qpid/dispatch/1.10.0-rc2/

The following features, improvements, and bug fixes are introduced in 1.10.0:

Features -
DISPATCH-1441 - optparse python library deprecated, migrate to argparse
DISPATCH-1442 - Add a metadata field to the router management entity
DISPATCH-1463 - Detect deliveries that are stuck in the router for
a long time
DISPATCH-1467 - Add build option to enable Address Sanitizer build (ASAN)

Improvements -
DISPATCH-1186 - qdstat to include csv output format
DISPATCH-1358 - Port console to patternfly 4 / React
DISPATCH-1369 - Update console dependencies to avoid npm security warnings
DISPATCH-1399 - Allow arrows on console's topology page to be disabled
DISPATCH-1409 - Update qdstat -l output to include the current credit
DISPATCH-1411 - Add timestamp and router name to header of qdstat output
DISPATCH-1412 - Policy C code performance issue:  reload python
module for each call
DISPATCH-1416 - Policy log could include denial counts on connection close
DISPATCH-1419 - Add status to connector mgmt schema
DISPATCH-1427 - Allow policy to define user (group) specific
connection limits
DISPATCH-1434 - Add new attribute saslPasswordFile to the connector entity
DISPATCH-1438 - Have ctest parse the routers debug dump files for
memory pool leaks
DISPATCH-1439 - Expose create time/last transfer time through the
Connection management entity
DISPATCH-1440 - Deprecate the passwordFile field in sslProfile and
consolidate all password scenarios to use  the password field
DISPATCH-1445 - Update saslPassword attribute in connector entity
to use openssl style prefixes
DISPATCH-1446 - system_tests_qdmanage failing on test_get_log
DISPATCH-1450 - Add build option to enable thread sanitizer build
DISPATCH-1454 - system_tests_one_router failing due to changes in
qpid-proton
DISPATCH-1455 - Two system tests failing after optparse to
argparse migration
DISPATCH-1465 - system_tests_policy.test_verify_z_connection_stats fails
DISPATCH-1466 - flake8 errors in system_test.py
DISPATCH-1471 - [test] When string comparison asserts fail the
strings are not printed
DISPATCH-1480 - Address Sanitizer leak in system_tests_multi_phase
DISPATCH-1491 - bottleneck adding or removing addresses in mobile
address engine
DISPATCH-1500 - inefficiencies in handling large MAU messages
DISPATCH-1507 - Don't collapse small number of edge routers and
clients into single circle
DISPATCH-1516 - Trace log the peer delivery id and link id when
linking and unlinking peers

Bug fixes -
DISPATCH-1172 - Link routes and auto links activated on wrong
connections if many route-container conns exist
DISPATCH-1258 - Crash executing http test
DISPATCH-1377 - system_tests_topology_disposition failing on
machine with python3 only
DISPATCH-1418 - The default forwarding treatment is not overridden
by the treatment in the address configuration
DISPATCH-1421 - Attaching link to unavailable address sets source
address to null in attach reply
DISPATCH-1423 - Multicast sender with no receiver has first 250
messages released
DISPATCH-1426 - Repetitive receiver fail over causes memory leak
DISPATCH-1428 - route connection not indexed by 'connection' field
of connector
DISPATCH-1431 - system_tests_one_router_failing on
test_19_semantics_multicast
DISPATCH-1433 - system_tests_delivery_abort failing due to
receiver connecting late
DISPATCH-1443 - Unable to run ctest on Centos 8
DISPATCH-1453 - Adding "defaultDistribution: unavailable"
overrides the regular handling of transaction coordinator link refusal
DISPATCH-1460 - Router control messages for local subscribers hang
in Q2 holdoff
DISPATCH-1461 - Crashed router due to terminus address overflow
DISPATCH-1462 - [policy] Test for IPv6 leaves socket open
DISPATCH-1468 - out-of-bounds array access in qd_entity_refresh_connector
DISPATCH-1473 - [test] test_command fail on python 2.7
DISPATCH-1474 - Console message path skips one router hop
DISPATCH-1475 - Seg fault in qdr_link_cleanup_CT after 12,400+ connections
DISPATCH-1476 - [tools] New proton logging breaks Scraper
DISPATCH-1477 - Crash router by deleting authServicePlugin entity
through management call
DISPATCH-1481 - Multicast producers should block on credit until
consumers are present
DISPATCH-1483 - Link counters for dispositions are not incremented
for outgoing links
DISPATCH-1485 - qdstat --limit 0 seems to cause infinit loop
DISPATCH-1488 - link-routed transaction coordination broken due to
declared' state truncation
DISPATCH-1492 - Router asserts when client connects to edge listener
DISPATCH-1493 -