[Bug 1728132] Re: percona-cluster crashes on artful deploys
Hello Ryan, or anyone else affected, Accepted percona-xtradb-cluster-5.6 into artful-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source /percona-xtradb-cluster-5.6/5.6.34-26.19-0ubuntu4.17.10.1 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation on how to enable and use -proposed.Your feedback will aid us getting this update out to other Ubuntu users. If this package fixes the bug for you, please add a comment to this bug, mentioning the version of the package you tested and change the tag from verification-needed-artful to verification-done-artful. If it does not fix the bug for you, please add a comment stating that, and change the tag to verification-failed-artful. In either case, without details of your testing we will not be able to proceed. Further information regarding the verification process can be found at https://wiki.ubuntu.com/QATeam/PerformingSRUVerification . Thank you in advance! ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu Artful) Status: In Progress => Fix Committed ** Tags added: verification-needed verification-needed-artful -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
This bug was fixed in the package percona-xtradb-cluster-5.6 -
5.6.34-26.19-0ubuntu5
---
percona-xtradb-cluster-5.6 (5.6.34-26.19-0ubuntu5) bionic; urgency=medium
* Switch back to using gcc-6 as gcc-7 results in a
broken PXC (LP: #1728132):
- d/rules,control: BD on g{cc,++}-6, force use during build.
- d/p/series: Disable gcc-7 related patches.
- d/p/ibuf-uses-full-memory-barrier-ppc64.patch: Revert gcc-7
specific changes.
- d/rules: Drop gcc-7 related overrides for errors.
* d/control: Update Vcs fields for Ubuntu.
-- James Page Thu, 30 Nov 2017 13:55:40 +
** Changed in: percona-xtradb-cluster-5.6 (Ubuntu Bionic)
Status: In Progress => Fix Released
--
You received this bug notification because you are a member of Ubuntu
Bugs, which is subscribed to Ubuntu.
https://bugs.launchpad.net/bugs/1728132
Title:
percona-cluster crashes on artful deploys
To manage notifications about this bug go to:
https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions
--
ubuntu-bugs mailing list
ubuntu-bugs@lists.ubuntu.com
https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
gcc-6 built binaries pass testing (deployment and tempest openstack tests); proposing binaries built using gcc-6 as a solution to this problem; this does not remove the requirement to move forward with pxc 5.7 built using gcc-7. ** Description changed: - On Artful x86_64, percona-cluster shared-db-relation-changed hooks - frequently error out, but not always. Various db migrate operations - fail (sometimes keystone, sometimes glance). + >> Impact << + percona-xtradb-cluster 5.6 is unusable on Ubuntu >= artful + + >> Test Case << + sudo apt install percona-xtradb-cluster-5.6 + + >> Regression Potential << + minimal; the changes to the packaging force use of gcc-6 (rather than gcc-7) which was know to work @ zesty. + + >> Original Bug Report << + On Artful x86_64, percona-cluster shared-db-relation-changed hooks frequently error out, but not always. Various db migrate operations fail (sometimes keystone, sometimes glance). Juju unit logs indicate db migrate operations were underway on the api unit, and system logs indicate mysql (percona-cluster) crashed on the db unit. Artifacts: https://openstack-ci-reports.ubuntu.com/artifacts/test_charm_pipeline_amulet_full/openstack/charm-ceph/508041/4/743/consoleText.test_charm_amulet_full_.txt percona-cluster/0* error idle8172.17.106.18 3306/tcp hook failed: "shared-db-relation-changed" for glance:shared-db # A simple percona-cluster exercise on Artful, can readily repro with this on serverstack series: artful relations: - - keystone:shared-db - - percona-cluster:shared-db + - percona-cluster:shared-db - - glance:identity-service - - keystone:identity-service + - keystone:identity-service - - glance:amqp - - rabbitmq-server:amqp + - rabbitmq-server:amqp services: - percona-cluster: - charm: cs:~openstack-charmers-next/percona-cluster - num_units: 1 - constraints: "cpu-cores=4 mem=4G" - options: - max-connections: 1000 - innodb-buffer-pool-size: 256M - keystone: - charm: cs:~openstack-charmers-next/keystone - num_units: 1 - constraints: "cpu-cores=2 mem=2G" - options: - admin-password: openstack - worker-multiplier: 0.25 - glance: - charm: cs:~openstack-charmers-next/glance - num_units: 1 - constraints: "cpu-cores=2 mem=2G" - options: - worker-multiplier: 0.25 - rabbitmq-server: - charm: cs:~openstack-charmers-next/rabbitmq-server - num_units: 1 - constraints: "cpu-cores=4 mem=4G" + percona-cluster: + charm: cs:~openstack-charmers-next/percona-cluster + num_units: 1 + constraints: "cpu-cores=4 mem=4G" + options: + max-connections: 1000 + innodb-buffer-pool-size: 256M + keystone: + charm: cs:~openstack-charmers-next/keystone + num_units: 1 + constraints: "cpu-cores=2 mem=2G" + options: + admin-password: openstack + worker-multiplier: 0.25 + glance: + charm: cs:~openstack-charmers-next/glance + num_units: 1 + constraints: "cpu-cores=2 mem=2G" + options: + worker-multiplier: 0.25 + rabbitmq-server: + charm: cs:~openstack-charmers-next/rabbitmq-server + num_units: 1 + constraints: "cpu-cores=4 mem=4G" DEBUG:bundletester.utils:Updating JUJU_MODEL: "auto-osci-sv06:admin/auto-osci-sv06" -> "" DEBUG:bundletester.fetchers:git rev-parse HEAD: d0d41964227bc1dc46887fa77ba4be3bc5065fae ERROR: InvocationError: '/var/lib/jenkins/checkout/0/ceph/.tox/func27/bin/bundletester -vl DEBUG -r json -o func-results.json --test-pattern gate-* --no-destroy' ___ summary ERROR: func27: commands failed - ! Amulet test failed. + ! Amulet test failed. Model Controller Cloud/Region Version SLA auto-osci-sv06 auto-osci-sv06 serverstack/serverstack 2.2.4unsupported App Version Status Scale CharmStore Rev OS Notes - ceph 12.2.0active 3 ceph local 105 ubuntu - ceph-osd 12.2.0active 1 ceph-osd jujucharms 297 ubuntu - cinder 11.0.0waiting 1 cinder jujucharms 298 ubuntu - cinder-cephwaiting0/1 cinder-ceph jujucharms 247 ubuntu - glance 15.0.0waiting 1 glance jujucharms 292 ubuntu - keystone 12.0.0waiting 1 keystone jujucharms 322 ubuntu - nova-compute 16.0.1active 1 nova-compute jujucharms 336 ubuntu - percona-cluster 5.6.34-26.19 error1 percona-cluster jujucharms 274 ubuntu - rabbitmq-server 3.6.10active 1 rabbitmq-server jujucharms 280 ubuntu + ceph 12.2.0active 3 ceph local 105 ubuntu + ceph-osd
[Bug 1728132] Re: percona-cluster crashes on artful deploys
I think we need to unblock this in the short term while work happens on 5.7; so I've built PXC packages using gcc-5: https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/3060 and gcc-6 for testing purposes: https://launchpad.net/~ci-train-ppa-service/+archive/ubuntu/3061 If gcc-6 built binaries prove stable, I'd propose we force pxc builds for 5.6 to using gcc-6 (which is trivial todo); I checked with doko and both 5 & 6 binaries will remain in archive (albeit 5 will be in universe) for bionic so we can 'fix' things this way. ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu) Importance: Undecided => High ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu) Status: Confirmed => Triaged ** Also affects: percona-xtradb-cluster-5.6 (Ubuntu Bionic) Importance: High Status: Triaged ** Also affects: percona-xtradb-cluster-5.6 (Ubuntu Artful) Importance: Undecided Status: New ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu Artful) Status: New => Triaged ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu Artful) Importance: Undecided => High ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu Artful) Assignee: (unassigned) => James Page (james-page) ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu Bionic) Assignee: (unassigned) => James Page (james-page) -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
As a work-around for enabling testing of OpenStack on >= Artful, we can force percona-cluster juju units to a series: xenial. This will allow everything in the deployment, except for percona-cluster, to be validated on the later series. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
Please also see the related bug, requesting 5.7: https://bugs.launchpad.net/ubuntu/+source/percona-xtradb- cluster-5.6/+bug/1719213 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
Right now, OpenStack Charm Engineering are unable to test Bionic and Artful OpenStack clouds due to this issue, which puts us at a stand- still in preparing for the next LTS. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
** Changed in: charm-percona-cluster Importance: Critical => High -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
Status changed to 'Confirmed' because the bug affects multiple users. ** Changed in: percona-xtradb-cluster-5.6 (Ubuntu) Status: New => Confirmed -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
Marking charm bug task as invalid - this appears to be a gcc-7 type issue. -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
Reference: #0 0x563d4629c8be in thr_get_trx (thr=0x0) at /build/percona- xtradb-cluster-5.6-EJAmtv/percona-xtradb- cluster-5.6-5.6.34-26.19/storage/innobase/include/que0que.ic:38 .. #1 btr_cur_optimistic_insert (flags=flags@entry=7, cursor=cursor@entry=0x7fc078270a70, offsets=offsets@entry=0x7fc078270a60, heap=heap@entry=0x7fc078270a68, entry=entry@entry=0x7fc04403c938, rec=rec@entry=0x7fc078270a58, big_rec=0x7fc078270a50, n_ext=, thr=0x0, mtr=0x7fc078271310) at /build/percona-xtradb-cluster-5.6-EJAmtv/percona- xtradb-cluster-5.6-5.6.34-26.19/storage/innobase/btr/btr0cur.cc:1510 ** Also affects: percona-xtradb-cluster-5.6 (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
Hmmm: https://jira.mariadb.org/browse/MDEV-12358 ** Changed in: charm-percona-cluster Status: New => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
[Bug 1728132] Re: percona-cluster crashes on artful deploys
UNIV_UNLIKELY is a macro that hints to the compiler - I wonder whether that causes us pain with gcc-7 -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1728132 Title: percona-cluster crashes on artful deploys To manage notifications about this bug go to: https://bugs.launchpad.net/charm-percona-cluster/+bug/1728132/+subscriptions -- ubuntu-bugs mailing list ubuntu-bugs@lists.ubuntu.com https://lists.ubuntu.com/mailman/listinfo/ubuntu-bugs
