[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-26 Thread Corey Bryant
This bug was fixed in the package keystone - 2:9.3.0-0ubuntu3.2~cloud0 --- keystone (2:9.3.0-0ubuntu3.2~cloud0) trusty-mitaka; urgency=medium . * New update for the Ubuntu Cloud Archive. . keystone (2:9.3.0-0ubuntu3.2) xenial; urgency=medium . * LDAP backend performance

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-26 Thread Corey Bryant
This bug was fixed in the package keystone - 2:10.0.3-0ubuntu1~cloud1 --- keystone (2:10.0.3-0ubuntu1~cloud1) xenial-newton; urgency=medium . * LDAP backend performance improvements (LP: #1582585) - d/p/faster-id-mapping-lookup.patch: Allow querying for all public ids

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-26 Thread Corey Bryant
Regression testing for newton and mitaka were successful: xenial-newton-proposed: Ran: 102 tests in 1448.5591 sec. - Passed: 94 - Skipped: 8 - Expected Fail: 0 - Unexpected Success: 0 - Failed: 0 Sum of execute time for each test: 919.5493 sec. xenial-mitaka-proposed: Ran: 102 tests in

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-15 Thread Launchpad Bug Tracker
This bug was fixed in the package keystone - 2:9.3.0-0ubuntu3.2 --- keystone (2:9.3.0-0ubuntu3.2) xenial; urgency=medium * LDAP backend performance improvements (LP: #1582585) - d/p/prevent-error-when-duplicate-mapping-is-created.patch: Handle races for creating id

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-13 Thread Billy Olsen
** Tags removed: verification-newton-done verification-xenial-done ** Tags added: verification-done-newton verification-done-xenial -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1582585 Title: the

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-08 Thread Billy Olsen
Tests completed below with 12,500 users in ldap tree === Mitaka Results === $ dpkg -l | grep keystone ii keystone 2:9.3.0-0ubuntu3.1 all OpenStack identity service - Daemons $ time openstack user list --domain userdomain ... real

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-08 Thread Billy Olsen
Adding tar.gz of /etc/keystone for reference ** Attachment added: "keystone-config.tar.gz" https://bugs.launchpad.net/keystone/+bug/1582585/+attachment/5051668/+files/keystone-config.tar.gz ** Tags removed: verification-mitaka-needed verification-needed verification-needed-xenial

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-08 Thread Billy Olsen
@gunph1ld - these changes are already in the ocata code you are running. While 15-20 seconds is still not fast, it is generally faster than the previous code which would issue a query per entry record in the id_mapping table. -- You received this bug notification because you are a member of

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-02-01 Thread Jack Ivanov
I have the same issue on Ocata (keystone-11.0.3), each request to keystone takes 15-20 sec. There are more then 15 records in the id_mapping table. Does the patch actually fix the problem? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-29 Thread Billy Olsen
@raja - can you share your keystone config (with sensitive parts redacted)? How many users are in your ldap directory which is configured as the backend domain? -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-24 Thread raja
and for the mitaka-proposed, looks like the same. the keystone version is: ``` root@ubuntu:~# apt-cache policy keystone keystone: Installed: 2:9.3.0-0ubuntu3.1~cloud0 Candidate: 2:9.3.0-0ubuntu3.1~cloud0 Version table: *** 2:9.3.0-0ubuntu3.1~cloud0 0 500

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-23 Thread raja
the ubuntu release is: DISTRIB_DESCRIPTION="Ubuntu 16.04.3 LTS" -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1582585 Title: the speed of query user from ldap server is very slow To manage

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-23 Thread raja
for the newton-proposed: As our ldap server has a limit exceed setting, so I configured ``` [ldap] page_size = 2 ``` before using the keystone in proposed repo, the keystone version is: ``` root@ubuntu:~# apt-cache policy keystone keystone: Installed: 2:10.0.3-0ubuntu1~cloud0 Candidate:

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-18 Thread Łukasz Zemczak
Hello jackning, or anyone else affected, Accepted keystone into xenial-proposed. The package will build now and be available at https://launchpad.net/ubuntu/+source/keystone/2:9.3.0-0ubuntu3.2 in a few hours, and then in the -proposed repository. Please help us by testing this new package. See

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-18 Thread Łukasz Zemczak
** Description changed: + [Impact] + + * When using an LDAP backend for Keystone, the performance can be slow if there are +a large number of users using the cloud. This is due in large part to querying the +SQL database for the identity mapping information of each user in a separate

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-11 Thread Corey Bryant
** Changed in: cloud-archive Status: New => Invalid ** Changed in: keystone (Ubuntu) Status: New => Invalid -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1582585 Title: the speed of

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-11 Thread Corey Bryant
This is currently building in newton-staging, and will be promoted to newton-proposed once built. I've also uploaded the new package version for xenial to the unapproved queue where it is awaiting review by the SRU team. -- You received this bug notification because you are a member of Ubuntu

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-11 Thread Billy Olsen
** Tags added: sts -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu. https://bugs.launchpad.net/bugs/1582585 Title: the speed of query user from ldap server is very slow To manage notifications about this bug go to:

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-11 Thread Corey Bryant
The last bullet above is in reference to faster-id-mapping-lookup.patch and fallback-for-custom-id-map-drivers.patch. And patch 1-3 are in reference to: * Patch 1: prevent-error-when-duplicate-mapping-is-created.patch * Patch 2: added-cache-for-id-mapping-manager.patch * Patch 3:

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-11 Thread Corey Bryant
Thanks for the patches Billy. I've reviewed the patches and I think they justify an SRU. Some notes from my review: * Patches 1 through 3 are fairly straight forward cherry-picks that are already in Newton and require a very minimal changes to apply to Mitaka. * Patch 3 adds a new

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-10 Thread Ubuntu Foundations Team Bug Bot
The attachment "newton-lp1582585.debdiff" seems to be a debdiff. The ubuntu-sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the "patch" flag from the attachment, remove the "patch" tag,

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-10 Thread Billy Olsen
[Impact] * When using an LDAP backend for Keystone, the performance can be slow if there are a large number of users using the cloud. This is due in large part to querying the SQL database for the identity mapping information of each user in a separate transaction. For example, an

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-10 Thread Billy Olsen
A patch for Mitaka version (xenial and the trusty-mitaka Ubuntu Cloud Archive) ** Patch added: "mitaka-lp1582585.debdiff" https://bugs.launchpad.net/ubuntu/+source/keystone/+bug/1582585/+attachment/5034743/+files/mitaka-lp1582585.debdiff -- You received this bug notification because you are

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-10 Thread Billy Olsen
A patch for xenial-newton Ubuntu Cloud Archive ** Patch added: "newton-lp1582585.debdiff" https://bugs.launchpad.net/ubuntu/+source/keystone/+bug/1582585/+attachment/5034732/+files/newton-lp1582585.debdiff -- You received this bug notification because you are a member of Ubuntu Bugs, which

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-10 Thread Corey Bryant
** Also affects: cloud-archive/newton Importance: Undecided Status: New ** Changed in: cloud-archive/newton Status: New => Triaged ** Changed in: cloud-archive/newton Importance: Undecided => High -- You received this bug notification because you are a member of Ubuntu

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-10 Thread Corey Bryant
** Also affects: cloud-archive/mitaka Importance: Undecided Status: New ** Also affects: keystone (Ubuntu Xenial) Importance: Undecided Status: New ** Changed in: cloud-archive/mitaka Status: New => Triaged ** Changed in: keystone (Ubuntu Xenial) Status: New =>

[Bug 1582585] Re: the speed of query user from ldap server is very slow

2018-01-09 Thread Billy Olsen
** Also affects: keystone (Ubuntu) Importance: Undecided Status: New ** Also affects: cloud-archive Importance: Undecided Status: New -- You received this bug notification because you are a member of Ubuntu Bugs, which is subscribed to Ubuntu.