[Openstack-operators] Fwd: [openstack-dev] [nova][neutron] Filtering Instances by IP address performance improvement test result

2018-01-05 Thread Matt Riedemann
FYI, some performance test results for a series of patches between nova 
and neutron to try and improve the performance of listing instances and 
filtering by ip.



 Forwarded Message 
Subject: 	[openstack-dev] [nova][neutron] Filtering Instances by IP 
address performance improvement test result

Date:   Fri, 5 Jan 2018 10:53:56 +0800
From:   Zhenyu Zheng 
Reply-To: 	OpenStack Development Mailing List (not for usage questions) 

To: 	OpenStack Development Mailing List (not for usage questions) 





Hi All,

We are working on patches to improve the performance filtering instance 
by IP address this cycle. As discussed in the previous ML[1], it 
contains both patches from Nova and Neutron[2][3][4][5][6].


As the POC is almost functional(the neutron extension part seems not 
working, it cannot be successfully listed in patchset 14 of [5] , I have 
to bypass the "if" condition for checking neutron 
"ip-substring-filtering" extension to make it work, but that seems easy 
to fix), I made some tests to check what kind of improvement has been 
done with those patches.


In the tests, I wrote a simple script [7](the script is silly, please 
don't laugh at me:) ) which generated 2000 vm records in Nova DB with IP 
address allocated(one IP for each vm), and also 2000 port records with 
corresponding IP addresses in my local devstack env.


Before adding those patches, querying instance with a specific IP 
filtering causes about 4000 ms, the test has been done several times, 
and I took the averaged result:

Inline image 1

After adding those patches(and some modifications as mentioned above) 
querying with the same request causes only about 400ms:

Inline image 2

So, the design seems working well.

I also tested with a "Sub-String" manner filtering with IP address: 
192.168.7.2, which will match 66 instances, and it takes about 900ms:

Inline image 3

It increased, but seems reasonable as it matches more instances, and 
still much better than current implementation.


Please test out in your own env if interested, the script might need 
some modification as I hardcoded db connection, network_id and subnet_id.


And also, please help review the patches :)

[1] 
http://lists.openstack.org/pipermail/openstack-operators/2017-October/014459.html

[2] https://review.openstack.org/#/c/509326/
[3] https://review.openstack.org/#/c/525505/
[4] https://review.openstack.org/#/c/518865/
[5] https://review.openstack.org/#/c/521683/
[6] https://review.openstack.org/#/c/525284/
[7] 
https://github.com/zhengzhenyu/groceries/blob/master/Ip_filtering_performance_test.py


BR,

Kevin Zheng
__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


[Openstack-operators] [policy] [keystone] Analyzing other access-control systems

2018-01-05 Thread Lance Bragstad
Hey all,

This note is a continuation of a thread we started last year on
analyzing other policy systems [0]. Now that we're back from the
holidays and having policy meetings on Wednesdays [1], it'd be good to
pick up the conversation again. We had a few good sessions a couple
months ago going through AWS IAM policy bits and contrasting it to RBAC
in OpenStack. Before we wrapped up those sessions we thought about doing
the same thing with GKE or a more technical deep dive of the IAM stuff.

Do we want to pick this back up in the next few weeks? We can use this
thread to generate discussion about what we'd like to see and jot down
ideas. It might be nice timing to get a session or two scheduled before
the PTG, where we can have face-to-face discussions.

Thoughts?


[0]
http://lists.openstack.org/pipermail/openstack-dev/2017-October/123069.html
[1] http://eavesdrop.openstack.org/#Keystone_Policy_Meeting




signature.asc
Description: OpenPGP digital signature
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


Re: [Openstack-operators] [publiccloud-wg] Missing features work session

2018-01-05 Thread Flint WALRUS
I'm thrilled to see improvement within this field of concerns and the way
Openstack mature by listening from users, would them be architects,
operators, end-users etc.

I'm glade to see such initiative and for sure will be there!

See you on Wednesday!

Le ven. 5 janv. 2018 à 15:02, Tobias Rydberg  a
écrit :

> Hi everyone,
>
> During our last meeting we decided to get together at IRC for a work
> session dedicated to get the "Missing features list" up to date, and
> take the fist steps converting items into a more official list at
> launchpad - where we have a project [1]. Would be awesome to see as many
> of you as possible joining this.
>
> Where: #openstack-publiccloud
> When: Wednesday 10th January 1400 UTC
> Agenda: https://etherpad.openstack.org/p/publiccloud-wg
>
> This first effort of its kind is as you can see at the same time as
> bi-weekly meetings. Please send feedback of that, I'm happy to setup
> another session just like this - at a time that suites you better!
>
> Hope to see you there!
>
> Regards,
> Tobias Rydberg
> Chair Public Cloud WG
>
>
> [1] https://launchpad.net/openstack-publiccloud-wg
>
> ___
> OpenStack-operators mailing list
> OpenStack-operators@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators
>
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators


[Openstack-operators] [publiccloud-wg] Missing features work session

2018-01-05 Thread Tobias Rydberg

Hi everyone,

During our last meeting we decided to get together at IRC for a work 
session dedicated to get the "Missing features list" up to date, and 
take the fist steps converting items into a more official list at 
launchpad - where we have a project [1]. Would be awesome to see as many 
of you as possible joining this.


Where: #openstack-publiccloud
When: Wednesday 10th January 1400 UTC
Agenda: https://etherpad.openstack.org/p/publiccloud-wg

This first effort of its kind is as you can see at the same time as 
bi-weekly meetings. Please send feedback of that, I'm happy to setup 
another session just like this - at a time that suites you better!


Hope to see you there!

Regards,
Tobias Rydberg
Chair Public Cloud WG


[1] https://launchpad.net/openstack-publiccloud-wg



smime.p7s
Description: S/MIME Cryptographic Signature
___
OpenStack-operators mailing list
OpenStack-operators@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-operators