Re: [openstack-dev] [Nova][glance] Question about evacuate with no shared storage..

2014-02-21 Thread Joshua Harlow
That requires ssh (or some tunnel/other RPC?) connections from-to all hypervisors to work correct?? Is that allowed in your organization (headless ssh keys from-to all hypervisors)? Isn't that a huge security problem if someone manages to break out of a VM and get access to those keys? If I was

Re: [openstack-dev] Storing license information in openstack/requirements

2014-02-17 Thread Joshua Harlow
+1 for yaml instead of shoving all kinds of package metadata in comments. Sent from my really tiny device... On Feb 17, 2014, at 4:12 PM, Sean Dague s...@dague.net wrote: Honestly, if we are going to track this, we should probably do the set of things that reviewers tend to do when running

Re: [openstack-dev] Gamification and on-boarding ...

2014-02-14 Thread Joshua Harlow
+1 Mentoring and devoted mentors and not demotivating new folks (but instead growing and fostering them) is IMHO 10x more important than a badge program. Badges seem nice and all but I think it's not the biggest win for the buck. Sent from my really tiny device... On Feb 13, 2014, at 6:06

Re: [openstack-dev] [Murano] Need a new DSL for Murano

2014-02-14 Thread Joshua Harlow
An honest question, U are mentioning what appears to be the basis for a full programming language (variables, calling other workflows - similar to functions) but then u mention this is being stuffed into yaml. Why? It appears like u might as well spend the effort and define a grammar and

Re: [openstack-dev] [All]Optional dependencies and requirements.txt

2014-02-12 Thread Joshua Harlow
In taskflow we've done something like the following. Its not perfect, but it is what currently works (willing to take suggestions on better). We have three different requirements files. 1. Required to work in any manner @ https://github.com/openstack/taskflow/blob/master/requirements.txt 2.

Re: [openstack-dev] [All]Optional dependencies and requirements.txt

2014-02-12 Thread Joshua Harlow
seems to do what you want: SQLAlchemy=0.7.99,=0.9.99 [SQLAlchemyPersistence] alembic=0.4.1 [SQLAlchemyPersistence] ... [1] http://www.pip-installer.org/en/1.1/requirements.html -- Koo On Thu, 13 Feb 2014 02:37:44 + Joshua Harlow harlo...@yahoo-inc.com wrote: In taskflow we've

Re: [openstack-dev] [Murano] Can we migrate to oslo.messaging?

2014-02-11 Thread Joshua Harlow
Is murano python3.x compatible, from what I understand oslo.messaging isn't (yet). If murano is supporting python3.x then brining in oslo.messaging might make it hard for murano to be 3.x compatible. Maybe not a problem (I'm not sure of muranos python version support). From: Serg Melikyan

Re: [openstack-dev] several oslo library repositories have moved

2014-02-07 Thread Joshua Harlow
+1 thanks guys! From: Doug Hellmann doug.hellm...@dreamhost.commailto:doug.hellm...@dreamhost.com Reply-To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.orgmailto:openstack-dev@lists.openstack.org Date: Friday, February 7, 2014 at 1:02 PM To:

Re: [openstack-dev] Asynchrounous programming: replace eventlet with asyncio

2014-02-06 Thread Joshua Harlow
Has there been any investigation into heat. Heat has already used parts of the coroutine approach (for better or worse). An example: https://github.com/openstack/heat/blob/master/heat/engine/scheduler.py#L230 Decorator for a task that needs to drive a subtask. This is essentially a

Re: [openstack-dev] Asynchrounous programming: replace eventlet with asyncio

2014-02-06 Thread Joshua Harlow
Its a good question, I see openstack as mostly like the following 2 groups of applications. Group 1: API entrypoints using [apache/nginx]+wsgi (nova-api, glance-api…) In this group we can just let the underlying framework/app deal with the scaling and just use native wsgi as it was intended.

Re: [openstack-dev] [nova][glance] bp: glance-snapshot-tasks

2014-02-06 Thread Joshua Harlow
Hi alex, I think u are referring to the following: https://blueprints.launchpad.net/nova/+spec/glance-snapshot-tasks Can u describe the #2 part in more detail. Do some of the drivers already implement these new steps? The goal I think u are having is to make the snapshot functionality resume

Re: [openstack-dev] Asynchrounous programming: replace eventlet with asyncio

2014-02-06 Thread Joshua Harlow
+1 lots of respect for zane in doing this :) I'm still very much interested in seeing how we can connect taskflow in to your model. I think the features that you guys were wanting (remote workers) are showing up and hopefully will be all they can be! It helps (imho) that taskflow doesn't

[openstack-dev] [State-Management] Agenda for meeting (tommorow) at 2000 UTC

2014-02-05 Thread Joshua Harlow
library. - Discuss about any other ideas, reviews needing help, questions and answers (and more!). Any other topics are welcome :-) See you all soon! -- Joshua Harlow It's openstack, relax... | harlo...@yahoo-inc.com ___ OpenStack-dev mailing list

Re: [openstack-dev] Asynchrounous programming: replace eventlet with asyncio

2014-02-05 Thread Joshua Harlow
Any mysql DB drivers (I think the majority of openstack deployments use mysql?). How about sqlalchemy (what would possibly need to change there for it to work)? The pain that I see is that to connect all these libraries into asyncio they have to invert how they work (sqlalchemy would have to

Re: [openstack-dev] Asynchrounous programming: replace eventlet with asyncio

2014-02-04 Thread Joshua Harlow
A follow up kind of question, Why not just create a eventlet micro version that underneath uses asyncio? Then code isn't riddled with yield from or Return() or similar. It seems possible (maybe?) to replace the eventlet hub with one that uses asyncio? This is then a nice change for all those

Re: [openstack-dev] Asynchrounous programming: replace eventlet with asyncio

2014-02-04 Thread Joshua Harlow
I was just thinking that openstack would be better to slowly get off eventlet (avoids the large amount of changes this new mostly untested/unproven tulip/trollius framework introduces). A first step could be to replace the greenlet layer with asyncio (or similar). Then the eventlet layer still

[openstack-dev] Cinder + taskflow

2014-02-03 Thread Joshua Harlow
Hi all, After talking with john g. about taskflow in cinder and seeing more and more reviews showing up I wanted to start a thread to gather all our lessons learned and how we can improve a little before continuing to add too many more refactoring and more reviews (making sure everyone is

Re: [openstack-dev] Cinder + taskflow

2014-02-03 Thread Joshua Harlow
Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] Cinder + taskflow On Mon, Feb 3, 2014 at 1:53 PM, Joshua Harlow harlo...@yahoo-inc.com wrote: Hi all, After talking with john g. about taskflow in cinder and seeing more and more

Re: [Openstack] nova unique name generator middleware

2014-02-03 Thread Joshua Harlow
wrote: +1 intel use cases. It would be nice to avoid our current custom patches. On Sunday, February 2, 2014, Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com wrote: +1 yahoo use case(s) would also benefit from not having to patch the +code

Re: [Openstack] nova unique name generator middleware

2014-02-02 Thread Joshua Harlow
+1 yahoo use case(s) would also benefit from not having to patch the code to achieve similar results. Sent from my really tiny device... On Feb 2, 2014, at 12:12 AM, Tim Bell tim.b...@cern.ch wrote: It would be interesting to have a formal exit inside OpenStack nova at VM creation for

Re: [openstack-dev] [Nova][Neutron] nova-network in Icehouse and beyond

2014-01-29 Thread Joshua Harlow
I think depending on use-case it can be accomplished. The steps we have been thinking at Y! 1. Take offline APIs nova-compute (so new/existing VMs can't be scheduled/modified) -- existing running VMs will not be affected. 2. Save/dump nova database. 3. Translate nova database entries into

[openstack-dev] [State-Management] Agenda for tommorow meeting at 2000 UTC

2014-01-29 Thread Joshua Harlow
library. - Discuss about any other ideas, questions and answers (and more!). Any other topics are welcome :-) See you all soon! -- Joshua Harlow It's openstack, relax... | harlo...@yahoo-inc.com ___ OpenStack-dev mailing list OpenStack-dev

[openstack-dev] Mistral + taskflow mini-meetup

2014-01-27 Thread Joshua Harlow
Hi all, In order to encourage further discussion off IRC and more in public I'd like to share a etherpad that was worked on during a 'meetup' with some of the mistral folks and me. https://etherpad.openstack.org/p/taskflow-mistral-jan-meetup It was more of a (mini) in-person meetup but I

Re: [openstack-dev] [oslo] log message translations

2014-01-27 Thread Joshua Harlow
+1 I've never understood this either personally. From what I know most all (correct me if I am wrong) open source projects don't translate log messages; so it seems odd to be the special snowflake project/s. Do people find this type of translation useful? It'd be nice to know how many people

Re: [openstack-dev] Mistral + taskflow mini-meetup

2014-01-27 Thread Joshua Harlow
PoC is not using TaskFlow but moving forward we we’d like to try to marry these two technologies to be more aligned in terms of APIs and feature sets. Renat Akhmerov @ Mirantis Inc. On 27 Jan 2014, at 13:21, Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com wrote: Hi all

[openstack-dev] Hacking repair scripts

2014-01-27 Thread Joshua Harlow
Hi all, I have had in my ~/bin for a while a little script that I finally got around to tuning up and I thought others might be interested in it/find it useful. The concept is similar to https://pypi.python.org/pypi/autopep8 but does a really simple action to start. As many of u know the

Re: [openstack-dev] [Ironic] Node groups and multi-node operations

2014-01-26 Thread Joshua Harlow
Doesn't nova already have logic for creating N virtual machines (similar to a group) in the same request? I thought it did (maybe it doesn't anymore in the v3 API), creating N bare metal machines seems like it would comply to that api? Sent from my really tiny device... On Jan 22, 2014, at

Re: [openstack-dev] [Ironic] Node groups and multi-node operations

2014-01-26 Thread Joshua Harlow
, Robert Collins robe...@robertcollins.net wrote: On 27 January 2014 08:04, Joshua Harlow harlo...@yahoo-inc.com wrote: Doesn't nova already have logic for creating N virtual machines (similar to a group) in the same request? I thought it did (maybe it doesn't anymore in the v3 API

Re: [openstack-dev] Fwd: [TripleO] mid-cycle meetup?

2014-01-25 Thread Joshua Harlow
good to know we have options if we overflow available meeting rooms or suchlike :) Cheers, -- Chris Jones On 25 Jan 2014, at 03:22, Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com wrote: Yahoo! is right in the middle of sunnyvale; and probably has enough free space to handle

Re: [openstack-dev] [Ironic] File Injection (and the lack thereof)

2014-01-24 Thread Joshua Harlow
Cloud-init 0.7.5 (not yet released) will have the ability to read from an ec2-metadata server using SSL. In a recent change I did we now use requests which correctly does SSL for the ec2-metadata/ec2-userdata reading. - http://bazaar.launchpad.net/~cloud-init-dev/cloud-init/trunk/revision/910

Re: [openstack-dev] [Ironic] File Injection (and the lack thereof)

2014-01-24 Thread Joshua Harlow
Also just to note; file-injection seems unneeded when cloud-init can use this: http://cloudinit.readthedocs.org/en/latest/topics/examples.html#writing-out -arbitrary-files That I believe is in most modern versions of cloud-init (forgot when I implemented that). Just FYI :) -Josh On 1/24/14,

Re: [openstack-dev] Fwd: [TripleO] mid-cycle meetup?

2014-01-24 Thread Joshua Harlow
Yahoo! is right in the middle of sunnyvale; and probably has enough free space to handle all u folks (some rooms are quite big really). I can talk with some folks here about hosting all of this here if that’s desired (depending on how big). -Josh From: Roman Alekseenkov

Re: [openstack-dev] [oslo] memoizer aka cache

2014-01-23 Thread Joshua Harlow
So to me memoizing is typically a premature optimization in a lot of cases. And doing it incorrectly leads to overfilling the python processes memory (your global dict will have objects in it that can't be garbage collected, and with enough keys+values being stored will act just like a memory

Re: [openstack-dev] [oslo] memoizer aka cache

2014-01-23 Thread Joshua Harlow
at any type of scale). -Josh On 1/23/14, 1:35 PM, Renat Akhmerov rakhme...@mirantis.com wrote: On 23 Jan 2014, at 08:41, Joshua Harlow harlo...@yahoo-inc.com wrote: So to me memoizing is typically a premature optimization in a lot of cases. And doing it incorrectly leads to overfilling

Re: [openstack-dev] [oslo] memoizer aka cache

2014-01-23 Thread Joshua Harlow
for all to use. --Morgan On Thu, Jan 23, 2014 at 2:54 PM, Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com wrote: Sure, no cancelling cases of conscious usage, but we need to be careful here and make sure its really appropriate. Caching and invalidation techniques are right up

[openstack-dev] [State-Management] Agenda for tommorow meeting at 2000 UTC

2014-01-22 Thread Joshua Harlow
you all soon! -- Joshua Harlow It's openstack, relax... | harlo...@yahoo-inc.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] sqla 0.8 ... and sqla 0.9

2014-01-16 Thread Joshua Harlow
Also with: https://review.openstack.org/#/c/66051/ On 1/16/14, 10:40 AM, Jeremy Stanley fu...@yuggoth.org wrote: On 2014-01-12 07:27:11 -0500 (-0500), Sean Dague wrote: With the taskflow update, the only thing between upping our sqla requirement to 0.8.99 is pbr's requirements integration

[openstack-dev] [State-Management] Proposal to add Changbin Liu to taskflow-core

2014-01-16 Thread Joshua Harlow
Greetings all stackers, I propose that we add Changbin Liu[1] to the taskflow-core team[2]. Changbin has been actively contributing to taskflow for a while now, both in helping develop code and helping with the review load. He has provided quality reviews and is doing an awesome job with the

Re: [openstack-dev] [oslo] dependency analysis for graduating more oslo libraries

2014-01-15 Thread Joshua Harlow
Very nice write up +1 A question, many modules are pulling in oslo.log as seen from the dependency graph which itself then pulls in oslo.config. Is the plan to just have all these modules use the regular python logging and have oslo.log be a plugin/formatter/adapter to python logging? Likely

[openstack-dev] [State-Management] Agenda for tommorow meeting at 2000 UTC

2014-01-15 Thread Joshua Harlow
, feedback...) - Any other ongoing taskflow work (questions, comments, feedback...) - Discuss about any other potential new use-cases for said library. - Discuss about any other ideas, questions and answers (and more!). Any other topics are welcome :-) See you all soon! -- Joshua Harlow

Re: [openstack-dev] [all] Organizing a Gate Blocking Bug Fix Day

2014-01-09 Thread Joshua Harlow
And my ring, my precious. Count me in! On 1/9/14, 6:06 AM, Julien Danjou jul...@danjou.info wrote: On Thu, Jan 09 2014, Sean Dague wrote: I'm hopefully that if we can get everyone looking at this one a single day, we can start to dislodge the log jam that exists. I will help you bear

[openstack-dev] [State-Management] Agenda for tommorow meeting at 2000 UTC

2014-01-08 Thread Joshua Harlow
are welcome :-) See you all soon! -- Joshua Harlow It's openstack, relax... | harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo

Re: [openstack-dev] [Gantt] Looking for some answers...

2014-01-06 Thread Joshua Harlow
Was the history filtered out using something like http://git-scm.com/docs/git-filter-branch?? There seems to be a lot of commit history that isn't related to gantt files (baremetal…) Was the plan to figure out which files to keep, then cleanup that commit history? I wouldn't expect

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-05 Thread Joshua Harlow
With regards to the futures module it should just work fine with the packaging of https://pypi.python.org/pypi/futures which is a backport of the 3.2 concurrent futures package into 2.6,2.7, so that's the package there. Feel free to bug me on irc if u want any other help with dependencies, the

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-05 Thread Joshua Harlow
Agreed, we are going to expand it and work on figuring out how to test against multiple versions. It does work with 0.8 and it seems even like 0.9 works fine also. But all compatible also means I can't guarantee 0.10 (if it comes out) will work since afaik semver means sqlalchemy could still

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-04 Thread Joshua Harlow
Such a bad state seems like FUD. Taskflow was just syncing its requirements with the same requirements that everyone else is... Those global requirements have 0.7.99 in them as we speak (which is why taskflow picked up that version). The issue here will be worked through and fixed, it won't

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-04 Thread Joshua Harlow
I was more of referring to general dependency issues, sqlalchemy hopefully never again but one never knows :P Sent from my really tiny device... On Jan 4, 2014, at 8:40 AM, Thomas Goirand z...@debian.org wrote: On 01/05/2014 12:12 AM, Joshua Harlow wrote: it won't be the last time

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-03 Thread Joshua Harlow
So taskflow was tested with the version of sqlalchemy that was available and in the requirements at the time of its 0.1 release (taskflow syncs it's requirements from the same global requirements). From what I remember this is the same requirement that everyone else is bound to:

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-03 Thread Joshua Harlow
even more of these types of new 3rd party libraries to appear on pypi (and therefore causing similar issues of transitive dependencies as taskflow). Will bug u on #openstack-infra soon :-) On 1/3/14, 9:05 AM, Sean Dague s...@dague.net wrote: On 01/03/2014 11:37 AM, Joshua Harlow wrote: So

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-03 Thread Joshua Harlow
Sounds good to me. Talked on #openstack-infra with some folks there and just awaiting next steps. Doesn't seem like should be anything to hard to adjust/move/... -Josh On 1/3/14, 11:27 AM, Sean Dague s...@dague.net wrote: On 01/03/2014 12:45 PM, Joshua Harlow wrote: Ok, I think I'm fine

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-03 Thread Joshua Harlow
really need to I can push out a 0.1.2 with the unpinned version (one of the above reviews). -Josh From: Doug Hellmann doug.hellm...@dreamhost.commailto:doug.hellm...@dreamhost.com Date: Friday, January 3, 2014 at 11:44 AM To: Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com Cc

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-03 Thread Joshua Harlow
Since the library model is what most everyone else uses outside of openstack (I assume?) what can we do to get there so that this model works as well? Expanding dependencies recursively seems like it could help? This could then detect transitive dependency issues (and doesn't seem so hard to do).

Re: [openstack-dev] [requirements] - taskflow preventing sqla 0.8 upgrade

2014-01-03 Thread Joshua Harlow
, but sometimes u just work with what u got :-P On 1/3/14, 3:32 PM, Sean Dague s...@dague.net wrote: On 01/03/2014 06:14 PM, Joshua Harlow wrote: Since the library model is what most everyone else uses outside of openstack (I assume?) what can we do to get there so that this model works as well

Re: [Openstack] [Keystone] Keystone performance work

2014-01-03 Thread Joshua Harlow
:09 PM, Neependra Khare wrote: Hi Joshua, On 12/20/2013 01:34 PM, Joshua Harlow wrote: Awesome i will see if I can make it, maybe u guys can send out a summary afterwards? Glad to see performance work (and the associated tooling) get the attention it deserves! We had a meeting yesterday. Etherpad

Re: [Openstack] this can crash devstack

2014-01-02 Thread Joshua Harlow
If u want to try an alternate: http://anvil.readthedocs.org/ It goes through various stages: 1. Downloading preparing the components (git cloning...) 2. Building components rpms (and component dependencies to rpms) a. This creates 2 yum repositories that can be used for other installs 3.

Re: [openstack-dev] [trove][mistral] scheduled tasks

2013-12-31 Thread Joshua Harlow
Agreed taskflow doesn't currently provide scheduling as it was thought that reliable execution that can be restarted and resumed is the foundation that someone using taskflow can easily provide scheduling ontop of... Better IMHO to have a project doing this foundation well (since openstack

Re: [openstack-dev] [trove][mistral] scheduled tasks

2013-12-30 Thread Joshua Harlow
Any reason to not use taskflow (https://wiki.openstack.org/wiki/TaskFlow) to help u here?? I think it could be easily adapted to do what u want, and would save u from having to recreate the same task execution logic that everyone seems to rebuild… -Josh From: Greg Hill

Re: [Openstack] Openstack achieve the elasticity for computation

2013-12-24 Thread Joshua Harlow
in different way. Shall any VM use distributed(for eg. RAM from the different host) resources at the same time? or Shall any VM use two cores(that lies on different hosts) at the same time?, in the distributed fashion. On Tue, Dec 24, 2013 at 2:36 AM, Joshua Harlow harlo...@yahoo

[openstack-dev] [State-Management] No meeting this week

2013-12-23 Thread Joshua Harlow
Since its xmas in most of the world lets skip the IRC meeting this week (normally on thursdays). See you all soon and have a great vacation! P.S. #openstack-state-management if u feel the need to chat :-) -- Joshua Harlow It's openstack, relax... | harlo...@yahoo-inc.com

Re: [Openstack] Openstack achieve the elasticity for computation

2013-12-23 Thread Joshua Harlow
Nope, u can over provision on most all of the resources (CPU, ram, disk) u described there. Ram is the tricky one as the Linux oom killer may start to get involved when u push the ram limits to high. But there is nothing stopping u from running 8 or more vms on a box, depending on the over

Re: [Openstack] Openstack achieve the elasticity for computation

2013-12-23 Thread Joshua Harlow
8 virtual cores in compute node with 2 cores. The same is valid for using swap as memory to reach the desired 12gb. Of course, if you don't plan on using that machine for any real work, you can do it. On Mon, Dec 23, 2013 at 6:39 PM, Joshua Harlow harlo...@yahoo-inc.com wrote: Nope, u can over

Re: [Openstack] Openstack achieve the elasticity for computation

2013-12-23 Thread Joshua Harlow
plan on using that machine for any real work, you can do it. On Mon, Dec 23, 2013 at 6:39 PM, Joshua Harlow harlo...@yahoo-inc.com wrote: Nope, u can over provision on most all of the resources (CPU, ram, disk) u described there. Ram is the tricky one as the Linux oom killer may start to get

Re: [Openstack] Bringing focus to the Operators and Users at the next summit

2013-12-22 Thread Joshua Harlow
For the state problem: https://wiki.openstack.org/wiki/TaskFlow Presentation I did at the HK summit: http://www.slideshare.net/harlowja/taskflow-27820295http://www.slideshare.net/mobile/harlowja/taskflow-27820295 It was designed to help with this and other issues, including saving state

Re: [Openstack] Bringing focus to the Operators and Users at the next summit

2013-12-22 Thread Joshua Harlow
And another related project that is just getting started, around break/fix like tooling. https://wiki.openstack.org/wiki/Entropy Sent from my really tiny device... On Dec 22, 2013, at 7:04 AM, Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com wrote: For the state problem

Re: [Openstack] [Keystone] Keystone performance work

2013-12-20 Thread Joshua Harlow
...@redhat.com wrote: On 12/17/2013 05:19 PM, Neependra Khare wrote: On 12/17/2013 12:48 AM, Joshua Harlow wrote: Another thing that u might consider. The rally project[1] has been using a tool called tomograph[2] and making tomograph better and it has been collecting some similar use-cases and test-cases

[openstack-dev] [State-Management] Agenda for today meeting at 2000 UTC

2013-12-19 Thread Joshua Harlow
/TaskFlow ## Agenda (30-60 mins): - Discuss any action items from last meeting. - Discuss about any other potential new use-cases for said library. - Discuss about any other ideas, questions and answers (and more!). Any other topics are welcome :-) See you all soon! -- Joshua Harlow

Re: [openstack-dev] Re-initializing or dynamically configuring cinder driver

2013-12-16 Thread Joshua Harlow
to child processes and then starting them? I know this is the hard way of achieving the objective and SIGHUP approach will handle it more gracefully. As you mentioned it is a major change, tentatively can we use SIGTERM to achieve the objective? On Mon, Dec 16, 2013 at 9:50 AM, Joshua Harlow

Re: [openstack-dev] Re-initializing or dynamically configuring cinder driver

2013-12-15 Thread Joshua Harlow
this is the hard way of achieving the objective and SIGHUP approach will handle it more gracefully. As you mentioned it is a major change, tentatively can we use SIGTERM to achieve the objective? On Mon, Dec 16, 2013 at 9:50 AM, Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com wrote

Re: [openstack-dev] [Nova] [Neutron] How do we know a host is ready to have servers scheduled onto it?

2013-12-12 Thread Joshua Harlow
Maybe time to revive something like: https://review.openstack.org/#/c/12759/ From experience, all sites (and those internal to yahoo) provide a /status (or equivalent) that is used for all sorts of things (from basic load-balancing up/down) to other things like actually introspecting the state

[openstack-dev] [State-Management] Agenda for tomorrow meeting at 2000 UTC

2013-12-11 Thread Joshua Harlow
topics are welcome :-) See you all soon! -- Joshua Harlow It's openstack, relax... | harlo...@yahoo-inc.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] Unified Guest Agent proposal

2013-12-07 Thread Joshua Harlow
Sounds like a pretty neat idea. I like it! Another idea: instead of saying pushing for one agent to rule them all why don't we come up with a desired reference spec (maybe including a reference implementation?) that the salt, chef, mcollective, (other...) can base theres off of. In a way this

Re: [openstack-dev] [Oslo] Layering olso.messaging usage of config

2013-12-06 Thread Joshua Harlow
I really have to agree with this. It's especially important if oslo.messaging is also used in libraries like taskflow. If oslo.messaging imposes that users of it must use oslo.config then by using it in taskflow, taskflow then imposes the same oslo.config usage. This makes all libraries that

Re: [openstack-dev] [Oslo] Layering olso.messaging usage of config

2013-12-06 Thread Joshua Harlow
Previous not precious, ha, durn autocorrect, lol. Sent from my really tiny device... On Dec 6, 2013, at 9:50 AM, Joshua Harlow harlo...@yahoo-inc.com wrote: Forgive me for not understanding your precious email (which I guess was confusing for me to understand). This one clears that up

Re: [openstack-dev] [Oslo] Layering olso.messaging usage of config

2013-12-06 Thread Joshua Harlow
+, Joshua Harlow wrote: I really have to agree with this. It's especially important if oslo.messaging is also used in libraries like taskflow. If oslo.messaging imposes that users of it must use oslo.config then by using it in taskflow, taskflow then imposes the same oslo.config usage. You

Re: [openstack-dev] [Oslo] Layering olso.messaging usage of config

2013-12-06 Thread Joshua Harlow
Could jsonschema[1] be used here to do the options schema part? It works on dictionaries (and really isn't tied to json). But maybe I am missing some greater context/understanding (see other emails). [1] https://pypi.python.org/pypi/jsonschema Sent from my really tiny device... On Dec 6,

Re: [openstack-dev] Unified Guest Agent proposal

2013-12-06 Thread Joshua Harlow
Another idea that I'll put up for consideration (since I work with the cloud-init codebase also). Cloud-init[1] which currently does lots of little useful initialization types of activities (similar to the racker agents activities) has been going through some of the same questions[2] as to should

Re: [openstack-dev] Unified Guest Agent proposal

2013-12-06 Thread Joshua Harlow
Agreed, Chatting earlier today on #cloud-init about all of this I think scott convinced me that maybe we (the joint we in the community at large) should think about asking ourselves what do we really want a guest agent for/to do? If it's for software installation or user management then aren't

[openstack-dev] [State-Management] Agenda for tomorrow meeting at 2000 UTC

2013-12-04 Thread Joshua Harlow
soon! -- Joshua Harlow It's openstack, relax... | harlo...@yahoo-inc.com ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Re: [openstack-dev] When should things get added to Oslo.Incubator

2013-12-03 Thread Joshua Harlow
Why not just make it a pypi party library from the start? Call it 'super-objects' or something. Why does it have to be connected to oslo.incubator? Process for process sake imho has been a problem for oslo. Why not just go straight to building a library (does it matter if it's in oslo?) that

Re: [openstack-dev] [Oslo] Layering olso.messaging usage of config

2013-12-03 Thread Joshua Harlow
for oslo.messaging (so maybe it can be adjusted to work with things other than eventlet to make it python33 compat). On 12/3/13 2:01 AM, Julien Danjou jul...@danjou.info wrote: On Mon, Dec 02 2013, Joshua Harlow wrote: Thanks for writing this up, looking forward to seeing this happen so

Re: [openstack-dev] When should things get added to Oslo.Incubator

2013-12-03 Thread Joshua Harlow
Sure, no one has said it. But it seems to be implied, otherwise these types of discussions wouldn't occur. Right? On 12/3/13 2:25 PM, Mark McLoughlin mar...@redhat.com wrote: On Tue, 2013-12-03 at 22:07 +, Joshua Harlow wrote: Process for process sake imho has been a problem for oslo

Re: [openstack-dev] When should things get added to Oslo.Incubator

2013-12-03 Thread Joshua Harlow
mar...@redhat.com wrote: On Tue, 2013-12-03 at 22:31 +, Joshua Harlow wrote: Sure, no one has said it. But it seems to be implied, otherwise these types of discussions wouldn't occur. Right? You're assuming the Nova objects API is at a point where the maintainers of it feel ready to commit

Re: [openstack-dev] [Oslo] Layering olso.messaging usage of config

2013-12-02 Thread Joshua Harlow
Thanks for writing this up, looking forward to seeing this happen so that oslo.messaging can be used outside of the core openstack projects (and be used in libraries that do not want to force a oslo.cfg model onto users of said libraries). Any idea of a timeline as to when this would be reflected

Re: [openstack-dev] [Nova] Remove ratelimits from nova v3 api

2013-11-25 Thread Joshua Harlow
+2 Turnstile seems to be a good middle ground (other companies I know have solutions for this problem via other software), does anyone have operational knowledge they can share about how turnstile has worked out for them? Sent from my really tiny device... On Nov 25, 2013, at 9:22 AM, Kevin

Re: [openstack-dev] Unwedging the gate

2013-11-25 Thread Joshua Harlow
+2 Sent from my really tiny device... On Nov 25, 2013, at 5:02 AM, Davanum Srinivas dava...@gmail.com wrote: Many thanks to everyone who helped with the many fixes. Kudos to Joe/Clark for spear heading the effort! -- dims On Mon, Nov 25, 2013 at 12:00 AM, Joe Gordon

Re: [openstack-dev] tenant or project

2013-11-24 Thread Joshua Harlow
+2 This kind of confusion is actually very bad from an external perspective and from a user perspective. Should this just get resolved by the TC once and for all? I remember this same project vs tenant question happening like 2 years ago (maybe less) and it makes us all look sort if mad if

Re: [Openstack] [Nova] Proposed removal of the PowerVM driver

2013-11-22 Thread Joshua Harlow
I'm not a user but is there any more details on why it was removed, seems like it would be nice to know more reasoning than it doesn't fit our (internal/unknown) strategic goals at IBM. Seems rather sad that a driver can be removed with more detail around why. Sent from my really tiny

Re: [openstack-dev] Propose project story wiki idea

2013-11-20 Thread Joshua Harlow
Agreed I like the idea. It reminds me of the blog the solum team is setting up. I think I asked then when they announced that blog if there was plans to make it easy for other projects to also have there own supported blog.

Re: [openstack-dev] [Cinder] TaskFlow 0.1 integration

2013-11-20 Thread Joshua Harlow
is important for me from point of cancelling with using taskflow. So, let me help you to impl taskflow to API. Sincerely, Haruka Tanizawa 2013/11/20 Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com Sweet! Feel free to ask lots of questions and jump on both irc channels (#openstack

Re: [openstack-dev] [Cinder] TaskFlow 0.1 integration

2013-11-20 Thread Joshua Harlow
. All right. I found reminder mail from you just now. I will probably join 'State management' IRC meeting. ( If I could get up early:) or join 'Cinder' IRC meeting) Haruka Tanizawa 2013/11/21 Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com Howdy! My guess is there is very much

Re: [openstack-dev] [Cinder] TaskFlow 0.1 integration

2013-11-19 Thread Joshua Harlow
Sweet! Feel free to ask lots of questions and jump on both irc channels (#openstack-state-management and #openstack-cinder) if u need any help that can be better solved in real time chat. Thanks for helping getting this ball rolling :-) Sent from my really tiny device... On Nov 19, 2013, at

Re: [openstack-dev] [Neutron] Race condition between DB layer and plugin back-end implementation

2013-11-19 Thread Joshua Harlow
If you start adding these states you might really want to consider the following work that is going on in other projects. It surely appears that everyone is starting to hit the same problem (and joining efforts would produce a more beneficial result). Relevant icehouse etherpads: -

Re: [openstack-dev] [Neutron] Race condition between DB layer and plugin back-end implementation

2013-11-19 Thread Joshua Harlow
And also of course, nearly forgot a similar situation/review in heat. https://review.openstack.org/#/c/49440/ Except theres was/is dealing with stack locking (a heat concept). On 11/19/13 10:33 AM, Joshua Harlow harlo...@yahoo-inc.com wrote: If you start adding these states you might really

Re: [openstack-dev] [Nova] Does Nova really need an SQL database?

2013-11-19 Thread Joshua Harlow
Sorry that was I prefer #3 (not #2) at the end there. Keyboard failure ;) On 11/19/13 10:27 AM, Joshua Harlow harlo...@yahoo-inc.com wrote: Personally I would prefer #3 from the below. #2 I think will still have to deal with consistency issues, just switching away from a DB doesn't make magical

Re: [openstack-dev] [Neutron] Race condition between DB layer and plugin back-end implementation

2013-11-19 Thread Joshua Harlow
Cc: Joshua Harlow harlo...@yahoo-inc.commailto:harlo...@yahoo-inc.com, Isaku Yamahata isaku.yamah...@gmail.commailto:isaku.yamah...@gmail.com, Robert Kukura rkuk...@redhat.commailto:rkuk...@redhat.com Subject: Re: [openstack-dev] [Neutron] Race condition between DB layer and plugin back-end

Re: [openstack-dev] [Nova] Does Nova really need an SQL database?

2013-11-19 Thread Joshua Harlow
At yahoo at least 50+ simultaneous will be the common case (maybe we are special). Think of what happens on www.yahoo.com say on the olympics, news.yahoo.com could need 50+ very very quickly (especially if say a gold medal is won by some famous person). So I wouldn't discount those being the

Re: [Openstack] oraclelinux and cloud-init with config drive

2013-11-19 Thread Joshua Harlow
Hmmm at yahoo cloudinit works on rhel 5.6, 6.2, 6.3, 6.4 so my guess there could be some bug. U shouldn't need your own custom script to set the networking setting. It hopefully should just work. Sent from my really tiny device... On Nov 19, 2013, at 9:52 AM, Cristian Falcas

Re: [Openstack] oraclelinux and cloud-init with config drive

2013-11-19 Thread Joshua Harlow
was referring to cloud init and config drive specifically, no dhcp ip. Is it working in thi scenario? On Tue, Nov 19, 2013 at 10:19 PM, Joshua Harlow harlo...@yahoo-inc.com wrote: Hmmm at yahoo cloudinit works on rhel 5.6, 6.2, 6.3, 6.4 so my guess there could be some bug. U shouldn't need

[openstack-dev] [State-Management] Proposal to add Anastasia Karpinska to taskflow-core

2013-11-18 Thread Joshua Harlow
Greetings all stackers, I propose that we add Anastasia Karpinska to the taskflow-core team [1]. Anastasia has been actively contributing to taskflow for a while now, both in code and reviews. She provides high quality reviews and is doing an awesome job with the various taskflow concepts (and

Re: [openstack-dev] [Oslo] Layering olso.messaging usage of config

2013-11-18 Thread Joshua Harlow
I see it as important (and not theoretical). I'd like to use oslo.messaging (and oslo.messaging.rpc) in taskflow (to prototype how a distributed engine would work using it) and bringing in a library which requires global configuration is almost a non-starter for me. Although taskflow is targeted

<    5   6   7   8   9   10   11   12   >