Re: [openstack-dev] [neutron][db] online-schema-migrations patch landed

2015-07-16 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 07/15/2015 04:03 PM, Salvatore Orlando wrote:
 Do you reckon that the process that led to creating a migration
 like [1] should also be documented in devref?

https://review.openstack.org/202534
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVp6YxAAoJEC5aWaUY1u5759wH/RTu1EypLWtgJfUplQisMD6K
qkve7/reMSzdxUYH+7M4oqdcKJt+ADi3FqtEkmhGlp19AxZMCkQ8lyRiBrz/I65X
rrChRpa/taXm0d4/+Qj3qB7q8FN1OdmpYMOIMjRBE0yfju0G+PP5iIyBxh3x3t5q
TJkGGNcF9G2hOTs3Pj4YzJC6D0RbGxPG5gcBjG/i6FzvUn2XBr3nhVG+3JZMR4Cz
BxG27FkJX9GbgtP0dXETzvwq52lHXT4m9U8tp0Kwd7nqqPVSeXbRDdHDyuawpBKs
GKiur+n8wIPuQkdmDyhH+QA+pHYz1vrcvI7EGpAD4/Fj8xBs0bVq+5SuSofsVmw=
=E/Tx
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][db] online-schema-migrations patch landed

2015-07-15 Thread Salvatore Orlando
Do you reckon that the process that led to creating a migration like [1]
should also be documented in devref?
That might be helplful for developers, unless that process is already
documented elsewhere.

Salvatore


[1] https://review.openstack.org/#/c/202013/1

On 15 July 2015 at 15:54, Mike Bayer mba...@redhat.com wrote:



 On 7/15/15 9:26 AM, Ihar Hrachyshka wrote:

 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA256

 Hi all,

 since it's a high impact change in the migration tree, I wanted to
 drop an email to everyone affected (basically, anyone who wants to
 introduce a new migration from now on).

 So there was a proposal to split migration rules into independent
 branches, with one 'expand' branch containing only those rules that
 are safe to apply while neutron-server is running. Proposal is at:

 http://specs.openstack.org/openstack/neutron-specs/specs/liberty/online-
 schema-migrations.html

 And the first patch to implement it just landed in neutron:

 http://git.openstack.org/cgit/openstack/neutron/commit/?id=c7acfbabdc13e
 d2a73bdbc6275af8063b8c1eb2f

 - From now on,

 - - there are multiple alembic heads for any database state;
 - - there is a new file structure under
 neutron/db/migration/versions/alembic_versions/{cycle}_{branch};
 - - you may need to split your migrations into pieces (for expand and
 contract branches, respectively, depending on the character of schema
 changes; more details in the spec);
 - - 'neutron-db-manage upgrade head' still applies all heads;
 - - I'd like to rearrange migration trees for *aas repos in the same
 way, though neutron-db-manage still supports the old file layout.

 To get an example of how the split would look like for existing
 migration rules in review, I took Kevin's patch for RBAC:

 https://review.openstack.org/191707

 And transformed it into something that adopts the new file layout:

 https://review.openstack.org/202013

 Changes I made:
 - - split migration script into two pieces;
 - - updated HEADS file;
 - - made the contract phase script depends_on the expand one;

 Note that 'neutron-db-manage revision --autogenerate' command does not
 yet filter operations into corresponding branches, though we would
 like to have it in L once new alembic is released.


 This API is in master and will be the focus of the 0.8 release. This is a
 major refactor so I'm still working out backwards-compatibility stuff as
 well as getting some more pluggability into autogenerate while we're at
 it.   The documentation for the specific aspect of filtering operations
 during autogenerate is up at
 http://alembic.readthedocs.org/en/latest/api/autogenerate.html#customizing-revision-generation
 .




 Ihar
 -BEGIN PGP SIGNATURE-
 Version: GnuPG v2

 iQEcBAEBCAAGBQJVpl92AAoJEC5aWaUY1u57EHoIALn4Q+k46liBJeto/pVZ+/Yd
 PYOJuuAV8jIrC1Xrg+70HDJ2W3TeioYAy+XqNLQ178P7cq2Gbn9xKOlzm8tuojtl
 dwc2cmtS443YI1IGe6Vcv9uQdYQ3qtdkuruGoaxGvIb7oRCZ9QF9qLdJELw4hG6z
 8B2TSrpJ6aduudmkO+DUw9rcmyG6SNAEuXSdLPEkz9oIaVPvNODHA5D8VSN0xmNY
 kHRNFfXcdsLZ3IWqu/xsgIbujLBPcblgdl8Oofw4GaMA271sdGMPUgPl07nAnJqa
 WoyOER9VQz8DqnLpXOq36oZpmCrFc+Uk7SVbvyB4nZgB0OMkvQHdtzB/Tw2yCc8=
 =3nWE
 -END PGP SIGNATURE-

 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe:
 openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



 __
 OpenStack Development Mailing List (not for usage questions)
 Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
 http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][db] online-schema-migrations patch landed

2015-07-15 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

On 07/15/2015 04:03 PM, Salvatore Orlando wrote:
 Do you reckon that the process that led to creating a migration
 like [1] should also be documented in devref? That might be
 helplful for developers, unless that process is already documented
 elsewhere.
 

I will take your suggestion as my high priority task, My Lord! I'll
update devref tomorrow with an example.

Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVpmmnAAoJEC5aWaUY1u57bOoIAKBFAo/+VI/JN8vaKxhbRnAZ
4H8eupOJzUHinWGCSlldiPcdIA0nGtszc/GCaaoeUAzFR3JDsnvBoimihk+bsj/D
BS6jZasvO+XRFy1kULxjyA0Me5c7avHOIdjnpmA0OkCinUASsU0UhcP2NZG6Jkcx
3jHndL2OsKZe4BMPrSq8kJdt/0oqFxE+6PMXgNmljbuAVE3fpluFvzuQ/GO1NqpE
gqvoR3nyuUm+Df/+hGTbL//ZbIQuf0ro6j6S7VyLi3kdAEf03AfNtHZznM98mB7E
9CaSVXs9VOppzWej8Xzfv2l4FQm2cydK/SC0yhLCMfWAsHq62PLc61JbZD/LJQM=
=pgkF
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


[openstack-dev] [neutron][db] online-schema-migrations patch landed

2015-07-15 Thread Ihar Hrachyshka
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Hi all,

since it's a high impact change in the migration tree, I wanted to
drop an email to everyone affected (basically, anyone who wants to
introduce a new migration from now on).

So there was a proposal to split migration rules into independent
branches, with one 'expand' branch containing only those rules that
are safe to apply while neutron-server is running. Proposal is at:

http://specs.openstack.org/openstack/neutron-specs/specs/liberty/online-
schema-migrations.html

And the first patch to implement it just landed in neutron:

http://git.openstack.org/cgit/openstack/neutron/commit/?id=c7acfbabdc13e
d2a73bdbc6275af8063b8c1eb2f

- From now on,

- - there are multiple alembic heads for any database state;
- - there is a new file structure under
neutron/db/migration/versions/alembic_versions/{cycle}_{branch};
- - you may need to split your migrations into pieces (for expand and
contract branches, respectively, depending on the character of schema
changes; more details in the spec);
- - 'neutron-db-manage upgrade head' still applies all heads;
- - I'd like to rearrange migration trees for *aas repos in the same
way, though neutron-db-manage still supports the old file layout.

To get an example of how the split would look like for existing
migration rules in review, I took Kevin's patch for RBAC:

https://review.openstack.org/191707

And transformed it into something that adopts the new file layout:

https://review.openstack.org/202013

Changes I made:
- - split migration script into two pieces;
- - updated HEADS file;
- - made the contract phase script depends_on the expand one;

Note that 'neutron-db-manage revision --autogenerate' command does not
yet filter operations into corresponding branches, though we would
like to have it in L once new alembic is released.

Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVpl92AAoJEC5aWaUY1u57EHoIALn4Q+k46liBJeto/pVZ+/Yd
PYOJuuAV8jIrC1Xrg+70HDJ2W3TeioYAy+XqNLQ178P7cq2Gbn9xKOlzm8tuojtl
dwc2cmtS443YI1IGe6Vcv9uQdYQ3qtdkuruGoaxGvIb7oRCZ9QF9qLdJELw4hG6z
8B2TSrpJ6aduudmkO+DUw9rcmyG6SNAEuXSdLPEkz9oIaVPvNODHA5D8VSN0xmNY
kHRNFfXcdsLZ3IWqu/xsgIbujLBPcblgdl8Oofw4GaMA271sdGMPUgPl07nAnJqa
WoyOER9VQz8DqnLpXOq36oZpmCrFc+Uk7SVbvyB4nZgB0OMkvQHdtzB/Tw2yCc8=
=3nWE
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev


Re: [openstack-dev] [neutron][db] online-schema-migrations patch landed

2015-07-15 Thread Mike Bayer



On 7/15/15 9:26 AM, Ihar Hrachyshka wrote:

-BEGIN PGP SIGNED MESSAGE-
Hash: SHA256

Hi all,

since it's a high impact change in the migration tree, I wanted to
drop an email to everyone affected (basically, anyone who wants to
introduce a new migration from now on).

So there was a proposal to split migration rules into independent
branches, with one 'expand' branch containing only those rules that
are safe to apply while neutron-server is running. Proposal is at:

http://specs.openstack.org/openstack/neutron-specs/specs/liberty/online-
schema-migrations.html

And the first patch to implement it just landed in neutron:

http://git.openstack.org/cgit/openstack/neutron/commit/?id=c7acfbabdc13e
d2a73bdbc6275af8063b8c1eb2f

- From now on,

- - there are multiple alembic heads for any database state;
- - there is a new file structure under
neutron/db/migration/versions/alembic_versions/{cycle}_{branch};
- - you may need to split your migrations into pieces (for expand and
contract branches, respectively, depending on the character of schema
changes; more details in the spec);
- - 'neutron-db-manage upgrade head' still applies all heads;
- - I'd like to rearrange migration trees for *aas repos in the same
way, though neutron-db-manage still supports the old file layout.

To get an example of how the split would look like for existing
migration rules in review, I took Kevin's patch for RBAC:

https://review.openstack.org/191707

And transformed it into something that adopts the new file layout:

https://review.openstack.org/202013

Changes I made:
- - split migration script into two pieces;
- - updated HEADS file;
- - made the contract phase script depends_on the expand one;

Note that 'neutron-db-manage revision --autogenerate' command does not
yet filter operations into corresponding branches, though we would
like to have it in L once new alembic is released.


This API is in master and will be the focus of the 0.8 release. This is 
a major refactor so I'm still working out backwards-compatibility stuff 
as well as getting some more pluggability into autogenerate while we're 
at it.   The documentation for the specific aspect of filtering 
operations during autogenerate is up at 
http://alembic.readthedocs.org/en/latest/api/autogenerate.html#customizing-revision-generation.





Ihar
-BEGIN PGP SIGNATURE-
Version: GnuPG v2

iQEcBAEBCAAGBQJVpl92AAoJEC5aWaUY1u57EHoIALn4Q+k46liBJeto/pVZ+/Yd
PYOJuuAV8jIrC1Xrg+70HDJ2W3TeioYAy+XqNLQ178P7cq2Gbn9xKOlzm8tuojtl
dwc2cmtS443YI1IGe6Vcv9uQdYQ3qtdkuruGoaxGvIb7oRCZ9QF9qLdJELw4hG6z
8B2TSrpJ6aduudmkO+DUw9rcmyG6SNAEuXSdLPEkz9oIaVPvNODHA5D8VSN0xmNY
kHRNFfXcdsLZ3IWqu/xsgIbujLBPcblgdl8Oofw4GaMA271sdGMPUgPl07nAnJqa
WoyOER9VQz8DqnLpXOq36oZpmCrFc+Uk7SVbvyB4nZgB0OMkvQHdtzB/Tw2yCc8=
=3nWE
-END PGP SIGNATURE-

__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev



__
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev