Re: [Openstack] UnsupportedVersion Endpoint does not support RPC version

[Mohammed Naser]

Hi there,

We ran into that same issue.  It was a Liberty -> Mitaka upgrade, control
plane was all Mitaka with a few Liberty nodes.  We couldn't live migrate
till everything was up to Mitaka

Thanks
Mohammed

On Thu, Oct 27, 2016 at 12:53 PM, John Petrini 
wrote:

> I don't have any further suggestions. Since the 7th parameter was added in
> API version 4.2 the issue you're having doesn't really surprise me. However
> it seems like you have a workaround for migrating either direction. Is that
> not enough for what you're trying to accomplish?
>
> ___
>
> John Petrini
>
> NOC Systems Administrator   //   *CoreDial, LLC*   //   coredial.com
>//   [image: Twitter]    [image:
> LinkedIn]    [image: Google Plus]
>    [image: Blog]
> 
> Hillcrest I, 751 Arbor Way, Suite 150, Blue Bell PA, 19422
> *P: *215.297.4400 x232   //   *F: *215.297.4401   //   *E: *
> jpetr...@coredial.com
>
> [image: Exceptional people. Proven Processes. Innovative Technology.
> Discover CoreDial - watch our video]
> 
>
> The information transmitted is intended only for the person or entity to
> which it is addressed and may contain confidential and/or privileged
> material. Any review, retransmission,  dissemination or other use of, or
> taking of any action in reliance upon, this information by persons or
> entities other than the intended recipient is prohibited. If you received
> this in error, please contact the sender and delete the material from any
> computer.
>
> On Wed, Oct 26, 2016 at 9:12 PM, Oisin O'Malley <
> oisin.omal...@iocane.com.au> wrote:
>
>> Thanks John,
>>
>> > I think it may be your API version. See here:
>> https://github.com/openstack/nova/blob/2014.2/nova/compute/rpcapi.py#L270
>>
>> There seems to be a discrepancy in the rpcapi.py "kilo" alias between the
>> Kilo and Liberty releases. In the Kilo release the compute alias is
>> "kilo=3.40" but in Liberty it is "kilo=4.0". Setting the compute API
>> version to 4.0 on the Kilo compute node or removing it entirely appears to
>> resolve the issue. Though has either caused or led to another issue.
>>
>> I've testing and can live migrate from Kilo -> Liberty compute nodes, but
>> fails on migrating from  Liberty -> Kilo. I suspect another API version
>> issue. With compute API level pined to 4.0 across all Nova nodes,  the
>> following error is raised in the Liberty Nova compute nodes log when I try
>> live migrate from Liberty to Kilo;
>>
>>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
>> line 142, in _dispatch_and_reply
>>  executor_callback))
>>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
>> line 186, in _dispatch
>>  executor_callback)
>>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
>> line 129, in _do_dispatch
>>  result = func(ctxt, **new_args)
>>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 89,
>> in wrapped
>>  payload)
>>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
>> 195, in __exit__
>>  six.reraise(self.type_, self.value, self.tb)
>>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 72,
>> in wrapped
>>  return f(self, context, *args, **kw)
>>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
>> 400, in decorated_function
>>  return function(self, context, *args, **kwargs)
>>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
>> 378, in decorated_function
>>  kwargs['instance'], e, sys.exc_info())
>>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
>> 195, in __exit__
>>  six.reraise(self.type_, self.value, self.tb)
>>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
>> 366, in decorated_function
>>  return function(self, context, *args, **kwargs)
>>  TypeError: live_migration() takes exactly 7 arguments (6 given)
>>
>> There appears to of been a few bugs raised previously for this. The 4.2
>> API version of live_migration with 7 parameters appears to be getting
>> called with the 6 parameters from API version 4.0. I'm not sure why.
>>
>> https://bugs.launchpad.net/nova/+bug/1595864
>> I've unsuccessful tried the suggestion in the above and restarted all
>> nova-conductor services to no effect.
>>
>> Any suggestions?
>>
>>
>> Oisin O'Malley
>> Systems Engineer
>> Iocane Pty Ltd
>> 763 South Road
>> Black Forest SA 5035
>>
>> Office:+61 (8) 8413 1010
>> Fax:+61 (8) 8231 2050
>> Email:oisin.omal...@iocane.com.au
>> Web:www.iocane.com.au
>>
>> Better for business
>>
>
>
> ___
> Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/
> openstack

Re: [Openstack] UnsupportedVersion Endpoint does not support RPC version

[John Petrini]

I don't have any further suggestions. Since the 7th parameter was added in
API version 4.2 the issue you're having doesn't really surprise me. However
it seems like you have a workaround for migrating either direction. Is that
not enough for what you're trying to accomplish?

___

John Petrini

NOC Systems Administrator   //   *CoreDial, LLC*   //   coredial.com
//   [image:
Twitter]    [image: LinkedIn]
   [image: Google Plus]
   [image: Blog]

Hillcrest I, 751 Arbor Way, Suite 150, Blue Bell PA, 19422
*P: *215.297.4400 x232   //   *F: *215.297.4401   //   *E: *
jpetr...@coredial.com

[image: Exceptional people. Proven Processes. Innovative Technology.
Discover CoreDial - watch our video]


The information transmitted is intended only for the person or entity to
which it is addressed and may contain confidential and/or privileged
material. Any review, retransmission,  dissemination or other use of, or
taking of any action in reliance upon, this information by persons or
entities other than the intended recipient is prohibited. If you received
this in error, please contact the sender and delete the material from any
computer.

On Wed, Oct 26, 2016 at 9:12 PM, Oisin O'Malley  wrote:

> Thanks John,
>
> > I think it may be your API version. See here:
> https://github.com/openstack/nova/blob/2014.2/nova/compute/rpcapi.py#L270
>
> There seems to be a discrepancy in the rpcapi.py "kilo" alias between the
> Kilo and Liberty releases. In the Kilo release the compute alias is
> "kilo=3.40" but in Liberty it is "kilo=4.0". Setting the compute API
> version to 4.0 on the Kilo compute node or removing it entirely appears to
> resolve the issue. Though has either caused or led to another issue.
>
> I've testing and can live migrate from Kilo -> Liberty compute nodes, but
> fails on migrating from  Liberty -> Kilo. I suspect another API version
> issue. With compute API level pined to 4.0 across all Nova nodes,  the
> following error is raised in the Liberty Nova compute nodes log when I try
> live migrate from Liberty to Kilo;
>
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 142, in _dispatch_and_reply
>  executor_callback))
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 186, in _dispatch
>  executor_callback)
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 129, in _do_dispatch
>  result = func(ctxt, **new_args)
>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 89, in
> wrapped
>  payload)
>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
> 195, in __exit__
>  six.reraise(self.type_, self.value, self.tb)
>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 72, in
> wrapped
>  return f(self, context, *args, **kw)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 400, in decorated_function
>  return function(self, context, *args, **kwargs)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 378, in decorated_function
>  kwargs['instance'], e, sys.exc_info())
>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
> 195, in __exit__
>  six.reraise(self.type_, self.value, self.tb)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 366, in decorated_function
>  return function(self, context, *args, **kwargs)
>  TypeError: live_migration() takes exactly 7 arguments (6 given)
>
> There appears to of been a few bugs raised previously for this. The 4.2
> API version of live_migration with 7 parameters appears to be getting
> called with the 6 parameters from API version 4.0. I'm not sure why.
>
> https://bugs.launchpad.net/nova/+bug/1595864
> I've unsuccessful tried the suggestion in the above and restarted all
> nova-conductor services to no effect.
>
> Any suggestions?
>
>
> Oisin O'Malley
> Systems Engineer
> Iocane Pty Ltd
> 763 South Road
> Black Forest SA 5035
>
> Office:+61 (8) 8413 1010
> Fax:+61 (8) 8231 2050
> Email:oisin.omal...@iocane.com.au
> Web:www.iocane.com.au
>
> Better for business
>
___
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

Re: [Openstack] UnsupportedVersion Endpoint does not support RPC version

[Oisin O'Malley]

Thanks John,

> I think it may be your API version. See here: 
> https://github.com/openstack/nova/blob/2014.2/nova/compute/rpcapi.py#L270

There seems to be a discrepancy in the rpcapi.py "kilo" alias between the Kilo 
and Liberty releases. In the Kilo release the compute alias is "kilo=3.40" but 
in Liberty it is "kilo=4.0". Setting the compute API version to 4.0 on the Kilo 
compute node or removing it entirely appears to resolve the issue. Though has 
either caused or led to another issue.

I've testing and can live migrate from Kilo -> Liberty compute nodes, but fails 
on migrating from  Liberty -> Kilo. I suspect another API version issue. With 
compute API level pined to 4.0 across all Nova nodes,  the following error is 
raised in the Liberty Nova compute nodes log when I try live migrate from 
Liberty to Kilo;

   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", 
line 142, in _dispatch_and_reply
 executor_callback))
   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", 
line 186, in _dispatch
 executor_callback)
   File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py", 
line 129, in _do_dispatch
 result = func(ctxt, **new_args)
   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 89, in 
wrapped
 payload)
   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in 
__exit__
 six.reraise(self.type_, self.value, self.tb)
   File "/usr/lib/python2.7/site-packages/nova/exception.py", line 72, in 
wrapped
 return f(self, context, *args, **kw)
   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 400, 
in decorated_function
 return function(self, context, *args, **kwargs)
   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 378, 
in decorated_function
 kwargs['instance'], e, sys.exc_info())
   File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 195, in 
__exit__
 six.reraise(self.type_, self.value, self.tb)
   File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 366, 
in decorated_function
 return function(self, context, *args, **kwargs)
 TypeError: live_migration() takes exactly 7 arguments (6 given)

There appears to of been a few bugs raised previously for this. The 4.2 API 
version of live_migration with 7 parameters appears to be getting called with 
the 6 parameters from API version 4.0. I'm not sure why.

https://bugs.launchpad.net/nova/+bug/1595864
I've unsuccessful tried the suggestion in the above and restarted all 
nova-conductor services to no effect.

Any suggestions?


Oisin O'Malley
Systems Engineer
Iocane Pty Ltd
763 South Road
Black Forest SA 5035

Office:+61 (8) 8413 1010
Fax:+61 (8) 8231 2050
Email:oisin.omal...@iocane.com.au
Web:www.iocane.com.au

Better for business
___
Mailing list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack
Post to : openstack@lists.openstack.org
Unsubscribe : http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack

Re: [Openstack] UnsupportedVersion Endpoint does not support RPC version

[John Petrini]

I think it may be your API version. See here:
https://github.com/openstack/nova/blob/2014.2/nova/compute/rpcapi.py#L270



On Wed, Oct 26, 2016 at 1:08 AM, Oisin O'Malley  wrote:

> Hi All,
>
> In the process of a Kilo to Liberty upgrade and cannot live migrate VMs
> between Kilo and Liberty compute hosts. The Control nodes and a single
> Compute node have been upgraded to Liberty. We get the following error in
> the compute nodes log when we attempt to live migrate a instance from the
> Kilo node to the Liberty node;
>
> Traceback (most recent call last):
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 5314, in live_migration
>  block_migration, disk, dest, migrate_data)
>File "/usr/lib/python2.7/site-packages/nova/compute/rpcapi.py", line
> 623, in pre_live_migration
>  disk=disk, migrate_data=migrate_data)
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py",
> line 156, in call
> retry=self.retry)
>File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py",
> line 90, in _send
> timeout=timeout, retry=retry)
>File 
> "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py",
> line 350, in send
>  retry=retry)
>File 
> "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py",
> line 341, in _send
>  raise result
>  RemoteError: Remote error: UnsupportedVersion Endpoint does not support
> RPC version 3.19. Attempted met
> hod: pre_live_migration
>
>
> Traceback (most recent call last):
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 142, in _dispatch_and_reply
>  executor_callback))
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 186, in _dispatch
>  executor_callback)
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/dispatcher.py",
> line 130, in _do_dispatch
>  result = func(ctxt, **new_args)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 6810, in live_migration
>  migrate_data=migrate_data)
>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in
> wrapped
>  payload)
>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
> 85, in __exit__
>  six.reraise(self.type_, self.value, self.tb)
>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in
> wrapped
>  return f(self, context, *args, **kw)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 361, in decorated_function
>  kwargs['instance'], e, sys.exc_info())
>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
> 85, in __exit__
>  six.reraise(self.type_, self.value, self.tb)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 349, in decorated_function
>  return function(self, context, *args, **kwargs)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 5322, in live_migration
>  block_migration, migrate_data)
>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 88, in
> wrapped
>  payload)
>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
> 85, in __exit__
>  six.reraise(self.type_, self.value, self.tb)
>File "/usr/lib/python2.7/site-packages/nova/exception.py", line 71, in
> wrapped
>  return f(self, context, *args, **kw)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 361, in decorated_function
>  kwargs['instance'], e, sys.exc_info())
>File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line
> 85, in __exit__
>  six.reraise(self.type_, self.value, self.tb)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 349, in decorated_function
>  return function(self, context, *args, **kwargs)
>File "/usr/lib/python2.7/site-packages/nova/compute/manager.py", line
> 5564, in _rollback_live_migration
>  context, instance, bdm.volume_id, dest)
>File "/usr/lib/python2.7/site-packages/nova/compute/rpcapi.py", line
> 715, in remove_volume_connection
>  instance=instance, volume_id=volume_id)
>File "/usr/lib/python2.7/site-packages/oslo_messaging/rpc/client.py",
> line 156, in call
>  retry=self.retry)
>File "/usr/lib/python2.7/site-packages/oslo_messaging/transport.py",
> line 90, in _send
>  timeout=timeout, retry=retry)
>File 
> "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py",
> line 350, in send
>  retry=retry)
>File 
> "/usr/lib/python2.7/site-packages/oslo_messaging/_drivers/amqpdriver.py",
> line 341, in _send
>  raise result
>  RemoteError: Remote error: UnsupportedVersion Endpoint does not support
> RPC version 3.30. Attempted method: remove_volume_connection
>
>
> Upgrade level has been set to "kilo" on all Nova Control and Compute nodes
> in /etc/nova/nova.conf;
>