Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Qing He
7; Subject: RE: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant? Does the log alert operator? Something like SNMP trap? From: Ray Pekowski [mailto:pekow...@gmail.com]<mailto:[mailto:pekow...@gmail.com]> Sent: Tuesday, June 25, 2013 12:16 PM To: OpenStack Developm

Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Russell Bryant
On 06/25/2013 04:08 PM, Qing He wrote: > Does the log alert operator? Something like SNMP trap? You can turn on a mode where it will emit a notification, and notifications can be published via AMQP. -- Russell Bryant ___ OpenStack-dev mailing list Ope

Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Qing He
Does the log alert operator? Something like SNMP trap? From: Ray Pekowski [mailto:pekow...@gmail.com] Sent: Tuesday, June 25, 2013 12:16 PM To: OpenStack Development Mailing List Subject: Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant? On Jun 25, 2013 1:09 PM, "

Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Qing He
Subject: Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant? On 06/25/2013 03:15 PM, Ray Pekowski wrote: > > On Jun 25, 2013 1:09 PM, "Qing He" <mailto:qing...@radisys.com>> wrote: >> >> Basically, when 'unexpected' happens,

Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Russell Bryant
On 06/25/2013 03:15 PM, Ray Pekowski wrote: > > On Jun 25, 2013 1:09 PM, "Qing He" > wrote: >> >> Basically, when 'unexpected' happens, someone (e.g., operator) needs > to know about it and look into it to see if it is something benign or > fatal. If it is masked, the

Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Ray Pekowski
On Jun 25, 2013 1:09 PM, "Qing He" wrote: > > Basically, when 'unexpected' happens, someone (e.g., operator) needs to know about it and look into it to see if it is something benign or fatal. If it is masked, the system may degrade overtime unnoticed into unusable. The approach implemented in the

Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Qing He
5, 2013 10:16 AM To: 'raymond_pekow...@dell.com'; openstack-dev@lists.openstack.org Cc: Dirk Mueller; Andrea Rosa; Ben Nemec; Chris Behrens; Eric Windisch; Russell Bryant Subject: re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant? In this case, the exception is jus

Re: [openstack-dev] Should RPC consume_in_thread() be more fault tolerant?

2013-06-25 Thread Qing He
In this case, the exception is just hard to debug, and not something we expected in our design. The thorough solution would be to debug further to see the root cause, and deal with it as I suggested in the code review. However, If it is time consuming to debug, we can put the patch in there wit