Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Sean Dague
On 01/30/2014 07:15 PM, John Dickinson wrote: I've been keeping an eye on this thread, and it seems I actually have a few minutes to spend on a response today. To first answer the specific question, while there are some minor technical concerns about oslo logging, the bigger concerns are

Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Macdonald-Wallace, Matthew
-Original Message- From: Sean Dague [mailto:s...@dague.net] Sent: 31 January 2014 12:29 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards On 01/30/2014 07:15 PM, John Dickinson wrote: 1) Every log message

Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Ben Nemec
On 2014-01-31 07:00, Macdonald-Wallace, Matthew wrote: -Original Message- From: Sean Dague [mailto:s...@dague.net] Sent: 31 January 2014 12:29 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards On 01/30/2014 07:15 PM

Re: [openstack-dev] Proposed Logging Standards

2014-01-31 Thread Macdonald-Wallace, Matthew
-Original Message- From: Ben Nemec [mailto:openst...@nemebean.com] Sent: 31 January 2014 16:01 To: openstack-dev@lists.openstack.org Subject: Re: [openstack-dev] Proposed Logging Standards I'd just love to see the ability in the python logger to include the application name

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Macdonald-Wallace, Matthew
(not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards Hi Matthew, I¹m interested to help in this switch to python logging framework for shipping to logstash/etc. Are you working on a blueprint for this? Cheers, Cristian On 27/01/14 11:07, Macdonald-Wallace

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sanchez, Cristian A
. Hope that helps, Matt -Original Message- From: Sanchez, Cristian A [mailto:cristian.a.sanc...@intel.com] Sent: 29 January 2014 17:57 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards Hi Matthew, I¹m interested

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Macdonald-Wallace, Matthew
January 2014 13:08 To: OpenStack Development Mailing List Subject: [openstack-dev] Proposed Logging Standards Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sean Dague
, Cristian A [mailto:cristian.a.sanc...@intel.com] Sent: 30 January 2014 13:44 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards Hi Matt, What about the rest of the components? Do they also have this capability? Thanks

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sean Dague
On 01/27/2014 11:03 AM, Macdonald-Wallace, Matthew wrote: I've also noticed just now that we appear to be re-inventing some parts of the logging framework (openstack.common.log.WriteableLogger for example appears to be a catchall when we should just be handing off to the default logger and

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sean Dague
On 01/28/2014 06:28 PM, Scott Devoid wrote: A big part of my interest here is to make INFO a useful informational level for operators. That means getting a bunch of messages out of it that don't belong. +1 to that! How should I open / tag bugs for this? I'm thinking right

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread Sanchez, Cristian A
Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards Hi Matt, What about the rest of the components? Do they also have this capability? Thanks Cristian On 30/01/14 04:59, Macdonald-Wallace, Matthew matthew.macdonald-wall...@hp.com wrote: Hi

Re: [openstack-dev] Proposed Logging Standards

2014-01-30 Thread John Dickinson
Development Mailing List Subject: [openstack-dev] Proposed Logging Standards Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed changes to Nova and Keystone over the past couple

Re: [openstack-dev] Proposed Logging Standards

2014-01-29 Thread Sean Dague
On 01/28/2014 10:53 PM, Vishvananda Ishaya wrote: On Jan 27, 2014, at 6:57 PM, Christopher Yeoh cbky...@gmail.com mailto:cbky...@gmail.com wrote: On Tue, Jan 28, 2014 at 12:55 AM, Sean Dague s...@dague.net mailto:s...@dague.net wrote: On 01/27/2014 09:07 AM, Macdonald-Wallace,

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Thierry Carrez
Sean Dague wrote: Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed changes to Nova and Keystone over the past couple of days. This is going to be a long process, so

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sean Dague
On 01/27/2014 09:57 PM, Christopher Yeoh wrote: On Tue, Jan 28, 2014 at 12:55 AM, Sean Dague s...@dague.net mailto:s...@dague.net wrote: On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: Hi Sean, I'm currently working on moving away from the built-in logging

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sergey Lukjanov
Hi Sean, it's great that you're catching this up. I'd like to participate. I don't know how much time I'll be able to dedicate on it, but at least I'm ready for reviews and pushing it to Savanna. Thanks! On Tue, Jan 28, 2014 at 3:21 PM, Sean Dague s...@dague.net wrote: On 01/27/2014 09:57

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sergey Lukjanov
FYI it was added to the project meeting agenda - https://wiki.openstack.org/wiki/Meetings/ProjectMeeting On Tue, Jan 28, 2014 at 3:42 PM, Sergey Lukjanov slukja...@mirantis.comwrote: Hi Sean, it's great that you're catching this up. I'd like to participate. I don't know how much time I'll

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Alexander Tivelkov
Very interested, thanks a lot for this topic. Will work on bringing all of this to Murano -- Regards, Alexander Tivelkov On Tue, Jan 28, 2014 at 6:45 AM, Sergey Lukjanov slukja...@mirantis.comwrote: FYI it was added to the project meeting agenda -

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread iKhan
I haven't started contributing to openstack, looks like this might be good opportunity. Count me in. I had the same doubt about AUDIT level log in cinder. On Tue, Jan 28, 2014 at 8:16 PM, Alexander Tivelkov ativel...@mirantis.comwrote: Very interested, thanks a lot for this topic. Will work

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Everett Toews
Hi Sean, Could 1.1.1 Every Inbound WSGI request should be logged Exactly Once be used to track API call data in order to discover which API calls are being made most frequently? It certainly seems like it could but I want to confirm. I ask because this came up as B Get aggregate API call data

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Scott Devoid
For the uses I've seen of it in the nova api code INFO would be perfectly fine in place of AUDIT. We've found the AUDIT logs in nova useful for tracking which user initiated a particular request (e.g. delete this instance). AUDIT had a much better signal to noise ratio than INFO or DEBUG.

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sean Dague
On 01/28/2014 12:41 PM, Scott Devoid wrote: For the uses I've seen of it in the nova api code INFO would be perfectly fine in place of AUDIT. We've found the AUDIT logs in nova useful for tracking which user initiated a particular request (e.g. delete this instance). AUDIT had a

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Brad Topol
) openstack-dev@lists.openstack.org Date: 01/28/2014 12:47 PM Subject:Re: [openstack-dev] Proposed Logging Standards For the uses I've seen of it in the nova api code INFO would be perfectly fine in place of AUDIT. We've found the AUDIT logs in nova useful for tracking which user initiated

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Jay Pipes
On Tue, 2014-01-28 at 16:25 -0500, Brad Topol wrote: So we are starting to add more cloud audit (aka CADF) support to OpenStack. We have support in Nova and infrastructure added to Ceilometer and I am starting to add this capability to keystone. This work is based on sending events to

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Sean Dague
On 01/28/2014 05:56 PM, Jay Pipes wrote: On Tue, 2014-01-28 at 16:25 -0500, Brad Topol wrote: So we are starting to add more cloud audit (aka CADF) support to OpenStack. We have support in Nova and infrastructure added to Ceilometer and I am starting to add this capability to keystone. This

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Scott Devoid
A big part of my interest here is to make INFO a useful informational level for operators. That means getting a bunch of messages out of it that don't belong. +1 to that! How should I open / tag bugs for this? We should be logging user / tenant on every wsgi request, so that should be

Re: [openstack-dev] Proposed Logging Standards

2014-01-28 Thread Vishvananda Ishaya
On Jan 27, 2014, at 6:57 PM, Christopher Yeoh cbky...@gmail.com wrote: On Tue, Jan 28, 2014 at 12:55 AM, Sean Dague s...@dague.net wrote: On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: Hi Sean, I'm currently working on moving away from the built-in logging to use

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Macdonald-Wallace, Matthew
Development Mailing List Subject: [openstack-dev] Proposed Logging Standards Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed changes to Nova and Keystone over the past couple

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Macdonald-Wallace, Matthew
I've also noticed just now that we appear to be re-inventing some parts of the logging framework (openstack.common.log.WriteableLogger for example appears to be a catchall when we should just be handing off to the default logger and letting the python logging framework decide what to do

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Sean Dague
On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: Hi Sean, I'm currently working on moving away from the built-in logging to use log_config=filename and the python logging framework so that we can start shipping to logstash/sentry/insert other useful tool here. I'd be very

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Macdonald-Wallace, Matthew
-Original Message- From: Sean Dague [mailto:s...@dague.net] Sent: 27 January 2014 14:26 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards On 01/27/2014 09:07 AM, Macdonald-Wallace, Matthew wrote: Hi Sean

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Peter Portante
On Mon, Jan 27, 2014 at 8:07 AM, Sean Dague s...@dague.net wrote: Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed changes to Nova and Keystone over the past couple of

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Sean Dague
On 01/27/2014 09:44 AM, Macdonald-Wallace, Matthew wrote: -Original Message- From: Sean Dague [mailto:s...@dague.net] Sent: 27 January 2014 14:26 To: OpenStack Development Mailing List (not for usage questions) Subject: Re: [openstack-dev] Proposed Logging Standards On 01/27/2014 09

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Susanne Balle
What I'd like to find out now: 1) who's interested in this topic? Please include me. 2) who's interested in helping flesh out the guidelines for various log levels? Please include me. 3) who's interested in helping get these kinds of patches into various projects in OpenStack? 4) which

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Jay Pipes
On Mon, 2014-01-27 at 08:07 -0500, Sean Dague wrote: Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed changes to Nova and Keystone over the past couple of days. This is

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread John Griffith
On Mon, Jan 27, 2014 at 6:07 AM, Sean Dague s...@dague.net wrote: Back at the beginning of the cycle, I pushed for the idea of doing some log harmonization, so that the OpenStack logs, across services, made sense. I've pushed a proposed changes to Nova and Keystone over the past couple of

Re: [openstack-dev] Proposed Logging Standards

2014-01-27 Thread Jay S Bryant
john.griff...@solidfire.com To: OpenStack Development Mailing List (not for usage questions) openstack-dev@lists.openstack.org, Date: 01/27/2014 02:52 PM Subject:Re: [openstack-dev] Proposed Logging Standards On Mon, Jan 27, 2014 at 6:07 AM, Sean Dague s...@dague.net wrote: Back