Re: Log managment

2014-05-30 Thread Damien Hardy
Hello,

Yes I do.
I thought this was re right thing to do for logs.
But never ending file is not safe usable. This option --log_dir need
some rework I suppose.
I will go with stdout/stderr pipeline instead (using logrotate
copytruncate to handle open file descriptors)

Thank you

Le 15/05/2014 22:02, Tomas Barton a écrit :
 Hi Damien,
 
 do you use the `--log_dir` switch? If so, mesos is creating quite many
 files in a strange format:
 
 mesos-slave.{hostname}.invalid-user.log.INFO.20140409-155625.7545
 
 when you forward stdout of the service to a single file and afterwards
 apply simple logroate
 rules, you might get nicer logs.
 
 Tomas

-- 
Damien HARDY



signature.asc
Description: OpenPGP digital signature


Re: Log managment

2014-05-30 Thread Tomas Barton
I've already refactored the logging, I'm redirecting stdout and stderr to a
master.log or slave.log

https://github.com/deric/mesos-deb-packaging/blob/master/mesos-init-wrapper#L109

the logrotate itself it quite simple

/var/log/mesos/*.log {
daily

missingok
rotate 30
compress

delaycompress
notifempty
}



On 30 May 2014 11:14, Damien Hardy dha...@viadeoteam.com wrote:

 Hello,

 Yes I do.
 I thought this was re right thing to do for logs.
 But never ending file is not safe usable. This option --log_dir need
 some rework I suppose.
 I will go with stdout/stderr pipeline instead (using logrotate
 copytruncate to handle open file descriptors)

 Thank you

 Le 15/05/2014 22:02, Tomas Barton a écrit :
  Hi Damien,
 
  do you use the `--log_dir` switch? If so, mesos is creating quite many
  files in a strange format:
 
  mesos-slave.{hostname}.invalid-user.log.INFO.20140409-155625.7545
 
  when you forward stdout of the service to a single file and afterwards
  apply simple logroate
  rules, you might get nicer logs.
 
  Tomas

 --
 Damien HARDY




Re: Log managment

2014-05-30 Thread Damien Hardy
Hello,
Your point is right.
however --log_dir option provide a way to display logs for uses in HTTP
UI. That is not permit by tailing stdout/stderr.

Best regards,

Le 15/05/2014 17:42, Dick Davies a écrit :
 I'd try a newer version before you file bugs - but to be honest log rotation
 is logrotates job, it's really not very hard to setup.
 
 In our stack we run under upstart, so things make it into syslog and we
 don't have to worry about rotation - scales better too as it's easier to
 centralize.
 
 On 14 May 2014 09:46, Damien Hardy dha...@viadeoteam.com wrote:
 Hello,

 Log in mesos are problematic for me so far.
 We are used to use log4j facility in java world that permit a lot of things.

 Mainly I would like log rotation (ideally with logrotate tool to be
 homogeneous with other things) without restarting processes because in
 my experience it looses history ( mesos 0.16.0 so far )

 Best regards,

 --
 Damien HARDY

-- 
Damien HARDY



signature.asc
Description: OpenPGP digital signature


Re: Log managment

2014-05-16 Thread Damien Hardy
Hello,

I created https://issues.apache.org/jira/browse/MESOS-1375

Thank you,

Cheers,

Le 14/05/2014 19:28, Adam Bordelon a écrit :
 Hi Damien,
 
 Log rotation sounds like a reasonable request. Please file a JIRA for
 it, and we can discuss details there.
 
 Thanks,
 -Adam-

-- 
Damien HARDY



signature.asc
Description: OpenPGP digital signature


Re: Log managment

2014-05-16 Thread Dick Davies
I'd try a newer version before you file bugs - but to be honest log rotation
is logrotates job, it's really not very hard to setup.

In our stack we run under upstart, so things make it into syslog and we
don't have to worry about rotation - scales better too as it's easier to
centralize.

On 14 May 2014 09:46, Damien Hardy dha...@viadeoteam.com wrote:
 Hello,

 Log in mesos are problematic for me so far.
 We are used to use log4j facility in java world that permit a lot of things.

 Mainly I would like log rotation (ideally with logrotate tool to be
 homogeneous with other things) without restarting processes because in
 my experience it looses history ( mesos 0.16.0 so far )

 Best regards,

 --
 Damien HARDY
 IT Infrastructure Architect
 Viadeo - 30 rue de la Victoire - 75009 Paris - France
 PGP : 45D7F89A



Re: Log managment

2014-05-16 Thread Tomas Barton
Hi Damien,

do you use the `--log_dir` switch? If so, mesos is creating quite many
files in a strange format:

mesos-slave.{hostname}.invalid-user.log.INFO.20140409-155625.7545

when you forward stdout of the service to a single file and afterwards
apply simple logroate
rules, you might get nicer logs.

Tomas


On 14 May 2014 19:28, Adam Bordelon a...@mesosphere.io wrote:

 Hi Damien,

 Log rotation sounds like a reasonable request. Please file a JIRA for it,
 and we can discuss details there.

 Thanks,
 -Adam-


 On Wed, May 14, 2014 at 1:46 AM, Damien Hardy dha...@viadeoteam.comwrote:

 Hello,

 Log in mesos are problematic for me so far.
 We are used to use log4j facility in java world that permit a lot of
 things.

 Mainly I would like log rotation (ideally with logrotate tool to be
 homogeneous with other things) without restarting processes because in
 my experience it looses history ( mesos 0.16.0 so far )

 Best regards,

 --
 Damien HARDY
 IT Infrastructure Architect
 Viadeo - 30 rue de la Victoire - 75009 Paris - France
 PGP : 45D7F89A