Re: Log managment
Hello, Yes I do. I thought this was re right thing to do for logs. But never ending file is not safe usable. This option --log_dir need some rework I suppose. I will go with stdout/stderr pipeline instead (using logrotate copytruncate to handle open file descriptors) Thank you Le 15/05/2014 22:02, Tomas Barton a écrit : Hi Damien, do you use the `--log_dir` switch? If so, mesos is creating quite many files in a strange format: mesos-slave.{hostname}.invalid-user.log.INFO.20140409-155625.7545 when you forward stdout of the service to a single file and afterwards apply simple logroate rules, you might get nicer logs. Tomas -- Damien HARDY signature.asc Description: OpenPGP digital signature
Re: Log managment
I've already refactored the logging, I'm redirecting stdout and stderr to a master.log or slave.log https://github.com/deric/mesos-deb-packaging/blob/master/mesos-init-wrapper#L109 the logrotate itself it quite simple /var/log/mesos/*.log { daily missingok rotate 30 compress delaycompress notifempty } On 30 May 2014 11:14, Damien Hardy dha...@viadeoteam.com wrote: Hello, Yes I do. I thought this was re right thing to do for logs. But never ending file is not safe usable. This option --log_dir need some rework I suppose. I will go with stdout/stderr pipeline instead (using logrotate copytruncate to handle open file descriptors) Thank you Le 15/05/2014 22:02, Tomas Barton a écrit : Hi Damien, do you use the `--log_dir` switch? If so, mesos is creating quite many files in a strange format: mesos-slave.{hostname}.invalid-user.log.INFO.20140409-155625.7545 when you forward stdout of the service to a single file and afterwards apply simple logroate rules, you might get nicer logs. Tomas -- Damien HARDY
Re: Log managment
Hello, Your point is right. however --log_dir option provide a way to display logs for uses in HTTP UI. That is not permit by tailing stdout/stderr. Best regards, Le 15/05/2014 17:42, Dick Davies a écrit : I'd try a newer version before you file bugs - but to be honest log rotation is logrotates job, it's really not very hard to setup. In our stack we run under upstart, so things make it into syslog and we don't have to worry about rotation - scales better too as it's easier to centralize. On 14 May 2014 09:46, Damien Hardy dha...@viadeoteam.com wrote: Hello, Log in mesos are problematic for me so far. We are used to use log4j facility in java world that permit a lot of things. Mainly I would like log rotation (ideally with logrotate tool to be homogeneous with other things) without restarting processes because in my experience it looses history ( mesos 0.16.0 so far ) Best regards, -- Damien HARDY -- Damien HARDY signature.asc Description: OpenPGP digital signature
Re: Log managment
Hello, I created https://issues.apache.org/jira/browse/MESOS-1375 Thank you, Cheers, Le 14/05/2014 19:28, Adam Bordelon a écrit : Hi Damien, Log rotation sounds like a reasonable request. Please file a JIRA for it, and we can discuss details there. Thanks, -Adam- -- Damien HARDY signature.asc Description: OpenPGP digital signature
Re: Log managment
I'd try a newer version before you file bugs - but to be honest log rotation is logrotates job, it's really not very hard to setup. In our stack we run under upstart, so things make it into syslog and we don't have to worry about rotation - scales better too as it's easier to centralize. On 14 May 2014 09:46, Damien Hardy dha...@viadeoteam.com wrote: Hello, Log in mesos are problematic for me so far. We are used to use log4j facility in java world that permit a lot of things. Mainly I would like log rotation (ideally with logrotate tool to be homogeneous with other things) without restarting processes because in my experience it looses history ( mesos 0.16.0 so far ) Best regards, -- Damien HARDY IT Infrastructure Architect Viadeo - 30 rue de la Victoire - 75009 Paris - France PGP : 45D7F89A
Re: Log managment
Hi Damien, do you use the `--log_dir` switch? If so, mesos is creating quite many files in a strange format: mesos-slave.{hostname}.invalid-user.log.INFO.20140409-155625.7545 when you forward stdout of the service to a single file and afterwards apply simple logroate rules, you might get nicer logs. Tomas On 14 May 2014 19:28, Adam Bordelon a...@mesosphere.io wrote: Hi Damien, Log rotation sounds like a reasonable request. Please file a JIRA for it, and we can discuss details there. Thanks, -Adam- On Wed, May 14, 2014 at 1:46 AM, Damien Hardy dha...@viadeoteam.comwrote: Hello, Log in mesos are problematic for me so far. We are used to use log4j facility in java world that permit a lot of things. Mainly I would like log rotation (ideally with logrotate tool to be homogeneous with other things) without restarting processes because in my experience it looses history ( mesos 0.16.0 so far ) Best regards, -- Damien HARDY IT Infrastructure Architect Viadeo - 30 rue de la Victoire - 75009 Paris - France PGP : 45D7F89A