On Tue, 6 May 2014 14:23:54 +0200
Reuti Reuti wrote:

> Hi,
Hi Reuti,
 
> > I rotate log every day, so I have diff files for each day. 
> 
> By which facility are they rotated?
logrotate:

[...]
> > shouldn't I find some job log entry in node?
> > what could be generating this duplicated entry in log file?
> 
> As the accounting file is sequentially written: are the entries
> before and after this particular job also the same or completely
> mixed up which are duplicate and which ones not?

# grep -A1 -B1  ":8786048:" accounting-2014041[4-5]|awk -F ":" {'print 
$1,$6,$7'}
accounting-20140414-long 8786053 sge
accounting-20140414 runcl_AlifoldZ_rand.sh 8786048
accounting-20140414-cn-el6 8786047 sge
--  
accounting-20140415-long 8786053 sge
accounting-20140415 runcl_AlifoldZ_rand.sh 8786048
accounting-20140415-cn-el6 8786047 sge

they are the same...

> Maybe the file was written to while it got compressed - or was the
> file renamed first and then compressed?

 I do replicate logs to another host (Accounting). I
have been working with replicated files, and now, that I've checked
logs in the master, I see that some of them are missing:

-rw-r--r-- 1 sgeadmin sgeadmin  6315520 abr 11 03:15 accounting-20140411.gz
-rw-r--r-- 1 sgeadmin sgeadmin  1209804 abr 12 03:06 accounting-20140412.gz
-rw-r--r-- 1 sgeadmin sgeadmin  3945722 abr 15 03:10 accounting-20140415.gz
-rw-r--r-- 1 sgeadmin sgeadmin  2091509 abr 16 03:07 accounting-20140416.gz
-rw-r--r-- 1 sgeadmin sgeadmin  4594577 abr 17 03:43 accounting-20140417.gz
-rw-r--r-- 1 sgeadmin sgeadmin  2394829 abr 18 03:22 accounting-20140418.gz
-rw-r--r-- 1 sgeadmin sgeadmin  6751283 abr 19 03:23 accounting-20140419.gz
-rw-r--r-- 1 sgeadmin sgeadmin 16110454 abr 10 03:31 reporting-20140410.gz
-rw-r--r-- 1 sgeadmin sgeadmin 10646948 abr 11 03:15 reporting-20140411.gz
-rw-r--r-- 1 sgeadmin sgeadmin  9437819 abr 12 03:06 reporting-20140412.gz
-rw-r--r-- 1 sgeadmin sgeadmin  9678358 abr 13 03:47 reporting-20140413.gz
-rw-r--r-- 1 sgeadmin sgeadmin  9352494 abr 14 03:09 reporting-20140414.gz
-rw-r--r-- 1 sgeadmin sgeadmin 11833316 abr 15 03:10 reporting-20140415.gz
-rw-r--r-- 1 sgeadmin sgeadmin 12970158 abr 16 03:07 reporting-20140416.gz
-rw-r--r-- 1 sgeadmin sgeadmin 19448598 abr 17 03:43 reporting-20140417.gz
-rw-r--r-- 1 sgeadmin sgeadmin 15036582 abr 18 03:23 reporting-20140418.gz
-rw-r--r-- 1 sgeadmin sgeadmin 24743269 abr 19 03:24 reporting-20140419.gz
-rw-r--r-- 1 sgeadmin sgeadmin 13565676 abr 10 03:31 schedule-20140410.gz
-rw-r--r-- 1 sgeadmin sgeadmin 17504235 abr 11 03:15 schedule-20140411.gz
-rw-r--r-- 1 sgeadmin sgeadmin 17177519 abr 12 03:06 schedule-20140412.gz
-rw-r--r-- 1 sgeadmin sgeadmin 22672756 abr 13 03:47 schedule-20140413.gz
-rw-r--r-- 1 sgeadmin sgeadmin 30202772 abr 14 03:09 schedule-20140414.gz
-rw-r--r-- 1 sgeadmin sgeadmin 23746347 abr 15 03:10 schedule-20140415.gz
-rw-r--r-- 1 sgeadmin sgeadmin 58913604 abr 16 03:07 schedule-20140416.gz
-rw-r--r-- 1 sgeadmin sgeadmin 77504397 abr 17 03:43 schedule-20140417.gz
-rw-r--r-- 1 sgeadmin sgeadmin 92775132 abr 18 03:23 schedule-20140418.gz
-rw-r--r-- 1 sgeadmin sgeadmin 81833066 abr 19 03:24 schedule-20140419.gz

whereas in replica all accounting files are there:

# ls accounting-2014041*
accounting-20140410.gz  accounting-20140412.gz  accounting-20140414.gz  
accounting-20140416.gz  accounting-20140418.gz
accounting-20140411.gz  accounting-20140413.gz  accounting-20140415.gz  
accounting-20140417.gz  accounting-20140419.gz

I'll check if the rsync process (which is done in the logrotate
process) could cause some trouble.


> -- Reuti
Thanks for your answer,
Arnau
_______________________________________________
users mailing list
[email protected]
https://gridengine.org/mailman/listinfo/users

Reply via email to