On 08/18/2014 04:56 AM, Sebastian Kurfürst wrote:
Hey everybody,
so far, Heka works out quite nicely in our environment. However, we're
still having one issue:
Currently, we're using rsync to copy all the log files to a central
server; which are then analyzed using Heka.
However, when using rsync, changes to the log files are not picked up
correctly; only when Heka is restarted, it "sees" that new data is
inside the logs.
Oof. Definitely suboptimal.
Does anybody have a similar setup? I quite like that it reduces the
complexity a lot... Should I maybe use "rsync --inplace"? Or just
restart heka every few minutes?
I would definitely try using --inplace and/or --append and/or
--append-verify. And please report back how it goes, if that resolves
the issue then we can just add a note to the documentation so people
will know about this gotcha.
If it doesn't work then restarting Heka periodically is certainly a
workaround, but that's definitely not how it should be. In that case I'd
love it if you could open a bug so we can track and fix the issue.
Thanks,
-r
_______________________________________________
Heka mailing list
[email protected]
https://mail.mozilla.org/listinfo/heka
