Collectors don't finish writing .done datasink from last .chukwa datasink when
stopped using bin/stop-collectors
----------------------------------------------------------------------------------------------------------------
Key: HADOOP-4835
URL: https://issues.apache.org/jira/browse/HADOOP-4835
Project: Hadoop Core
Issue Type: Bug
Components: contrib/chukwa
Affects Versions: 0.19.1
Environment: I am running on our local cluster. This is a linux
machine that I also run Hadoop cluster from.
Reporter: Andrew
Assignee: Andrew
Priority: Minor
When I use start-collectors, it creates the datasink as expected, writes to it
as per normal, i.e. writes to the .chukwa file, and roll overs work fine when
it renames the .chukwa file to .done. However, when I use bin/stop-collectors
to shut down the running collector it leaves a .chukwa file in the HDFS file
system. Not sure if this is a valid sink or not, but I think that the collector
should gracefully clean up the datasink and rename it .done before exiting.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.