Chukwa - Add a config parameter to allow agent to talk to the same collector
until connection fails.
----------------------------------------------------------------------------------------------------
Key: HADOOP-4711
URL: https://issues.apache.org/jira/browse/HADOOP-4711
Project: Hadoop Core
Issue Type: New Feature
Environment: Redhat EL 4.5, Java 1.6, Hadoop trunk
Reporter: Eric Yang
In chukwa agent, we added ability to rotate collector on each HTTP post. RAD
Lab is using Chukwa Agent differently, and would like to have the option to
keep agent on the same collector. On the smaller scale of the Chukwa, it makes
sense to process data without the map reduce job. A new interface needs to be
created as a T pipe line to stream data from collector directly into a Database
or external storage. In this configuration, it is better to channel similar
data to the same collector to reduce the cost of reassembling chunks.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.