[
https://issues.apache.org/jira/browse/FLUME-1318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13401008#comment-13401008
]
Mubarak Seyed commented on FLUME-1318:
--------------------------------------
Scheduled maintenance of agents in collection tier requires this feature as
publisher (RpcClient) keeps streaming events to 1 of N agents (passed in
Properties for RpcClient.getDefaultProperties()) and list of hosts given to
RpcClient is a static and there is no way to dynamically change the list of
hosts in RpcClient (even if there is one, it is very hard to go and change the
hosts list across all the N publishers as it is an operational overhead). From
the ops perspective, graceful shutdown of an agent helps to do rolling-restart
of new version of flume binaries.
> Graceful shutdown and drain for memory channel
> ----------------------------------------------
>
> Key: FLUME-1318
> URL: https://issues.apache.org/jira/browse/FLUME-1318
> Project: Flume
> Issue Type: Improvement
> Components: Channel, Sinks+Sources
> Reporter: Mubarak Seyed
> Labels: newbie
>
> It appears from our test that if i go and shutdown the agent which uses
> memory channel, there is no clean way of throttling incoming requests to
> source, draining events from memory channel and do clean graceful shutdown of
> an agent. We don't have a visibility of how much data(events) in memory
> channel are getting dropped when shutdown happens.
> It would be good if we add a method to throttle incoming requests to source,
> drain events from memory channel and then shutdown sink/channel/source. (We
> can certainly add counters/metrics as part of channel monitoring). I think
> file-channel covers by adding it to WAL.
> HBase RegionServer shutdown handler does the some drain process (it syncs the
> edits in Write-Ahead-Log and notifies the master for regions move/assignment)
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
