[
https://issues.apache.org/jira/browse/FLUME-871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13164821#comment-13164821
]
[email protected] commented on FLUME-871:
-----------------------------------------------------
-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/3019/
-----------------------------------------------------------
(Updated 2011-12-07 23:12:09.859775)
Review request for Arvind Prabhakar and Eric Sammer.
Changes
-------
Corrected the Bug#
Summary
-------
The HDFS sink currently waits indefinitely for the append to complete. We need
to support a configurable timeout for the append so that the flow can continue
when a given operation is hung.
The patch includes executing append in a separate thread and wait for the
completion with timeout if specified.
This addresses bug FLUME-871.
https://issues.apache.org/jira/browse/FLUME-871
Diffs
-----
flume-ng-sinks/flume-hdfs-sink/src/main/java/org/apache/flume/sink/hdfs/HDFSEventSink.java
556aa3d
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/HDFSBadDataStream.java
233e8c1
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/HDFSBadSeqWriter.java
3f7a735
flume-ng-sinks/flume-hdfs-sink/src/test/java/org/apache/flume/sink/hdfs/TestHDFSEventSink.java
93b0b69
Diff: https://reviews.apache.org/r/3019/diff
Testing
-------
HDFS tests. Added new test cases to test the hung/slow sink operations
Thanks,
Prasad
> HDFS sink needs to handle blocked/hung append operation
> -------------------------------------------------------
>
> Key: FLUME-871
> URL: https://issues.apache.org/jira/browse/FLUME-871
> Project: Flume
> Issue Type: Improvement
> Components: Sinks+Sources
> Affects Versions: NG alpha 2
> Reporter: Prasad Mujumdar
> Assignee: Prasad Mujumdar
> Fix For: NG alpha 3
>
> Attachments: Flume-871.patch.1
>
>
> The HDFS sink currently waits indefinitely for the append to complete. We
> need to support a configurable timeout for the append so that the flow can
> continue when a given operation is hung.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
