Mingjie Lai created FLUME-1209:
----------------------------------
Summary: Support file name extension for HDFS sink
Key: FLUME-1209
URL: https://issues.apache.org/jira/browse/FLUME-1209
Project: Flume
Issue Type: Improvement
Components: Sinks+Sources
Affects Versions: NG alpha 1
Reporter: Mingjie Lai
Assignee: Mingjie Lai
Here is a common use case for using pig to analyze hdfs files collected by
flume:
{code}
data = LOAD '/data/mydata/*'
org.apache.pig.piggybank.storage.avro.AvroStorage();
{code}
Since the current hdfs sink creates tmp files under the current directory, pig
will complain loading file failure.
At Flume-965, Brock mentioned we can add a filePostfix attribute to hdfs sink.
I think it's a good way to solve the issue.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
