[
https://issues.apache.org/jira/browse/FLUME-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inder SIngh updated FLUME-1096:
-------------------------------
Summary: Add support to pass headers through AvroCLIClient (was: Issues in
using AvroClient with HDFSEventSink for regex based destination paths)
> Add support to pass headers through AvroCLIClient
> -------------------------------------------------
>
> Key: FLUME-1096
> URL: https://issues.apache.org/jira/browse/FLUME-1096
> Project: Flume
> Issue Type: Bug
> Affects Versions: v1.2.0
> Reporter: Inder SIngh
> Assignee: Inder SIngh
> Priority: Minor
> Labels: avroclient
> Fix For: v1.2.0
>
> Attachments: FLUME-1096-2.patch, FLUME-1096-3.patch
>
>
> Configured HDFSEvent Sink to generate file path's using regex based date
> format.
> Config for hdfs-sink -> collector1.sinks.hdfs-sink1.hdfs.filePrefix = flume/%D
> Hit NumberFormatException in BucketPath.replaceShorthand() as it reads
> timestamp from headers
>
> Date date = new Date(Long.valueOf(headers.get("timestamp")));
> java.lang.NumberFormatException: null
> at java.lang.Long.parseLong(Long.java:375)
> at java.lang.Long.valueOf(Long.java:525)
> at
> org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:185)
> at
> org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:219)
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:341)
> at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
> at java.lang.Thread.run(Thread.java:680)
> Sending the events using - ./flume-ng avro-client --conf ../conf/ -H
> localhost -p 41415 -F ~/.bash_profile
> Issue - AvroCLiClient isn't adding timestamp in headers
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
