[
https://issues.apache.org/jira/browse/FLUME-1096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Inder SIngh updated FLUME-1096:
-------------------------------
Description:
Configured HDFSEvent Sink to generate file path's using regex based date format.
Config for hdfs-sink -> collector1.sinks.hdfs-sink1.hdfs.filePrefix = flume/%D
Hit NumberFormatException in BucketPath.replaceShorthand() as it reads
timestamp from headers
Date date = new Date(Long.valueOf(headers.get("timestamp")));
java.lang.NumberFormatException: null
at java.lang.Long.parseLong(Long.java:375)
at java.lang.Long.valueOf(Long.java:525)
at
org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:185)
at
org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:219)
at
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:341)
at
org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
at java.lang.Thread.run(Thread.java:680)
Sending the events using - ./flume-ng avro-client --conf ../conf/ -H localhost
-p 41415 -F ~/.bash_profile
Issue - AvroCLiClient isn't adding timestamp in headers
Assignee: Inder SIngh
> Issues in using AvroClient with HDFSEvent for regex based destination paths
> ---------------------------------------------------------------------------
>
> Key: FLUME-1096
> URL: https://issues.apache.org/jira/browse/FLUME-1096
> Project: Flume
> Issue Type: Bug
> Reporter: Inder SIngh
> Assignee: Inder SIngh
> Priority: Minor
>
> Configured HDFSEvent Sink to generate file path's using regex based date
> format.
> Config for hdfs-sink -> collector1.sinks.hdfs-sink1.hdfs.filePrefix = flume/%D
> Hit NumberFormatException in BucketPath.replaceShorthand() as it reads
> timestamp from headers
>
> Date date = new Date(Long.valueOf(headers.get("timestamp")));
> java.lang.NumberFormatException: null
> at java.lang.Long.parseLong(Long.java:375)
> at java.lang.Long.valueOf(Long.java:525)
> at
> org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:185)
> at
> org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:219)
> at
> org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:341)
> at
> org.apache.flume.sink.DefaultSinkProcessor.process(DefaultSinkProcessor.java:65)
> at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:148)
> at java.lang.Thread.run(Thread.java:680)
> Sending the events using - ./flume-ng avro-client --conf ../conf/ -H
> localhost -p 41415 -F ~/.bash_profile
> Issue - AvroCLiClient isn't adding timestamp in headers
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
