Denny Ye created FLUME-1419:
-------------------------------

             Summary: Using system time if 'timestamp' property is absent in 
event header
                 Key: FLUME-1419
                 URL: https://issues.apache.org/jira/browse/FLUME-1419
             Project: Flume
          Issue Type: Improvement
          Components: Sinks+Sources
    Affects Versions: v1.2.0
            Reporter: Denny Ye
            Assignee: Denny Ye
             Fix For: v1.3.0


If we want to use pattern for generating HDFS path but the 'timestamp' property 
is absent in event header, it may cause the exception...

Event may comes from several Sources and doesn't use Interceptor(pupulate 
'timestamp' property). Thus, event may be haven't this property normally.
Use the local system time to replace it.

java.lang.RuntimeException: Flume wasn't able to parse timestamp header in the 
event to resolve time based bucketing. Please check that you're correctly 
populating timestamp header (for example using TimestampInterceptor source 
interceptor).
        at 
org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:149)
        at 
org.apache.flume.formatter.output.BucketPath.escapeString(BucketPath.java:318)
        at 
org.apache.flume.formatter.output.TestBucketPath.testDateFormatHours(TestBucketPath.java:46)
Caused by: java.lang.NumberFormatException: null
        at java.lang.Long.parseLong(Unknown Source)
        at java.lang.Long.valueOf(Unknown Source)
        at 
org.apache.flume.formatter.output.BucketPath.replaceShorthand(BucketPath.java:147)
        ... 26 more

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to