Re: HDFS escape sequence and use of timestamp header

2012-08-23 Thread Mohit Anchlia
thanks that works On Wed, Aug 22, 2012 at 5:52 PM, Kathleen Ting wrote: > Mohit, > > As it happens, both the example and the table are correct. You can > specify either the fully qualified class name or the alias 'TIMESTAMP' > > Regards, Kathleen > > On Wed, Aug 22, 2012 at 5:05 PM, Mohit Anchli

Re: HDFS escape sequence and use of timestamp header

2012-08-22 Thread Kathleen Ting
Mohit, As it happens, both the example and the table are correct. You can specify either the fully qualified class name or the alias 'TIMESTAMP' Regards, Kathleen On Wed, Aug 22, 2012 at 5:05 PM, Mohit Anchlia wrote: > > > On Wed, Aug 22, 2012 at 2:16 PM, Kathleen Ting wrote: >> >> Hi Mohit, >

Re: HDFS escape sequence and use of timestamp header

2012-08-22 Thread Mohit Anchlia
On Wed, Aug 22, 2012 at 2:16 PM, Kathleen Ting wrote: > Hi Mohit, > > You can configure a timestamp interceptor onto your source as follows: > > agent.sources.src-0.interceptors.ts.type = TIMESTAMP > > Once the timestamp interceptor is in place, you can use, in sinks, the > timestamp it writes. H

Re: HDFS escape sequence and use of timestamp header

2012-08-22 Thread Kathleen Ting
Hi Mohit, You can configure a timestamp interceptor onto your source as follows: agent.sources.src-0.interceptors.ts.type = TIMESTAMP Once the timestamp interceptor is in place, you can use, in sinks, the timestamp it writes. Here is an example of using the timestamp in an HDFS sink: agent.sink

Re: HDFS escape sequence and use of timestamp header

2012-08-22 Thread Mohit Anchlia
I see this JIRA https://issues.apache.org/jira/browse/FLUME-1215 but how do I take advantage of it? I am using 1.2.0 but %Y %m doesn't work. I just get number format exceptions. On Tue, Aug 21, 2012 at 5:52 PM, Mohit Anchlia wrote: > I am using flume-ng 1.2.0 and I need to use %Y%M%D escape seque

HDFS escape sequence and use of timestamp header

2012-08-21 Thread Mohit Anchlia
I am using flume-ng 1.2.0 and I need to use %Y%M%D escape sequence. Do I need to write some custom interceptor? Could you please point me to an example? Currently my AvroClient looks like this: *public* *void* sendDataToFlume(String data) { // Create *flume* event object Event event = EventBuil