Hi Mohit, You can configure a timestamp interceptor onto your source as follows:
agent.sources.src-0.interceptors.ts.type = TIMESTAMP Once the timestamp interceptor is in place, you can use, in sinks, the timestamp it writes. Here is an example of using the timestamp in an HDFS sink: agent.sinks.sink-0.hdfs.filePrefix = FlumeData.%Y-%m-%d Here is more info about the timestamp interceptor: http://flume.apache.org/FlumeUserGuide.html#timestamp-interceptor Regards, Kathleen On Wed, Aug 22, 2012 at 11:50 AM, Mohit Anchlia <mohitanch...@gmail.com> wrote: > I see this JIRA https://issues.apache.org/jira/browse/FLUME-1215 but how do > I take advantage of it? I am using 1.2.0 but %Y %m doesn't work. I just get > number format exceptions. > > > On Tue, Aug 21, 2012 at 5:52 PM, Mohit Anchlia <mohitanch...@gmail.com> > wrote: >> >> I am using flume-ng 1.2.0 and I need to use %Y%M%D escape sequence. Do I >> need to write some custom interceptor? Could you please point me to an >> example? Currently my AvroClient looks like this: >> >> >> public void sendDataToFlume(String data) { >> >> // Create flume event object >> >> Event event = EventBuilder.withBody(data, Charset.forName( >> >> "UTF-8")); >> >> Map<String,String> headers = >> >> new HashMap<String,String>(); >> >> headers.put( >> >> "host", hostName); >> >> event.setHeaders(headers); >> >> try { >> >> rpcClient.append(event); >> >> } >> >> catch (EventDeliveryException e) { >> >> connect(); >> >> } >> >> } > >
