Re: Not able to set date %d%m%Y in Sink Directory name

2013-10-24 Thread Deepak Subhramanian
Thanks David. On Thu, Oct 24, 2013 at 2:47 PM, David Sinclair < dsincl...@chariotsolutions.com> wrote: > You could do that or add the TimestampInterceptor to your source as well. > > > On Thu, Oct 24, 2013 at 5:16 AM, Deepak Subhramanian < > deepak.subhraman...@gmail.com> wrote: > >> I am using

Re: Not able to set date %d%m%Y in Sink Directory name

2013-10-24 Thread David Sinclair
You could do that or add the TimestampInterceptor to your source as well. On Thu, Oct 24, 2013 at 5:16 AM, Deepak Subhramanian < deepak.subhraman...@gmail.com> wrote: > I am using a SimpleHTTPEventHandler which implements HTTPSourceHandler > which reads a log message from HTTP Request and create

Re: Not able to set date %d%m%Y in Sink Directory name

2013-10-24 Thread Deepak Subhramanian
I am using a SimpleHTTPEventHandler which implements HTTPSourceHandler which reads a log message from HTTP Request and create a Flume event. May be I have to add the header to the event with the timestamp. String message = (String)request.getParameter("log"); //LOG.info(message ); LOG.inf

Re: Not able to set date %d%m%Y in Sink Directory name

2013-10-23 Thread David Sinclair
The sink is dependent on a header with the key "timestamp" being present in the event for this to work. What source are you using? On Wed, Oct 23, 2013 at 11:25 AM, Deepak Subhramanian < deepak.subhraman...@gmail.com> wrote: > Hi , > > I am trying to store my logs in folders named with date for

Not able to set date %d%m%Y in Sink Directory name

2013-10-23 Thread Deepak Subhramanian
Hi , I am trying to store my logs in folders named with date for my file_roll and hdfssink. For some reason when I pass %d%m%Y in the sink directory it is not working . Any thoughts . My Flume source is a simple HTTP Handler extended from HTTPSourceHandler tier1.sinks.filesink1.type = file_roll