Can you try setting hdfs.idleTimeout to a small value (much smaller than roll timeout) and then see if the file gets rolled correctly?
Thanks, Hari On Wednesday, September 25, 2013 at 9:22 AM, Edwin Chiu wrote: > Hi, > > I have also observed this behavior with gzip and bz2. I'm using > flume-1.3.1.1.3.0.0-107.el6.noarch under Hortonworks 1.3. > > Best, > > > - Edwin > > On Wed, Sep 25, 2013 at 2:51 AM, Devendra Tagare > <[email protected] (mailto:[email protected])> wrote: > > Hi, > > > > I am using Cloudera Flume (apache-flume-1.3.0-cdh4.3.1) > > > > I have observed a large number of *.lzo.tmp files not getting rolled even > > though their file sizes are non-zero and the roll time has elapsed > > > > Regards, > > Dev
