Re: Collector going crazy...

2011-08-10 Thread Eran Kutner
Great! By the way, I've opened FLUME-734 about this issue, it has some more log data there. Thanks. -eran On Wed, Aug 10, 2011 at 16:55, Jonathan Hsieh wrote: > Eran, > > I've dug into this and I think I've found the root cause of this bug. I'll > try to patch this today. > > Jon. > > > On

Re: Collector going crazy...

2011-08-10 Thread Jonathan Hsieh
Eran, I've dug into this and I think I've found the root cause of this bug. I'll try to patch this today. Jon. On Mon, Aug 8, 2011 at 7:41 AM, Eran Kutner wrote: > Hi, > I have 3 collectors running, all with this configuration: > collectorSource(54001) | collector(60) { > escapedFormatDfs

Collector going crazy...

2011-08-08 Thread Eran Kutner
Hi, I have 3 collectors running, all with this configuration: collectorSource(54001) | collector(60) { escapedFormatDfs("hdfs://hadoop1-m1:8020/raw-events/%Y-%m-%d/", "events-%{rolltag}-col1.snappy", seqfile("SnappyCodec")) } Right now tall three are going crazy, opening multiple HDFS files pe