Re: NullPointerException : (Channel closed) on writeCheckpoint

2013-05-13 Thread Jay Vyas
Ahhh I had no batchSize parameter. So the fix was to add batchSize = 1 to my file and now its working. Anyone wants more details just ping me On Sun, May 12, 2013 at 7:13 PM, Jay Vyas jayunit...@gmail.com wrote: Hi ! Thanks --- Here's my config a1.sources = r1 a1.sinks = myFileSystem

Re: NullPointerException : (Channel closed) on writeCheckpoint

2013-05-13 Thread Jay Vyas
sure :) ... Maybe we could also commit the fix on our end to. would love a chance to dive into the flume code some more On Mon, May 13, 2013 at 11:39 AM, Brock Noland br...@cloudera.com wrote: Hmm that shouldn't cause an NPE. Could you find a JIRA for this? On Mon, May 13, 2013 at 10:11

Re: NullPointerException : (Channel closed) on writeCheckpoint

2013-05-13 Thread Brock Noland
I'd be highly surprised if not setting batchSize caused the NPE. Here is a good tuning article: https://blogs.apache.org/flume/entry/flume_performance_tuning_part_1 On Mon, May 13, 2013 at 10:58 AM, Jay Vyas jayunit...@gmail.com wrote: Alas - i cannot reproduce this bug anymore., maybe as a

Re: NullPointerException : (Channel closed) on writeCheckpoint

2013-05-12 Thread Jay Vyas
Hi ! Thanks --- Here's my config a1.sources = r1 a1.sinks = myFileSystem a1.channels = c1 # Describe/configure the source a1.sources.r1.type = exec a1.sources.r1.command = tail -F /root/xyz/flumeinput.tmp a1.sources.r1.channels = c1 a1.sources = r1 a1.channels = c1 a1.sinks = k1 a1.sinks.k1.type

NullPointerException : (Channel closed) on writeCheckpoint

2013-05-11 Thread Jay Vyas
Hi flume : I've setup a file to file source/sink , just as a test. Im using the exec source, with tail -F to follow a simple tmp file that is being catted to. However, I've started seeing the following exception in the flume logs: java.lang. IllegalStateException: Channel closed [channel=c1].