Hi Brock,
I created a JIRA https://issues.apache.org/jira/browse/FLUME-1900 which has
the log file attached.
~Rahul.
From: Brock Noland br...@cloudera.com
To: user@flume.apache.org; Rahul Ravindran rahu...@yahoo.com
Sent: Saturday, February 2, 2013 4:05 PM
Subject: Re: FileChannel error on Flume 1.3.1
Yes that err looks odd so I'd like have a look if possible.
--
Brock Noland
Sent with Sparrow
On Saturday, February 2, 2013 at 4:50 PM, Rahul Ravindran wrote:
Hi,
No, I did not delete the checkpoint previously. That is what I did to fix
the problem.
Searching through the archives, it looks like
http://mail-archives.apache.org/mod_mbox/flume-user/201211.mbox/%3cda66e7657bfbd949829f3c98d73a54cf18e...@rhv-exrda-s11.corp.ebay.com%3E
needs the checkpoint to be deleted. Will do that in future. Do you still need
the logs?
~Rahul.
From: Brock Noland br...@cloudera.com
To: user@flume.apache.org user@flume.apache.org; Rahul Ravindran
rahu...@yahoo.com
Sent: Saturday, February 2, 2013 2:32 PM
Subject: Re: FileChannel error on Flume 1.3.1
Hi,
That isn't a good error message. Could you share your entire log file? Post it
on a JIRA or pastebin.
Did you delete the checkpoint before starting the channel after changing
capacity? Capacity is fixed for the file channel as such the checkpoint must
be deleted to change the capacity.
Brock
On Saturday, February 2, 2013, Rahul Ravindran wrote:
Hi,
I increased the capacity and the max file size parameters of the
filechannel in our config and began seeing the below exception. I continue
seeing the below on restarting the channel. I fixed this by removing the
files in the checkpoint and data folders.
02 Feb 2013 21:45:51,113 WARN
[SinkRunner-PollingRunner-LoadBalancingSinkProcessor]
(org.apache.flume.sink.LoadBalancingSinkProcessor.process:158) - Sink failed
to consume event. Attempting next sink if available.
java.lang.IllegalStateException: Channel closed [channel=ch2]. Due to
java.io.EOFException: null
at
org.apache.flume.channel.file.FileChannel.createTransaction(FileChannel.java:353)
at
org.apache.flume.channel.BasicChannelSemantics.getTransaction(BasicChannelSemantics.java:122)
at org.apache.flume.sink.AvroSink.process(AvroSink.java:277)
at
org.apache.flume.sink.LoadBalancingSinkProcessor.process(LoadBalancingSinkProcessor.java:154)
at org.apache.flume.SinkRunner$PollingRunner.run(SinkRunner.java:147)
at java.lang.Thread.run(Thread.java:662)
Caused by: java.io.EOFException
at java.io.RandomAccessFile.readInt(RandomAccessFile.java:759)
at java.io.RandomAccessFile.readLong(RandomAccessFile.java:792)
at
org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:71)
at
org.apache.flume.channel.file.EventQueueBackingStoreFactory.get(EventQueueBackingStoreFactory.java:36)
at org.apache.flume.channel.file.Log.replay(Log.java:365)
at org.apache.flume.channel.file.FileChannel.start(FileChannel.java:303)
at
org.apache.flume.lifecycle.LifecycleSupervisor$MonitorRunnable.run(LifecycleSupervisor.java:236)
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:439)
at java.util.concurrent.FutureTask$Sync.innerRunAndReset(FutureTask.java:317)
at java.util.concurrent.FutureTask.runAndReset(FutureTask.java:150)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$101(ScheduledThreadPoolExecutor.java:98)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.runPeriodic(ScheduledThreadPoolExecutor.java:180)
at
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:204)
at
java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
--
Apache MRUnit - Unit testing MapReduce - http://incubator.apache.org/mrunit/
