Hi Sandesh,
Good to hear that you made it work.
I don't think you need to compile/re-build Flume from source.
Regards,
Jeongshik
2/18/14, 6:42 PM, Sandesh Hurli 쓴 글:
Hi Jeong-shik,
Thanks for the response.
My Hadoop was using protobuf-java-2.5.0 and Flume was using
protobuf-java-2.4.1. guava-x.x.x.jar versions are compatible.
I downloaded protobuf-java-2.5.0.jar file and replaced it with the
older file in the $FLUME_HOME/lib directory. It seems to be working now.
But is this the right way to do it, or do I need to compile Flume from
source?
Reagrds,
Sandesh
On Tue, Feb 18, 2014 at 2:31 PM, Jeong-shik Jang <[email protected]
<mailto:[email protected]>> wrote:
Hi Sandesh,
You may want to check protobuf-java-x.x.x.jar in Flume against one
in Hadoop; you should use one in Hadoop or the same version; same
thing with guava-x.x.x.jar
Regards,
Jeongshik
2/18/14, 4:58 PM, Sandesh Hurli 쓴 글:
Hi,
I have started using Flume recently. I have configured Flume to
write data into a HDFS sink running locally, but everytime I run
the agent, I get the below error:
2014-02-18 13:23:40,863
(SinkRunner-PollingRunner-DefaultSinkProcessor) [ERROR -
org.apache.flume.sink.hdfs.HDFSEventSink.process(HDFSEventSink.java:422)]
process failed
java.lang.VerifyError: class
org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$SetOwnerRequestProto
overrides final method
getUnknownFields.()Lcom/google/protobuf/UnknownFieldSet;
Following are the contents of my flume.conf file:
agent.sources = seqGenSrc
agent.channels = memoryChannel
agent.sinks = loggerSink
agent.sources.seqGenSrc.type = exec
agent.sources.seqGenSrc.command = tail -F /home/hduser/sample.txt
agent.sources.seqGenSrc.channels = memoryChannel
agent.sinks.loggerSink.type = hdfs
agent.sinks.loggerSink.hdfs.path =
hdfs://localhost:54310/user/hduser/sample.txt
agent.sinks.loggerSink.hdfs.fileType = DataStream
agent.sinks.loggerSink.channel = memoryChannel
agent.channels.memoryChannel.type = memory
agent.channels.memoryChannel.capacity = 100
Why does this happen?
Regards,
Sandesh
--
Jeong-shik Jang /[email protected] <mailto:[email protected]>
Gruter, Inc., Vice President
www.gruter.com <http://www.gruter.com>
Enjoy Connecting
--
Jeong-shik Jang / [email protected]
Gruter, Inc., Vice President
www.gruter.com
Enjoy Connecting
