the hadoop jar files which are needed by the HDFS sink. I
would expected it to be packaged in the lib folder. Is this deliberate? Is
there a different binary which I could look to download for the hadoop jars?
Thanks,
~Rahul.
Currently, unfortunately, i dont think there is any such documentation.
A very general answer would be..Normally this list would depend on the
source/sink/channel you are using.
I think it would be nice if the user manual did list these external
dependencies for each component.
I am not the
Easiest way is to install cdh binary and point your flume's classpath to it.
On Mon, Nov 19, 2012 at 2:25 PM, Roshan Naik ros...@hortonworks.com wrote:
Currently, unfortunately, i dont think there is any such documentation.
A very general answer would be..Normally this list would depend on
Flume installs all required binaries, except for Hadoop (and the dependencies
it would pull in) and HBase. This is because Flume, like most other Hadoop
ecosystem components is meant to work against binary incompatible versions of
Hadoop (Hadoop-1/Hadoop2). So instead of packaging hadoop jars
@flume.apache.org
Sent: Monday, November 19, 2012 3:29 PM
Subject: Re: Hadoop jars
Flume installs all required binaries, except for Hadoop (and the dependencies
it would pull in) and HBase. This is because Flume, like most other Hadoop
ecosystem components is meant to work against binary incompatible
Unfortunately, the FileChannel too has a hadoop dependency - even though the
classes are never used. So you need the hadoop jars (and they should be added
to FLUME_CLASSPATH in flume-env.sh or HADOOP_HOME/HADOOP_PREFIX should be set)
on machines which will use the FileChannel. The channel
, November 19, 2012 4:08 PM
Subject: Re: Hadoop jars
Unfortunately, the FileChannel too has a hadoop dependency - even though the
classes are never used. So you need the hadoop jars (and they should be added
to FLUME_CLASSPATH in flume-env.sh or HADOOP_HOME/HADOOP_PREFIX should be set)
on machines
@flume.apache.org; Rahul Ravindran rahu...@yahoo.com
Sent: Monday, November 19, 2012 4:08 PM
Subject: Re: Hadoop jars
Unfortunately, the FileChannel too has a hadoop dependency - even though the
classes are never used. So you need the hadoop jars (and they should be
added to FLUME_CLASSPATH in flume
