Pe 15.03.2012 15:51, Pat Ferrel a scris:
Can you elaborate on how to set these classpaths?
The job takes a classpath param, (from mahout --help)
-libjars <paths> comma separated jar files to include in
the classpath.
is the needed code bundled with the job or does the path need to be
available to hadoop/mahout on all nodes? Also is this the only thing
that affects the classpath to any code outside the jar file?
On 3/15/12 5:33 AM, Ioan Eugen Stan wrote:
Also, if you submit a job there are two class paths that you must be
aware of:
- the one that starts the job submitting app
- the one that will be available to the job on each node
Hi Pat,
To set up your main app class-path use HADOOP_CLASS_PATH env var. For
the Job class-path it's best explained here [1], although, from my
experience -libjars did not work as advertised. It's hadoop version
dependant probably but I may be wrong. Test and see for yourself.
Also see my post on common-user about this issue [2]. Search for
ClassNotFoundException: libjars .
[1]
http://www.cloudera.com/blog/2011/01/how-to-include-third-party-libraries-in-your-map-reduce-job/
[2] http://hadoop.markmail.org/thread/st3cy7alcodlztng
Hope this helps,
--
Ioan Eugen Stan
http://ieugen.blogspot.com
