What's the best way to use third party libraries with Hadoop? For
example, I want to run a job with both a jar file containing the mob,
and also extra libraries. I noticed a couple solutions with a search,
but I'm hoping for something better:
- Merge the third party jar libraries into the job jar
- Distribute the third party libraries across the cluster in the local
boxes classpath.
What I'd really like is a way to add an extra option to the hadoop jar
command, such as hadoop/bin/hadoop jar myJar.jar myJobClass -classpath
thirdpartyjar1.jar:jar2.jar:etc args
Anything exist like this?
