Hi,
Just to add that, at least for hadoop-2.7.1 and phoenix 4.5.2-HBase-1.1,
hadoop guava lib has to be patched to 14.0.1 (under
hadoop/share/hadoop/common/lib) otherwise spark tasks might fail due to
missing guava methods.
Cheers
On 29/09/15 10:17, Hardika Catur Sapta wrote:
Spark setup
1.
Ensure that all requisite Phoenix / HBase platform
dependencies are available on the classpath for the Spark
executors and drivers
2.
One method is to add the phoenix-4.4.0-client.jar to
‘SPARK_CLASSPATH’ in spark-env.sh, or setting both
‘spark.executor.
3.
To help your IDE, you may want to add the following
‘provided’ dependency
sorry for bad English.
intent to number 2 and 3 how ??
please explain step by step.
Thanks.
