Akhil,
In locally ,all nodes will has the same jar because the driver will be
assgined to random node ;otherwise the driver log wiil report :no jar was
founded .
Ricky Ou(欧 锐)
From: Akhil Das
Date: 2015-11-02 17:59
To: our...@cnsuning.com
CC: user; 494165115
Subject: Re: --jars option using hdfs jars cannot effect when spark standlone
deploymode with cluster
Can you give a try putting the jar locally without hdfs?
Thanks
Best Regards
On Wed, Oct 28, 2015 at 8:40 AM, our...@cnsuning.com <our...@cnsuning.com>
wrote:
hi all,
when using command:
spark-submit --deploy-mode cluster --jars hdfs:///user/spark/cypher.jar
--class com.suning.spark.jdbc.MysqlJdbcTest hdfs:///user/spark/MysqlJdbcTest.jar
the program throw exception that cannot find class in cypher.jar, the driver
log show no --jars download with cluster mode. Isn't it only use fatjar?
Ricky Ou(欧 锐)
