Hi, I am currently using the kite library(https://github.com/kite-sdk/kite) to persist to HBase from my Spark Job. All this happens in the driver.
I am on version 1.6.1 on spark. The problem I am facing is that a particular class in one of the dependency jars is not found by kite when it uses Class.forName and I get a ClassNotFoundException. For example: I have my spark job and 2 relevant dependencies: 1. kite jar 2. dependency1 jar Kite is trying to read a class which is present in dependency1 jar using https://github.com/kite-sdk/kite/blob/master/kite-data/kite-data-hbase/src/main/java/org/kitesdk/data/hbase/HBaseDatasetRepository.java#L163 I have tried: 1. Adding all the jars using the --jars option in spark-submit. 2. Adding all the jars using --driver-class-path option in spark-submit. I am also registering the class using the KryoRegistrator present in the twitter-chill library without any issues. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Loading-a-class-from-a-dependency-jar-tp28238.html Sent from the Apache Spark User List mailing list archive at Nabble.com. --------------------------------------------------------------------- To unsubscribe e-mail: user-unsubscr...@spark.apache.org
