Sugamber commented on issue #2637:
URL: https://github.com/apache/hudi/issues/2637#issuecomment-799211234


   @nsivabalan  Yes, 
   I have added the jar file in both driver and executor class path.
   `spark-submit --jars 
/path/lib/orders-poc-1.0.41-SNAPSHOT-shaded.jar,/path/hudi-support-jars/org.apache.avro_avro-1.8.2.jar,/path/hudi-support-jars/spark-avro_2.11-2.4.4.jar,/path/hudi-support-jars/hudi-spark-bundle_2.11-0.7.0.jar
 --master yarn --deploy-mode cluster --num-executors 2 --executor-cores 4 
--executor-memory 8g --driver-memory=8g --queue=default --conf 
spark.serializer=org.apache.spark.serializer.KryoSerializer --conf 
spark.driver.extraClassPath=org.apache.avro_avro-1.8.2.jar:spark-avro_2.11-2.4.4.jar:hudi-spark-bundle_2.11-0.7.0.jar:/path/lib/orders-poc-1.0.41-SNAPSHOT-shaded.jar
 --conf 
spark.executor.extraClassPath=org.apache.avro_avro-1.8.2.jar:spark-avro_2.11-2.4.4.jar:hudi-spark-bundle_2.11-0.7.0.jar:/path/lib/orders-poc-1.0.41-SNAPSHOT-shaded.jar
 --files /path/hive-site.xml,/path/resources/hudiConf.conf --class 
com.app.workflows.RecordPartialUpdate 
lib/orders-poc-1.0.41-SNAPSHOT-shaded.jar/`
   
   I'm able to find class name in jar using linux command.
   `find /path/orders-poc-1.0.41-SNAPSHOT-shaded.jar|xargs grep 
CustomRecordUpdate
   Binary file /path/orders-poc-1.0.41-SNAPSHOT-shaded.jar matches`


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


Reply via email to