Re: Dependencies issue in spark

2022-07-20 Thread rajat kumar
Hi Users, Pasting full stack trace, Could anyone pls suggest Main error toward end is : NoClassDefFoundError Attaching full trace. Lost task 31.0 in stage 6.0 (TID 235, 10.139.64.16, executor 9): java.lang.ExceptionInInitializerError at sun.reflect.NativeMethodAccessorImpl.invoke0(Native

Dependencies issue in spark

2022-07-20 Thread rajat kumar
Hello , I am using maven with Spark. Post upgrading scala form 2.11 to 2.12 I am getting below error and have observed this coming while reading avro Appreciate help. ShuffleMapStage 6 (save at Calling.scala:81) failed in 0.633 s due to Job aborted due to stage failure: Task 83 in stage 6.0 fail