Re: Spark 3.2.0 upgrade

2022-01-22 Thread Amit Sharma
Alex, Please find below the build.sbt. I am using the assembly command to create a fat jar. These things were working fine until i changed the version scala and spark cassandra connector and other dependent jars. I tried to run my job on my local intellij then also i am getting the issue. Thanks

Re: Spark 3.2.0 upgrade

2022-01-22 Thread Alex Ott
Show how do you execute your code - either you didn't pack it as uberjar, or didn't provide all necessary dependencies, if you're using `--jars` option. You may try `-assembly` variant when submitting your application Amit Sharma at "Fri, 21 Jan 2022 11:17:38 -0500" wrote: AS> Hello, I tried

Re: Spark 3.2.0 upgrade

2022-01-21 Thread Amit Sharma
Hello, I tried using a cassandra unshaded connector or normal connector both are giving the same error at runtime while connecting to cassandra. "com.datastax.spark" %% "spark-cassandra-connector-unshaded" % "2.4.2" Or "com.datastax.spark" %% "spark-cassandra-connector" % "3.1.0" Russ

Spark 3.2.0 upgrade

2022-01-20 Thread Amit Sharma
Hello, I am trying to upgrade my project from spark 2.3.3 to spark 3.2.0. While running the application locally I am getting below error. Could you please let me know which version of the cassandra connector I should use. I am using below shaded connector but i think that causing the issue