Is the library in your assembly jar?
> On 6. Apr 2017, at 15:06, nayan sharma <nayansharm...@gmail.com> wrote: > > Hi All, > I am getting error while loading CSV file. > > val > datacsv=sqlContext.read.format("com.databricks.spark.csv").option("header", > "true").load("timeline.csv") > java.lang.NoSuchMethodError: > org.apache.commons.csv.CSVFormat.withQuote(Ljava/lang/Character;)Lorg/apache/commons/csv/CSVFormat; > > > I have added the dependencies in sbt file > // Spark Additional Library - CSV Read as DF > libraryDependencies += "com.databricks" %% "spark-csv" % “1.5.0" > and starting the spark-shell with command > > spark-shell --master yarn-client --jars > /opt/packages/xxxx-data-prepration/target/scala-2.10/xxxx-data-prepration-assembly-1.0.jar > --name nayan > > > > Thanks for any help!! > > > Thanks, > Nayan