It seems not an issue in Spark. Does "CSVParser" works fine without Spark with the data?
On 20 Sep 2016 2:15 a.m., "Mohamed ismail" <mismai...@yahoo.com.invalid> wrote: > Hi all > > I am trying to read: > > sc.textFile(DataFile).mapPartitions(lines => { > val parser = new CSVParser(",") > lines.map(line=>parseLineToTuple(line, parser)) > }) > Data looks like: > android phone,0,0,0,,0,0,0,0,0,0,0,5,0,0,0,5,0,0.00000,0.00000,0. > 00000,0.00000,0.00000,0,0,0,0,0,0,0,0.00000,0,0,0 > ios phone,0,-1,0,,0,0,0,0,0,0,1,0,0,0,0,1,0,0.00000,0.00000,0. > 00000,0.00000,0.00000,0,0,0,0,0,0,0,0.00000,0,0,0 > > org.apache.spark.SparkException: Job aborted due to stage failure: Task 1 > in stage 23055.0 failed 4 times, most recent failure: Lost task 1.3 in > stage 23055.0 (TID 191607, ): > java.lang.NumberFormatException: For input string: "0.00000" > > Has anyone faced such issues. Is there a solution? > > Thanks, > Mohamed > >