Re: PLs assist: trying to FlatMap a DataSet / partially OT

Not exactly...I was not going to flatmap the rdd In the end I amended my approach to the problem and managed to get the flatmap on the dataset Thx for answering Kr On Sep 16, 2017 4:53 PM, "Akhil Das" wrote: > scala> case class Fruit(price: Double, name: String) > defined

Re: PLs assist: trying to FlatMap a DataSet / partially OT

scala> case class Fruit(price: Double, name: String) defined class Fruit scala> val ds = Seq(Fruit(10.0,"Apple")).toDS() ds: org.apache.spark.sql.Dataset[Fruit] = [price: double, name: string] scala> ds.rdd.flatMap(f => f.name.toList).collect res8: Array[Char] = Array(A, p, p, l, e) This is

PLs assist: trying to FlatMap a DataSet / partially OT

HI all could anyone assist pls? i am trying to flatMap a DataSet[(String, String)] and i am getting errors in Eclipse the errors are more Scala related than spark -related, but i was wondering if someone came across a similar situation here's what i got. A DS of (String, String) , out of which i