Re: Dataset throws: Task not serializable

2016-01-11 Thread Wail Alkowaileet
Hello Michael, Sorry for the late replay .. I was crossing the world the last few days. I actually tried both ... REPEL and SparkApp. The reported exception was in App. Unfortunately the data I have is not for distribution ... sorry about that. I saw it has been resolved.. I will try to

Re: Dataset throws: Task not serializable

2016-01-07 Thread Michael Armbrust
Were you running in the REPL? On Thu, Jan 7, 2016 at 10:34 AM, Michael Armbrust wrote: > Thanks for providing a great description. I've opened > https://issues.apache.org/jira/browse/SPARK-12696 > > I'm actually getting a different error (running in notebooks though). >

Re: Dataset throws: Task not serializable

2016-01-07 Thread Michael Armbrust
Thanks for providing a great description. I've opened https://issues.apache.org/jira/browse/SPARK-12696 I'm actually getting a different error (running in notebooks though). Something seems wrong either way. > > *P.S* mapping by name with case classes doesn't work if the order of the > fields