Re: Spark 1.4 RDD to DF fails with toDF()

2015-09-08 Thread Gheorghe Postelnicu
6 a spark version compiled with scala > 2.11? > > On Mon, Sep 7, 2015 at 5:29 PM, Gheorghe Postelnicu < > gheorghe.posteln...@gmail.com> wrote: > >> sbt assembly; $SPARK_HOME/bin/spark-submit --class main.scala.TestMain >> --master "local[4]" target/scala-

Re: Spark 1.4 RDD to DF fails with toDF()

2015-09-08 Thread Gheorghe Postelnicu
Compiling from source with Scala 2.11 support fixed this issue. Thanks again for the help! On Tue, Sep 8, 2015 at 7:33 AM, Gheorghe Postelnicu < gheorghe.posteln...@gmail.com> wrote: > Good point. It is a pre-compiled Spark version. Based on the text on the > downloads page, the an

Spark 1.4 RDD to DF fails with toDF()

2015-09-07 Thread Gheorghe Postelnicu
Hi, The following code fails when compiled from SBT: package main.scala import org.apache.spark.SparkContext import org.apache.spark.sql.SQLContext object TestMain { def main(args: Array[String]): Unit = { implicit val sparkContext = new SparkContext() val sqlContext = new

Re: Spark 1.4 RDD to DF fails with toDF()

2015-09-07 Thread Gheorghe Postelnicu
ow are you building and running it? > > > El lunes, 7 de septiembre de 2015, Gheorghe Postelnicu < > gheorghe.posteln...@gmail.com> escribió: > >> Interesting idea. Tried that, didn't work. Here is my new SBT file: >> >> name := """tes