subscribe

2016-01-03 Thread Rajdeep Dua

InferredSchema Example in Spark-SQL

2015-05-17 Thread Rajdeep Dua
Hi All, Was trying the Inferred Schema spart example http://spark.apache.org/docs/latest/sql-programming-guide.html#overview I am getting the following compilation error on the function toRD() value toRD is not a member of org.apache.spark.rdd.RDD[Person] [error] val people =

Re: InferredSchema Example in Spark-SQL

2015-05-17 Thread Rajdeep Dua
Here are my imports *import* org.apache.spark.SparkContext *import* org.apache.spark.SparkContext._ *import* org.apache.spark.SparkConf *import* org.apache.spark.sql.SQLContext *import* org.apache.spark.sql.SchemaRDD On Sun, May 17, 2015 at 8:05 PM, Rajdeep Dua rajdeep@gmail.com wrote

Re: InferredSchema Example in Spark-SQL

2015-05-17 Thread Rajdeep Dua
/people.txt).map(_.split(,)).map(p = Person(p(0), p(1).trim.toInt)).toDF() On Sun, May 17, 2015 at 5:41 PM, Cheng, Hao hao.ch...@intel.com wrote: Typo? Should be .toDF(), not .toRD() *From:* Ram Sriharsha [mailto:sriharsha@gmail.com] *Sent:* Monday, May 18, 2015 8:31 AM *To:* Rajdeep Dua