In 1.2 it's a member of SchemaRDD and it becomes available on RDD (through
the type class mechanism) when you add a SQLContext, like so.
val sqlContext = new SQLContext(sc)import sqlContext._
In 1.3, the method has moved to the new DataFrame type.
Dean Wampler, Ph.D.
Author: Programming Scala,
Hi,
I am running spark when I use sc.version I get 1.2 but when I call
registerTempTable(MyTable) I get error saying registedTempTable is not a
member of RDD
Why?
--
Eran | CTO
Thanks.
I am new to the environment and running cloudera CDH5.3 with spark in it.
apparently when running in spark-shell this command val sqlContext = new
SQLContext(sc)
I am failing with the not found type SQLContext
Any idea why?
On Mon, Mar 23, 2015 at 3:05 PM, Dean Wampler
Have you tried adding the following ?
import org.apache.spark.sql.SQLContext
Cheers
On Mon, Mar 23, 2015 at 6:45 AM, IT CTO goi@gmail.com wrote:
Thanks.
I am new to the environment and running cloudera CDH5.3 with spark in it.
apparently when running in spark-shell this command val
