Re: Creating a DataFrame from scratch

2016-07-22 Thread Jean Georges Perrin
You're right, it's the save behavior... Oh well... I wanted something easy :( > On Jul 22, 2016, at 12:41 PM, Everett Anderson > wrote: > > Actually, sorry, my mistake, you're calling > > DataFrame df =

Re: Creating a DataFrame from scratch

2016-07-22 Thread Everett Anderson
Actually, sorry, my mistake, you're calling DataFrame df = sqlContext.createDataFrame(data, org.apache.spark.sql.types.NumericType.class); and giving it a list of objects which aren't NumericTypes, but the wildcards in the signature let it happen. I'm curious what'd happen if you gave it

Creating a DataFrame from scratch

2016-07-22 Thread Jean Georges Perrin
I am trying to build a DataFrame from a list, here is the code: private void start() { SparkConf conf = new SparkConf().setAppName("Data Set from Array").setMaster("local"); SparkContext sc = new SparkContext(conf); SQLContext sqlContext