Re: Spark SQL 1.1.0: NPE when join two cached table

2014-09-22 Thread Yin Huai
It is a bug. I have created https://issues.apache.org/jira/browse/SPARK-3641 to track it. Thanks for reporting it. Yin On Mon, Sep 22, 2014 at 4:34 AM, Haopu Wang wrote: > I have two data sets and want to join them on each first field. Sample > data are below: > > > > data set 1: > > id2,na

Spark SQL 1.1.0: NPE when join two cached table

2014-09-22 Thread Haopu Wang
I have two data sets and want to join them on each first field. Sample data are below: data set 1: id2,name1,2,300.0 data set 2: id1, The code is something like below: val sparkConf = new SparkConf().setAppName("JoinInScala") val sc = new SparkContext(spar