CompileException for spark-sql generated code in 2.0.0-SNAPSHOT

2016-05-17 Thread Koert Kuipers
hello all, we are slowly expanding our test coverage for spark 2.0.0-SNAPSHOT to more in-house projects. today i ran into this issue... this runs fine: val df = sc.parallelize(List(("1", "2"), ("3", "4"))).toDF("a", "b") df .map(row => row)(RowEncoder(df.schema)) .select("a", "b") .show how

Re: CompileException for spark-sql generated code in 2.0.0-SNAPSHOT

2016-05-17 Thread Reynold Xin
It seems like the problem here is that we are not using unique names for mapelements_isNull? On Tue, May 17, 2016 at 3:29 PM, Koert Kuipers wrote: > hello all, we are slowly expanding our test coverage for spark > 2.0.0-SNAPSHOT to more in-house projects. today i ran into this issue... > > thi

Re: CompileException for spark-sql generated code in 2.0.0-SNAPSHOT

2016-05-17 Thread Michael Armbrust
Yeah, can you open a JIRA with that reproduction please? You can ping me on it. On Tue, May 17, 2016 at 4:55 PM, Reynold Xin wrote: > It seems like the problem here is that we are not using unique names > for mapelements_isNull? > > > > On Tue, May 17, 2016 at 3:29 PM, Koert Kuipers wrote: > >

Re: CompileException for spark-sql generated code in 2.0.0-SNAPSHOT

2016-05-18 Thread Koert Kuipers
https://issues.apache.org/jira/browse/SPARK-15384 On Tue, May 17, 2016 at 9:06 PM, Michael Armbrust wrote: > Yeah, can you open a JIRA with that reproduction please? You can ping me > on it. > > On Tue, May 17, 2016 at 4:55 PM, Reynold Xin wrote: > >> It seems like the problem here is that we