Re: how do i force unit test to do whole stage codegen

2017-04-05 Thread Jacek Laskowski
x of each operation that the >>> whole-stage codegen can be apply to. >>> >>> So, in your test case, whole-stage codegen has been already enabled!! >>> >>> FYI. I think that it is a good topic for d...@spark.apache.org. >>> >>> Kazuaki

Re: how do i force unit test to do whole stage codegen

2017-04-05 Thread Koert Kuipers
t; FYI. I think that it is a good topic for d...@spark.apache.org. >> >> Kazuaki Ishizaki >> >> >> >> From: Koert Kuipers <ko...@tresata.com> >> To:"user@spark.apache.org" <user@spark.apache.org> >> Date:2017/04

Re: how do i force unit test to do whole stage codegen

2017-04-05 Thread Jacek Laskowski
abled!! > > FYI. I think that it is a good topic for d...@spark.apache.org. > > Kazuaki Ishizaki > > > > From:Koert Kuipers <ko...@tresata.com> > To:"user@spark.apache.org" <user@spark.apache.org> > Date:2017/04/05 05:12 >

Re: how do i force unit test to do whole stage codegen

2017-04-04 Thread Koert Kuipers
"user@spark.apache.org" <user@spark.apache.org> > Date: 2017/04/05 05:12 > Subject:how do i force unit test to do whole stage codegen > -- > > > > i wrote my own expression with eval and doGenCode, but doGenCode

Re: how do i force unit test to do whole stage codegen

2017-04-04 Thread Kazuaki Ishizaki
opic for d...@spark.apache.org. Kazuaki Ishizaki From: Koert Kuipers <ko...@tresata.com> To: "user@spark.apache.org" <user@spark.apache.org> Date: 2017/04/05 05:12 Subject: how do i force unit test to do whole stage codegen i wrote my own expression with eval an

how do i force unit test to do whole stage codegen

2017-04-04 Thread Koert Kuipers
i wrote my own expression with eval and doGenCode, but doGenCode never gets called in tests. also as a test i ran this in a unit test: spark.range(10).select('id as 'asId).where('id === 4).explain according to