Re: Nested/Chained case statements generate codegen over 64k exception

2016-07-25 Thread Jonathan Gray
I came back to this to try and investigate further using the latest version of the project. However, I don't have enough experience with the code base to understand fully what is now happening, could someone take a look at the testcase attached to this JIRA and run on the latest version of the cod

Re: Nested/Chained case statements generate codegen over 64k exception

2016-05-19 Thread Jonathan Gray
That makes sense, I will take a look there first. That will at least give a clearer understanding of the problem space to determine when to fallback. On 15 May 2016 3:02 am, "Reynold Xin" wrote: > It might be best to fix this with fallback first, and then figure out how > we can do it more intell

Re: Nested/Chained case statements generate codegen over 64k exception

2016-05-14 Thread Reynold Xin
It might be best to fix this with fallback first, and then figure out how we can do it more intelligently. On Sat, May 14, 2016 at 2:29 AM, Jonathan Gray wrote: > Hi, > > I've raised JIRA SPARK-15258 (with code attached to re-produce problem) > and would like to have a go at fixing it but don'

Nested/Chained case statements generate codegen over 64k exception

2016-05-14 Thread Jonathan Gray
Hi, I've raised JIRA SPARK-15258 (with code attached to re-produce problem) and would like to have a go at fixing it but don't really know where to start. Could anyone provide some pointers? I've looked at the code associated with SPARK-13242 but was hoping to find a way to avoid the codegen fall