Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Aris
Hello Michael, I made a JIRA with sample code to reproduce this problem. I set you as the "shepherd" -- I Hope this is enough, otherwise I can fix it. https://issues.apache.org/jira/browse/SPARK-17092 On Sun, Aug 14, 2016 at 9:38 AM, Michael Armbrust wrote: > Anytime

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Aris
>>> https://github.com/apache/spark/commit/fa244e5a90690d6a31be5 >>> 0f2aa203ae1a2e9a1cf >>> >>> I can reproduce the problem in SPARK-15285 with master branch. >>> Should we reopen SPARK-15285? >>> >>> Best Regards, >>> Kazuaki I

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Ted Yu
Ted Yu <yuzhih...@gmail.com> >> To:dhruve ashar <dhruveas...@gmail.com> >> Cc:Aris <arisofala...@gmail.com>, "user@spark.apache.org" < >> user@spark.apache.org> >> Date:2016/08/15 06:19 >> Subject:Re: S

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Aris
t;arisofala...@gmail.com>, "user@spark.apache.org" < > user@spark.apache.org> > Date:2016/08/15 06:19 > Subject:Re: Spark 2.0.0 JaninoRuntimeException > -- > > > > Looks like the proposed fix was reverted: >

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Ted Yu
gmail.com>, "user@spark.apache.org" > <user@spark.apache.org> > Date:2016/08/15 06:19 > Subject:Re: Spark 2.0.0 JaninoRuntimeException > > > > Looks like the proposed fix was reverted: > > Revert &q

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-16 Thread Kazuaki Ishizaki
hih...@gmail.com> To: dhruve ashar <dhruveas...@gmail.com> Cc: Aris <arisofala...@gmail.com>, "user@spark.apache.org" <user@spark.apache.org> Date: 2016/08/15 06:19 Subject:Re: Spark 2.0.0 JaninoRuntimeException Looks like the proposed fix was revert

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-14 Thread Ted Yu
Looks like the proposed fix was reverted: Revert "[SPARK-15285][SQL] Generated SpecificSafeProjection.apply method grows beyond 64 KB" This reverts commit fa244e5a90690d6a31be50f2aa203ae1a2e9a1cf. Maybe this was fixed in some other JIRA ? On Fri, Aug 12, 2016 at 2:30 PM, dhruve ashar

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-14 Thread Michael Armbrust
Anytime you see JaninoRuntimeException you are seeing a bug in our code generation. If you can come up with a small example that causes the problem it would be very helpful if you could open a JIRA. On Fri, Aug 12, 2016 at 2:30 PM, dhruve ashar wrote: > I see a similar

Re: Spark 2.0.0 JaninoRuntimeException

2016-08-12 Thread dhruve ashar
I see a similar issue being resolved recently: https://issues.apache.org/jira/browse/SPARK-15285 On Fri, Aug 12, 2016 at 3:33 PM, Aris wrote: > Hello folks, > > I'm on Spark 2.0.0 working with Datasets -- and despite the fact that > smaller data unit tests work on my

Spark 2.0.0 JaninoRuntimeException

2016-08-12 Thread Aris
Hello folks, I'm on Spark 2.0.0 working with Datasets -- and despite the fact that smaller data unit tests work on my laptop, when I'm on a cluster, I get cryptic error messages: Caused by: org.codehaus.janino.JaninoRuntimeException: Code of method >