Apache Groovy and Spark

Hi I start playing with both Apache projects and quickly got that exception. Anyone being able to give some hint on the problem so that I can dig further. It seems to be a problem for Spark to load some of the groovy classes ... Any idea? Thanks Guillaume tog GroovySpark $

Re: Apache Groovy and Spark

Looks like groovy scripts dont' serialize over the wire properly. Back in 2011 I hooked up groovy to mapreduce, so that you could do mappers and reducers there; "grumpy" https://github.com/steveloughran/grumpy slides: http://www.slideshare.net/steve_l/hadoop-gets-groovy What I ended up doing

Re: Apache Groovy and Spark

Given there is no existing Groovy integration out there, I'd tend to agree to use Scala if possible - the basics of functional-style Groovy is fairly similar to Scala. — Sent from Mailbox On Wed, Nov 18, 2015 at 11:52 PM, Steve Loughran wrote: > Looks like groovy

Re: Apache Groovy and Spark

Hi Steve Since you are familiar with groovy it will go a bit deeper in details. My (simple) groovy scripts are working fine with Apache Spark - a closure (when dehydrated) will nicely serialize. My issue comes when I want to use GroovyShell to run my scripts (my ultimate goal is to integrate with