Re: [julia-users] Re: Spark and Julia

Hi Jey, Spock.jl looks interesting. Am I right with my understanding that this gives us something like a streaming model for calling Julia methods from within Spark? I am yet to try it and just had a glance at the code, but is a JuliaRDD.java file missing there? It will be great if you can el

Re: [julia-users] Re: Spark and Julia

Hi julia-users, I have the beginnings of a Spark interface for Julia up at https://github.com/jey/Spock.jl. This implementation follows the design used in Spark's Python and R bindings. It so far has the core of the Spark RDD interface implemented, but does not yet implement the additional feature

[julia-users] Re: Spark and Julia

It would be nice to co-ordinate these efforts under the JuliaParallel organization. -viral On Sunday, April 5, 2015 at 9:39:51 AM UTC+5:30, wil...@gmail.com wrote: > > Spark integration is a tricky thing. Python and R bindings go in a great > length to map language specific functions into Spark

[julia-users] Re: Spark and Julia

Spark integration is a tricky thing. Python and R bindings go in a great length to map language specific functions into Spark JVM library calls. I guess same could be done with JavaCall.jl package in a manner similar to SparkR. Look at slide 20 from here: http://spark-summit.org/wp-content/uplo

[julia-users] Re: Spark and Julia

On Saturday, April 4, 2015 at 2:22:38 AM UTC-4, Viral Shah wrote: > > I am changing the subject of this thread from GSOC to Spark. I was just > looking around and found this: > > https://github.com/d9w/Spark.jl >