On Thursday, May 21, 2015 at 4:55:16 PM UTC-4, Jey Kottalam wrote: > > Hi Jeff, > > > they relied on a 3rd party to containerize a Pythonprogram for > transmission > > That is due to the pecularities of Python's serialization module than > anything intrinsic to creating a Spark binding. (E.g. Python's pickle > format doesn't have support for serializing code and closures, so some > extra code was required.) This isn't an issue in Julia since > Base.serialize() already has the needed functionality. An initial > implementation of a Spark binding done in the same style as PySpark is > available at http://github.com/jey/Spock.jl > > -Jey >
Hey awesome. Initial you say, what's missing?
