Re: [julia-users] Re: Julia and Spark

Are you asking about Spark Streaming support? On Sun, Nov 1, 2015 at 4:42 AM, Sisyphuss <zhengwend...@gmail.com> wrote: > http://dl.acm.org/citation.cfm?id=2228301 > > On Saturday, October 31, 2015 at 5:18:01 PM UTC+1, Jey Kottalam wrote: >> >> Could you ple

Re: [julia-users] Re: Julia and Spark

Could you please define "streams of RDDs"? On Sat, Oct 31, 2015 at 12:59 AM, wrote: > Is there any implementation with streams of RDDs for Julia ? > > > On Monday, April 20, 2015 at 11:54:10 AM UTC-7, wil...@gmail.com wrote: >> >> Unfortunately, Spark.jl is an

Re: [julia-users] Julia Summer of Code

- or if you would be able to participate to build these? -viral On 23-May-2015, at 7:54 am, Jey Kottalam j...@cs.berkeley.edu wrote: The core functionality is there, but there's also more to be implemented to have a complete interface to spark-core: - distributed I/O - broadcast vars

Re: [julia-users] Re: Julia Summer of Code

Waller truth...@gmail.com wrote: On Thursday, May 21, 2015 at 4:55:16 PM UTC-4, Jey Kottalam wrote: Hi Jeff, they relied on a 3rd party to containerize a Pythonprogram for transmission That is due to the pecularities of Python's serialization module than anything intrinsic to creating

Re: [julia-users] Re: Julia Summer of Code

Hi Jeff, they relied on a 3rd party to containerize a Pythonprogram for transmission That is due to the pecularities of Python's serialization module than anything intrinsic to creating a Spark binding. (E.g. Python's pickle format doesn't have support for serializing code and closures, so

Re: [julia-users] Re: Spark and Julia

Hi julia-users, I have the beginnings of a Spark interface for Julia up at https://github.com/jey/Spock.jl. This implementation follows the design used in Spark's Python and R bindings. It so far has the core of the Spark RDD interface implemented, but does not yet implement the additional

Re: [julia-users] Address of variable

Hi Gerry, You're probably looking for Julia's operator, or possibly the unsafe_pointer_from_objref method (unlikely). Note that works different in Julia than in C. The full documentation for calling C and Fortran code is available at