RE: Spark Streaming - use the data in different jobs

2015-10-19 Thread Ewan Leith
:49 To: user <user@spark.apache.org> Subject: Spark Streaming - use the data in different jobs Hi, we've build a spark streaming process that get data from a pub/sub (rabbitmq in our case). now we want the streamed data to be used in different spark jobs (also in realtime if possible)

Re: Spark Streaming - use the data in different jobs

2015-10-19 Thread Adrian Tanase
...@scene53.com] Sent: 18 October 2015 12:49 To: user <user@spark.apache.org<mailto:user@spark.apache.org>> Subject: Spark Streaming - use the data in different jobs Hi, we've build a spark streaming process that get data from a pub/sub (rabbitmq in our case). now we want the streamed dat

Spark Streaming - use the data in different jobs

2015-10-18 Thread Oded Maimon
Hi, we've build a spark streaming process that get data from a pub/sub (rabbitmq in our case). now we want the streamed data to be used in different spark jobs (also in realtime if possible) what options do we have for doing that ? - can the streaming process and different spark jobs