You could all express it in one program, alternatively ignite in memory file 
system or the ignite sharedrdd ( not sure if dataframe is supported)

> On 20. Jun 2017, at 19:46, Jean Georges Perrin <j...@jgp.net> wrote:
> 
> Hey,
> 
> Here is my need: program A does something on a set of data and produces 
> results, program B does that on another set, and finally, program C combines 
> the data of A and B. Of course, the easy way is to dump all on disk after A 
> and B are done, but I wanted to avoid this. 
> 
> I was thinking of creating a temp view, but I do not really like the temp 
> aspect of it ;). Any idea (they are all worth sharing)
> 
> jg
> 
> 
> 
> ---------------------------------------------------------------------
> To unsubscribe e-mail: user-unsubscr...@spark.apache.org
> 

---------------------------------------------------------------------
To unsubscribe e-mail: user-unsubscr...@spark.apache.org

Reply via email to