.nabble.com/Spark-Streaming-how-to-implement-multiple-calculation-using-the-same-data-set-tp13306.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr
Hi,
On Wed, Sep 3, 2014 at 6:54 AM, salemi alireza.sal...@udo.edu wrote:
I was able to calculate the individual measures separately and know I have
to merge them and spark streaming doesn't support outer join yet.
Can't you assign some dummy key (e.g., index) before your processing and
then
Tobias,
That was what I was planing to do and technical lead is the opinion that
we should some how process a message only once and calculate all the
measures for the worker.
I was wondering if there is a solution out there for that?
Thanks,
Ali
Hi,
On Wed, Sep 3, 2014 at 6:54 AM, salemi