-requirement-of-using-Spark-tp17177p17204.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
y, in this case most of the data would reside on the disk and spark
will utilize it efficiently.
Thanks
Best Regards
On Fri, Oct 24, 2014 at 8:47 AM, jian.t wrote:
> Hello,
> I am new to Spark. I have a basic question about the memory requirement of
> using Spark.
>
> I need to j
Hello,
I am new to Spark. I have a basic question about the memory requirement of
using Spark.
I need to join multiple data sources between multiple data sets. The join is
not a straightforward join. The logic is more like: first join T1 on column
A with T2, then for all the records that
