yncxcw wrote
> hi,
>
> I think if the OOM occurs before the computation begins, the input data is
> probably too big to fit in memory. I remembered that the graph data would
> expand when loading the data input memory. And the scale of expanding is
> pretty huge( based on my experiment on Pagerank
yncxcw wrote
> hi,
>
> It highly depends on the algorithms you are going to apply to your data
> sets. Graph applications are usually memory hungry and probably cause
> long
> GC or even OOM.
>
> Suggestions include: 1. make some highly reused RDD as
> StorageLevel.MEMORY_ONLY
> and leave the r
