how to force graphx to execute transfomtation
Hello, I work with Graphx. When I call graph.partitionBy(..) nothing happens, because, as I understood, that all transformation are lazy and partitionBy is built using transformations. Is there way how to force spark to actually execute this transformation and not use any action? -- Cordialement, Hlib Mykhailenko Doctorant à INRIA Sophia-Antipolis Méditerranée 2004 Route des Lucioles BP93 06902 SOPHIA ANTIPOLIS cedex
Re: how to force graphx to execute transfomtation
Hi, can't you just use graph.partitionBy(..).collect()? Cheers, Joerg On Wed, Nov 26, 2014 at 2:25 PM, Hlib Mykhailenko hlib.mykhaile...@inria.fr wrote: Hello, I work with Graphx. When I call graph.partitionBy(..) nothing happens, because, as I understood, that all transformation are lazy and partitionBy is built using transformations. Is there way how to force spark to actually execute this transformation and not use any action? -- Cordialement, *Hlib Mykhailenko* Doctorant à INRIA Sophia-Antipolis Méditerranée http://www.inria.fr/centre/sophia/ 2004 Route des Lucioles BP93 06902 SOPHIA ANTIPOLIS cedex
Re: how to force graphx to execute transfomtation
At 2014-11-26 05:25:10 -0800, Hlib Mykhailenko hlib.mykhaile...@inria.fr
wrote:
I work with Graphx. When I call graph.partitionBy(..) nothing happens,
because, as I understood, that all transformation are lazy and partitionBy is
built using transformations.
Is there way how to force spark to actually execute this transformation and
not use any action?
If you just want the transformation to run without returning anything, such as
for benchmarking, you can use graph.partitionBy(...).foreachPartition(x = {}).
Ankur
-
To unsubscribe, e-mail: user-unsubscr...@spark.apache.org
For additional commands, e-mail: user-h...@spark.apache.org
