No - the vertices are hash-partitioned onto workers independently of the
edges. It would be nice for each vertex to be on the worker with the most
adjacent edges, but we haven't done this yet since it would add a lot of
complexity to avoid load imbalance while reducing the overall communication
by
...@yahoo.com
Cc: dev@spark.apache.org dev@spark.apache.org
Sent: Monday, January 19, 2015 2:08 PM
Subject: Re: GraphX vertex partition/location strategy
No - the vertices are hash-partitioned onto workers independently of the edges.
It would be nice for each vertex to be on the worker
Does GraphX make an effort to co-locate vertices onto the same workers as the
majority (or even some) of its edges?
-
To unsubscribe, e-mail: dev-unsubscr...@spark.apache.org
For additional commands, e-mail:
