Hi,
I'm not sure aggregators require necessarily high traffic. Aggregators are
aggregated locally on the worker before they are aggregated on the
(corresponding) master worker.
Anyway, assuming you want to proceed, my understanding is that you want
vertices on the same worker to share
Hi,
There are two interfaces:
WorkerGraphPartitioner - Maps vertexes to partitions
MasterGraphPartitioner - Maps partitions to workers.
So you need custom MasterGraphPartitioner.
You dont need any external preprocessing step.
Lukas
On 25.3.2015 19:51, Arjun Sharma wrote:
Hi,
I understand we
Hi Steve,
Thanks for the link - there's a different error I get now regarding not
finding some other classes,
but ive seen that before and should be able to find a fix.
Running PageRank however, still gives me the *localJobRunner* error (above)
- did you get that to run
successfully?
Thanks,
Hi,
I understand we can override the GraphPartitionerFactory class in order to
achieve custom partitioning of vertices over partitions. Is there a way to
do the same to enable assigning partitions to workers in a custom way
(e.g., partition n should be assigned to worker m)? The reason is that it
Its same.
GraphPartitionerFactory has got two methods. One for
WorkerGraphPartitioner and second for MasterGraphPartitioner.
public interface GraphPartitionerFactory ... {
MasterGraphPartitionerI, V, E createMasterGraphPartitioner();
WorkerGraphPartitionerI, V, E
