Hi,

I am trying to change the mapping of partitions to workers in

createInitialPartitionOwners(Collection<WorkerInfo> availableWorkerInfos,
int maxWorkers) defined
in org.apache.giraph.partition.MasterGraphPartitionerImpl.java.

The first argument to this method is the list of available workers and each
worker has a task id associated with it.

When I am specifying the number of workers as 40, the task id are 1 to 40.

I have removed one node from the yarn-cluster by following this answer
https://stackoverflow.com/questions/41820759/how-to-separately-specify-a-set-of-nodes-for-hdfs-and-others-for-mapreduce-jobs
.

After this change, the task ids assigned to the workers are no longer
consecutive (e.g. for 40 workers the range of task id is 1- 43). Some
task-ids are excluded.

Is there any way to get these task ids strictly consecutive?

Thanks
Ravikant

Reply via email to