Hi Mailing list,
using a RichMapPartitionFunction i can access the total number m of this mapper
utilized in my job with
int m = getRuntimeContext().getNumberOfParallelSubtasks();
I think that would be - in general - the total number of CPU Cores used by
Apache Flink among the cluster.
Is there a way to access the number of the following reducer?
In general i would assume that the number of the following reducers depends on
the number of groups generated by the groupBy() transformation. So the number
of the reducer r would be 1 <= r <= m.
My Job:
DataSet<?> output = input
.mapPartition(new MR_GPMRS_Mapper())
.groupBy(0)
.reduceGroup(new MR_GPMRS_Reducer());
Thank you in advance
Robert