val rdd2 = rdd.partitionBy(my partitioner).reduceByKey(some function)

I see that rdd2's partitions are not internally sorted. Can someone confirm
that this is expected behavior? And if so, the only way to get partitions
internally sorted is to follow it with something like this

val rdd2 = rdd.partitionBy(my partitioner).reduceByKey(some
function).mapPartitions(p => sort(p))

Thanks,
Ameet

Reply via email to