Hi, Till ~ Thanks for your comments. Yes, I think we are on the same page –
we are discussing how should JMPartitionTracker manage partitions properly ~
> If the ShuffleMaster should lose a result partition, then a reading task
should fail with a PartitionException which will invalidate the
Hi Jin,
thanks for starting this discussion and the initiative to implement a
remote shuffle service. It has always been the idea of the ShuffleService
abstraction to make this possible and we probably have overlooked some
details.
What I have understood from your description, you would like to
