Hi dev, I'd like to start a discussion for FLIP-209 [1] which aims to support to run multiple shuffle plugins in one session cluster. Currently, one Flink cluster can only use one shuffle service plugin configured by 'shuffle-service-factory.class'. It is not flexible enough and cannot support use cases like selecting different shuffle service for different workloads (e.g. batch vs. streaming). This feature has been mentioned for several times [2] and FLIP-209 aims to implement it.
Please refer to FLIP-209 [1] for more details and any feedback is highly appreciated. Best, Yingjie [1] https://cwiki.apache.org/confluence/display/FLINK/FLIP-209%3A+Support+to+run+multiple+shuffle+plugins+in+one+session+cluster?moved=true [2] https://lists.apache.org/thread/k4owttq9q3cq4knoobrzc31bghf7vc0o
