Thanks for creating this FLIP. @Xia +1 for this proposal. Dynamic parallelism inference can be helpful to decide a better parallelism. And it's good to unify the settings of static & dynamic parallelism inference.
Thanks, Zhu Xia Sun <xingbe...@gmail.com> 于2024年4月16日周二 15:12写道： > Hi everyone, > I would like to start a discussion on FLIP-445: Support dynamic parallelism > inference for HiveSource[1]. > > FLIP-379[2] has introduced dynamic source parallelism inference for batch > jobs, which can utilize runtime information to more accurately decide the > source parallelism. As a follow-up task, we plan to implement the dynamic > parallelism inference interface for HiveSource, and also switch the default > static parallelism inference to dynamic parallelism inference. > > Looking forward to your feedback and suggestions, thanks. > > [1] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-445%3A+Support+dynamic+parallelism+inference+for+HiveSource > [2] > > https://cwiki.apache.org/confluence/display/FLINK/FLIP-379%3A+Dynamic+source+parallelism+inference+for+batch+jobs > > Best regards, > Xia >
