advancedxy commented on issue #407: URL: https://github.com/apache/incubator-uniffle/issues/407#issuecomment-1350436759
> > Also another question, in which cases AQE would trigger reading the same partition many times? I know the `OptimizeSkewedJoin` would split the same partition into multiple parts, and therefore trigger the behavior you described. > > Is there any other cases? > > rebalance could you elaborate it a bit more? Do you mean `OptimizeSkewInRebalancePartitions`? I just checked the code and I believe the optimization rule is only applied when user rebalances output and there's indeed some skew partitions. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
