advancedxy commented on issue #838: URL: https://github.com/apache/incubator-uniffle/issues/838#issuecomment-1519041507
> For a pity, sometimes the partial partition is so huge, but the broadcastHashJoin won't optimize skew join. This optimization will be solved by spark community ASSP If skewed join should not be converted into broadcast join, users should disable broadcast join or lower threshold for broadcast join by tweaking relating configurations. I didn't see how that a spark patch is related, even if the patch was to release users from manually setting here, I don't think the patch belongs to Uniffle's project. However we can add documentations about that cases. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
