[ https://issues.apache.org/jira/browse/SPARK-39921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
wang-zhun updated SPARK-39921: ------------------------------ Description: There is data skew in BroadcastJoin. Since LocalShuffle cannot cover all cases, we can refer to the solution of SortMergeJoin skew to consider solving the data skew problem in BroadcastJoin. h3. senairo !1.png! !2.png! h3. Effect !4.png! !3.png! was: There is data skew in BroadcastJoin. Since LocalShuffle cannot cover all cases, we can refer to the solution of SortMergeJoin skew to consider solving the data skew problem in BroadcastJoin. h3. senairo !https://git.n.xiaomi.com/computing/spark/uploads/ee0bf49e1c2a378592c6885c1a37a14c/image.png! h3. !image-2022-07-29-14-52-10-659.png! h3. Effect !image-2022-07-29-14-53-27-021.png! !image-2022-07-29-14-52-58-810.png! > SkewJoin--Stream side skew in BroadcastJoin > ------------------------------------------- > > Key: SPARK-39921 > URL: https://issues.apache.org/jira/browse/SPARK-39921 > Project: Spark > Issue Type: Improvement > Components: SQL > Affects Versions: 3.1.2 > Reporter: wang-zhun > Priority: Major > Fix For: 3.1.2, 3.3.0 > > Attachments: 1.png, 2.png, 3.png, 4.png > > > There is data skew in BroadcastJoin. Since LocalShuffle cannot cover all > cases, we can refer to the solution of SortMergeJoin skew to consider solving > the data skew problem in BroadcastJoin. > h3. senairo > !1.png! > !2.png! > h3. Effect > !4.png! > !3.png! -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org