Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/21698 > What happened to the other pr proposal of just using the hashPartitioner? It's not able to handle the use case when we use `repartition()` to shuffle skewed data, so we give up on that way.
--- --------------------------------------------------------------------- To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org