Github user jiangxb1987 commented on the issue:

    https://github.com/apache/spark/pull/21698
  
    > What happened to the other pr proposal of just using the hashPartitioner? 
    
    It's not able to handle the use case when we use `repartition()` to shuffle 
skewed data, so we give up on that way.


---

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org
For additional commands, e-mail: reviews-h...@spark.apache.org

Reply via email to