[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699874#comment-17699874 ] Apache Spark commented on SPARK-21782: -- User 'megaserg' has created a pull request for this issue:

[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2023-03-13 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17699875#comment-17699875 ] Apache Spark commented on SPARK-21782: -- User 'megaserg' has created a pull request for this issue:

[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2017-08-18 Thread Sergey Serebryakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131865#comment-16131865 ] Sergey Serebryakov commented on SPARK-21782: I played with Scala's `hashing.byteswap32()` and

[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2017-08-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131818#comment-16131818 ] Sean Owen commented on SPARK-21782: --- I think scrambling the seed a bit is the smallest change that

[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2017-08-18 Thread Sergey Serebryakov (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131794#comment-16131794 ] Sergey Serebryakov commented on SPARK-21782: Your understanding is correct. Either reusing

[jira] [Commented] (SPARK-21782) Repartition creates skews when numPartitions is a power of 2

2017-08-18 Thread Sean Owen (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16131784#comment-16131784 ] Sean Owen commented on SPARK-21782: --- Is the problem summary just: with a power of 2 bound, similar