[ https://issues.apache.org/jira/browse/SPARK-2944?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Xiangrui Meng resolved SPARK-2944. ---------------------------------- Resolution: Cannot Reproduce Closing this one now because I couldn't find an easy way to reproduce this issue. > sc.makeRDD doesn't distribute partitions evenly > ----------------------------------------------- > > Key: SPARK-2944 > URL: https://issues.apache.org/jira/browse/SPARK-2944 > Project: Spark > Issue Type: Bug > Components: Spark Core > Affects Versions: 1.1.0 > Reporter: Xiangrui Meng > Assignee: Xiangrui Meng > > 16 nodes EC2 cluster: > {code} > val rdd = sc.makeRDD(0 until 1e9.toInt, 1000).cache() > rdd.count() > {code} > Saw 156 partitions on one node while only 8 partitions on another. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org