[ https://issues.apache.org/jira/browse/SPARK-17447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15474375#comment-15474375 ]
Sean Owen commented on SPARK-17447: ----------------------------------- Why don't they need to be sorted? > performance improvement in Partitioner.DefaultPartitioner > ---------------------------------------------------------- > > Key: SPARK-17447 > URL: https://issues.apache.org/jira/browse/SPARK-17447 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Affects Versions: 2.0.0 > Reporter: WangJianfei > Labels: performance > Original Estimate: 1h > Remaining Estimate: 1h > > if there are many rdds in some situations,the sort will loss he performance > servely,actually we needn't sort the rdds , we can just scan the rdds one > time to gain the same goal. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org