[jira] [Commented] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-08-06 Thread Apache Spark (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570573#comment-16570573 ] Apache Spark commented on SPARK-21436: -- User 'holdenk' has created a pull request for this issue:

[jira] [Commented] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-08-06 Thread holdenk (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16570517#comment-16570517 ] holdenk commented on SPARK-21436: - @[~podongfeng]  So distinct triggers a `map` first (e.g. it is

[jira] [Commented] (SPARK-21436) Take advantage of known partioner for distinct on RDDs

2018-07-26 Thread zhengruifeng (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16558013#comment-16558013 ] zhengruifeng commented on SPARK-21436: -- [~holdenk] It looks like that \{distinct} already utilized