[jira] [Commented] (SPARK-5954) Add topByKey to pair RDDs
[ https://issues.apache.org/jira/browse/SPARK-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14376215#comment-14376215 ] Xiangrui Meng commented on SPARK-5954: -- Note: We added topByKey in mllib.rdd.MLPairRDDFunctions instead of in Core. > Add topByKey to pair RDDs > - > > Key: SPARK-5954 > URL: https://issues.apache.org/jira/browse/SPARK-5954 > Project: Spark > Issue Type: New Feature > Components: Spark Core >Reporter: Xiangrui Meng >Assignee: Shuo Xiang > Fix For: 1.4.0 > > > `topByKey(num: Int): RDD[(K, V)]` finds the top-k values for each key in a > pair RDD. This is used, e.g., in computing top recommendations. We can use > the Guava implementation of finding top-k from an iterator. See also > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/collection/Utils.scala. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5954) Add topByKey to pair RDDs
[ https://issues.apache.org/jira/browse/SPARK-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14366081#comment-14366081 ] Apache Spark commented on SPARK-5954: - User 'coderxiang' has created a pull request for this issue: https://github.com/apache/spark/pull/5075 > Add topByKey to pair RDDs > - > > Key: SPARK-5954 > URL: https://issues.apache.org/jira/browse/SPARK-5954 > Project: Spark > Issue Type: New Feature > Components: Spark Core >Reporter: Xiangrui Meng >Assignee: Shuo Xiang > > `topByKey(num: Int): RDD[(K, V)]` finds the top-k values for each key in a > pair RDD. This is used, e.g., in computing top recommendations. We can use > the Guava implementation of finding top-k from an iterator. See also > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/collection/Utils.scala. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Commented] (SPARK-5954) Add topByKey to pair RDDs
[ https://issues.apache.org/jira/browse/SPARK-5954?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14364703#comment-14364703 ] Reynold Xin commented on SPARK-5954: Shouldn't this just be an API in dataframe? > Add topByKey to pair RDDs > - > > Key: SPARK-5954 > URL: https://issues.apache.org/jira/browse/SPARK-5954 > Project: Spark > Issue Type: New Feature > Components: Spark Core >Reporter: Xiangrui Meng >Assignee: Shuo Xiang > > `topByKey(num: Int): RDD[(K, V)]` finds the top-k values for each key in a > pair RDD. This is used, e.g., in computing top recommendations. We can use > the Guava implementation of finding top-k from an iterator. See also > https://github.com/apache/spark/blob/master/core/src/main/scala/org/apache/spark/util/collection/Utils.scala. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
