Github user koertkuipers commented on the pull request:
https://github.com/apache/spark/pull/2963#issuecomment-67754464
i am going to close this pullreq. i hope to pick up foldLeft later again
(together with a proper java version), but for SPARK-3655 the focus for now is
on:
https
Github user koertkuipers closed the pull request at:
https://github.com/apache/spark/pull/2963
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature i
Github user koertkuipers commented on the pull request:
https://github.com/apache/spark/pull/2963#issuecomment-65828969
Hey @zsxwing,
In Scala Seq the order in which the values get processed in foldLeft is
well defined.
But can we make any assumptions at all about the ordering
Github user koertkuipers commented on a diff in the pull request:
https://github.com/apache/spark/pull/2963#discussion_r21387829
--- Diff: core/src/main/scala/org/apache/spark/rdd/PairRDDFunctions.scala
---
@@ -460,6 +461,63 @@ class PairRDDFunctions[K, V](self: RDD[(K, V)])
Github user AmplabJenkins commented on the pull request:
https://github.com/apache/spark/pull/2963#issuecomment-60665549
Can one of the admins verify this patch?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your pro
GitHub user koertkuipers opened a pull request:
https://github.com/apache/spark/pull/2963
add foldLeftByKey to PairRDDFunctions for reduce algorithms that by key ...
...need to process values in a particular order
see:
https://issues.apache.org/jira/browse/SPARK-3655