[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-02 Thread jason-dai
Github user jason-dai commented on the pull request: https://github.com/apache/spark/pull/3549#issuecomment-65343799 Maybe we can try something like: class ZippedPartitionsRDD2 (sc, f, …) { val cleanF(part1, part2, ctx) = sc.clean(f(rdd1.iterator(part1, ctx), r

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-02 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/3549#issuecomment-65336297 Thanks, merged into master and branch-1.2. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-02 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/3549 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-02 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3549#issuecomment-65316895 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/24

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3549#issuecomment-65316886 [Test build #24056 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24056/consoleFull) for PR 3549 at commit [`d1aa8d8`](https://gith

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-02 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/3549#issuecomment-65304304 [Test build #24056 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/24056/consoleFull) for PR 3549 at commit [`d1aa8d8`](https://githu

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-02 Thread ankurdave
Github user ankurdave commented on the pull request: https://github.com/apache/spark/pull/3549#issuecomment-65303586 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/3549#issuecomment-65188935 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your pro

[GitHub] spark pull request: [SPARK-4672][GraphX]Perform checkpoint() on Pa...

2014-12-01 Thread JerryLead
GitHub user JerryLead opened a pull request: https://github.com/apache/spark/pull/3549 [SPARK-4672][GraphX]Perform checkpoint() on PartitionsRDD to shorten the lineage The related JIRA is https://issues.apache.org/jira/browse/SPARK-4672 Iterative GraphX applications al