[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-22 Thread naliazheli
Github user naliazheli commented on the issue: https://github.com/apache/spark/pull/15517 dataset.checkpoint is what i need. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enab

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-21 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15517 I'm closing this since caching is not the ultimate solution for this problem anyway. Caching is too memory consuming when you, say, computing connected components in an iterative way over a graph

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-19 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15517 The most recent version still breaks some test cases related to caching. Investigating it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub a

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15517 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-19 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15517 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67208/ Test FAILed. ---

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15517 **[Test build #67208 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67208/consoleFull)** for PR 15517 at commit [`fffbd69`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-19 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15517 **[Test build #67208 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67208/consoleFull)** for PR 15517 at commit [`fffbd69`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-19 Thread yhuai
Github user yhuai commented on the issue: https://github.com/apache/spark/pull/15517 cc @mengxr and @jkbradley --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15517 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/67120/ Test FAILed. ---

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15517 **[Test build #67120 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67120/consoleFull)** for PR 15517 at commit [`e1283a8`](https://github.com/apache/spark/commit/

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-18 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15517 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature e

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-18 Thread liancheng
Github user liancheng commented on the issue: https://github.com/apache/spark/pull/15517 The previous test failure was because we replace the analyzed plan with `withCacheData`, while cache manager uses the original analyzed plan as keys. Force-pushed a new and much simpler ap

[GitHub] spark issue #15517: [SPARK-17972][SQL] Build Datasets upon `withCachedData` ...

2016-10-18 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15517 **[Test build #67120 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/67120/consoleFull)** for PR 15517 at commit [`e1283a8`](https://github.com/apache/spark/commit/e