[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/10864 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-185450619 LGTM, so I'm merging this to master. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-182587983 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-182593835 **[Test build #51054 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51054/consoleFull)** for PR 10864 at commit [`d768182`](https://github.com/apache/spark/commit/d768182f0f4efaee1d55fd6704caa070609ce158). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-182632354 **[Test build #51054 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/51054/consoleFull)** for PR 10864 at commit [`d768182`](https://github.com/apache/spark/commit/d768182f0f4efaee1d55fd6704caa070609ce158). * This patch passes all tests. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-182632545 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-182632547 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/51054/ Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user shijinkui commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-175477733 @JoshRosen fix checkstyle failure, please retest it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user shijinkui commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-175317509 test it --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user JoshRosen commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-175333456 Jenkins, retest this please. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-175340161 **[Test build #50154 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50154/consoleFull)** for PR 10864 at commit [`04c4ef4`](https://github.com/apache/spark/commit/04c4ef47c2fa9268bab26d676bbb3f4780a5d1a9). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-175340989 **[Test build #50154 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/50154/consoleFull)** for PR 10864 at commit [`04c4ef4`](https://github.com/apache/spark/commit/04c4ef47c2fa9268bab26d676bbb3f4780a5d1a9). * This patch **fails Scala style tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-175340999 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/50154/ Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-175340997 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174622929 **[Test build #2456 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2456/consoleFull)** for PR 10864 at commit [`2de63ec`](https://github.com/apache/spark/commit/2de63ecdfa8c7b0241587c0f9bb7d3f2edd4f7ce). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174624509 **[Test build #2456 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2456/consoleFull)** for PR 10864 at commit [`2de63ec`](https://github.com/apache/spark/commit/2de63ecdfa8c7b0241587c0f9bb7d3f2edd4f7ce). * This patch **fails to build**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
GitHub user shijinkui reopened a pull request: https://github.com/apache/spark/pull/10864 [SPARK-12953][Examples]RDDRelation writer set overwrite mode https://issues.apache.org/jira/browse/SPARK-12953 fix error when run RDDRelation.main(): "path file:/Users/sjk/pair.parquet already exists" Set DataFrameWriter's mode to SaveMode.Overwrite You can merge this pull request into a Git repository by running: $ git pull https://github.com/shijinkui/spark set_mode Alternatively you can review and apply these changes as the patch at: https://github.com/apache/spark/pull/10864.patch To close this pull request, make a commit to your master/trunk branch with (at least) the following in the commit message: This closes #10864 commit 958a419877e36ad0d3987e83e56b6007937334e8 Author: shijinkuiDate: 2016-01-21T08:56:26Z fix error when run RDDRelation.main():"path file:/Users/sjk/pair.parquet already exists" Setting DataFrameWriter's mode to `SaveMode.Overwrite` commit 2de63ecdfa8c7b0241587c0f9bb7d3f2edd4f7ce Author: shijinkui Date: 2016-01-25T16:13:21Z import order --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user shijinkui commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174562740 hi, @rxin, I have reopened, please trigger the test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174442060 That's fair -- if you reopen I can merge it provided that tests pass. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174442347 **[Test build #2452 has started](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2452/consoleFull)** for PR 10864 at commit [`958a419`](https://github.com/apache/spark/commit/958a419877e36ad0d3987e83e56b6007937334e8). --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174442760 **[Test build #2452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/2452/consoleFull)** for PR 10864 at commit [`958a419`](https://github.com/apache/spark/commit/958a419877e36ad0d3987e83e56b6007937334e8). * This patch **fails Scala style tests**. * This patch merges cleanly. * This patch adds no public classes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user shijinkui commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174383417 @rxin This case throw exception at the second time of running. Unit test is import to project, example is useful for spark user. :) this problem is not important and critical, if can be fixed by the way, maybe better for user :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user shijinkui closed the pull request at: https://github.com/apache/spark/pull/10864 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174142956 Thanks for submitting a patch. However, I don't think these examples are here for you to keep running them -- it is just an example. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-174142968 Can you close this pull request? Thanks. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org
[GitHub] spark pull request: [SPARK-12953][Examples]RDDRelation writer set ...
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/10864#issuecomment-173506209 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enabled but not working, please contact infrastructure at infrastruct...@apache.org or file a JIRA ticket with INFRA. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org