[GitHub] spark pull request: [SPARK-14642][SQL] import org.apache.spark.sql...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12458#issuecomment-217699238 **[Test build #58093 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58093/consoleFull)** for PR 12458 at commit [`0d2310f`](https://g

[GitHub] spark pull request: [SPARK-14642][SQL] import org.apache.spark.sql...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12458#issuecomment-217699240 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14642][SQL] import org.apache.spark.sql...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12458#issuecomment-217699239 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217699205 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15210][SQL] Add missing @DeveloperApi a...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12982#issuecomment-217699194 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217699207 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15210][SQL] Add missing @DeveloperApi a...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12982#issuecomment-217699193 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217699173 **[Test build #58091 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58091/consoleFull)** for PR 12956 at commit [`b40fd4b`](https://g

[GitHub] spark pull request: [SPARK-14642][SQL] import org.apache.spark.sql...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12458#issuecomment-217699183 **[Test build #58093 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58093/consoleFull)** for PR 12458 at commit [`0d2310f`](https://gi

[GitHub] spark pull request: [SPARK-15210][SQL] Add missing @DeveloperApi a...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12982#issuecomment-217699158 **[Test build #58090 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58090/consoleFull)** for PR 12982 at commit [`158fe63`](https://g

[GitHub] spark pull request: [SPARK-14642][SQL] import org.apache.spark.sql...

2016-05-07 Thread zsxwing
Github user zsxwing commented on the pull request: https://github.com/apache/spark/pull/12458#issuecomment-217699068 ok to test --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark pull request: [SPARK-12479][SPARKR] sparkR collect on Groupe...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12976#issuecomment-217699029 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-12479][SPARKR] sparkR collect on Groupe...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12976#issuecomment-217699028 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-12479][SPARKR] sparkR collect on Groupe...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12976#issuecomment-217699014 **[Test build #58092 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58092/consoleFull)** for PR 12976 at commit [`aa1f664`](https://g

[GitHub] spark pull request: [SPARK-12479][SPARKR] sparkR collect on Groupe...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12976#issuecomment-217698395 **[Test build #58092 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58092/consoleFull)** for PR 12976 at commit [`aa1f664`](https://gi

[GitHub] spark pull request: [SPARK-12479][SPARKR] sparkR collect on Groupe...

2016-05-07 Thread sun-rui
Github user sun-rui commented on the pull request: https://github.com/apache/spark/pull/12976#issuecomment-217698338 @shivaram, added a test case --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Update OneVsRest E...

2016-05-07 Thread MLnick
Github user MLnick commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217692278 Just use accuracy I think similar to the decision tree example On Sun, 8 May 2016 at 04:21, Ruifeng Zheng wrote: > @MLnick M

[GitHub] spark pull request: [SPARK-15210][SQL] Add missing @DeveloperApi a...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12982#issuecomment-217692283 **[Test build #58090 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58090/consoleFull)** for PR 12982 at commit [`158fe63`](https://gi

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217692284 **[Test build #58091 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58091/consoleFull)** for PR 12956 at commit [`b40fd4b`](https://gi

[GitHub] spark pull request: [SPARK-15210][SQL] Add missing @DeveloperApi a...

2016-05-07 Thread zhengruifeng
GitHub user zhengruifeng opened a pull request: https://github.com/apache/spark/pull/12982 [SPARK-15210][SQL] Add missing @DeveloperApi annotation in sql.types ## What changes were proposed in this pull request? add @DeveloperApi annotation for `AbstractDataType` `MapType` `User

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217691066 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217691065 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217691058 **[Test build #58089 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58089/consoleFull)** for PR 12927 at commit [`0191d6a`](https://g

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217690886 **[Test build #58089 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58089/consoleFull)** for PR 12927 at commit [`0191d6a`](https://gi

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217690734 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217690728 **[Test build #58088 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58088/consoleFull)** for PR 12927 at commit [`8625754`](https://g

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217690733 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15150][EXAMPLE][DOC] Add python example...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12927#issuecomment-217690544 **[Test build #58088 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58088/consoleFull)** for PR 12927 at commit [`8625754`](https://gi

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12980#issuecomment-217690316 Definitely, the failure is not related to this PR since this PR just adds `.travis.yml` file. ``` [error] (mllib/test:test) sbt.TestsFailedException: Tests

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217690214 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217690194 **[Test build #58083 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58083/consoleFull)** for PR 12956 at commit [`ff1b7d0`](https://g

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217690215 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [WIP][SPARK-15208][Core][Streaming][Docs] Upda...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12981#issuecomment-217690030 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [WIP][SPARK-15208][Core][Streaming][Docs] Upda...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12981#issuecomment-217690032 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [WIP][SPARK-15208][Core][Streaming][Docs] Upda...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12981#issuecomment-217690006 **[Test build #58087 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58087/consoleFull)** for PR 12981 at commit [`2d51982`](https://g

[GitHub] spark pull request: [WIP][SPARK-15208][Core][Streaming][Docs] Upda...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12981#issuecomment-217689797 **[Test build #58087 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58087/consoleFull)** for PR 12981 at commit [`2d51982`](https://gi

[GitHub] spark pull request: [WIP][SPARK-15208][Core][Docs] Update spark ex...

2016-05-07 Thread lw-lin
Github user lw-lin commented on the pull request: https://github.com/apache/spark/pull/12981#issuecomment-217689734 Once the AccumulatorV2 Java API is finalized, I would update the Java & Python part. Thanks --- If your project is set up for it, you can reply to this email and have y

[GitHub] spark pull request: [WIP][SPARK-15208][Core][Docs] Update spark ex...

2016-05-07 Thread lw-lin
GitHub user lw-lin opened a pull request: https://github.com/apache/spark/pull/12981 [WIP][SPARK-15208][Core][Docs] Update spark examples with AccumulatorV2 ## What changes were proposed in this pull request? The patch updates the codes & docs in the example module as well a

[GitHub] spark pull request: [SPARK-15136][PySpark][DOC] Fix links to sphin...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217689572 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15136][PySpark][DOC] Fix links to sphin...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217689573 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15136][PySpark][DOC] Fix links to sphin...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217689560 **[Test build #58086 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58086/consoleFull)** for PR 12918 at commit [`bfdcbe3`](https://g

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12980#issuecomment-217689272 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12980#issuecomment-217689275 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12980#issuecomment-217689064 **[Test build #58080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58080/consoleFull)** for PR 12980 at commit [`6063822`](https://g

[GitHub] spark pull request: [SPARK-15092][SPARK-15139][PYSPARK][ML] Pyspar...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12919#issuecomment-217688792 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15092][SPARK-15139][PYSPARK][ML] Pyspar...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12919#issuecomment-217688781 **[Test build #58085 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58085/consoleFull)** for PR 12919 at commit [`5f8b0ce`](https://g

[GitHub] spark pull request: [SPARK-15092][SPARK-15139][PYSPARK][ML] Pyspar...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12919#issuecomment-217688791 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15136][PySpark][DOC] Fix links to sphin...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12918#issuecomment-217688690 **[Test build #58086 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58086/consoleFull)** for PR 12918 at commit [`bfdcbe3`](https://gi

[GitHub] spark pull request: [SPARK-15092][SPARK-15139][PYSPARK][ML] Pyspar...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12919#issuecomment-217688416 **[Test build #58085 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58085/consoleFull)** for PR 12919 at commit [`5f8b0ce`](https://gi

[GitHub] spark pull request: [SPARK-15149][EXAMPLE][DOC] update kmeans exam...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12925#issuecomment-217688383 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15149][EXAMPLE][DOC] update kmeans exam...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12925#issuecomment-217688382 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15149][EXAMPLE][DOC] update kmeans exam...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12925#issuecomment-217688370 **[Test build #58084 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58084/consoleFull)** for PR 12925 at commit [`d91cbe9`](https://g

[GitHub] spark pull request: [SPARK-15094][SPARK-14803][SQL] Add ObjectProj...

2016-05-07 Thread viirya
Github user viirya commented on the pull request: https://github.com/apache/spark/pull/12926#issuecomment-217688312 @cloud-fan ok. let me try it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not ha

[GitHub] spark pull request: [SPARK-15092][PySpark][ML] Add toDebugString t...

2016-05-07 Thread holdenk
Github user holdenk closed the pull request at: https://github.com/apache/spark/pull/12937 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is en

[GitHub] spark pull request: [SPARK-15092][PySpark][ML] Add toDebugString t...

2016-05-07 Thread holdenk
Github user holdenk commented on the pull request: https://github.com/apache/spark/pull/12937#issuecomment-217688189 Closing and merging into https://github.com/apache/spark/pull/12919 --- If your project is set up for it, you can reply to this email and have your reply appear on GitH

[GitHub] spark pull request: [SPARK-14340][DOC] Add Scala Example and User ...

2016-05-07 Thread zhengruifeng
Github user zhengruifeng commented on the pull request: https://github.com/apache/spark/pull/11844#issuecomment-217688171 @MLnick I updated the PRs of KMeans and BisectingKMeans to directly load data file `data/mllib/sample_kmeans_data.txt`. However, due to issue in `spark.read.for

[GitHub] spark pull request: [SPARK-15149][EXAMPLE][DOC] update kmeans exam...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12925#issuecomment-217688139 **[Test build #58084 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58084/consoleFull)** for PR 12925 at commit [`d91cbe9`](https://gi

[GitHub] spark pull request: [SPARK-15180][SQL] Support subexpression elimi...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12956#issuecomment-217688141 **[Test build #58083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58083/consoleFull)** for PR 12956 at commit [`ff1b7d0`](https://gi

[GitHub] spark pull request: [SPARK-15195][PySpark][DOCS] Update ml.tuning ...

2016-05-07 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/12967#discussion_r62425641 --- Diff: python/pyspark/ml/tuning.py --- @@ -143,6 +145,8 @@ def getEvaluator(self): class CrossValidator(Estimator, ValidatorParams): ""

[GitHub] spark pull request: [SPARK-15149][EXAMPLE][DOC] update kmeans exam...

2016-05-07 Thread zhengruifeng
Github user zhengruifeng commented on the pull request: https://github.com/apache/spark/pull/12925#issuecomment-217688076 `data/mllib/sample_kmeans_data.txt` was created in [BisectingKMeans examples](https://github.com/apache/spark/pull/11844) --- If your project is set up for it, yo

[GitHub] spark pull request: [SPARK-14340][DOC] Add Scala Example and User ...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11844#issuecomment-217687880 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14340][DOC] Add Scala Example and User ...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/11844#issuecomment-217687879 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14340][DOC] Add Scala Example and User ...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11844#issuecomment-217687810 **[Test build #58081 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58081/consoleFull)** for PR 11844 at commit [`d3a0be1`](https://g

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Add python example...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217686125 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Add python example...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217686124 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Add python example...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217686109 **[Test build #58082 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58082/consoleFull)** for PR 12920 at commit [`af95019`](https://g

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Add python example...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217685059 **[Test build #58082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58082/consoleFull)** for PR 12920 at commit [`af95019`](https://gi

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12980#issuecomment-217683635 Hi, @rxin and @andrewor14 . I think this is the only way to re-enable Java linter. --- If your project is set up for it, you can reply to this email and have

[GitHub] spark pull request: [SPARK-15205][SQL][WIP] Codegen can compile mo...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12979#issuecomment-217683640 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-15205][SQL][WIP] Codegen can compile mo...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12979#issuecomment-217683639 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-15205][SQL][WIP] Codegen can compile mo...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12979#issuecomment-217683613 **[Test build #58079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58079/consoleFull)** for PR 12979 at commit [`766f5c6`](https://g

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12980#issuecomment-217683609 Travis CI passed. It took less than 25 minutes. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If

[GitHub] spark pull request: [SPARK-15141][EXAMPLE][DOC] Add python example...

2016-05-07 Thread zhengruifeng
Github user zhengruifeng commented on the pull request: https://github.com/apache/spark/pull/12920#issuecomment-217683598 @MLnick `MulticlassClassificationEvaluator` do not support `confusionMatrix` not. So I will just remove the computaion of `confusionMatrix`. --- If your project

[GitHub] spark pull request: [SPARK-14340][DOC] Add Scala Example and User ...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/11844#issuecomment-217683538 **[Test build #58081 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58081/consoleFull)** for PR 11844 at commit [`d3a0be1`](https://gi

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12980#issuecomment-217682754 **[Test build #58080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58080/consoleFull)** for PR 12980 at commit [`6063822`](https://gi

[GitHub] spark pull request: [SPARK-15207][BUILD] Use Travis CI for Java/Sc...

2016-05-07 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/12980 [SPARK-15207][BUILD] Use Travis CI for Java/Scala/Python Linter and JDK7/8 compilation test ## What changes were proposed in this pull request? Currently, Java Linter is disabled due

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217679449 Since `CleanupAliases` already handles all the corner cases safely, `FoldablePropagate` optimizer becomes now amazingly simple with one rule: `AttributeReference`

[GitHub] spark pull request: [SPARK-15205][SQL][WIP] Codegen can compile mo...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12979#issuecomment-217679242 **[Test build #58079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58079/consoleFull)** for PR 12979 at commit [`766f5c6`](https://gi

[GitHub] spark pull request: [SPARK-15205][SQL][WIP] Codegen can compile mo...

2016-05-07 Thread sarutak
GitHub user sarutak opened a pull request: https://github.com/apache/spark/pull/12979 [SPARK-15205][SQL][WIP] Codegen can compile more than twice for the same source code ## What changes were proposed in this pull request? Sometimes, we have generated codes they are equal e

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217678394 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217678395 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217678370 **[Test build #58078 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58078/consoleFull)** for PR 12719 at commit [`2f86364`](https://g

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217673764 **[Test build #58078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58078/consoleFull)** for PR 12719 at commit [`2f86364`](https://gi

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217673741 This is the example of DDL command failures: PartitionColumn [a#0] is replaced with [1 AS a#3]. ``` InsertIntoHadoopFsRelation file:/private/var/folders/d

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217669798 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217669799 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217669765 **[Test build #58077 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58077/consoleFull)** for PR 12719 at commit [`1b66b0a`](https://g

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217668923 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread AmplabJenkins
Github user AmplabJenkins commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217668921 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your projec

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217668878 **[Test build #58076 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58076/consoleFull)** for PR 12719 at commit [`7ced114`](https://g

[GitHub] spark pull request: Remove unnecessary things from SparkEnv

2016-05-07 Thread ajbozarth
Github user ajbozarth commented on the pull request: https://github.com/apache/spark/pull/12970#issuecomment-217668698 Updated the description with more detail --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your proje

[GitHub] spark pull request: [SPARK-13566][CORE] Avoid deadlock between Blo...

2016-05-07 Thread cenyuhai
Github user cenyuhai closed the pull request at: https://github.com/apache/spark/pull/11546 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is e

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217666795 **[Test build #58077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58077/consoleFull)** for PR 12719 at commit [`1b66b0a`](https://gi

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread SparkQA
Github user SparkQA commented on the pull request: https://github.com/apache/spark/pull/12719#issuecomment-217665830 **[Test build #58076 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/58076/consoleFull)** for PR 12719 at commit [`7ced114`](https://gi

[GitHub] spark pull request: [SPARK-15178][CORE] Remove LazyFileRegion inst...

2016-05-07 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/12977 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is ena

[GitHub] spark pull request: [SPARK-15178][CORE] Remove LazyFileRegion inst...

2016-05-07 Thread rxin
Github user rxin commented on the pull request: https://github.com/apache/spark/pull/12977#issuecomment-217664194 LGTM - merging in master / branch-2.0. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project doe

[GitHub] spark pull request: [SPARK-14939][SQL] Add FoldablePropagation opt...

2016-05-07 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/12719#discussion_r62421170 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala --- @@ -617,6 +618,77 @@ object NullPropagation extends

[GitHub] spark pull request: [SPARK-15196][SparkR] Add a wrapper for dapply...

2016-05-07 Thread NarineK
Github user NarineK commented on the pull request: https://github.com/apache/spark/pull/12966#issuecomment-217662459 Hi @sun-rui , I think it depends on how we do the repartitioning. It shouldn't be the case when we do it by : https://github.com/apache/spark/blob/master/sql/

[GitHub] spark pull request: [SPARK-14476][SQL] Improve the physical plan v...

2016-05-07 Thread yhuai
Github user yhuai commented on a diff in the pull request: https://github.com/apache/spark/pull/12947#discussion_r62420950 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/ExistingRDD.scala --- @@ -224,7 +236,9 @@ private[sql] case class BatchedDataSourceScanExec(

[GitHub] spark pull request: [SPARK-14958][Core] Failed task not handled wh...

2016-05-07 Thread markhamstra
Github user markhamstra commented on the pull request: https://github.com/apache/spark/pull/12775#issuecomment-217661490 Sorry, I haven't been completely clear while thinking through this issue. There are two basic considerations: 1) Is NoClassDefFoundError benign enough in this cont

  1   2   3   >