[GitHub] spark pull request #15788: [SPARK-18291][SparkR][ML] SparkR glm predict shou...

2016-11-05 Thread yanboliang
GitHub user yanboliang opened a pull request: https://github.com/apache/spark/pull/15788 [SPARK-18291][SparkR][ML] SparkR glm predict should output original label when family = binomial. ## What changes were proposed in this pull request? SparkR ```spark.glm``` predict should

[GitHub] spark issue #15787: [SPARK-18286][ML][WIP] Add Scala/Java/Python examples fo...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15787 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15773: [SPARK-18276][ML] ML models should copy the training sum...

2016-11-05 Thread yanboliang
Github user yanboliang commented on the issue: https://github.com/apache/spark/pull/15773 LGTM, merged into master and branch-2.1. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have

[GitHub] spark pull request #15773: [SPARK-18276][ML] ML models should copy the train...

2016-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15773 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark pull request #15787: [SPARK-18286][ML][WIP] Add Scala/Java/Python exam...

2016-11-05 Thread jiayuezhangsc
GitHub user jiayuezhangsc opened a pull request: https://github.com/apache/spark/pull/15787 [SPARK-18286][ML][WIP] Add Scala/Java/Python examples for MinHash and RandomProjection ## What changes were proposed in this pull request? Add Scala/Java/Python examples for MinHash

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #68227 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68227/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #15745: [SPARK-18207][SQL] Fix a compilation error due to HashEx...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15745 **[Test build #68226 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68226/consoleFull)** for PR 15745 at commit

[GitHub] spark issue #15745: [SPARK-18207][SQL] Fix a compilation error due to HashEx...

2016-11-05 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/15745 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark pull request #15546: [SPARK-17982][SQL] SQLBuilder should wrap the gen...

2016-11-05 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/15546#discussion_r86679323 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/catalyst/LogicalPlanToSQLSuite.scala --- @@ -45,7 +45,7 @@ class LogicalPlanToSQLSuite extends

[GitHub] spark issue #15786: [SPARK-18261][Structured Streaming] Add statistics to Me...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15786 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15786: [SPARK-18261][Structured Streaming] Add statistics to Me...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15786 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68221/ Test PASSed. ---

[GitHub] spark issue #15786: [SPARK-18261][Structured Streaming] Add statistics to Me...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15786 **[Test build #68221 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68221/consoleFull)** for PR 15786 at commit

[GitHub] spark issue #15745: [SPARK-18207][SQL] Fix a compilation error due to HashEx...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15745 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68223/ Test FAILed. ---

[GitHub] spark issue #15745: [SPARK-18207][SQL] Fix a compilation error due to HashEx...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15745 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15745: [SPARK-18207][SQL] Fix a compilation error due to HashEx...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15745 **[Test build #68223 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68223/consoleFull)** for PR 15745 at commit

[GitHub] spark issue #15546: [SPARK-17982][SQL] SQLBuilder should wrap the generated ...

2016-11-05 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15546 Will do the review soon. Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-05 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15688 Regarding the current code changes, LGTM Like what @cloud-fan said in the code comment, we need to decide whether we should follow Hive. --- If your project is set up for it, you can

[GitHub] spark pull request #15765: [MINOR][Documentation] Fix some minor description...

2016-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15765 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15765: [MINOR][Documentation] Fix some minor descriptions in fu...

2016-11-05 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/15765 Sure then. Merged to master/branch-2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this

[GitHub] spark issue #15767: [SPARK-18269][SQL] CSV datasource should read null prope...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15767 **[Test build #68225 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68225/consoleFull)** for PR 15767 at commit

[GitHub] spark issue #15767: [SPARK-18269][SQL] CSV datasource should read null prope...

2016-11-05 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/15767 retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes

[GitHub] spark issue #15767: [SPARK-18269][SQL] CSV datasource should read null prope...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15767 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15767: [SPARK-18269][SQL] CSV datasource should read null prope...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15767 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68222/ Test FAILed. ---

[GitHub] spark issue #15767: [SPARK-18269][SQL] CSV datasource should read null prope...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15767 **[Test build #68222 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68222/consoleFull)** for PR 15767 at commit

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #68224 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68224/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15769 The failed test case is imported by #15725, which is not related to our changes in this PR. --- If your project is set up for it, you can reply to this email and have your reply appear on

[GitHub] spark issue #15725: [SPARK-18167] Re-enable the non-flaky parts of SQLQueryS...

2016-11-05 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15725 This is also flaky.. https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68219/consoleFull --- If your project is set up for it, you can reply to this email and have your

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68219/ Test FAILed. ---

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68219 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68219/consoleFull)** for PR 15769 at commit

[GitHub] spark issue #15745: [SPARK-18207][SQL] Fix a compilation error due to HashEx...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15745 **[Test build #68223 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68223/consoleFull)** for PR 15745 at commit

[GitHub] spark issue #15767: [SPARK-18269][SQL] CSV datasource should read null prope...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15767 **[Test build #68222 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68222/consoleFull)** for PR 15767 at commit

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15480 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68220/ Test FAILed. ---

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15480 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15480 **[Test build #68220 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68220/consoleFull)** for PR 15480 at commit

[GitHub] spark issue #15786: [SPARK-18261][Structured Streaming] Add statistics to Me...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15786 **[Test build #68221 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68221/consoleFull)** for PR 15786 at commit

[GitHub] spark pull request #15688: [SPARK-18173][SQL] data source tables should supp...

2016-11-05 Thread cloud-fan
Github user cloud-fan commented on a diff in the pull request: https://github.com/apache/spark/pull/15688#discussion_r86677982 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1628,29 +1628,56 @@ class DDLSuite extends QueryTest with

[GitHub] spark pull request #15658: [SPARK-13770] [Documentation][ML] Document the ML...

2016-11-05 Thread hayashidac
Github user hayashidac commented on a diff in the pull request: https://github.com/apache/spark/pull/15658#discussion_r86677670 --- Diff: docs/ml-features.md --- @@ -729,6 +729,58 @@ for more details on the API. +## Interaction + +`Interaction` is a

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15480 **[Test build #68220 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68220/consoleFull)** for PR 15480 at commit

[GitHub] spark issue #15480: [SPARK-16845][SQL] `GeneratedClass$SpecificOrdering` gro...

2016-11-05 Thread lw-lin
Github user lw-lin commented on the issue: https://github.com/apache/spark/pull/15480 Jenkins retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/11105 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68218/ Test FAILed. ---

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #68218 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68218/consoleFull)** for PR 11105 at commit

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-11-05 Thread karlhigley
Github user karlhigley commented on the issue: https://github.com/apache/spark/pull/15148 @sethah: I think you're right that there's a discrepancy here, and I'm embarrassed that I didn't see it when I first reviewed the PR. On a reread of the source and your comment above, it looks

[GitHub] spark pull request #15652: [SPARK-16987] [None] Add spark-default.conf prope...

2016-11-05 Thread hayashidac
Github user hayashidac commented on a diff in the pull request: https://github.com/apache/spark/pull/15652#discussion_r86677391 --- Diff: docs/configuration.md --- @@ -1664,6 +1664,14 @@ Apart from these, the following properties are also available, and may be useful

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68219 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68219/consoleFull)** for PR 15769 at commit

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-05 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15659 Gentle ping to @rgbkrk / @minrk / @sethah if any of you happen to have a chance to try out pip installation on your own machine/enviroment with something along the lines of `./build/sbt package;cd

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15659 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68217/ Test PASSed. ---

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68217 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68217/consoleFull)** for PR 15659 at commit

[GitHub] spark pull request #15769: [SPARK-18191][CORE] Port RDD API to use commit pr...

2016-11-05 Thread jiangxb1987
Github user jiangxb1987 commented on a diff in the pull request: https://github.com/apache/spark/pull/15769#discussion_r86676927 --- Diff: core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala --- @@ -23,11 +23,11 @@ import java.text.SimpleDateFormat import

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-05 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/15777 Thanks for working on this @sethah - more work towards increased parity is good :) --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well.

[GitHub] spark issue #11105: [SPARK-12469][CORE] Data Property accumulators for Spark

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/11105 **[Test build #68218 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68218/consoleFull)** for PR 11105 at commit

[GitHub] spark pull request #15777: [SPARK-18282][ML][PYSPARK] Add python clustering ...

2016-11-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15777#discussion_r86676702 --- Diff: python/pyspark/ml/tests.py --- @@ -1097,6 +1097,42 @@ def test_logistic_regression_summary(self): sameSummary = model.evaluate(df)

[GitHub] spark pull request #15777: [SPARK-18282][ML][PYSPARK] Add python clustering ...

2016-11-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15777#discussion_r86676679 --- Diff: python/pyspark/ml/classification.py --- @@ -309,13 +309,16 @@ def interceptVector(self): @since("2.0.0") def summary(self):

[GitHub] spark pull request #15767: [SPARK-18269][SQL] CSV datasource should read nul...

2016-11-05 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/15767#discussion_r86676501 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -232,7 +232,9 @@ private[csv] object

[GitHub] spark issue #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip instal...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15659 **[Test build #68217 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68217/consoleFull)** for PR 15659 at commit

[GitHub] spark issue #15148: [SPARK-5992][ML] Locality Sensitive Hashing

2016-11-05 Thread sethah
Github user sethah commented on the issue: https://github.com/apache/spark/pull/15148 I apologize for coming late to this, but I am taking a look at some of the documentation now. For `RandomProjection` class there are two links: one to wikipedia entry on stable distributions and one

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r86674922 --- Diff: python/setup.py --- @@ -0,0 +1,180 @@ +#!/usr/bin/env python + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-05 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r86674883 --- Diff: docs/building-spark.md --- @@ -259,6 +259,14 @@ or Java 8 tests are automatically enabled when a Java 8 JDK is detected. If you have JDK

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68215/ Test PASSed. ---

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68215 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68215/consoleFull)** for PR 15769 at commit

[GitHub] spark pull request #15742: [SPARK-16808][Core] History Server main page does...

2016-11-05 Thread ajbozarth
Github user ajbozarth commented on a diff in the pull request: https://github.com/apache/spark/pull/15742#discussion_r86672775 --- Diff: core/src/main/scala/org/apache/spark/deploy/history/HistoryServer.scala --- @@ -143,6 +143,12 @@ class HistoryServer( appCache.stop()

[GitHub] spark pull request #15769: [SPARK-18191][CORE] Port RDD API to use commit pr...

2016-11-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15769#discussion_r86672448 --- Diff: core/src/main/scala/org/apache/spark/internal/io/SparkNewHadoopWriter.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15769: [SPARK-18191][CORE] Port RDD API to use commit pr...

2016-11-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15769#discussion_r86672438 --- Diff: core/src/main/scala/org/apache/spark/internal/io/SparkNewHadoopWriter.scala --- @@ -0,0 +1,248 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #15769: [SPARK-18191][CORE] Port RDD API to use commit pr...

2016-11-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15769#discussion_r86672427 --- Diff: core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala --- @@ -23,11 +23,11 @@ import java.text.SimpleDateFormat import java.util.{Date,

[GitHub] spark pull request #15769: [SPARK-18191][CORE] Port RDD API to use commit pr...

2016-11-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15769#discussion_r86672421 --- Diff: core/src/main/scala/org/apache/spark/SparkHadoopWriter.scala --- @@ -23,11 +23,11 @@ import java.text.SimpleDateFormat import java.util.{Date,

[GitHub] spark pull request #15767: [SPARK-18269][SQL] CSV datasource should read nul...

2016-11-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15767#discussion_r86672295 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/csv/CSVInferSchema.scala --- @@ -232,7 +232,9 @@ private[csv] object CSVTypeCast

[GitHub] spark pull request #15688: [SPARK-18173][SQL] data source tables should supp...

2016-11-05 Thread rxin
Github user rxin commented on a diff in the pull request: https://github.com/apache/spark/pull/15688#discussion_r86672283 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/execution/command/DDLSuite.scala --- @@ -1628,29 +1628,56 @@ class DDLSuite extends QueryTest with

[GitHub] spark issue #15688: [SPARK-18173][SQL] data source tables should support tru...

2016-11-05 Thread rxin
Github user rxin commented on the issue: https://github.com/apache/spark/pull/15688 cc @gatorsmile --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15777 Merged build finished. Test PASSed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15777 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68216/ Test PASSed. ---

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15777 **[Test build #68216 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68216/consoleFull)** for PR 15777 at commit

[GitHub] spark issue #15777: [SPARK-18282][ML][PYSPARK] Add python clustering summari...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15777 **[Test build #68216 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68216/consoleFull)** for PR 15777 at commit

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68215 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68215/consoleFull)** for PR 15769 at commit

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68214/ Test FAILed. ---

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68214 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68214/consoleFull)** for PR 15769 at commit

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68214 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68214/consoleFull)** for PR 15769 at commit

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread jiangxb1987
Github user jiangxb1987 commented on the issue: https://github.com/apache/spark/pull/15769 Moved the logic from `saveAsNewAPIHadoopDataset` into `SparkNewHadoopWriter`, also added `SparkNewHadoopWriterUtils` to store functions used by Hadoop/NewHadoop writer. In a followup PR,

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15769 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68213/ Test FAILed. ---

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68213 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68213/consoleFull)** for PR 15769 at commit

[GitHub] spark issue #15769: [SPARK-18191][CORE] Port RDD API to use commit protocol

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15769 **[Test build #68213 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68213/consoleFull)** for PR 15769 at commit

[GitHub] spark pull request #15779: [SPARK-17748][ML] Minor cleanups to one-pass line...

2016-11-05 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15779#discussion_r86670363 --- Diff: mllib/src/main/scala/org/apache/spark/ml/regression/LinearRegression.scala --- @@ -166,6 +166,9 @@ class LinearRegression @Since("1.3.0")

[GitHub] spark pull request #15779: [SPARK-17748][ML] Minor cleanups to one-pass line...

2016-11-05 Thread sethah
Github user sethah commented on a diff in the pull request: https://github.com/apache/spark/pull/15779#discussion_r86670216 --- Diff: mllib/src/main/scala/org/apache/spark/ml/optim/NormalEquationSolver.scala --- @@ -156,7 +157,7 @@ private[ml] class QuasiNewtonSolver( *

[GitHub] spark pull request #15700: [SPARK-17964][SparkR] Enable SparkR with Mesos cl...

2016-11-05 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/15700 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] spark issue #15700: [SPARK-17964][SparkR] Enable SparkR with Mesos client mo...

2016-11-05 Thread srowen
Github user srowen commented on the issue: https://github.com/apache/spark/pull/15700 Merged to master/2.1 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so,

[GitHub] spark issue #15742: [SPARK-16808][Core] History Server main page does not ho...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15742 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15742: [SPARK-16808][Core] History Server main page does not ho...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15742 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68212/ Test FAILed. ---

[GitHub] spark issue #15742: [SPARK-16808][Core] History Server main page does not ho...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15742 **[Test build #68212 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68212/consoleFull)** for PR 15742 at commit

[GitHub] spark issue #15742: [SPARK-16808][Core] History Server main page does not ho...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15742 Merged build finished. Test FAILed. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature

[GitHub] spark issue #15742: [SPARK-16808][Core] History Server main page does not ho...

2016-11-05 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/15742 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/68211/ Test FAILed. ---

[GitHub] spark issue #15742: [SPARK-16808][Core] History Server main page does not ho...

2016-11-05 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/15742 **[Test build #68211 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/68211/consoleFull)** for PR 15742 at commit

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-05 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r86668198 --- Diff: docs/building-spark.md --- @@ -259,6 +259,14 @@ or Java 8 tests are automatically enabled when a Java 8 JDK is detected. If you have JDK

[GitHub] spark pull request #15659: [SPARK-1267][SPARK-18129] Allow PySpark to be pip...

2016-11-05 Thread nchammas
Github user nchammas commented on a diff in the pull request: https://github.com/apache/spark/pull/15659#discussion_r86668059 --- Diff: python/setup.py --- @@ -0,0 +1,180 @@ +#!/usr/bin/env python + +# +# Licensed to the Apache Software Foundation (ASF) under one or

[GitHub] spark pull request #15781: [SPARK-17981] [SPARK-17957] [SQL] [BACKPORT-2.0] ...

2016-11-05 Thread gatorsmile
Github user gatorsmile closed the pull request at: https://github.com/apache/spark/pull/15781 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] spark issue #15781: [SPARK-17981] [SPARK-17957] [SQL] [BACKPORT-2.0] Fix Inc...

2016-11-05 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15781 Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

[GitHub] spark issue #15782: [SPARK-17693] [SQL] [BACKPORT-2.0] Fixed Insert Failure ...

2016-11-05 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/15782 Thanks! --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if

  1   2   3   4   >