[GitHub] spark issue #19607: [WIP][SPARK-22395][SQL][PYTHON] Fix the behavior of time...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19607 **[Test build #83320 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83320/testReport)** for PR 19607 at commit

[GitHub] spark issue #19638: [SPARK-22422][ML] Add Adjusted R2 to RegressionMetrics

2017-11-01 Thread tengpeng
Github user tengpeng commented on the issue: https://github.com/apache/spark/pull/19638 Would it be possible to add me to the white list for test? Thanks. On Thu, Nov 2, 2017 at 12:17 AM UCB AMPLab wrote: > Can one of the admins verify this

[GitHub] spark issue #19625: [SPARK-22407][WEB-UI] Add rdd id column on storage page ...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19625 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83316/ Test PASSed. ---

[GitHub] spark issue #19625: [SPARK-22407][WEB-UI] Add rdd id column on storage page ...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19625 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19625: [SPARK-22407][WEB-UI] Add rdd id column on storage page ...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19625 **[Test build #83316 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83316/testReport)** for PR 19625 at commit

[GitHub] spark issue #19638: [SPARK-22422][ML] Add Adjusted R2 to RegressionMetrics

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19638 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19638: [SPARK-22422][ML] Add Adjusted R2 to RegressionMe...

2017-11-01 Thread tengpeng
GitHub user tengpeng opened a pull request: https://github.com/apache/spark/pull/19638 [SPARK-22422][ML] Add Adjusted R2 to RegressionMetrics ## What changes were proposed in this pull request? I added adjusted R2 as a regression metric which was implemented in all major

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83317/ Test PASSed. ---

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19636 **[Test build #83317 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83317/testReport)** for PR 19636 at commit

[GitHub] spark issue #19622: [SPARK-22306][SQL][2.2] alter table schema should not er...

2017-11-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/19622 LGTM except a comment [here](https://github.com/apache/spark/pull/19622#discussion_r148441747) --- - To unsubscribe, e-mail:

[GitHub] spark pull request #19622: [SPARK-22306][SQL][2.2] alter table schema should...

2017-11-01 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/19622#discussion_r148441747 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveExternalCatalog.scala --- @@ -295,7 +297,7 @@ private[spark] class

[GitHub] spark issue #19637: [SPARK-22243][DStream]spark.yarn.jars should reload from...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19637 **[Test build #83319 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83319/testReport)** for PR 19637 at commit

[GitHub] spark issue #19637: [SPARK-22243][DStream]spark.yarn.jars should reload from...

2017-11-01 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/19637 jenkins test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19607: [SPARK-22395][SQL][PYTHON] Fix the behavior of timestamp...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19607 > I tried to find out a workaround for old Pandas, but I haven't done yet. I haven't looked at this closely yet but will definitely try to take a look and help soon together. I would

[GitHub] spark issue #19607: [SPARK-22395][SQL][PYTHON] Fix the behavior of timestamp...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19607 Yea, that was my proposal. If anything is blocked by this, I think we should bump it up as, IMHO, technically the fixed version specification was not yet released and published. ^ cc

[GitHub] spark issue #19607: [SPARK-22395][SQL][PYTHON] Fix the behavior of timestamp...

2017-11-01 Thread ueshin
Github user ueshin commented on the issue: https://github.com/apache/spark/pull/19607 @BryanCutler I guess the oldest version of Pandas is `0.13.0` currently according to #18403, cc @HyukjinKwon. --- - To

[GitHub] spark issue #19599: [SPARK-22381] [ML] Add StringParam that supports valid o...

2017-11-01 Thread hhbyyh
Github user hhbyyh commented on the issue: https://github.com/apache/spark/pull/19599 I used two ways to switch String params among different options: 1. In NaiveBayes: convert StringParam and String constants to lowercase. 2. in LinearRegression: .equalsIgnoreCase

[GitHub] spark pull request #19565: [SPARK-22111][MLLIB] OnlineLDAOptimizer should fi...

2017-11-01 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/19565#discussion_r148438581 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -497,40 +481,46 @@ final class OnlineLDAOptimizer extends

[GitHub] spark pull request #19565: [SPARK-22111][MLLIB] OnlineLDAOptimizer should fi...

2017-11-01 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/19565#discussion_r148438759 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -446,14 +445,14 @@ final class OnlineLDAOptimizer extends

[GitHub] spark pull request #19565: [SPARK-22111][MLLIB] OnlineLDAOptimizer should fi...

2017-11-01 Thread hhbyyh
Github user hhbyyh commented on a diff in the pull request: https://github.com/apache/spark/pull/19565#discussion_r148437931 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/LDAOptimizer.scala --- @@ -446,14 +445,14 @@ final class OnlineLDAOptimizer extends

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19636 Thank you for review, @jiangxb1987 . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17886 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/17886 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83318/ Test PASSed. ---

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17886 **[Test build #83318 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83318/testReport)** for PR 17886 at commit

[GitHub] spark issue #14638: [SPARK-11374][SQL] Support `skip.header.line.count` opti...

2017-11-01 Thread sadhen
Github user sadhen commented on the issue: https://github.com/apache/spark/pull/14638 yes --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19586: [SPARK-22367][WIP][CORE] Separate the serialization of c...

2017-11-01 Thread jerryshao
Github user jerryshao commented on the issue: https://github.com/apache/spark/pull/19586 I tend to agree with @cloud-fan , I think you can implement your own serializer out of Spark to be more specialized for your application, that will definitely be more efficient than the built-in

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/17886 **[Test build #83318 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83318/testReport)** for PR 17886 at commit

[GitHub] spark issue #17886: [SPARK-13983][SQL] Fix HiveThriftServer2 can not get "--...

2017-11-01 Thread wangyum
Github user wangyum commented on the issue: https://github.com/apache/spark/pull/17886 @gatorsmile master branch still has this issue. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #19208: [SPARK-21087] [ML] CrossValidator, TrainValidatio...

2017-11-01 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/19208#discussion_r148433035 --- Diff: mllib/src/main/scala/org/apache/spark/ml/tuning/CrossValidator.scala --- @@ -117,6 +123,12 @@ class CrossValidator @Since("1.2.0")

[GitHub] spark issue #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on Window...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19370 @jsnowacki, sorry for being late again and again. Will probably take a final look once the comments are addressed. --- - To

[GitHub] spark pull request #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r148431331 --- Diff: bin/find-spark-home.cmd --- @@ -0,0 +1,44 @@ +@echo off + +rem +rem Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r148432405 --- Diff: bin/find-spark-home.cmd --- @@ -0,0 +1,44 @@ +@echo off + +rem +rem Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark pull request #19370: [SPARK-18136] Fix setup of SPARK_HOME variable on...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19370#discussion_r148432692 --- Diff: bin/find-spark-home.cmd --- @@ -0,0 +1,44 @@ +@echo off + +rem +rem Licensed to the Apache Software Foundation (ASF) under one

[GitHub] spark issue #19586: [SPARK-22367][WIP][CORE] Separate the serialization of c...

2017-11-01 Thread ConeyLiu
Github user ConeyLiu commented on the issue: https://github.com/apache/spark/pull/19586 Hi @cloud-fan, for most case the data type should be same. So I think this optimization is valuable, because it can save the space and cpu resource considerable. What about setting a flag for the

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-11-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/16578 Yeah, I think with a config for this optimization is good. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #19632: Added description to python spark Pi example

2017-11-01 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19632 Thanks for helping out with the Spark project, it's great to see folks looking to improve the examples :) I'm not sure the in-line comment adds much, but the docstring one looks like a good minor

[GitHub] spark pull request #19632: Added description to python spark Pi example

2017-11-01 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/19632#discussion_r148430264 --- Diff: examples/src/main/python/pi.py --- @@ -27,12 +27,16 @@ if __name__ == "__main__": """ Usage: pi [partitions] +

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19439#discussion_r148429895 --- Diff: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala --- @@ -0,0 +1,236 @@ +/* + * Licensed to the Apache Software

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19636 **[Test build #83317 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83317/testReport)** for PR 19636 at commit

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19636 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19625: [SPARK-22407][WEB-UI] Add rdd id column on storage page ...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19625 **[Test build #83316 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83316/testReport)** for PR 19625 at commit

[GitHub] spark pull request #19625: [SPARK-22407][WEB-UI] Add rdd id column on storag...

2017-11-01 Thread caneGuy
Github user caneGuy commented on a diff in the pull request: https://github.com/apache/spark/pull/19625#discussion_r148427237 --- Diff: core/src/main/scala/org/apache/spark/ui/storage/StoragePage.scala --- @@ -49,6 +49,7 @@ private[ui] class StoragePage(parent: StorageTab) extends

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83315/ Test FAILed. ---

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19636 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83314/ Test FAILed. ---

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

2017-11-01 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/19439 Will do as soon as I can! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19439 To me, I have two concern. One is Python API shape, imatiach-msft#1 and Java API support related with `Map` - https://github.com/apache/spark/pull/19439#discussion_r148289879 at high level.

[GitHub] spark issue #19625: [SPARK-22407][WEB-UI] Add rdd id column on storage page ...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19625 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83313/ Test FAILed. ---

[GitHub] spark issue #19625: [SPARK-22407][WEB-UI] Add rdd id column on storage page ...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19625 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19439 @jkbradley, BTW, mind checking the API structure please? I reviewed this to be consistent with other components and codes at my best but, to be honest, my ML knowledge and familiarity are

[GitHub] spark issue #19637: [SPARK-22243][DStream]spark.yarn.jars should reload from...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19637 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive...

2017-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on a diff in the pull request: https://github.com/apache/spark/pull/19636#discussion_r148423575 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcOptions.scala --- @@ -27,7 +27,7 @@ import

[GitHub] spark issue #18538: [SPARK-14516][ML] Adding ClusteringEvaluator with the im...

2017-11-01 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/18538 @yanboliang @mgaido91 I just saw this PR. It creates a new test data directory. Could you please send a quite update to move the data to the existing data directory:

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

2017-11-01 Thread jkbradley
Github user jkbradley commented on the issue: https://github.com/apache/spark/pull/19439 Quick comment: I see that data are being added under mllib/src/test/resources/ That appears to be a new directory, created recently. The standard directory is

[GitHub] spark issue #19637: [SPARK-22243][DStream]spark.yarn.jars should reload from...

2017-11-01 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/19637 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #16578: [SPARK-4502][SQL] Parquet nested column pruning

2017-11-01 Thread felixcheung
Github user felixcheung commented on the issue: https://github.com/apache/spark/pull/16578 Thanks @CodingCat +1 on config switch. I think that would be a good idea. --- - To unsubscribe, e-mail:

[GitHub] spark issue #18118: [SPARK-20199][ML] : Provided featureSubsetStrategy to GB...

2017-11-01 Thread pralabhkumar
Github user pralabhkumar commented on the issue: https://github.com/apache/spark/pull/18118 @sethah please find some time to look into the changes . Please let me know if further changes are required. ---

[GitHub] spark issue #19637: [SPARK-22243][DStream]spark.yarn.jars should reload from...

2017-11-01 Thread ChenjunZou
Github user ChenjunZou commented on the issue: https://github.com/apache/spark/pull/19637 add spark.yarn.jars to the checkpoint reload configs. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark pull request #19637: [SPARK-22243][DStream]spark.yarn.jars should relo...

2017-11-01 Thread ChenjunZou
GitHub user ChenjunZou opened a pull request: https://github.com/apache/spark/pull/19637 [SPARK-22243][DStream]spark.yarn.jars should reload from config when checkpoint recovery the previous pr branch is deleted by mistake You can merge this pull request into a Git repository by

[GitHub] spark issue #19625: [SPARK-22407][WEB-UI] Add rdd id column on storage page ...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19625 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark pull request #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19636#discussion_r148420534 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/orc/OrcOptions.scala --- @@ -27,7 +27,7 @@ import

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19628 BTW, the test was passed for 5e1bbf0. It triggered again against the same commit after adding it to whitelist somehow. ---

[GitHub] spark pull request #19628: [MINOR][DOC] automatic type inference supports al...

2017-11-01 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/19628 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19628 Merged to mater, branch-2.2 and branch-2.1. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19628 **[Test build #83312 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83312/testReport)** for PR 19628 at commit

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19628 add to whitelist --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19628 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19628 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83311/ Test PASSed. ---

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19628 **[Test build #83311 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83311/testReport)** for PR 19628 at commit

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19628 **[Test build #83311 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83311/testReport)** for PR 19628 at commit

[GitHub] spark issue #19628: [MINOR][DOC] automatic type inference supports also Date...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/19628 ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19208: [SPARK-21087] [ML] CrossValidator, TrainValidationSplit ...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19208 **[Test build #3972 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3972/testReport)** for PR 19208 at commit

[GitHub] spark issue #19433: [SPARK-3162] [MLlib] Add local tree training for decisio...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19433 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83310/ Test FAILed. ---

[GitHub] spark issue #19433: [SPARK-3162] [MLlib] Add local tree training for decisio...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19433 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19468: [SPARK-18278] [Scheduler] Spark on Kubernetes - Basic Sc...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19468 **[Test build #83309 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83309/testReport)** for PR 19468 at commit

[GitHub] spark issue #19459: [SPARK-20791][PYSPARK] Use Arrow to create Spark DataFra...

2017-11-01 Thread BryanCutler
Github user BryanCutler commented on the issue: https://github.com/apache/spark/pull/19459 I made [SPARK-22417](https://issues.apache.org/jira/browse/SPARK-22417) for fixing reading from timestamps without arrow ---

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19439 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83303/ Test PASSed. ---

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19439 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19439: [SPARK-21866][ML][PySpark] Adding spark image reader

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19439 **[Test build #83303 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83303/testReport)** for PR 19439 at commit

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

2017-11-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/19439#discussion_r148405401 --- Diff: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala --- @@ -0,0 +1,236 @@ +/* + * Licensed to the Apache Software

[GitHub] spark pull request #19439: [SPARK-21866][ML][PySpark] Adding spark image rea...

2017-11-01 Thread dakirsa
Github user dakirsa commented on a diff in the pull request: https://github.com/apache/spark/pull/19439#discussion_r148404466 --- Diff: mllib/src/main/scala/org/apache/spark/ml/image/ImageSchema.scala --- @@ -0,0 +1,236 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] spark issue #19635: [SPARK-22413][SQL] Type coercion for IN is not coherent ...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19635 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83304/ Test FAILed. ---

[GitHub] spark issue #19635: [SPARK-22413][SQL] Type coercion for IN is not coherent ...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19635 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19635: [SPARK-22413][SQL] Type coercion for IN is not coherent ...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19635 **[Test build #83304 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83304/testReport)** for PR 19635 at commit

[GitHub] spark issue #19623: [SPARK-22078][SQL] clarify exception behaviors for all d...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19623 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83300/ Test PASSed. ---

[GitHub] spark issue #19623: [SPARK-22078][SQL] clarify exception behaviors for all d...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19623 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19623: [SPARK-22078][SQL] clarify exception behaviors for all d...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19623 **[Test build #83300 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83300/testReport)** for PR 19623 at commit

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19636 **[Test build #83308 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83308/testReport)** for PR 19636 at commit

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/19636 Retest this please. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/19636 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/83307/ Test FAILed. ---

[GitHub] spark issue #19629: [SPARK-22408][SQL] RelationalGroupedDataset's distinct p...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19629 **[Test build #3971 has finished](https://amplab.cs.berkeley.edu/jenkins/job/NewSparkPullRequestBuilder/3971/testReport)** for PR 19629 at commit

[GitHub] spark issue #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `s...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19636 **[Test build #83306 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83306/testReport)** for PR 19636 at commit

[GitHub] spark pull request #19636: [SPARK-22416][SQL] Move OrcOptions from `sql/hive...

2017-11-01 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/19636 [SPARK-22416][SQL] Move OrcOptions from `sql/hive` to `sql/core` ## What changes were proposed in this pull request? According to the

[GitHub] spark issue #19631: [SPARK-22372][core, yarn] Make cluster submission use Sp...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19631 **[Test build #83305 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83305/testReport)** for PR 19631 at commit

[GitHub] spark issue #19631: [SPARK-22372][core, yarn] Make cluster submission use Sp...

2017-11-01 Thread vanzin
Github user vanzin commented on the issue: https://github.com/apache/spark/pull/19631 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #19635: [SPARK-22413][SQL] Type coercion for IN is not coherent ...

2017-11-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/19635 **[Test build #83304 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/83304/testReport)** for PR 19635 at commit

  1   2   3   >