[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

2018-07-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r202360294 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -303,94 +303,44 @@ case class LoadDataCommand( s"

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

2018-07-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r202359876 --- Diff: sql/hive/src/test/scala/org/apache/spark/sql/hive/execution/SQLQuerySuite.scala --- @@ -1912,11 +1912,59 @@ class SQLQuerySuite extends QueryTest

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

2018-07-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r202360482 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -303,94 +303,44 @@ case class LoadDataCommand( s"

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

2018-07-13 Thread srowen
Github user srowen commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r202363783 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -303,94 +303,44 @@ case class LoadDataCommand( s"

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread mrow4a
Github user mrow4a commented on the issue: https://github.com/apache/spark/pull/21748 Can we remove this as a part of this PR? https://github.com/apache/spark/blob/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh#L87 - it seems to set a client mode b

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-07-13 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/20611 Look worth going ahead to me. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-m

[GitHub] spark pull request #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread gengliangwang
GitHub user gengliangwang opened a pull request: https://github.com/apache/spark/pull/21761 [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2 ## What changes were proposed in this pull request? Upgrade Apache Avro from 1.7.7 to 1.8.2. The major new features: 1. More

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21761 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21761 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/927/

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21761 **[Test build #92973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92973/testReport)** for PR 21761 at commit [`cd9d0e6`](https://github.com/apache/spark/commit/cd

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21761 **[Test build #92973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92973/testReport)** for PR 21761 at commit [`cd9d0e6`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21761 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21761 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92973/ Test FAILed. ---

[GitHub] spark issue #21745: [SPARK-24781][SQL] Using a reference from Dataset in Fil...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21745 Thanks! Merged to master/2.3 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mai

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21761 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21761 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/928/

[GitHub] spark issue #21761: [SPARK-24771][BUILD]Upgrade Apache AVRO to 1.8.2

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21761 **[Test build #92974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92974/testReport)** for PR 21761 at commit [`531be9a`](https://github.com/apache/spark/commit/53

[GitHub] spark pull request #21745: [SPARK-24781][SQL] Using a reference from Dataset...

2018-07-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21745 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #21760: [SPARK-24776][SQL]Avro unit test: use SQLTestUtil...

2018-07-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/21760 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add read schema suite for file-...

2018-07-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20208 Also, thank you, @HyukjinKwon . --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands,

[GitHub] spark issue #20208: [SPARK-23007][SQL][TEST] Add read schema suite for file-...

2018-07-13 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/spark/pull/20208 Thank you so much, @gatorsmile . Sure. I'll make a PR to improve error handling for that. --- - To unsubscribe, e-mail: re

[GitHub] spark issue #21720: [SPARK-24163][SPARK-24164][SQL] Support column list as t...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21720 ping @maryannxue Resolve the conflicts? Will review it again after that. --- - To unsubscribe, e-mail: reviews-unsubscr...@spa

[GitHub] spark pull request #21762: [SPARK-24800][SQL] Refactor Avro Serializer and D...

2018-07-13 Thread gengliangwang
GitHub user gengliangwang opened a pull request: https://github.com/apache/spark/pull/21762 [SPARK-24800][SQL] Refactor Avro Serializer and Deserializer ## What changes were proposed in this pull request? Currently the Avro Deserializer converts input Avro format data to `Row`,

[GitHub] spark issue #21762: [SPARK-24800][SQL] Refactor Avro Serializer and Deserial...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21762 **[Test build #92975 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92975/testReport)** for PR 21762 at commit [`bb7a43c`](https://github.com/apache/spark/commit/bb

[GitHub] spark issue #21762: [SPARK-24800][SQL] Refactor Avro Serializer and Deserial...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21762 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/929/

[GitHub] spark issue #21762: [SPARK-24800][SQL] Refactor Avro Serializer and Deserial...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21762 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21763: Branch 2.1

2018-07-13 Thread rajesh7738
GitHub user rajesh7738 opened a pull request: https://github.com/apache/spark/pull/21763 Branch 2.1 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How was this patch tested? (Please explain how this patc

[GitHub] spark issue #21760: [SPARK-24776][SQL]Avro unit test: use SQLTestUtils and r...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21760 This breaks the build. https://amplab.cs.berkeley.edu/jenkins/view/Spark%20QA%20Compile/job/spark-master-compile-maven-hadoop-2.6/7842/ I need to revert it. --- --

[GitHub] spark issue #21763: Branch 2.1

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21763 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21763: Branch 2.1

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21763 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #21757: [SPARK-24797] [SQL] respect spark.sql.hive.conver...

2018-07-13 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/21757#discussion_r202414440 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -254,13 +254,15 @@ class FindDataSourceTable

[GitHub] spark issue #21763: Branch 2.1

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21763 Can one of the admins verify this patch? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark issue #21762: [SPARK-24800][SQL] Refactor Avro Serializer and Deserial...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21762 **[Test build #92975 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92975/testReport)** for PR 21762 at commit [`bb7a43c`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-07-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/20908 Jenkins retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: re

[GitHub] spark issue #21762: [SPARK-24800][SQL] Refactor Avro Serializer and Deserial...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21762 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92975/ Test PASSed. ---

[GitHub] spark issue #21762: [SPARK-24800][SQL] Refactor Avro Serializer and Deserial...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21762 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21757: [SPARK-24797] [SQL] respect spark.sql.hive.conver...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21757#discussion_r202416374 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -254,13 +254,15 @@ class FindDataSourceTabl

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20908 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20908 **[Test build #92976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92976/testReport)** for PR 20908 at commit [`f5aeafc`](https://github.com/apache/spark/commit/f5

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20908 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/930/

[GitHub] spark pull request #21757: [SPARK-24797] [SQL] respect spark.sql.hive.conver...

2018-07-13 Thread CodingCat
Github user CodingCat commented on a diff in the pull request: https://github.com/apache/spark/pull/21757#discussion_r202417166 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DataSourceStrategy.scala --- @@ -254,13 +254,15 @@ class FindDataSourceTable

[GitHub] spark pull request #21757: [SPARK-24797] [SQL] respect spark.sql.hive.conver...

2018-07-13 Thread CodingCat
Github user CodingCat closed the pull request at: https://github.com/apache/spark/pull/21757 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/21748 test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark pull request #21603: [SPARK-17091][SQL] Add rule to convert IN predica...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21603#discussion_r202418387 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFileFormat.scala --- @@ -376,7 +374,8 @@ class ParquetFileFo

[GitHub] spark pull request #21603: [SPARK-17091][SQL] Add rule to convert IN predica...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21603#discussion_r202418582 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala --- @@ -222,6 +225,14 @@ private[parquet] clas

[GitHub] spark pull request #21603: [SPARK-17091][SQL] Add rule to convert IN predica...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21603#discussion_r202418683 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala --- @@ -222,6 +225,14 @@ private[parquet] clas

[GitHub] spark pull request #21603: [SPARK-17091][SQL] Add rule to convert IN predica...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21603#discussion_r202418834 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetFilters.scala --- @@ -222,6 +225,14 @@ private[parquet] clas

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 **[Test build #92977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92977/testReport)** for PR 21748 at commit [`88a9d7f`](https://github.com/apache/spark/commit/88

[GitHub] spark issue #20611: [SPARK-23425][SQL]Support wildcard in HDFS path for load...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20611 **[Test build #92978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92978/testReport)** for PR 20611 at commit [`9ceeb30`](https://github.com/apache/spark/commit/9c

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/931/ --- -

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/931/ --- ---

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/931/

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/21748 test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/21583 test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark pull request #21741: [SPARK-24718][SQL] Timestamp support pushdown to ...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on a diff in the pull request: https://github.com/apache/spark/pull/21741#discussion_r202423258 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala --- @@ -378,6 +378,15 @@ object SQLConf { .booleanConf

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 **[Test build #92979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92979/testReport)** for PR 21748 at commit [`88a9d7f`](https://github.com/apache/spark/commit/88

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21583 **[Test build #92980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92980/testReport)** for PR 21583 at commit [`c0b5927`](https://github.com/apache/spark/commit/c0

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 **[Test build #92977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92977/testReport)** for PR 21748 at commit [`88a9d7f`](https://github.com/apache/spark/commit/8

[GitHub] spark pull request #20629: [SPARK-23451][ML] Deprecate KMeans.computeCost

2018-07-13 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/20629#discussion_r202423675 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeansModel.scala --- @@ -37,7 +37,7 @@ import org.apache.spark.sql.{Row, SparkSession}

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/20908 **[Test build #92976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92976/testReport)** for PR 20908 at commit [`f5aeafc`](https://github.com/apache/spark/commit/f

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92977/ Test PASSed. ---

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20908 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #18139: [SPARK-20787][PYTHON] PySpark can't handle datetimes bef...

2018-07-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/18139 @rberenguel is this still on your radar? Also jenkins ok to test. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apa

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #20908: [WIP][SPARK-23672][PYTHON] Document support for nested r...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/20908 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92976/ Test FAILed. ---

[GitHub] spark issue #21049: [SPARK-23957][SQL] Remove redundant sort operators from ...

2018-07-13 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21049 @henryr Could you update the PR based on the review? We can safely drop them in scalar subqueries and nested subqueries --- -

[GitHub] spark issue #13599: [SPARK-13587] [PYSPARK] Support virtualenv in pyspark

2018-07-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/13599 I'm interested in us fixing this, especially after yesterday when I spent several hours working with workaround hacks. But I want us to do something not YARN specific and not involve a large slow do

[GitHub] spark issue #17673: [SPARK-20372] [ML] Word2Vec Continuous Bag of Words mode...

2018-07-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/17673 @shubhamchopra are you still working on this? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional

[GitHub] spark pull request #20629: [SPARK-23451][ML] Deprecate KMeans.computeCost

2018-07-13 Thread mgaido91
Github user mgaido91 commented on a diff in the pull request: https://github.com/apache/spark/pull/20629#discussion_r202425169 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeansModel.scala --- @@ -37,7 +37,7 @@ import org.apache.spark.sql.{Row, SparkSession}

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/932/ --- -

[GitHub] spark pull request #20944: [SPARK-23831][SQL] Add org.apache.derby to Isolat...

2018-07-13 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/20944#discussion_r202426713 --- Diff: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/IsolatedClientLoader.scala --- @@ -182,6 +182,7 @@ private[hive] class IsolatedClientLoa

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/932/ --- ---

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/932/

[GitHub] spark issue #19659: [SPARK-19668][ML] Multiple NGram sizes

2018-07-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/19659 Is this a thing you are still working on @mpetruska ? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For addi

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 **[Test build #92979 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92979/testReport)** for PR 21748 at commit [`88a9d7f`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21583 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21748 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92979/ Test PASSed. ---

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21583 **[Test build #92980 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92980/testReport)** for PR 21583 at commit [`c0b5927`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21583 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92980/ Test PASSed. ---

[GitHub] spark pull request #20611: [SPARK-23425][SQL]Support wildcard in HDFS path f...

2018-07-13 Thread sujith71955
Github user sujith71955 commented on a diff in the pull request: https://github.com/apache/spark/pull/20611#discussion_r202429058 --- Diff: sql/core/src/main/scala/org/apache/spark/sql/execution/command/tables.scala --- @@ -303,94 +303,44 @@ case class LoadDataCommand(

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21583 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/933/ --- -

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21583 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21583 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-make-spark-distribution-unified/933/ --- ---

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21583 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution-unified/933/

[GitHub] spark issue #21608: [SPARK-24626] [SQL] Improve location size calculation in...

2018-07-13 Thread Achuth17
Github user Achuth17 commented on the issue: https://github.com/apache/spark/pull/21608 Ping @gatorsmile --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h.

[GitHub] spark issue #21439: [SPARK-24391][SQL] Support arrays of any types by from_j...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21439 **[Test build #92981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92981/testReport)** for PR 21439 at commit [`82d4fd5`](https://github.com/apache/spark/commit/82

[GitHub] spark issue #20701: [SPARK-23528][ML] Add numIter to ClusteringSummary

2018-07-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/20701 Merged to master --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...

[GitHub] spark issue #21439: [SPARK-24391][SQL] Support arrays of any types by from_j...

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21439 **[Test build #92981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92981/testReport)** for PR 21439 at commit [`82d4fd5`](https://github.com/apache/spark/commit/8

[GitHub] spark issue #21439: [SPARK-24391][SQL] Support arrays of any types by from_j...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21439 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21439: [SPARK-24391][SQL] Support arrays of any types by from_j...

2018-07-13 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21439 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/92981/ Test FAILed. ---

[GitHub] spark pull request #20701: [SPARK-23528][ML] Add numIter to ClusteringSummar...

2018-07-13 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/spark/pull/20701 --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...@spark.apache.org

[GitHub] spark pull request #20629: [SPARK-23451][ML] Deprecate KMeans.computeCost

2018-07-13 Thread holdenk
Github user holdenk commented on a diff in the pull request: https://github.com/apache/spark/pull/20629#discussion_r202436972 --- Diff: mllib/src/main/scala/org/apache/spark/mllib/clustering/KMeansModel.scala --- @@ -37,7 +37,7 @@ import org.apache.spark.sql.{Row, SparkSession}

[GitHub] spark issue #20629: [SPARK-23451][ML] Deprecate KMeans.computeCost

2018-07-13 Thread holdenk
Github user holdenk commented on the issue: https://github.com/apache/spark/pull/20629 After I merged your other PR this has some minor conflicts so needs an update, but I'd be happy to try and get this in end of next week during my next review session :) --- --

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/21748 test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21748 **[Test build #92982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/92982/testReport)** for PR 21748 at commit [`88a9d7f`](https://github.com/apache/spark/commit/88

[GitHub] spark issue #21748: [SPARK-23146][K8S] Support client mode.

2018-07-13 Thread mccheah
Github user mccheah commented on the issue: https://github.com/apache/spark/pull/21748 > Can we remove this as a part of this PR? https://github.com/apache/spark/blob/master/resource-managers/kubernetes/docker/src/main/dockerfiles/spark/entrypoint.sh#L87 - it seems to set a client mod

[GitHub] spark issue #21583: [SPARK-23984][K8S][Test] Added Integration Tests for PyS...

2018-07-13 Thread shaneknapp
Github user shaneknapp commented on the issue: https://github.com/apache/spark/pull/21583 test this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h

<    1   2   3   4   >