[GitHub] spark issue #21203: [SPARK-24131][PySpark] Add majorMinorVersion API to PySp...

2018-05-01 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/21203 Sorry @jkbradley, I rushed it. It looked making sense when I merged this but I didn't closely check the Scala side. Will be careful next time. --- -

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21073 **[Test build #90020 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90020/testReport)** for PR 21073 at commit [`d9dccd3`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21073 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21073: [SPARK-23936][SQL] Implement map_concat

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21073 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90020/ Test FAILed. ---

[GitHub] spark pull request #21210: [SPARK-23489][SQL][TEST] HiveExternalCatalogVersi...

2018-05-01 Thread dongjoon-hyun
GitHub user dongjoon-hyun opened a pull request: https://github.com/apache/spark/pull/21210 [SPARK-23489][SQL][TEST] HiveExternalCatalogVersionsSuite should verify the downloaded file ## What changes were proposed in this pull request? Although `HiveExternalCatalogVersionsS

[GitHub] spark issue #21210: [SPARK-23489][SQL][TEST] HiveExternalCatalogVersionsSuit...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21210 **[Test build #90029 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90029/testReport)** for PR 21210 at commit [`51d4c0e`](https://github.com/apache/spark/commit/51

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21211 cc @jkbradley @HyukjinKwon --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: re

[GitHub] spark pull request #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVe...

2018-05-01 Thread viirya
GitHub user viirya opened a pull request: https://github.com/apache/spark/pull/21211 [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion API to PySpark for determining Spark versions ## What changes were proposed in this pull request? More close to Scala API behavior whe

[GitHub] spark issue #21210: [SPARK-23489][SQL][TEST] HiveExternalCatalogVersionsSuit...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21210 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2792/ Tes

[GitHub] spark issue #21210: [SPARK-23489][SQL][TEST] HiveExternalCatalogVersionsSuit...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21210 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21211 **[Test build #90030 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90030/testReport)** for PR 21211 at commit [`e4b8867`](https://github.com/apache/spark/commit/e4

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21211 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2793/ Tes

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21211 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21210: [SPARK-23489][SQL][TEST] HiveExternalCatalogVersionsSuit...

2018-05-01 Thread gatorsmile
Github user gatorsmile commented on the issue: https://github.com/apache/spark/pull/21210 Thanks for working on it! --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail:

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

2018-05-01 Thread kiszk
Github user kiszk commented on the issue: https://github.com/apache/spark/pull/21021 retest this please --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h...

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21021 **[Test build #90031 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90031/testReport)** for PR 21021 at commit [`9f63a76`](https://github.com/apache/spark/commit/9f

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21173 **[Test build #90027 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90027/testReport)** for PR 21173 at commit [`997d70f`](https://github.com/apache/spark/commit/9

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90027/ Test FAILed. ---

[GitHub] spark issue #21173: [SPARK-23856][SQL] Add an option `queryTimeout` in JDBCO...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21173 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVe...

2018-05-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21211#discussion_r185397366 --- Diff: python/pyspark/util.py --- @@ -62,24 +62,28 @@ def _get_argspec(f): return argspec -def majorMinorVersion(version):

[GitHub] spark pull request #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVe...

2018-05-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21211#discussion_r185397331 --- Diff: python/pyspark/util.py --- @@ -62,24 +62,28 @@ def _get_argspec(f): return argspec -def majorMinorVersion(version):

[GitHub] spark pull request #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVe...

2018-05-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21211#discussion_r185397426 --- Diff: python/pyspark/util.py --- @@ -62,24 +62,28 @@ def _get_argspec(f): return argspec -def majorMinorVersion(version):

[GitHub] spark pull request #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVe...

2018-05-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21211#discussion_r185397304 --- Diff: python/pyspark/util.py --- @@ -62,24 +62,28 @@ def _get_argspec(f): return argspec -def majorMinorVersion(version):

[GitHub] spark pull request #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVe...

2018-05-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21211#discussion_r185397488 --- Diff: python/pyspark/util.py --- @@ -62,24 +62,28 @@ def _get_argspec(f): return argspec -def majorMinorVersion(version):

[GitHub] spark pull request #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVe...

2018-05-01 Thread HyukjinKwon
Github user HyukjinKwon commented on a diff in the pull request: https://github.com/apache/spark/pull/21211#discussion_r185397554 --- Diff: python/pyspark/tests.py --- @@ -2303,6 +2303,15 @@ def test_py4j_exception_message(self): self.assertTrue('NullPointerExcept

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21021: [SPARK-23921][SQL] Add array_sort function

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21021 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2794/ Tes

[GitHub] spark issue #21206: [SPARK-24133][SQL] Check for integer overflows when resi...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21206 **[Test build #90022 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90022/testReport)** for PR 21206 at commit [`ddfd147`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21211 **[Test build #90030 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90030/testReport)** for PR 21211 at commit [`e4b8867`](https://github.com/apache/spark/commit/e

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21211 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90030/ Test FAILed. ---

[GitHub] spark issue #21206: [SPARK-24133][SQL] Check for integer overflows when resi...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21206 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90022/ Test FAILed. ---

[GitHub] spark issue #21206: [SPARK-24133][SQL] Check for integer overflows when resi...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21206 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21211 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21212: [SPARK-24143] filter empty blocks when convert ma...

2018-05-01 Thread jinxing64
GitHub user jinxing64 opened a pull request: https://github.com/apache/spark/pull/21212 [SPARK-24143] filter empty blocks when convert mapstatus to (blockId,… … size) pair. ## What changes were proposed in this pull request? In current code(`MapOutputTracker.con

[GitHub] spark issue #21212: [SPARK-24143] filter empty blocks when convert mapstatus...

2018-05-01 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/21212 @squito @cloud-fan @jiangxb1987 Do you think this make sense? --- - To unsubscribe, e-mail: reviews-unsubscr...@spark

[GitHub] spark issue #21212: [SPARK-24143] filter empty blocks when convert mapstatus...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21212 **[Test build #90032 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90032/testReport)** for PR 21212 at commit [`5211ebd`](https://github.com/apache/spark/commit/52

[GitHub] spark issue #21211: [SPARK-24131][PYSPARK][Followup] Add majorMinorVersion A...

2018-05-01 Thread viirya
Github user viirya commented on the issue: https://github.com/apache/spark/pull/21211 @HyukjinKwon Thanks! I forgot to change doctests. I will update and address your comments once I get access of my laptop. On Wed, May 2, 2018, 1:41 PM Hyukjin Kwon wrote: >

[GitHub] spark issue #21212: [SPARK-24143] filter empty blocks when convert mapstatus...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21212 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2795/ Tes

[GitHub] spark issue #21212: [SPARK-24143] filter empty blocks when convert mapstatus...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21212 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21187: [SPARK-24035][SQL] SQL syntax for Pivot

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21187 **[Test build #90024 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90024/testReport)** for PR 21187 at commit [`171c0c2`](https://github.com/apache/spark/commit/1

[GitHub] spark issue #21187: [SPARK-24035][SQL] SQL syntax for Pivot

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21187 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21187: [SPARK-24035][SQL] SQL syntax for Pivot

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21187 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90024/ Test FAILed. ---

[GitHub] spark issue #21031: [SPARK-23923][SQL] Add cardinality function

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21031 **[Test build #90026 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90026/testReport)** for PR 21031 at commit [`dd46bbf`](https://github.com/apache/spark/commit/d

[GitHub] spark issue #21031: [SPARK-23923][SQL] Add cardinality function

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21031 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90026/ Test FAILed. ---

[GitHub] spark issue #21031: [SPARK-23923][SQL] Add cardinality function

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21031 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark pull request #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-01 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21054#discussion_r185399774 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Corr.scala --- @@ -22,18 +22,14 @@ import org.apache.spark.sql.cat

[GitHub] spark issue #21201: [SPARK-24128][SQL] Mention configuration option in impli...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21201 **[Test build #90023 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90023/testReport)** for PR 21201 at commit [`b267513`](https://github.com/apache/spark/commit/b

[GitHub] spark issue #21201: [SPARK-24128][SQL] Mention configuration option in impli...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21201 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90023/ Test FAILed. ---

[GitHub] spark issue #21201: [SPARK-24128][SQL] Mention configuration option in impli...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21201 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21202: [SPARK-24129] [K8S] Add option to pass --build-arg's to ...

2018-05-01 Thread foxish
Github user foxish commented on the issue: https://github.com/apache/spark/pull/21202 LGTM pending test run --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-

[GitHub] spark pull request #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-01 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21054#discussion_r185400649 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala --- @@ -686,4 +687,72 @@ class DataFrameAggregateSuite extends QueryTest

[GitHub] spark issue #21202: [SPARK-24129] [K8S] Add option to pass --build-arg's to ...

2018-05-01 Thread foxish
Github user foxish commented on the issue: https://github.com/apache/spark/pull/21202 jenkins, ok to test --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional commands, e-mail: reviews-h.

[GitHub] spark issue #21202: [SPARK-24129] [K8S] Add option to pass --build-arg's to ...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21202 **[Test build #90033 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90033/testReport)** for PR 21202 at commit [`3e410cd`](https://github.com/apache/spark/commit/3e

[GitHub] spark pull request #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-01 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21054#discussion_r185401222 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala --- @@ -36,6 +36,8 @@ case class Fact(date: Int, hour: Int, minute: Int,

[GitHub] spark pull request #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-01 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21054#discussion_r185402034 --- Diff: sql/core/src/test/scala/org/apache/spark/sql/DataFrameAggregateSuite.scala --- @@ -686,4 +687,72 @@ class DataFrameAggregateSuite extends QueryTest

[GitHub] spark issue #21202: [SPARK-24129] [K8S] Add option to pass --build-arg's to ...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21202 Merged build finished. Test PASSed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21202: [SPARK-24129] [K8S] Add option to pass --build-arg's to ...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21202 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/testing-k8s-prb-make-spark-distribution/2796/ Tes

[GitHub] spark issue #21202: [SPARK-24129] [K8S] Add option to pass --build-arg's to ...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21202 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/2727/ --- --

[GitHub] spark issue #21202: [SPARK-24129] [K8S] Add option to pass --build-arg's to ...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21202 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/testing-k8s-prb-spark-integration/2727/ ---

[GitHub] spark pull request #21054: [SPARK-23907][SQL] Add regr_* functions

2018-05-01 Thread maropu
Github user maropu commented on a diff in the pull request: https://github.com/apache/spark/pull/21054#discussion_r185403679 --- Diff: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/aggregate/Average.scala --- @@ -23,23 +23,13 @@ import org.apache.spark.sql.

[GitHub] spark issue #20894: [SPARK-23786][SQL] Checking column names of csv headers

2018-05-01 Thread gengliangwang
Github user gengliangwang commented on the issue: https://github.com/apache/spark/pull/20894 Some questions here: 1. The case exists in all data source format, right? 2. If user didn't provide schema, should we check the header among CSV files? 3. Users should be responsibl

[GitHub] spark issue #21197: [SPARK-23971] [BACKPORT-2.3] Should not leak Spark sessi...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21197 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/90025/ Test FAILed. ---

[GitHub] spark issue #21197: [SPARK-23971] [BACKPORT-2.3] Should not leak Spark sessi...

2018-05-01 Thread SparkQA
Github user SparkQA commented on the issue: https://github.com/apache/spark/pull/21197 **[Test build #90025 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/90025/testReport)** for PR 21197 at commit [`c1c6377`](https://github.com/apache/spark/commit/c

[GitHub] spark issue #21197: [SPARK-23971] [BACKPORT-2.3] Should not leak Spark sessi...

2018-05-01 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/21197 Merged build finished. Test FAILed. --- - To unsubscribe, e-mail: reviews-unsubscr...@spark.apache.org For additional comma

[GitHub] spark issue #21143: [SPARK-24072][SQL] clearly define pushed filters

2018-05-01 Thread cloud-fan
Github user cloud-fan commented on the issue: https://github.com/apache/spark/pull/21143 Hi @rdblue , you can also create a codegen-ed filter in your data source, but the real problem is whole-stage-codegen. The code is generated at the driver side, sent to and compiled at the executo

[GitHub] spark pull request #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserF...

2018-05-01 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/21178#discussion_r185406504 --- Diff: sql/hive-thriftserver/src/main/scala/org/apache/spark/sql/hive/thriftserver/SparkSQLCLIService.scala --- @@ -52,8 +52,22 @@ private[hive] class S

[GitHub] spark pull request #21178: [SPARK-24110][Thrift-Server] Avoid UGI.loginUserF...

2018-05-01 Thread mridulm
Github user mridulm commented on a diff in the pull request: https://github.com/apache/spark/pull/21178#discussion_r185404453 --- Diff: sql/hive-thriftserver/src/main/java/org/apache/hive/service/auth/HiveAuthFactory.java --- @@ -92,7 +95,26 @@ public String getAuthName() {

<    1   2   3   4   5   6