[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494634258 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] HyukjinKwon commented on issue #24660: [SPARK-27789]Use stopEarly in codegen of ColumnarBatchScan

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24660: [SPARK-27789]Use stopEarly in codegen of ColumnarBatchScan URL: https://github.com/apache/spark/pull/24660#issuecomment-494633273 @WangGuangxin, is this issue not existent in master? Thi

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494633236 **[Test build #105657 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494633234 **[Test build #105658 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuil

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632867 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632862 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632867 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632862 Merged build finished. Test PASSed. ---

[GitHub] [spark] WangGuangxin commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
WangGuangxin commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494632040 @dongjoon-hyun Thanks for your review. I've updated it according to your comments. ---

[GitHub] [spark] SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630568 **[Test build #105656 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105656/tes

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630270 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630267 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630267 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630270 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629554 Test FAILed. Refer to this link for build results (access rights to CI server needed): https

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629542 Merged build finished. Test FAILed. --

[GitHub] [spark] SparkQA removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494627868 **[Test build #105653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/10

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629554 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://ampla

[GitHub] [spark] SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629532 **[Test build #105653 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105653/te

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629542 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494629294 **[Test build #105655 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullReques

[GitHub] [spark] SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494629276 **[Test build #105654 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628917 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628921 Test PASSed. Refer to this link for build results (access rights to C

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628904 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628934 Test PASSed. Refer to this link for build results (access rights to CI server needed): http

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628930 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628899 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628904 Test PASSed. Refer to this link for build results (access rights to CI server needed)

[GitHub] [spark] JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286292793 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execut

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628899 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628917 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628934 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://ampl

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628921 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628930 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627274 Can one of the admins verify this patch? --

[GitHub] [spark] SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627851 **[Test build #105652 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPul

[GitHub] [spark] HyukjinKwon commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627840 ok to test This

[GitHub] [spark] SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494627868 **[Test build #105653 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105653/tes

[GitHub] [spark] rezasafi edited a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi edited a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627509 I created this pr per @HyukjinKwon comment on the jira, but the cherry-pick t

[GitHub] [spark] HyukjinKwon commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494627577 Oh, I was thinking we should do it 3.x only .. i thought it might be quite breaking chang

[GitHub] [spark] AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amp

[GitHub] [spark] AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627506 Merged build finished. Test PASSed. This

[GitHub] [spark] viirya commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
viirya commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286291653 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627498 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627514 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.b

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627498 Test PASSed. Refer to this link for build results (access rights to C

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627495 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627506 Merged build finished. Test PASSed. This is an a

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627495 Merged build finished. Test PASSed. ---

[GitHub] [spark] rezasafi commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627509 I created this pr per @HyukjinKwon, but the cherry-pick to 2.3 was clean and without

[GitHub] [spark] AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494626363 Can one of the admins verify this patch? This is

[GitHub] [spark] rezasafi opened a new pull request #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi opened a new pull request #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670 ## What changes were proposed in this pull request? Python uses a prefetch approach to rea

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627274 Can one of the admins verify this patch? --

[GitHub] [spark] AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494627280 Can one of the admins verify this patch? This is an auto

[GitHub] [spark] AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494625916 Can one of the admins verify this patch? This is

[GitHub] [spark] SparkQA commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
SparkQA commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494626419 **[Test build #105651 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105651/testReport

[GitHub] [spark] AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494626363 Can one of the admins verify this patch? This is an auto

[GitHub] [spark] beliefer commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
beliefer commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494626017 Based on the above discussion, we all not sure the contract whether providers are required to be stateless. So I agree

[GitHub] [spark] AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494625916 Can one of the admins verify this patch? This is an auto

[GitHub] [spark] alex-lx opened a new pull request #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
alex-lx opened a new pull request #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669 3 ^ 5 should be 6 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How

[GitHub] [spark] JoshRosen commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494625442 @HyukjinKwon, thanks for the pointer to the migration guide (I couldn't remember if this li

[GitHub] [spark] wenxuanguan commented on issue #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs

2019-05-21 Thread GitBox
wenxuanguan commented on issue #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-494623894 @HyukjinKwon @srowen @dongjoon-hyun Thank you for review This i

[GitHub] [spark] JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286287606 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execut

[GitHub] [spark] SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

2019-05-21 Thread GitBox
SparkQA commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-494622177 **[Test build #105650 has started](https://amplab.cs.berkeley.edu/jenkins/job/S

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
HyukjinKwon commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286287344 ## File path: sql/core/src/test/scala/org/apache/spark/sql/exe

[GitHub] [spark] AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494621864 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-494621849 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-494621853 Test PASSed. Refer to this link for build results (access right

[GitHub] [spark] AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494621858 Merged build finished. Test PASSed. T

[GitHub] [spark] AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494621864 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab.c

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-494621853 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24637: [SPARK-27707][SQL] Prune unnecessary nested fields from Generate to address performance issue in explode URL: https://github.com/apache/spark/pull/24637#issuecomment-494621849 Merged build finished. Test PASSed. -

[GitHub] [spark] AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494621858 Merged build finished. Test PASSed. This is a

[GitHub] [spark] cloud-fan commented on issue #24635: [SPARK-27762][SQL] Support user provided avro schema for writing fields with different ordering

2019-05-21 Thread GitBox
cloud-fan commented on issue #24635: [SPARK-27762][SQL] Support user provided avro schema for writing fields with different ordering URL: https://github.com/apache/spark/pull/24635#issuecomment-494621790 Hi @dbtsai , adding to release notes usually means adding an entry in the SQL migratio

[GitHub] [spark] viirya commented on a change in pull request #24599: [SPARK-27701][SQL] Extend NestedColumnAliasing to more nested field cases

2019-05-21 Thread GitBox
viirya commented on a change in pull request #24599: [SPARK-27701][SQL] Extend NestedColumnAliasing to more nested field cases URL: https://github.com/apache/spark/pull/24599#discussion_r286286753 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/Nes

[GitHub] [spark] HyukjinKwon commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494621445 Yea, I was thinking about respecting this option but just decided to follow the existent way

[GitHub] [spark] SparkQA commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
SparkQA commented on issue #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#issuecomment-494620856 **[Test build #105649 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105649/testRep

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494620471 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494620477 Test PASSed. Refer to this link for build results (access rights to CI server nee

[GitHub] [spark] HyukjinKwon closed pull request #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs

2019-05-21 Thread GitBox
HyukjinKwon closed pull request #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494620477 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494620471 Merged build finished. Test PASSed. ---

[GitHub] [spark] viirya commented on a change in pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing

2019-05-21 Thread GitBox
viirya commented on a change in pull request #24525: [SPARK-27633][SQL] Remove redundant aliases in NestedColumnAliasing URL: https://github.com/apache/spark/pull/24525#discussion_r286285796 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/optimizer/NestedCol

[GitHub] [spark] HyukjinKwon commented on issue #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24631: [SPARK-27774][CORE][MLLIB] Avoid hardcoded configs URL: https://github.com/apache/spark/pull/24631#issuecomment-494619984 Merged to master. This is an automated message from the Apache G

[GitHub] [spark] Ngone51 commented on issue #24530: [SPARK-27520][CORE][WIP] Introduce a global config system to replace hadoopConfiguration

2019-05-21 Thread GitBox
Ngone51 commented on issue #24530: [SPARK-27520][CORE][WIP] Introduce a global config system to replace hadoopConfiguration URL: https://github.com/apache/spark/pull/24530#issuecomment-494619523 @jiangxb1987 Could you have another look please ? -

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494619248 Test PASSed. Refer to this link for build results (access rights to CI server needed): https:

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494619439 **[Test build #105648 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBui

[GitHub] [spark] AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494619246 Merged build finished. Test PASSed. ---

[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494619246 Merged build finished. Test PASSed. This i

[GitHub] [spark] AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494619248 Test PASSed. Refer to this link for build results (access rights to CI server needed): https://amplab

[GitHub] [spark] SparkQA removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494598249 **[Test build #105645 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105

[GitHub] [spark] SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling

2019-05-21 Thread GitBox
SparkQA commented on issue #24374: [WIP][SPARK-27366][CORE] Support GPU Resources in Spark job scheduling URL: https://github.com/apache/spark/pull/24374#issuecomment-494618870 **[Test build #105645 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/105645/tes

[GitHub] [spark] HyukjinKwon closed pull request #24620: [SPARK-27737][SQL] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
HyukjinKwon closed pull request #24620: [SPARK-27737][SQL] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620 This is an automated message from the Apache

[GitHub] [spark] HyukjinKwon commented on issue #24620: [SPARK-27737][SQL] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24620: [SPARK-27737][SQL] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620#issuecomment-494616181 Merged to master. This i

[GitHub] [spark] AmplabJenkins removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620#issuecomment-494613361 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620#issuecomment-494613363 Test PASSed. Refer to this link for build result

[GitHub] [spark] AmplabJenkins commented on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620#issuecomment-494613361 Merged build finished. Test PASSed. --

[GitHub] [spark] AmplabJenkins commented on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620#issuecomment-494613363 Test PASSed. Refer to this link for build results (acces

[GitHub] [spark] SparkQA removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24620: [SPARK-27737][SQL][test-hadoop3.2][test-maven] Upgrade to Hive 2.3.5 for Hive Metastore Client and Hadoop-3.2 profile URL: https://github.com/apache/spark/pull/24620#issuecomment-494536413 **[Test build #105636 has started](https://amplab.cs.ber

<    1   2   3   4   5   6   7   8   9   10   >