[GitHub] [spark] AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494639945 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494639947 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] cloud-fan closed pull request #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

2019-05-21 Thread GitBox
cloud-fan closed pull request #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586 This is an automated message from the Apache Git Service.

[GitHub] [spark] AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494639947 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494639945 Merged build finished. Test PASSed.

[GitHub] [spark] WangGuangxin commented on issue #24660: [SPARK-27789]Use stopEarly in codegen of ColumnarBatchScan

2019-05-21 Thread GitBox
WangGuangxin commented on issue #24660: [SPARK-27789]Use stopEarly in codegen of ColumnarBatchScan URL: https://github.com/apache/spark/pull/24660#issuecomment-494639908 > @WangGuangxin, is this issue not existent in master? I just checked and found that master has refactored this

[GitHub] [spark] SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639820 **[Test build #105661 has

[GitHub] [spark] SparkQA removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494609115 **[Test build #105647 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639463 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639469 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled

2019-05-21 Thread GitBox
SparkQA commented on issue #24650: [SPARK-27778][PYTHON] Fix toPandas conversion of empty DataFrame with Arrow enabled URL: https://github.com/apache/spark/pull/24650#issuecomment-494639661 **[Test build #105647 has

[GitHub] [spark] cloud-fan commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types

2019-05-21 Thread GitBox
cloud-fan commented on issue #21586: [SPARK-24586][SQL] Upcast should not allow casting from string to other types URL: https://github.com/apache/spark/pull/21586#issuecomment-494639610 thanks, merging to master! This is an

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639463 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494639469 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] cloud-fan commented on issue #24597: [SPARK-27698][SQL] Add new method `convertibleFilters` for getting pushed down filters in Parquet file reader

2019-05-21 Thread GitBox
cloud-fan commented on issue #24597: [SPARK-27698][SQL] Add new method `convertibleFilters` for getting pushed down filters in Parquet file reader URL: https://github.com/apache/spark/pull/24597#issuecomment-494638806 thanks, merging to master!

[GitHub] [spark] cloud-fan closed pull request #24597: [SPARK-27698][SQL] Add new method `convertibleFilters` for getting pushed down filters in Parquet file reader

2019-05-21 Thread GitBox
cloud-fan closed pull request #24597: [SPARK-27698][SQL] Add new method `convertibleFilters` for getting pushed down filters in Parquet file reader URL: https://github.com/apache/spark/pull/24597 This is an automated

[GitHub] [spark] AmplabJenkins commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-494636903 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-494636898 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-494636903 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-494636898 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-494636717 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead.

2019-05-21 Thread GitBox
SparkQA commented on issue #24671: [MINOR][DOCS]Improve docs about spark.driver.memoryOverhead and spark.executor.memoryOverhead. URL: https://github.com/apache/spark/pull/24671#issuecomment-494635896 **[Test build #105660 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635498 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635494 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494633234 **[Test build #105658 has

[GitHub] [spark] beliefer opened a new pull request #24671: [MINOR][DOCS]Improve docs about overhead.

2019-05-21 Thread GitBox
beliefer opened a new pull request #24671: [MINOR][DOCS]Improve docs about overhead. URL: https://github.com/apache/spark/pull/24671 ## What changes were proposed in this pull request? I found the docs of `spark.driver.memoryOverhead` and `spark.executor.memoryOverhead` exists a

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635494 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635498 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494635470 **[Test build #105658 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494634261 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494634258 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494634251 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494634255 Merged build finished. Test PASSed.

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494634582 **[Test build #105659 has

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494634251 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494634255 Merged build finished. Test PASSed.

[GitHub] [spark] JoshRosen commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494634359 I took a stab at writing a migration guide entry, but the resulting entry is a bit subtle

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494634261 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494634258 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens

2019-05-21 Thread GitBox
SparkQA commented on issue #24569: [SPARK-23191][CORE] Warn rather than terminate when duplicate worker register happens URL: https://github.com/apache/spark/pull/24569#issuecomment-494633234 **[Test build #105658 has

[GitHub] [spark] HyukjinKwon commented on issue #24660: [SPARK-27789]Use stopEarly in codegen of ColumnarBatchScan

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24660: [SPARK-27789]Use stopEarly in codegen of ColumnarBatchScan URL: https://github.com/apache/spark/pull/24660#issuecomment-494633273 @WangGuangxin, is this issue not existent in master?

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494633236 **[Test build #105657 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632867 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632862 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632867 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494632862 Merged build finished. Test PASSed.

[GitHub] [spark] WangGuangxin commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC

2019-05-21 Thread GitBox
WangGuangxin commented on issue #24043: [SPARK-11412][SQL] Support merge schema for ORC URL: https://github.com/apache/spark/pull/24043#issuecomment-494632040 @dongjoon-hyun Thanks for your review. I've updated it according to your comments.

[GitHub] [spark] SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630568 **[Test build #105656 has

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630270 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630267 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630267 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494630270 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629554 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629542 Merged build finished. Test FAILed.

[GitHub] [spark] SparkQA removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494627868 **[Test build #105653 has

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629554 Test FAILed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629532 **[Test build #105653 has

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494629542 Merged build finished. Test FAILed. This

[GitHub] [spark] SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
SparkQA commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494629294 **[Test build #105655 has

[GitHub] [spark] SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494629276 **[Test build #105654 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628917 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628921 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628904 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628934 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628930 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628899 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628921 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628930 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628904 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286292793 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494628899 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494628917 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494628934 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627274 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
SparkQA commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627851 **[Test build #105652 has

[GitHub] [spark] HyukjinKwon commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627840 ok to test This

[GitHub] [spark] SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver

2019-05-21 Thread GitBox
SparkQA commented on issue #24628: [SPARK-27749][SQL][test-hadoop3.2] hadoop-3.2 support hive-thriftserver URL: https://github.com/apache/spark/pull/24628#issuecomment-494627868 **[Test build #105653 has

[GitHub] [spark] rezasafi edited a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi edited a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627509 I created this pr per @HyukjinKwon comment on the jira, but the cherry-pick

[GitHub] [spark] HyukjinKwon commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
HyukjinKwon commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494627577 Oh, I was thinking we should do it 3.x only .. i thought it might be quite breaking

[GitHub] [spark] AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627514 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627506 Merged build finished. Test PASSed.

[GitHub] [spark] viirya commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
viirya commented on a change in pull request #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#discussion_r286291653 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627498 Test PASSed. Refer to this link for build results (access rights to CI

[GitHub] [spark] AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627514 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627498 Test PASSed. Refer to this link for build results (access rights to

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627495 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494627506 Merged build finished. Test PASSed. This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627495 Merged build finished. Test PASSed.

[GitHub] [spark] rezasafi commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627509 I created this pr per @HyukjinKwon, but the cherry-pick to 2.3 was clean and

[GitHub] [spark] AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494626363 Can one of the admins verify this patch? This

[GitHub] [spark] rezasafi opened a new pull request #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
rezasafi opened a new pull request #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670 ## What changes were proposed in this pull request? Python uses a prefetch approach to

[GitHub] [spark] AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24670: [SPARK-25139][SPARK-18406][CORE][BRANCH-2.3] Avoid NonFatals to kill the Executor in PythonRunner URL: https://github.com/apache/spark/pull/24670#issuecomment-494627274 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494627280 Can one of the admins verify this patch? This is an

[GitHub] [spark] AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins removed a comment on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494625916 Can one of the admins verify this patch? This

[GitHub] [spark] SparkQA commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
SparkQA commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494626419 **[Test build #105651 has

[GitHub] [spark] AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494626363 Can one of the admins verify this patch? This is an

[GitHub] [spark] beliefer commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource.

2019-05-21 Thread GitBox
beliefer commented on issue #24647: [SPARK-27776][SQL]Avoid duplicate Java reflection in DataSource. URL: https://github.com/apache/spark/pull/24647#issuecomment-494626017 Based on the above discussion, we all not sure the contract whether providers are required to be stateless. So I

[GitHub] [spark] AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
AmplabJenkins commented on issue #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669#issuecomment-494625916 Can one of the admins verify this patch? This is an

[GitHub] [spark] alex-lx opened a new pull request #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor

2019-05-21 Thread GitBox
alex-lx opened a new pull request #24669: [SPARK-27800][Fix wrong answer of example for BitwiseXor URL: https://github.com/apache/spark/pull/24669 3 ^ 5 should be 6 ## What changes were proposed in this pull request? (Please fill in changes proposed in this fix) ## How

[GitHub] [spark] JoshRosen commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles

2019-05-21 Thread GitBox
JoshRosen commented on issue #24668: [SPARK-27676][SQL][SS] InMemoryFileIndex should respect spark.sql.files.ignoreMissingFiles URL: https://github.com/apache/spark/pull/24668#issuecomment-494625442 @HyukjinKwon, thanks for the pointer to the migration guide (I couldn't remember if this

<    1   2   3   4   5   6   7   8   9   10   >