[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268044726 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268044461 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268044461 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268043952 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268043735 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268043492 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268043465 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins

AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-474679573 Merged build finished. Test FAILed. This is an

[GitHub] [spark] SparkQA commented on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins

SparkQA commented on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-475501638 **[Test build #103804 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103804/testReport)** for PR

[GitHub] [spark] AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins

AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-475501384 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins

AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-475501384 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268043072 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins

AmplabJenkins commented on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-475501381 Merged build finished. Test PASSed. This is an automated

[GitHub] [spark] AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins

AmplabJenkins removed a comment on issue #24044: [WIP][test-hadoop3.2] Test Hadoop 3.2 on jenkins URL: https://github.com/apache/spark/pull/24044#issuecomment-475501381 Merged build finished. Test PASSed. This is an

[GitHub] [spark] gatorsmile commented on issue #24166: [SPARK-27226][SQL] Reduce the code duplicate when upgrading built-in Hive

gatorsmile commented on issue #24166: [SPARK-27226][SQL] Reduce the code duplicate when upgrading built-in Hive URL: https://github.com/apache/spark/pull/24166#issuecomment-475501083 @wangyum Thank you for your work! This looks much better. cc @dongjoon-hyun @liancheng

[GitHub] [spark] viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268042658 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268042394 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268042299 ## File path:

[GitHub] [spark] viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

viirya commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268042148 ## File path:

[GitHub] [spark] gengliangwang commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

gengliangwang commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268041550 ## File path:

[GitHub] [spark] gatorsmile commented on a change in pull request #23900: [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF

gatorsmile commented on a change in pull request #23900: [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF URL: https://github.com/apache/spark/pull/23900#discussion_r268040170 ## File path: python/pyspark/sql/functions.py ## @@ -2868,6 +2869,15

[GitHub] [spark] gatorsmile commented on a change in pull request #23900: [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF

gatorsmile commented on a change in pull request #23900: [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF URL: https://github.com/apache/spark/pull/23900#discussion_r268040038 ## File path: python/pyspark/sql/functions.py ## @@ -2868,6 +2869,15

[GitHub] [spark] gatorsmile commented on a change in pull request #23900: [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF

gatorsmile commented on a change in pull request #23900: [SPARK-23836][PYTHON] Add support for StructType return in Scalar Pandas UDF URL: https://github.com/apache/spark/pull/23900#discussion_r268039959 ## File path: python/pyspark/sql/functions.py ## @@ -2868,6 +2869,15

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268039339 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268039339 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

dongjoon-hyun commented on a change in pull request #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#discussion_r268039038 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268038230 ## File path:

[GitHub] [spark] BryanCutler commented on issue #24095: [SPARK-27163][PYTHON] Cleanup and consolidate Pandas UDF functionality

BryanCutler commented on issue #24095: [SPARK-27163][PYTHON] Cleanup and consolidate Pandas UDF functionality URL: https://github.com/apache/spark/pull/24095#issuecomment-475494263 Thanks @HyukjinKwon and @ueshin ! This is

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268037271 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268037271 ## File path:

[GitHub] [spark] maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268036183 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475491041 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

SparkQA removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475490850 **[Test build #103800 has

[GitHub] [spark] AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475491040 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475491040 Merged build finished. Test FAILed.

[GitHub] [spark] AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475491041 Test FAILed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] SparkQA commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

SparkQA commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475491038 **[Test build #103800 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475490595 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins removed a comment on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475490591 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175#issuecomment-475490799 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

AmplabJenkins removed a comment on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175#issuecomment-475490399 Can one of the admins verify this patch?

[GitHub] [spark] SparkQA commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode'

SparkQA commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode' URL: https://github.com/apache/spark/pull/24123#issuecomment-475490865 **[Test build #103802 has

[GitHub] [spark] SparkQA commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time

SparkQA commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#issuecomment-475490880 **[Test build #103803 has

[GitHub] [spark] SparkQA commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

SparkQA commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475490850 **[Test build #103800 has

[GitHub] [spark] SparkQA commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

SparkQA commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475490866 **[Test build #103801 has

[GitHub] [spark] AmplabJenkins removed a comment on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time

AmplabJenkins removed a comment on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#issuecomment-475490635 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475490560 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode'

AmplabJenkins removed a comment on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode' URL: https://github.com/apache/spark/pull/24123#issuecomment-475490585 Test PASSed. Refer to this link for build

[GitHub] [spark] AmplabJenkins removed a comment on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time

AmplabJenkins removed a comment on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#issuecomment-475490641 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins removed a comment on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode'

AmplabJenkins removed a comment on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode' URL: https://github.com/apache/spark/pull/24123#issuecomment-475490582 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time

AmplabJenkins commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#issuecomment-475490635 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475490565 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time

AmplabJenkins commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#issuecomment-475490641 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475490595 Test PASSed. Refer to this link for build results (access rights to CI server

[GitHub] [spark] AmplabJenkins removed a comment on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

AmplabJenkins removed a comment on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175#issuecomment-475490073 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode'

AmplabJenkins commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode' URL: https://github.com/apache/spark/pull/24123#issuecomment-475490582 Merged build finished. Test PASSed.

[GitHub] [spark] maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268035004 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

AmplabJenkins commented on issue #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174#issuecomment-475490591 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475490560 Merged build finished. Test PASSed. This

[GitHub] [spark] AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475490565 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] AmplabJenkins commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode'

AmplabJenkins commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode' URL: https://github.com/apache/spark/pull/24123#issuecomment-475490585 Test PASSed. Refer to this link for build results

[GitHub] [spark] AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175#issuecomment-475490399 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins removed a comment on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

AmplabJenkins removed a comment on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175#issuecomment-475486685 Can one of the admins verify this patch?

[GitHub] [spark] AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175#issuecomment-475490073 Can one of the admins verify this patch?

[GitHub] [spark] wangjiaochun commented on issue #24127: [SPARK-27186][CORE] optimize sortshuffle write

wangjiaochun commented on issue #24127: [SPARK-27186][CORE] optimize sortshuffle write URL: https://github.com/apache/spark/pull/24127#issuecomment-475488979 Sorry，I have no good idea about your suggestion。 This is an

[GitHub] [spark] LantaoJin commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time

LantaoJin commented on issue #23951: [SPARK-13704][CORE][YARN] Re-implement RackResolver to reduce resolving time URL: https://github.com/apache/spark/pull/23951#issuecomment-475488699 Jenkins, retest this please This is an

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268033297 ## File path:

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268033297 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

SparkQA removed a comment on issue #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-475448045 **[Test build #103798 has

[GitHub] [spark] SparkQA removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

SparkQA removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475466941 **[Test build #103799 has

[GitHub] [spark] SparkQA commented on issue #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2

SparkQA commented on issue #24005: [SPARK-27085][SQL] Migrate CSV to File Data Source V2 URL: https://github.com/apache/spark/pull/24005#issuecomment-475488184 **[Test build #103798 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/103798/testReport)** for

[GitHub] [spark] SparkQA commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

SparkQA commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475487986 **[Test build #103799 has

[GitHub] [spark] maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268032776 ## File path:

[GitHub] [spark] SparkQA removed a comment on issue #20793: [SPARK-23643][CORE][SQL][ML] Shrinking the buffer in hashSeed up to size of the seed parameter

SparkQA removed a comment on issue #20793: [SPARK-23643][CORE][SQL][ML] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-475432207 **[Test build #103795 has

[GitHub] [spark] SparkQA commented on issue #20793: [SPARK-23643][CORE][SQL][ML] Shrinking the buffer in hashSeed up to size of the seed parameter

SparkQA commented on issue #20793: [SPARK-23643][CORE][SQL][ML] Shrinking the buffer in hashSeed up to size of the seed parameter URL: https://github.com/apache/spark/pull/20793#issuecomment-475487441 **[Test build #103795 has

[GitHub] [spark] AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

AmplabJenkins commented on issue #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175#issuecomment-475486685 Can one of the admins verify this patch?

[GitHub] [spark] HyukjinKwon commented on issue #24151: [SPARK-26739][SQL] Standardized Join Types for DataFrames

HyukjinKwon commented on issue #24151: [SPARK-26739][SQL] Standardized Join Types for DataFrames URL: https://github.com/apache/spark/pull/24151#issuecomment-475486315 Probably, I guess this idea came from save modes. I don't have strong opinion on this too ..

[GitHub] [spark] dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

dongjoon-hyun commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268031289 ## File path:

[GitHub] [spark] HyukjinKwon commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode'

HyukjinKwon commented on issue #24123: [SPARK-27184][CORE] Avoid hardcoded 'spark.jars', 'spark.files', 'spark.submit.pyFiles' and 'spark.submit.deployMode' URL: https://github.com/apache/spark/pull/24123#issuecomment-475485564 retest this please

[GitHub] [spark] HyukjinKwon commented on a change in pull request #24169: [SPARK-27235] Remove the Dead code in HashedRelation.scala file from sql core module

HyukjinKwon commented on a change in pull request #24169: [SPARK-27235] Remove the Dead code in HashedRelation.scala file from sql core module URL: https://github.com/apache/spark/pull/24169#discussion_r268031059 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #24170: [SPARK-26998][CORE] Add secure alternatives of ssl password parameters

HeartSaVioR commented on a change in pull request #24170: [SPARK-26998][CORE] Add secure alternatives of ssl password parameters URL: https://github.com/apache/spark/pull/24170#discussion_r268030160 ## File path: core/src/main/scala/org/apache/spark/SSLOptions.scala ## @@

[GitHub] [spark] HeartSaVioR commented on a change in pull request #24170: [SPARK-26998][CORE] Add secure alternatives of ssl password parameters

HeartSaVioR commented on a change in pull request #24170: [SPARK-26998][CORE] Add secure alternatives of ssl password parameters URL: https://github.com/apache/spark/pull/24170#discussion_r268030333 ## File path: core/src/main/scala/org/apache/spark/SSLOptions.scala ## @@

[GitHub] [spark] maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268031052 ## File path:

[GitHub] [spark] hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' & 'spark.submit.pyFiles' & 'spark.submit.deployMode' with the variable

hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' & 'spark.submit.pyFiles' & 'spark.submit.deployMode' with the variables of this config object URL: https://github.com/apache/spark/pull/24123#discussion_r268029099 ##

[GitHub] [spark] hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' & 'spark.submit.pyFiles' & 'spark.submit.deployMode' with the variable

hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' & 'spark.submit.pyFiles' & 'spark.submit.deployMode' with the variables of this config object URL: https://github.com/apache/spark/pull/24123#discussion_r268030208 ##

[GitHub] [spark] WangGuangxin opened a new pull request #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero

WangGuangxin opened a new pull request #24175: [SPARK-27232][SQL]Ignore file locality in InMemoryFileIndex if spark.locality.wait is set to zero URL: https://github.com/apache/spark/pull/24175 ## What changes were proposed in this pull request? `InMemoryFileIndex` needs to request

[GitHub] [spark] maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support

maropu commented on a change in pull request #24158: [SPARK-26847][SQL] Pruning nested serializers from object serializers: MapType support URL: https://github.com/apache/spark/pull/24158#discussion_r268029888 ## File path:

[GitHub] [spark] HeartSaVioR commented on a change in pull request #24170: [SPARK-26998][CORE] Add secure alternatives of ssl password parameters

HeartSaVioR commented on a change in pull request #24170: [SPARK-26998][CORE] Add secure alternatives of ssl password parameters URL: https://github.com/apache/spark/pull/24170#discussion_r268029322 ## File path: core/src/main/scala/org/apache/spark/SSLOptions.scala ## @@

[GitHub] [spark] hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' with the variables of this config object

hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' with the variables of this config object URL: https://github.com/apache/spark/pull/24123#discussion_r268027700 ## File path:

[GitHub] [spark] hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' with the variables of this config object

hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' with the variables of this config object URL: https://github.com/apache/spark/pull/24123#discussion_r268029099 ## File path:

[GitHub] [spark] HeartSaVioR commented on issue #24163: [SPARK-26606][CORE] Handle driver options properly when submitting to standalone cluster mode via legacy Client

HeartSaVioR commented on issue #24163: [SPARK-26606][CORE] Handle driver options properly when submitting to standalone cluster mode via legacy Client URL: https://github.com/apache/spark/pull/24163#issuecomment-475482328 cc. @vanzin since passing SparkConf here seemed to be introduced by

[GitHub] [spark] 10110346 opened a new pull request #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet `

10110346 opened a new pull request #24174: [SPARK-27238][SQL] Add a fine-grained configuration to handle `convertMetastoreParquet ` URL: https://github.com/apache/spark/pull/24174 ## What changes were proposed in this pull request? In the same APP, TableA and TableB are both hive

[GitHub] [spark] wangyum commented on issue #24119: [SPARK-27182][SQL] Move the conflict source code of the sql/core module to sql/core/v1.2.1

wangyum commented on issue #24119: [SPARK-27182][SQL] Move the conflict source code of the sql/core module to sql/core/v1.2.1 URL: https://github.com/apache/spark/pull/24119#issuecomment-475481039 Yes. Thanks @HyukjinKwon

[GitHub] [spark] hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' with the variables of this config object

hehuiyuan commented on a change in pull request #24123: [SPARK-27184][CORE] Replace 'spark.jars' & 'spark.files' with the variables of this config object URL: https://github.com/apache/spark/pull/24123#discussion_r268027700 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475480866 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum commented on a change in pull request #24166: [SPARK-27226][SQL] Reduce the code duplicate when upgrading built-in Hive

wangyum commented on a change in pull request #24166: [SPARK-27226][SQL] Reduce the code duplicate when upgrading built-in Hive URL: https://github.com/apache/spark/pull/24166#discussion_r268027587 ## File path:

[GitHub] [spark] AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475480866 Test PASSed. Refer to this link for build results (access rights to CI server needed):

[GitHub] [spark] wangyum commented on a change in pull request #24166: [SPARK-27226][SQL] Reduce the code duplicate when upgrading built-in Hive

wangyum commented on a change in pull request #24166: [SPARK-27226][SQL] Reduce the code duplicate when upgrading built-in Hive URL: https://github.com/apache/spark/pull/24166#discussion_r268027527 ## File path:

[GitHub] [spark] AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins removed a comment on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475480863 Merged build finished. Test PASSed.

[GitHub] [spark] AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve…

AmplabJenkins commented on issue #24136: [SPARK-27088][SQL] Apply conf "spark.sql.optimizer.planChangeLog.leve… URL: https://github.com/apache/spark/pull/24136#issuecomment-475480863 Merged build finished. Test PASSed. This

  1   2   3   4   5   6   7   8   >