[GitHub] [spark] gaborgsomogyi commented on pull request #30389: [SPARK-33143][PYTHON] Add configurable timeout to python server and client

gaborgsomogyi commented on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-729507006 Thanks for pinpointing this out. The dev jar + python changes sent out on 2.4 version which differs from 3.1 code. Maybe just restructured but I need to go deeper because

[GitHub] [spark] SparkQA commented on pull request #30404: [SPARK-33475][BUILD] Bump ANTLR runtime version to 4.8-1

SparkQA commented on pull request #30404: URL: https://github.com/apache/spark/pull/30404#issuecomment-729507463 **[Test build #131248 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131248/testReport)** for PR 30404 at commit [`e28ef62`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30404: [SPARK-33475][BUILD] Bump ANTLR runtime version to 4.8-1

SparkQA removed a comment on pull request #30404: URL: https://github.com/apache/spark/pull/30404#issuecomment-729404605 **[Test build #131248 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131248/testReport)** for PR 30404 at commit [`e28ef62`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30373: [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order

AmplabJenkins removed a comment on pull request #30373: URL: https://github.com/apache/spark/pull/30373#issuecomment-729501074 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting externa

AmplabJenkins removed a comment on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-729494363 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30373: [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order

AmplabJenkins removed a comment on pull request #30373: URL: https://github.com/apache/spark/pull/30373#issuecomment-729501085 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8

[GitHub] [spark] SparkQA commented on pull request #30312: [WIP][SPARK-32917][SHUFFLE][CORE][test-maven][test-hadoop2.7] Adds support for executors to push shuffle blocks after successful map task com

SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-729508420 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffle serv

SparkQA commented on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-729508407 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #30393: [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

SparkQA commented on pull request #30393: URL: https://github.com/apache/spark/pull/30393#issuecomment-729508414 **[Test build #131260 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131260/testReport)** for PR 30393 at commit [`b257470`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30373: [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order

SparkQA commented on pull request #30373: URL: https://github.com/apache/spark/pull/30373#issuecomment-729508408 **[Test build #131256 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131256/testReport)** for PR 30373 at commit [`fa6050a`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30260: [SPARK-33354][SQL] New explicit cast syntax rules in ANSI mode

SparkQA commented on pull request #30260: URL: https://github.com/apache/spark/pull/30260#issuecomment-729508413 **[Test build #131250 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131250/testReport)** for PR 30260 at commit [`1d57a24`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

SparkQA commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729508409 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #30400: [SPARK-33469][SQL] Add current_timezone function

SparkQA commented on pull request #30400: URL: https://github.com/apache/spark/pull/30400#issuecomment-729508415 **[Test build #131247 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131247/testReport)** for PR 30400 at commit [`73f71c5`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

SparkQA commented on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729508405 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #30399: [SPARK-33468][SQL] ParseUrl in ANSI mode should fail if input string is not a valid url

SparkQA commented on pull request #30399: URL: https://github.com/apache/spark/pull/30399#issuecomment-729508416 **[Test build #131245 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131245/testReport)** for PR 30399 at commit [`2202ca4`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #30351: [SPARK-33441][BUILD] Add unused-imports compilation check and remove all unused-imports

SparkQA commented on pull request #30351: URL: https://github.com/apache/spark/pull/30351#issuecomment-729508410 **[Test build #131251 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131251/testReport)** for PR 30351 at commit [`f6f8cb7`](https://github.co

[GitHub] [spark] AngersZhuuuu commented on a change in pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

AngersZh commented on a change in pull request #30407: URL: https://github.com/apache/spark/pull/30407#discussion_r525881911 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/HiveUtils.scala ## @@ -96,17 +96,18 @@ private[spark] object HiveUtils extends Loggin

[GitHub] [spark] SparkQA removed a comment on pull request #30373: [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order

SparkQA removed a comment on pull request #30373: URL: https://github.com/apache/spark/pull/30373#issuecomment-729448443 **[Test build #131256 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131256/testReport)** for PR 30373 at commit [`fa6050a`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting externa

AmplabJenkins removed a comment on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-729508496 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins commented on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuffl

AmplabJenkins commented on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-729508496 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA removed a comment on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting external shuf

SparkQA removed a comment on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-729440162 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] SparkQA commented on pull request #30393: [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

SparkQA commented on pull request #30393: URL: https://github.com/apache/spark/pull/30393#issuecomment-729508682 **[Test build #131262 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131262/testReport)** for PR 30393 at commit [`3f2ef98`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30312: [WIP][SPARK-32917][SHUFFLE][CORE][test-maven][test-hadoop2.7] Adds support for executors to push shuffle blocks after successful map task com

SparkQA commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-729508755 **[Test build #131263 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131263/testReport)** for PR 30312 at commit [`d41b34c`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

AmplabJenkins commented on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729508672 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30404: [SPARK-33475][BUILD] Bump ANTLR runtime version to 4.8-1

AmplabJenkins commented on pull request #30404: URL: https://github.com/apache/spark/pull/30404#issuecomment-729508742 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #30389: [SPARK-33143][PYTHON] Add configurable timeout to python server and client

gaborgsomogyi commented on a change in pull request #30389: URL: https://github.com/apache/spark/pull/30389#discussion_r525882048 ## File path: core/src/main/scala/org/apache/spark/internal/config/Python.scala ## @@ -50,4 +50,9 @@ private[spark] object Python { .version("2

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Migrate CACHE/UNCACHE TABLE command to use UnresolvedTableOrView to resolve the identifier

SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-729508674 **[Test build #131261 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131261/testReport)** for PR 30403 at commit [`f36bc59`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

AmplabJenkins commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729508750 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30393: [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

AmplabJenkins commented on pull request #30393: URL: https://github.com/apache/spark/pull/30393#issuecomment-729508777 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30312: [WIP][SPARK-32917][SHUFFLE][CORE][test-maven][test-hadoop2.7] Adds support for executors to push shuffle blocks after successful map ta

AmplabJenkins commented on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-729508797 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30373: [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order

AmplabJenkins commented on pull request #30373: URL: https://github.com/apache/spark/pull/30373#issuecomment-729508940 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30260: [SPARK-33354][SQL] New explicit cast syntax rules in ANSI mode

AmplabJenkins commented on pull request #30260: URL: https://github.com/apache/spark/pull/30260#issuecomment-729508843 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30260: [SPARK-33354][SQL] New explicit cast syntax rules in ANSI mode

AmplabJenkins removed a comment on pull request #30260: URL: https://github.com/apache/spark/pull/30260#issuecomment-729508843 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

AmplabJenkins removed a comment on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729508672 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30373: [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order

AmplabJenkins removed a comment on pull request #30373: URL: https://github.com/apache/spark/pull/30373#issuecomment-729508940 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting externa

AmplabJenkins removed a comment on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-729508500 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30312: [WIP][SPARK-32917][SHUFFLE][CORE][test-maven][test-hadoop2.7] Adds support for executors to push shuffle blocks after successful map

SparkQA removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-729344249 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] SparkQA removed a comment on pull request #30260: [SPARK-33354][SQL] New explicit cast syntax rules in ANSI mode

SparkQA removed a comment on pull request #30260: URL: https://github.com/apache/spark/pull/30260#issuecomment-729419446 **[Test build #131250 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131250/testReport)** for PR 30260 at commit [`1d57a24`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30404: [SPARK-33475][BUILD] Bump ANTLR runtime version to 4.8-1

AmplabJenkins removed a comment on pull request #30404: URL: https://github.com/apache/spark/pull/30404#issuecomment-729508742 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30399: [SPARK-33468][SQL] ParseUrl in ANSI mode should fail if input string is not a valid url

SparkQA removed a comment on pull request #30399: URL: https://github.com/apache/spark/pull/30399#issuecomment-729395393 **[Test build #131245 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131245/testReport)** for PR 30399 at commit [`2202ca4`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30393: [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

SparkQA removed a comment on pull request #30393: URL: https://github.com/apache/spark/pull/30393#issuecomment-729477702 **[Test build #131260 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131260/testReport)** for PR 30393 at commit [`b257470`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30400: [SPARK-33469][SQL] Add current_timezone function

SparkQA removed a comment on pull request #30400: URL: https://github.com/apache/spark/pull/30400#issuecomment-729400055 **[Test build #131247 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131247/testReport)** for PR 30400 at commit [`73f71c5`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #30351: [SPARK-33441][BUILD] Add unused-imports compilation check and remove all unused-imports

SparkQA removed a comment on pull request #30351: URL: https://github.com/apache/spark/pull/30351#issuecomment-729429758 **[Test build #131251 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131251/testReport)** for PR 30351 at commit [`f6f8cb7`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30312: [WIP][SPARK-32917][SHUFFLE][CORE][test-maven][test-hadoop2.7] Adds support for executors to push shuffle blocks after successfu

AmplabJenkins removed a comment on pull request #30312: URL: https://github.com/apache/spark/pull/30312#issuecomment-729508797 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA removed a comment on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

SparkQA removed a comment on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729473677 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30393: [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

AmplabJenkins removed a comment on pull request #30393: URL: https://github.com/apache/spark/pull/30393#issuecomment-729508777 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] SparkQA removed a comment on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

SparkQA removed a comment on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729471571 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

AmplabJenkins removed a comment on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729508750 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] AmplabJenkins commented on pull request #30399: [SPARK-33468][SQL] ParseUrl in ANSI mode should fail if input string is not a valid url

AmplabJenkins commented on pull request #30399: URL: https://github.com/apache/spark/pull/30399#issuecomment-729509068 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30400: [SPARK-33469][SQL] Add current_timezone function

AmplabJenkins commented on pull request #30400: URL: https://github.com/apache/spark/pull/30400#issuecomment-729509127 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] opensky142857 commented on a change in pull request #29725: [SPARK-32096][SQL] Improve sorting performance of Spark SQL window function by removing window partition key from sort orde

opensky142857 commented on a change in pull request #29725: URL: https://github.com/apache/spark/pull/29725#discussion_r525882766 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowWindowSorter.java ## @@ -0,0 +1,453 @@ +/* + * Licensed to the

[GitHub] [spark] SparkQA commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

SparkQA commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729509412 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #30234: [SPARK-33285][CORE][SQL] Fix deprecated compilation warnings of "Auto-application to () is deprecated" in Scala 2.13

SparkQA commented on pull request #30234: URL: https://github.com/apache/spark/pull/30234#issuecomment-729509448 **[Test build #131266 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131266/testReport)** for PR 30234 at commit [`9284fdc`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

AmplabJenkins commented on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729509501 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30355: [SPARK-32907][ML][PYTHON] Adaptively blockify instances - AFT,LiR,LoR

SparkQA commented on pull request #30355: URL: https://github.com/apache/spark/pull/30355#issuecomment-729509488 **[Test build #131268 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131268/testReport)** for PR 30355 at commit [`317bde9`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

AmplabJenkins removed a comment on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729508774 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] viirya commented on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

viirya commented on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729509556 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30260: [SPARK-33354][SQL] New explicit cast syntax rules in ANSI mode

AmplabJenkins removed a comment on pull request #30260: URL: https://github.com/apache/spark/pull/30260#issuecomment-729508854 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30373: [SPARK-33472][SQL] Adjust RemoveRedundantSorts rule order

AmplabJenkins removed a comment on pull request #30373: URL: https://github.com/apache/spark/pull/30373#issuecomment-729508947 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30164: [SPARK-32919][SHUFFLE][test-maven][test-hadoop2.7] Driver side changes for coordinating push based shuffle by selecting externa

AmplabJenkins removed a comment on pull request #30164: URL: https://github.com/apache/spark/pull/30164#issuecomment-729508588 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30400: [SPARK-33469][SQL] Add current_timezone function

AmplabJenkins removed a comment on pull request #30400: URL: https://github.com/apache/spark/pull/30400#issuecomment-729509127 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30399: [SPARK-33468][SQL] ParseUrl in ANSI mode should fail if input string is not a valid url

AmplabJenkins removed a comment on pull request #30399: URL: https://github.com/apache/spark/pull/30399#issuecomment-729509068 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

AmplabJenkins removed a comment on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729508687 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

SparkQA commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729509504 **[Test build #131269 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131269/testReport)** for PR 30407 at commit [`d7f040c`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #30351: [SPARK-33441][BUILD] Add unused-imports compilation check and remove all unused-imports

AmplabJenkins commented on pull request #30351: URL: https://github.com/apache/spark/pull/30351#issuecomment-729509659 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] viirya commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

viirya commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729509714 retest this please This is an automated message from the Apache Git Service. To respond to the message, please lo

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30400: [SPARK-33469][SQL] Add current_timezone function

AmplabJenkins removed a comment on pull request #30400: URL: https://github.com/apache/spark/pull/30400#issuecomment-729509143 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30351: [SPARK-33441][BUILD] Add unused-imports compilation check and remove all unused-imports

AmplabJenkins removed a comment on pull request #30351: URL: https://github.com/apache/spark/pull/30351#issuecomment-729509659 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30399: [SPARK-33468][SQL] ParseUrl in ANSI mode should fail if input string is not a valid url

AmplabJenkins removed a comment on pull request #30399: URL: https://github.com/apache/spark/pull/30399#issuecomment-729509084 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

AmplabJenkins removed a comment on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729509514 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

AmplabJenkins commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729510223 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

SparkQA commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729510205 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

SparkQA commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729510354 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35860/ ---

[GitHub] [spark] SparkQA commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

SparkQA commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729510365 **[Test build #131265 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131265/testReport)** for PR 30407 at commit [`8abc00f`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

AmplabJenkins commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729510369 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

AmplabJenkins commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729510381 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

AmplabJenkins removed a comment on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729510369 Merged build finished. Test FAILed. This is an automated message from the Apache Git Service. To r

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #30389: [SPARK-33143][PYTHON] Add configurable timeout to python server and client

gaborgsomogyi commented on a change in pull request #30389: URL: https://github.com/apache/spark/pull/30389#discussion_r525883959 ## File path: core/src/main/scala/org/apache/spark/internal/config/Python.scala ## @@ -50,4 +50,9 @@ private[spark] object Python { .version("2

[GitHub] [spark] SparkQA commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

SparkQA commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729510484 **[Test build #131269 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131269/testReport)** for PR 30407 at commit [`d7f040c`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

SparkQA removed a comment on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729509425 This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30351: [SPARK-33441][BUILD] Add unused-imports compilation check and remove all unused-imports

AmplabJenkins removed a comment on pull request #30351: URL: https://github.com/apache/spark/pull/30351#issuecomment-729509671 Test FAILed. Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/131

[GitHub] [spark] AmplabJenkins removed a comment on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

AmplabJenkins removed a comment on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729510223 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] opensky142857 commented on a change in pull request #29725: [SPARK-32096][SQL] Improve sorting performance of Spark SQL window function by removing window partition key from sort orde

opensky142857 commented on a change in pull request #29725: URL: https://github.com/apache/spark/pull/29725#discussion_r525882766 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowWindowSorter.java ## @@ -0,0 +1,453 @@ +/* + * Licensed to the

[GitHub] [spark] gaborgsomogyi commented on a change in pull request #30389: [SPARK-33143][PYTHON] Add configurable timeout to python server and client

gaborgsomogyi commented on a change in pull request #30389: URL: https://github.com/apache/spark/pull/30389#discussion_r525887029 ## File path: core/src/test/scala/org/apache/spark/api/python/PythonRDDSuite.scala ## @@ -76,12 +79,22 @@ class PythonRDDSuite extends SparkFunSuite

[GitHub] [spark] SparkQA commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

SparkQA commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729513059 **[Test build #131270 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131270/testReport)** for PR 30406 at commit [`ee4b070`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

SparkQA commented on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729513102 **[Test build #131271 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131271/testReport)** for PR 30405 at commit [`8ca8624`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30405: [SPARK-33476][CORE] Generalize ExecutorSource to expose user-given file system schemes

SparkQA commented on pull request #30405: URL: https://github.com/apache/spark/pull/30405#issuecomment-729514011 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35862/ -

[GitHub] [spark] LuciferYang commented on pull request #30351: [SPARK-33441][BUILD] Add unused-imports compilation check and remove all unused-imports

LuciferYang commented on pull request #30351: URL: https://github.com/apache/spark/pull/30351#issuecomment-729517035 @HyukjinKwon should we merge this ? This is an automated message from the Apache Git Service. To respond to

[GitHub] [spark] SparkQA commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

SparkQA commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729517367 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35861/ ---

[GitHub] [spark] AmplabJenkins commented on pull request #30406: [SPARK-33473][SQL] Extend interpreted subexpression elimination to other interpreted projections

AmplabJenkins commented on pull request #30406: URL: https://github.com/apache/spark/pull/30406#issuecomment-729517379 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[GitHub] [spark] SparkQA commented on pull request #30389: [SPARK-33143][PYTHON] Add configurable timeout to python server and client

SparkQA commented on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-729517562 **[Test build #131273 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131273/testReport)** for PR 30389 at commit [`f504af3`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #30407: [SPARK-32852][SQL][Doc][Followup] Revise the documentation of spark.sql.hive.metastore.jars

SparkQA commented on pull request #30407: URL: https://github.com/apache/spark/pull/30407#issuecomment-729517514 **[Test build #131272 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/131272/testReport)** for PR 30407 at commit [`45922bd`](https://github.com

[GitHub] [spark] mridulm commented on a change in pull request #30391: [SPARK-33464][INFRA] Add/remove (un)necessary cache and restructure GitHub Actions yaml

mridulm commented on a change in pull request #30391: URL: https://github.com/apache/spark/pull/30391#discussion_r525893835 ## File path: .github/workflows/build_and_test.yml ## @@ -433,11 +407,32 @@ jobs: key: scala-213-coursier-${{ hashFiles('**/pom.xml', '**/plugins

[GitHub] [spark] mridulm commented on a change in pull request #30391: [SPARK-33464][INFRA] Add/remove (un)necessary cache and restructure GitHub Actions yaml

mridulm commented on a change in pull request #30391: URL: https://github.com/apache/spark/pull/30391#discussion_r525894367 ## File path: .github/workflows/build_and_test.yml ## @@ -433,11 +407,32 @@ jobs: key: scala-213-coursier-${{ hashFiles('**/pom.xml', '**/plugins

[GitHub] [spark] SparkQA commented on pull request #30403: [SPARK-33448][SQL] Migrate CACHE/UNCACHE TABLE command to use UnresolvedTableOrView to resolve the identifier

SparkQA commented on pull request #30403: URL: https://github.com/apache/spark/pull/30403#issuecomment-729520689 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35864/ -

[GitHub] [spark] xuzikun2003 commented on a change in pull request #29725: [SPARK-32096][SQL] Improve sorting performance of Spark SQL window function by removing window partition key from sort order

xuzikun2003 commented on a change in pull request #29725: URL: https://github.com/apache/spark/pull/29725#discussion_r525900796 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowWindowSorter.java ## @@ -0,0 +1,453 @@ +/* + * Licensed to the A

[GitHub] [spark] SparkQA commented on pull request #30393: [SPARK-24554][PYTHON][SQL] Add MapType support for PySpark with Arrow

SparkQA commented on pull request #30393: URL: https://github.com/apache/spark/pull/30393#issuecomment-729523758 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/35863/ -

[GitHub] [spark] xuzikun2003 commented on a change in pull request #29725: [SPARK-32096][SQL] Improve sorting performance of Spark SQL window function by removing window partition key from sort order

xuzikun2003 commented on a change in pull request #29725: URL: https://github.com/apache/spark/pull/29725#discussion_r525900796 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowWindowSorter.java ## @@ -0,0 +1,453 @@ +/* + * Licensed to the A

[GitHub] [spark] gaborgsomogyi commented on pull request #30389: [SPARK-33143][PYTHON] Add configurable timeout to python server and client

gaborgsomogyi commented on pull request #30389: URL: https://github.com/apache/spark/pull/30389#issuecomment-729524618 Hmmm, does this mean `SPARK_BUFFER_SIZE` in `local_connect_and_auth` is also not covered in driver side? I was scanning the code for it to find the driver side part but

[GitHub] [spark] xuzikun2003 commented on a change in pull request #29725: [SPARK-32096][SQL] Improve sorting performance of Spark SQL window function by removing window partition key from sort order

xuzikun2003 commented on a change in pull request #29725: URL: https://github.com/apache/spark/pull/29725#discussion_r525862140 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/UnsafeExternalRowWindowSorter.java ## @@ -0,0 +1,453 @@ +/* + * Licensed to the A

  1   2   3   4   5   6   7   8   9   10   >