[GitHub] [spark] SparkQA commented on pull request #34853: [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

SparkQA commented on pull request #34853: URL: https://github.com/apache/spark/pull/34853#issuecomment-991518923 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50562/ -- This is an automated message from the Apache

[GitHub] [spark] beliefer opened a new pull request #34867: [SPARK-37613][SQL] Support ANSI Aggregate Function: regr_count

beliefer opened a new pull request #34867: URL: https://github.com/apache/spark/pull/34867 ### What changes were proposed in this pull request? This PR used to support ANSI aggregate Function: `regr_count` The mainstream database supports `regr_count` show below: **Teradata**

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins removed a comment on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991503105 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146086/ -

[GitHub] [spark] AmplabJenkins commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991503105 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146086/ -- This

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991502950 **[Test build #146086 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146086/testReport)** for PR 34866 at commit [`5a87b37`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA removed a comment on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991466743 **[Test build #146086 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146086/testReport)** for PR 34866 at commit [`5a87b37`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34853: [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

AmplabJenkins removed a comment on pull request #34853: URL: https://github.com/apache/spark/pull/34853#issuecomment-990134139 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] SparkQA commented on pull request #34853: [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

SparkQA commented on pull request #34853: URL: https://github.com/apache/spark/pull/34853#issuecomment-991500303 **[Test build #146087 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146087/testReport)** for PR 34853 at commit [`afbcaeb`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins removed a comment on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991499239 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50561/

[GitHub] [spark] AmplabJenkins commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991499239 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50561/ -- T

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34853: [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

HyukjinKwon commented on a change in pull request #34853: URL: https://github.com/apache/spark/pull/34853#discussion_r767101873 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/UnivocityGenerator.scala ## @@ -95,7 +95,7 @@ class UnivocityGenerator(

[GitHub] [spark] HyukjinKwon commented on pull request #34853: [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

HyukjinKwon commented on pull request #34853: URL: https://github.com/apache/spark/pull/34853#issuecomment-991495015 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34853: [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

HyukjinKwon commented on a change in pull request #34853: URL: https://github.com/apache/spark/pull/34853#discussion_r767101873 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/UnivocityGenerator.scala ## @@ -95,7 +95,7 @@ class UnivocityGenerator(

[GitHub] [spark] HyukjinKwon commented on a change in pull request #34853: [SPARK-37575][SQL] null values should be saved as nothing rather than quoted empty Strings "" by default settings

HyukjinKwon commented on a change in pull request #34853: URL: https://github.com/apache/spark/pull/34853#discussion_r767101820 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/csv/UnivocityGenerator.scala ## @@ -95,7 +95,7 @@ class UnivocityGenerator(

[GitHub] [spark] MaxGekk commented on a change in pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

MaxGekk commented on a change in pull request #31847: URL: https://github.com/apache/spark/pull/31847#discussion_r767096459 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/NumberUtils.scala ## @@ -0,0 +1,190 @@ +/* + * Licensed to the Apache Softwa

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991493379 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50561/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins removed a comment on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991474807 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146085/ -

[GitHub] [spark] SparkQA removed a comment on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA removed a comment on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991446330 **[Test build #146085 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146085/testReport)** for PR 34866 at commit [`584418c`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991474807 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146085/ -- This

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991474652 **[Test build #146085 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146085/testReport)** for PR 34866 at commit [`584418c`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins removed a comment on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991473179 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50560/

[GitHub] [spark] AmplabJenkins commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

AmplabJenkins commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991473179 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50560/ -- T

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991471597 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50561/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991469596 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50560/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991466743 **[Test build #146086 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146086/testReport)** for PR 34866 at commit [`5a87b37`](https://github.com

[GitHub] [spark] venkata91 commented on a change in pull request #33896: [SPARK-33701][SHUFFLE] Adaptive shuffle merge finalization for push-based shuffle

venkata91 commented on a change in pull request #33896: URL: https://github.com/apache/spark/pull/33896#discussion_r767090517 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1630,6 +1652,50 @@ private[spark] class DAGScheduler( } }

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

AmplabJenkins removed a comment on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991465008 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146083/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

AmplabJenkins removed a comment on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991465007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50559/

[GitHub] [spark] AmplabJenkins commented on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

AmplabJenkins commented on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991465008 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146083/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

AmplabJenkins commented on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991465007 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50559/ -- T

[GitHub] [spark] SparkQA removed a comment on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

SparkQA removed a comment on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991413276 **[Test build #146083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146083/testReport)** for PR 34578 at commit [`fa007be`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

SparkQA commented on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991459709 **[Test build #146083 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146083/testReport)** for PR 34578 at commit [`fa007be`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991458919 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50560/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

SparkQA commented on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991456357 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50559/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

SparkQA commented on pull request #34866: URL: https://github.com/apache/spark/pull/34866#issuecomment-991446330 **[Test build #146085 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146085/testReport)** for PR 34866 at commit [`584418c`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

AmplabJenkins removed a comment on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991445231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50558/

[GitHub] [spark] AmplabJenkins commented on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

AmplabJenkins commented on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991445231 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50558/ -- T

[GitHub] [spark] AngersZhuuuu commented on pull request #34848: [SPARK-37582][SPARK-37583][SQL] CONTAINS, STARTSWITH, ENDSWITH should support binary type

AngersZh commented on pull request #34848: URL: https://github.com/apache/spark/pull/34848#issuecomment-991443362 > @AngersZh Could you fix PR's title. Done -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and u

[GitHub] [spark] beliefer opened a new pull request #34866: [SPARK-27974][SQL] Support ANSI Aggregate Function: array_agg

beliefer opened a new pull request #34866: URL: https://github.com/apache/spark/pull/34866 ### What changes were proposed in this pull request? This PR used to support ANSI aggregate Function: `array_agg`. The mainstream database supports `array_agg` show below: **Presto** ht

[GitHub] [spark] SparkQA commented on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

SparkQA commented on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991440137 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50559/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

SparkQA commented on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991436674 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50558/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

AmplabJenkins removed a comment on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991429306 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146084/ -

[GitHub] [spark] AmplabJenkins commented on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

AmplabJenkins commented on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991429306 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146084/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

SparkQA removed a comment on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991423174 **[Test build #146084 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146084/testReport)** for PR 34865 at commit [`d09b596`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

SparkQA commented on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991429131 **[Test build #146084 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146084/testReport)** for PR 34865 at commit [`d09b596`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

SparkQA commented on pull request #34865: URL: https://github.com/apache/spark/pull/34865#issuecomment-991423174 **[Test build #146084 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146084/testReport)** for PR 34865 at commit [`d09b596`](https://github.com

[GitHub] [spark] wangyum commented on pull request #34827: [SPARK-37565][TESTS] Upgrade mysql-connector-java to 8.0.27

wangyum commented on pull request #34827: URL: https://github.com/apache/spark/pull/34827#issuecomment-991421779 Merged to master. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[GitHub] [spark] wangyum closed pull request #34827: [SPARK-37565][TESTS] Upgrade mysql-connector-java to 8.0.27

wangyum closed pull request #34827: URL: https://github.com/apache/spark/pull/34827 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubs

[GitHub] [spark] SparkQA commented on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

SparkQA commented on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991419201 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50558/ -- This is an automated message from the Apache

[GitHub] [spark] venkata91 commented on a change in pull request #33896: [SPARK-33701][SHUFFLE] Adaptive shuffle merge finalization for push-based shuffle

venkata91 commented on a change in pull request #33896: URL: https://github.com/apache/spark/pull/33896#discussion_r767079043 ## File path: core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala ## @@ -1630,6 +1652,50 @@ private[spark] class DAGScheduler( } }

[GitHub] [spark] dongjoon-hyun opened a new pull request #34865: [SPARK-37611][K8S] Remove upper limit of `spark.kubernetes.memoryOverheadFactor`

dongjoon-hyun opened a new pull request #34865: URL: https://github.com/apache/spark/pull/34865 ### What changes were proposed in this pull request? This PR aims to remove the upper limit `1` from `spark.kubernetes.memoryOverheadFactor`. ### Why are the changes needed?

[GitHub] [spark] SparkQA commented on pull request #34578: [SPARK-37300][CORE] TaskSchedulerImpl should ignore task finished eve…

SparkQA commented on pull request #34578: URL: https://github.com/apache/spark/pull/34578#issuecomment-991413276 **[Test build #146083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146083/testReport)** for PR 34578 at commit [`fa007be`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

AmplabJenkins removed a comment on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991410595 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146082/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34845: [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

AmplabJenkins removed a comment on pull request #34845: URL: https://github.com/apache/spark/pull/34845#issuecomment-991410596 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146080/ -

[GitHub] [spark] AmplabJenkins commented on pull request #34845: [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

AmplabJenkins commented on pull request #34845: URL: https://github.com/apache/spark/pull/34845#issuecomment-991410596 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146080/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

AmplabJenkins commented on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991410595 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146082/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34845: [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

SparkQA removed a comment on pull request #34845: URL: https://github.com/apache/spark/pull/34845#issuecomment-991292444 **[Test build #146080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146080/testReport)** for PR 34845 at commit [`a9862c3`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34845: [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

SparkQA commented on pull request #34845: URL: https://github.com/apache/spark/pull/34845#issuecomment-991408414 **[Test build #146080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146080/testReport)** for PR 34845 at commit [`a9862c3`](https://github.co

[GitHub] [spark] beliefer opened a new pull request #32477: [SPARK-35348][SQL] Support the utils for escapse the regex for ANSI SQL: SIMILAR TO … ESCAPE syntax

beliefer opened a new pull request #32477: URL: https://github.com/apache/spark/pull/32477 ### What changes were proposed in this pull request? `ANSI SQL: SIMILAR TO ... ESCAPE` is very useful. There are some mainstream database support the syntax. **PostgreSQL**: https://www.po

[GitHub] [spark] beliefer closed pull request #32477: [SPARK-35348][SQL] Support the utils for escapse the regex for ANSI SQL: SIMILAR TO … ESCAPE syntax

beliefer closed pull request #32477: URL: https://github.com/apache/spark/pull/32477 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsub

[GitHub] [spark] beliefer commented on pull request #32477: [SPARK-35348][SQL] Support the utils for escapse the regex for ANSI SQL: SIMILAR TO … ESCAPE syntax

beliefer commented on pull request #32477: URL: https://github.com/apache/spark/pull/32477#issuecomment-991408105 @cloud-fan Please help me to remove stale label. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the UR

[GitHub] [spark] SparkQA removed a comment on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

SparkQA removed a comment on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991361257 **[Test build #146082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146082/testReport)** for PR 34838 at commit [`63f3bfe`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

SparkQA commented on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991405611 **[Test build #146082 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146082/testReport)** for PR 34838 at commit [`63f3bfe`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34842: [SPARK-37590][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET PROPERTIES tests

AmplabJenkins removed a comment on pull request #34842: URL: https://github.com/apache/spark/pull/34842#issuecomment-991398815 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146078/ -

[GitHub] [spark] AmplabJenkins commented on pull request #34842: [SPARK-37590][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET PROPERTIES tests

AmplabJenkins commented on pull request #34842: URL: https://github.com/apache/spark/pull/34842#issuecomment-991398815 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146078/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #34842: [SPARK-37590][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET PROPERTIES tests

SparkQA removed a comment on pull request #34842: URL: https://github.com/apache/spark/pull/34842#issuecomment-991258539 **[Test build #146078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146078/testReport)** for PR 34842 at commit [`aaf0e5c`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34842: [SPARK-37590][SQL][TEST] Unify v1 and v2 ALTER TABLE .. SET PROPERTIES tests

SparkQA commented on pull request #34842: URL: https://github.com/apache/spark/pull/34842#issuecomment-991398382 **[Test build #146078 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146078/testReport)** for PR 34842 at commit [`aaf0e5c`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34642: [SPARK-37369][SQL] Avoid redundant ColumnarToRow transistion on InMemoryTableScan

AmplabJenkins removed a comment on pull request #34642: URL: https://github.com/apache/spark/pull/34642#issuecomment-991398176 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146079/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

AmplabJenkins removed a comment on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991398173 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50557/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34857: [SPARK-36850][SQL][FOLLOWUP] Code clean up

AmplabJenkins removed a comment on pull request #34857: URL: https://github.com/apache/spark/pull/34857#issuecomment-991398175 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146077/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

AmplabJenkins removed a comment on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991398174 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146081/ -

[GitHub] [spark] AmplabJenkins commented on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

AmplabJenkins commented on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991398173 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50557/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

AmplabJenkins commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991398174 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146081/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34642: [SPARK-37369][SQL] Avoid redundant ColumnarToRow transistion on InMemoryTableScan

AmplabJenkins commented on pull request #34642: URL: https://github.com/apache/spark/pull/34642#issuecomment-991398176 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146079/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34857: [SPARK-36850][SQL][FOLLOWUP] Code clean up

AmplabJenkins commented on pull request #34857: URL: https://github.com/apache/spark/pull/34857#issuecomment-991398175 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/146077/ -- This

[GitHub] [spark] linzebing commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

linzebing commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991397006 Quickly glanced through the code, seems for writing shuffle data we are writing locally first and then upload to S3, similarly for reading shuffle data we are downloading data

[GitHub] [spark] SparkQA removed a comment on pull request #34857: [SPARK-36850][SQL][FOLLOWUP] Code clean up

SparkQA removed a comment on pull request #34857: URL: https://github.com/apache/spark/pull/34857#issuecomment-991258454 **[Test build #146077 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146077/testReport)** for PR 34857 at commit [`765b8a3`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34857: [SPARK-36850][SQL][FOLLOWUP] Code clean up

SparkQA commented on pull request #34857: URL: https://github.com/apache/spark/pull/34857#issuecomment-991396645 **[Test build #146077 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146077/testReport)** for PR 34857 at commit [`765b8a3`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

SparkQA removed a comment on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991336315 **[Test build #146081 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146081/testReport)** for PR 34864 at commit [`4b67c8a`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

SparkQA commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991394024 **[Test build #146081 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146081/testReport)** for PR 34864 at commit [`4b67c8a`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34642: [SPARK-37369][SQL] Avoid redundant ColumnarToRow transistion on InMemoryTableScan

SparkQA removed a comment on pull request #34642: URL: https://github.com/apache/spark/pull/34642#issuecomment-991258783 **[Test build #146079 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146079/testReport)** for PR 34642 at commit [`dc9ad83`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34642: [SPARK-37369][SQL] Avoid redundant ColumnarToRow transistion on InMemoryTableScan

SparkQA commented on pull request #34642: URL: https://github.com/apache/spark/pull/34642#issuecomment-991392150 **[Test build #146079 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146079/testReport)** for PR 34642 at commit [`dc9ad83`](https://github.co

[GitHub] [spark] hiboyang commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

hiboyang commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991391300 > @hiboyang, thanks for the work here! Could you create a design doc for this? That might help get more people attention and easier for them to understand. Yes, good sug

[GitHub] [spark] SparkQA commented on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

SparkQA commented on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991391253 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50557/ -- This is an automated message from the A

[GitHub] [spark] c21 commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

c21 commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991390684 @hiboyang, thanks for the work here! Could you create a design doc for this? That might help get more people attention and easier for them to understand. -- This is an automated m

[GitHub] [spark] ravwojdyla commented on a change in pull request #34863: [SPARK-37601][PYTHON] sql.DataFrame.transform accept function parameters

ravwojdyla commented on a change in pull request #34863: URL: https://github.com/apache/spark/pull/34863#discussion_r767045781 ## File path: python/pyspark/sql/dataframe.py ## @@ -3058,7 +3058,7 @@ def toDF(self, *cols: "ColumnOrName") -> "DataFrame": jdf = self._jdf.t

[GitHub] [spark] github-actions[bot] commented on pull request #32477: [SPARK-35348][SQL] Support the utils for escapse the regex for ANSI SQL: SIMILAR TO … ESCAPE syntax

github-actions[bot] commented on pull request #32477: URL: https://github.com/apache/spark/pull/32477#issuecomment-991385630 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] github-actions[bot] closed pull request #33621: [SPARK-36390][SQL] Replace SessionState.close with SessionState.detachSession

github-actions[bot] closed pull request #33621: URL: https://github.com/apache/spark/pull/33621 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: re

[GitHub] [spark] github-actions[bot] commented on pull request #32813: [SPARK-34591][MLLIB][WIP] Add decision tree pruning as a parameter

github-actions[bot] commented on pull request #32813: URL: https://github.com/apache/spark/pull/32813#issuecomment-991385604 We're closing this PR because it hasn't been updated in a while. This isn't a judgement on the merit of the PR in any way. It's just a way of keeping the PR queue ma

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

AmplabJenkins removed a comment on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991382857 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50556/

[GitHub] [spark] AmplabJenkins commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

AmplabJenkins commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991382857 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50556/ -- T

[GitHub] [spark] SparkQA commented on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

SparkQA commented on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991378325 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50557/ -- This is an automated message from the Apache

[GitHub] [spark] ravwojdyla commented on a change in pull request #34863: [SPARK-37601][PYTHON] sql.DataFrame.transform accept function parameters

ravwojdyla commented on a change in pull request #34863: URL: https://github.com/apache/spark/pull/34863#discussion_r767045781 ## File path: python/pyspark/sql/dataframe.py ## @@ -3058,7 +3058,7 @@ def toDF(self, *cols: "ColumnOrName") -> "DataFrame": jdf = self._jdf.t

[GitHub] [spark] SparkQA commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

SparkQA commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991371738 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50556/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

AmplabJenkins removed a comment on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-990713499 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use t

[GitHub] [spark] SparkQA commented on pull request #34838: [SPARK-37598][PYTHON] Adding support for ShortWriables to pyspark's newAPIHadoopRDD method

SparkQA commented on pull request #34838: URL: https://github.com/apache/spark/pull/34838#issuecomment-991361257 **[Test build #146082 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/146082/testReport)** for PR 34838 at commit [`63f3bfe`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34845: [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

AmplabJenkins removed a comment on pull request #34845: URL: https://github.com/apache/spark/pull/34845#issuecomment-991360591 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50555/

[GitHub] [spark] AmplabJenkins commented on pull request #34845: [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

AmplabJenkins commented on pull request #34845: URL: https://github.com/apache/spark/pull/34845#issuecomment-991360591 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/50555/ -- T

[GitHub] [spark] SparkQA commented on pull request #34845: [SPARK-37577][SQL] Fix ClassCastException: ArrayType cannot be cast to StructType for Generate Pruning

SparkQA commented on pull request #34845: URL: https://github.com/apache/spark/pull/34845#issuecomment-991357405 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50555/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34864: [SHUFFLE] [WIP] Prototype: store shuffle file on external storage like S3

SparkQA commented on pull request #34864: URL: https://github.com/apache/spark/pull/34864#issuecomment-991354018 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/50556/ -- This is an automated message from the Apache

  1   2   3   4   >