[GitHub] [spark] AmplabJenkins commented on pull request #33994: [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33994: URL: https://github.com/apache/spark/pull/33994#issuecomment-921549759 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47905/ -- T

[GitHub] [spark] SparkQA commented on pull request #33994: [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
SparkQA commented on pull request #33994: URL: https://github.com/apache/spark/pull/33994#issuecomment-921549705 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47905/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33994: [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33994: URL: https://github.com/apache/spark/pull/33994#issuecomment-921549759 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47905/

[GitHub] [spark] SparkQA commented on pull request #33915: [SPARK-36663][SQL] Support number-only column names in ORC data sources

2021-09-17 Thread GitBox
SparkQA commented on pull request #33915: URL: https://github.com/apache/spark/pull/33915#issuecomment-921550110 **[Test build #143401 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143401/testReport)** for PR 33915 at commit [`525d4f9`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
SparkQA commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921550558 **[Test build #143382 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143382/testReport)** for PR 34025 at commit [`bfc304a`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921401718 **[Test build #143382 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143382/testReport)** for PR 34025 at commit [`bfc304a`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921551880 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143382/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921551880 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143382/ -

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921552803 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47907/ -- This is an automated message from the Apache

[GitHub] [spark] ulysses-you commented on pull request #32084: [SPARK-34980][SQL] Support coalesce partition through union in AQE

2021-09-17 Thread GitBox
ulysses-you commented on pull request #32084: URL: https://github.com/apache/spark/pull/32084#issuecomment-921558465 Now, there are two issues for Union in rule `CoalesceShufflePartitions` and I updated the description to make them more clear. cc @cloud-fan @maryannxue @JkSelf @viiry

[GitHub] [spark] AmplabJenkins commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921559558 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47907/ -- T

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921559520 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47907/ -- This is an automated message from the A

[GitHub] [spark] yutoacts commented on a change in pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
yutoacts commented on a change in pull request #33988: URL: https://github.com/apache/spark/pull/33988#discussion_r710779661 ## File path: python/pyspark/sql/functions.py ## @@ -394,6 +394,23 @@ def cot(col): return _invoke_function_over_column("cot", col) +def csc(col

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921559558 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47907/

[GitHub] [spark] yutoacts commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
yutoacts commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921577219 > > > @yutoacts you can use `dev/lint-python` to check style for Python code. Thank you. It should be fixed now. -- This is an automated message from the Apache

[GitHub] [spark] viirya commented on a change in pull request #34001: [SPARK-36760][SQL] Add internal utils to convert between v1 and v2 filters

2021-09-17 Thread GitBox
viirya commented on a change in pull request #34001: URL: https://github.com/apache/spark/pull/34001#discussion_r710827740 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/csv/CSVScanBuilder.scala ## @@ -42,16 +42,18 @@ case class CSVScanBuil

[GitHub] [spark] SparkQA commented on pull request #34029: [SPARK-36789][SQL] Use the correct constant type as the null value holder in array functions

2021-09-17 Thread GitBox
SparkQA commented on pull request #34029: URL: https://github.com/apache/spark/pull/34029#issuecomment-921582373 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47908/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33995: [SPARK-36754][SQL] ArrayIntersect handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
SparkQA commented on pull request #33995: URL: https://github.com/apache/spark/pull/33995#issuecomment-921582901 **[Test build #143396 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143396/testReport)** for PR 33995 at commit [`a9e6205`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #33995: [SPARK-36754][SQL] ArrayIntersect handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #33995: URL: https://github.com/apache/spark/pull/33995#issuecomment-921518420 **[Test build #143396 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143396/testReport)** for PR 33995 at commit [`a9e6205`](https://gi

[GitHub] [spark] zhouyejoe commented on a change in pull request #34018: [SPARK-36772] FinalizeShuffleMerge fails with an exception due to attempt id not matching

2021-09-17 Thread GitBox
zhouyejoe commented on a change in pull request #34018: URL: https://github.com/apache/spark/pull/34018#discussion_r710831644 ## File path: core/src/main/scala/org/apache/spark/SparkEnv.scala ## @@ -355,6 +355,11 @@ object SparkEnv extends Logging { None } +//

[GitHub] [spark] HyukjinKwon closed pull request #34029: [SPARK-36789][SQL] Use the correct constant type as the null value holder in array functions

2021-09-17 Thread GitBox
HyukjinKwon closed pull request #34029: URL: https://github.com/apache/spark/pull/34029 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-un

[GitHub] [spark] AmplabJenkins commented on pull request #33995: [SPARK-36754][SQL] ArrayIntersect handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33995: URL: https://github.com/apache/spark/pull/33995#issuecomment-921584966 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143396/ -- This

[GitHub] [spark] HyukjinKwon commented on pull request #34029: [SPARK-36789][SQL] Use the correct constant type as the null value holder in array functions

2021-09-17 Thread GitBox
HyukjinKwon commented on pull request #34029: URL: https://github.com/apache/spark/pull/34029#issuecomment-921585231 Merged to master, branch-3.2, branch-3.1 and branch-3.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
SparkQA commented on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921585810 **[Test build #143384 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143384/testReport)** for PR 34027 at commit [`f7019ca`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33995: [SPARK-36754][SQL] ArrayIntersect handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33995: URL: https://github.com/apache/spark/pull/33995#issuecomment-921584966 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143396/ -

[GitHub] [spark] SparkQA removed a comment on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921418365 **[Test build #143384 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143384/testReport)** for PR 34027 at commit [`f7019ca`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
SparkQA commented on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921586672 **[Test build #143385 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143385/testReport)** for PR 33993 at commit [`d8e80fc`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921587050 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143384/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921420738 **[Test build #143385 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143385/testReport)** for PR 33993 at commit [`d8e80fc`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921587050 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143384/ -

[GitHub] [spark] AmplabJenkins commented on pull request #34029: [SPARK-36789][SQL] Use the correct constant type as the null value holder in array functions

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34029: URL: https://github.com/apache/spark/pull/34029#issuecomment-921587396 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47908/ -- T

[GitHub] [spark] SparkQA commented on pull request #34029: [SPARK-36789][SQL] Use the correct constant type as the null value holder in array functions

2021-09-17 Thread GitBox
SparkQA commented on pull request #34029: URL: https://github.com/apache/spark/pull/34029#issuecomment-921587368 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47908/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34029: [SPARK-36789][SQL] Use the correct constant type as the null value holder in array functions

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #34029: URL: https://github.com/apache/spark/pull/34029#issuecomment-921587396 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47908/

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921587858 **[Test build #143402 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143402/testReport)** for PR 33988 at commit [`bf2179a`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921588012 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143385/ -- This

[GitHub] [spark] SparkQA commented on pull request #33915: [SPARK-36663][SQL] Support number-only column names in ORC data sources

2021-09-17 Thread GitBox
SparkQA commented on pull request #33915: URL: https://github.com/apache/spark/pull/33915#issuecomment-921588258 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47909/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921588012 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143385/ -

[GitHub] [spark] cloud-fan commented on a change in pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
cloud-fan commented on a change in pull request #34025: URL: https://github.com/apache/spark/pull/34025#discussion_r710838554 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/types/StructType.scala ## @@ -559,52 +559,82 @@ object StructType extends AbstractDataTy

[GitHub] [spark] SparkQA commented on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
SparkQA commented on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921592010 **[Test build #143383 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143383/testReport)** for PR 34027 at commit [`f7019ca`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921414115 **[Test build #143383 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143383/testReport)** for PR 34027 at commit [`f7019ca`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921593812 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143383/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921593812 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143383/ -

[GitHub] [spark] SparkQA commented on pull request #33915: [SPARK-36663][SQL] Support number-only column names in ORC data sources

2021-09-17 Thread GitBox
SparkQA commented on pull request #33915: URL: https://github.com/apache/spark/pull/33915#issuecomment-921594608 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47909/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #33915: [SPARK-36663][SQL] Support number-only column names in ORC data sources

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33915: URL: https://github.com/apache/spark/pull/33915#issuecomment-921594639 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47909/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33915: [SPARK-36663][SQL] Support number-only column names in ORC data sources

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33915: URL: https://github.com/apache/spark/pull/33915#issuecomment-921594639 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47909/

[GitHub] [spark] cloud-fan commented on a change in pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
cloud-fan commented on a change in pull request #34025: URL: https://github.com/apache/spark/pull/34025#discussion_r710846709 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSetOperationsSuite.scala ## @@ -1018,6 +1018,64 @@ class DataFrameSetOperationsSuit

[GitHub] [spark] SparkQA commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
SparkQA commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921599635 **[Test build #143403 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143403/testReport)** for PR 34025 at commit [`9bed2e6`](https://github.com

[GitHub] [spark] Ngone51 commented on a change in pull request #34018: [SPARK-36772] FinalizeShuffleMerge fails with an exception due to attempt id not matching

2021-09-17 Thread GitBox
Ngone51 commented on a change in pull request #34018: URL: https://github.com/apache/spark/pull/34018#discussion_r710853053 ## File path: core/src/main/scala/org/apache/spark/SparkEnv.scala ## @@ -355,6 +355,11 @@ object SparkEnv extends Logging { None } +// S

[GitHub] [spark] SparkQA commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
SparkQA commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921604885 **[Test build #143386 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143386/testReport)** for PR 34025 at commit [`ad4ec57`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921423017 **[Test build #143386 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143386/testReport)** for PR 34025 at commit [`ad4ec57`](https://gi

[GitHub] [spark] cloud-fan commented on a change in pull request #33958: [SPARK-36718][SQL] Only collapse projects if we don't duplicate expensive expressions

2021-09-17 Thread GitBox
cloud-fan commented on a change in pull request #33958: URL: https://github.com/apache/spark/pull/33958#discussion_r710864472 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/planning/ScanOperationSuite.scala ## @@ -57,7 +57,14 @@ class ScanOperationSuit

[GitHub] [spark] AmplabJenkins commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921624065 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143386/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921624065 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143386/ -

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921624604 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47910/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921626181 **[Test build #143404 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143404/testReport)** for PR 33988 at commit [`a67b93f`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33958: [SPARK-36718][SQL] Only collapse projects if we don't duplicate expensive expressions

2021-09-17 Thread GitBox
SparkQA commented on pull request #33958: URL: https://github.com/apache/spark/pull/33958#issuecomment-921626237 **[Test build #143405 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143405/testReport)** for PR 33958 at commit [`a113a7e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
SparkQA commented on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921626552 **[Test build #143387 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143387/testReport)** for PR 33993 at commit [`21e9422`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-17 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-921626507 **[Test build #143406 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143406/testReport)** for PR 33934 at commit [`421370b`](https://github.com

[GitHub] [spark] SparkQA removed a comment on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921434154 **[Test build #143387 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143387/testReport)** for PR 33993 at commit [`21e9422`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921628160 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143387/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921628160 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143387/ -

[GitHub] [spark] AmplabJenkins commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921631343 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47910/ -- T

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921631295 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47910/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921631343 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47910/

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921635151 **[Test build #143407 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143407/testReport)** for PR 33988 at commit [`0578140`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #34005: [SPARK-36762][PYTHON] Fix Series.isin when Series has NaN values

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34005: URL: https://github.com/apache/spark/pull/34005#issuecomment-921637277 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] yoda-mon commented on a change in pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
yoda-mon commented on a change in pull request #34027: URL: https://github.com/apache/spark/pull/34027#discussion_r710891751 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Column.scala ## @@ -846,6 +846,17 @@ class Column(val expr: Expression) extends Logging {

[GitHub] [spark] SparkQA commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
SparkQA commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921643044 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47911/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
SparkQA commented on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921643918 **[Test build #143408 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143408/testReport)** for PR 34027 at commit [`b26ae27`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
SparkQA commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921650076 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47911/ -- This is an automated message from the A

[GitHub] [spark] LuciferYang commented on a change in pull request #30701: [SPARK-33212][BUILD] Upgrade to Hadoop 3.2.2 and move to shaded clients for Hadoop 3.x profile

2021-09-17 Thread GitBox
LuciferYang commented on a change in pull request #30701: URL: https://github.com/apache/spark/pull/30701#discussion_r710902227 ## File path: core/pom.xml ## @@ -66,7 +66,13 @@ org.apache.hadoop - hadoop-client + ${hadoop-client-api.artifact} Revie

[GitHub] [spark] LuciferYang commented on a change in pull request #30701: [SPARK-33212][BUILD] Upgrade to Hadoop 3.2.2 and move to shaded clients for Hadoop 3.x profile

2021-09-17 Thread GitBox
LuciferYang commented on a change in pull request #30701: URL: https://github.com/apache/spark/pull/30701#discussion_r710902227 ## File path: core/pom.xml ## @@ -66,7 +66,13 @@ org.apache.hadoop - hadoop-client + ${hadoop-client-api.artifact} Revie

[GitHub] [spark] LuciferYang commented on a change in pull request #30701: [SPARK-33212][BUILD] Upgrade to Hadoop 3.2.2 and move to shaded clients for Hadoop 3.x profile

2021-09-17 Thread GitBox
LuciferYang commented on a change in pull request #30701: URL: https://github.com/apache/spark/pull/30701#discussion_r710902227 ## File path: core/pom.xml ## @@ -66,7 +66,13 @@ org.apache.hadoop - hadoop-client + ${hadoop-client-api.artifact} Revie

[GitHub] [spark] LuciferYang commented on a change in pull request #30701: [SPARK-33212][BUILD] Upgrade to Hadoop 3.2.2 and move to shaded clients for Hadoop 3.x profile

2021-09-17 Thread GitBox
LuciferYang commented on a change in pull request #30701: URL: https://github.com/apache/spark/pull/30701#discussion_r710902227 ## File path: core/pom.xml ## @@ -66,7 +66,13 @@ org.apache.hadoop - hadoop-client + ${hadoop-client-api.artifact} Revie

[GitHub] [spark] SparkQA commented on pull request #34001: [SPARK-36760][SQL] Add internal utils to convert between v1 and v2 filters

2021-09-17 Thread GitBox
SparkQA commented on pull request #34001: URL: https://github.com/apache/spark/pull/34001#issuecomment-921660282 **[Test build #143395 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143395/testReport)** for PR 34001 at commit [`5df37fb`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34001: [SPARK-36760][SQL] Add internal utils to convert between v1 and v2 filters

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #34001: URL: https://github.com/apache/spark/pull/34001#issuecomment-921505325 **[Test build #143395 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143395/testReport)** for PR 34001 at commit [`5df37fb`](https://gi

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-17 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-921662508 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47914/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921664931 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47911/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34001: [SPARK-36760][SQL] Add internal utils to convert between v1 and v2 filters

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34001: URL: https://github.com/apache/spark/pull/34001#issuecomment-921664929 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143395/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34025: [SPARK-36673][SQL] Fix incorrect schema of nested types of union

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #34025: URL: https://github.com/apache/spark/pull/34025#issuecomment-921664931 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47911/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34001: [SPARK-36760][SQL] Add internal utils to convert between v1 and v2 filters

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #34001: URL: https://github.com/apache/spark/pull/34001#issuecomment-921664929 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143395/ -

[GitHub] [spark] SparkQA commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-17 Thread GitBox
SparkQA commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-921668941 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47914/ -- This is an automated message from the A

[GitHub] [spark] AmplabJenkins commented on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-921668959 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47914/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33934: [SPARK-36691][PYTHON] PythonRunner failed should pass error message to ApplicationMaster too

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33934: URL: https://github.com/apache/spark/pull/33934#issuecomment-921668959 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47914/

[GitHub] [spark] SparkQA commented on pull request #33958: [SPARK-36718][SQL] Only collapse projects if we don't duplicate expensive expressions

2021-09-17 Thread GitBox
SparkQA commented on pull request #33958: URL: https://github.com/apache/spark/pull/33958#issuecomment-921670499 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47913/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921670866 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47912/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
SparkQA commented on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921670874 **[Test build #143391 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143391/testReport)** for PR 33993 at commit [`434a2be`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
SparkQA commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921671085 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/47915/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921497259 **[Test build #143391 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143391/testReport)** for PR 33993 at commit [`434a2be`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921672405 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143391/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921672405 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143391/ -

[GitHub] [spark] SparkQA removed a comment on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921504630 **[Test build #143393 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143393/testReport)** for PR 34027 at commit [`a8ad299`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
SparkQA commented on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921674421 **[Test build #143393 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143393/testReport)** for PR 34027 at commit [`a8ad299`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #33994: [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
SparkQA commented on pull request #33994: URL: https://github.com/apache/spark/pull/33994#issuecomment-921674785 **[Test build #143389 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143389/testReport)** for PR 33994 at commit [`5f4d1bb`](https://github.co

[GitHub] [spark] AngersZhuuuu commented on pull request #33993: [SPARK-36741][SQL] ArrayDistinct handle duplicated Double.NaN and Float.Nan

2021-09-17 Thread GitBox
AngersZh commented on pull request #33993: URL: https://github.com/apache/spark/pull/33993#issuecomment-921675421 ping @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [spark] SparkQA removed a comment on pull request #33994: [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
SparkQA removed a comment on pull request #33994: URL: https://github.com/apache/spark/pull/33994#issuecomment-921470327 **[Test build #143389 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/143389/testReport)** for PR 33994 at commit [`5f4d1bb`](https://gi

[GitHub] [spark] AmplabJenkins commented on pull request #34027: [SPARK-36778][SQL] Support ILIKE API on Scala(dataframe)

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #34027: URL: https://github.com/apache/spark/pull/34027#issuecomment-921676165 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143393/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33994: [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33994: URL: https://github.com/apache/spark/pull/33994#issuecomment-921676295 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143389/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33988: [SPARK-36683][SQL] Add new built-in SQL functions: SEC and CSC

2021-09-17 Thread GitBox
AmplabJenkins commented on pull request #33988: URL: https://github.com/apache/spark/pull/33988#issuecomment-921676848 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/47915/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33994: [SPARK-36753][SQL] ArrayExcept handle duplicated Double.NaN and Float.NaN

2021-09-17 Thread GitBox
AmplabJenkins removed a comment on pull request #33994: URL: https://github.com/apache/spark/pull/33994#issuecomment-921676295 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/143389/ -

  1   2   3   4   5   >