[GitHub] [spark] AmplabJenkins commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898829936 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142462/ -- This

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898829790 **[Test build #142462 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142462/testReport)** for PR 33695 at commit

[GitHub] [spark] huaxingao commented on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

huaxingao commented on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898829614 Thanks @dongjoon-hyun @viirya -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to

[GitHub] [spark] dongjoon-hyun closed pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

dongjoon-hyun closed pull request #33739: URL: https://github.com/apache/spark/pull/33739 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] MaxGekk commented on a change in pull request #33709: [SPARK-36418][SQL] Use CAST in parsing of dates/timestamps with default pattern

MaxGekk commented on a change in pull request #33709: URL: https://github.com/apache/spark/pull/33709#discussion_r688869845 ## File path: mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala ## @@ -95,14 +96,14 @@ class ImageFileFormatSuite extends

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

AmplabJenkins removed a comment on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898815579 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898809328 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

AmplabJenkins commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898824392 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46969/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898824393 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46968/ --

[GitHub] [spark] SparkQA removed a comment on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

SparkQA removed a comment on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898798085 **[Test build #142461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142461/testReport)** for PR 33736 at commit

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898821843 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46968/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

SparkQA commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898819883 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46969/ --

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898815603 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46968/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

AmplabJenkins commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898815579 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142461/ -- This

[GitHub] [spark] SparkQA commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

SparkQA commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898815538 **[Test build #142461 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142461/testReport)** for PR 33736 at commit

[GitHub] [spark] SparkQA commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

SparkQA commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898815242 **[Test build #142463 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142463/testReport)** for PR 33736 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898787815 **[Test build #142460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142460/testReport)** for PR 33695 at commit

[GitHub] [spark] sunchao commented on a change in pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

sunchao commented on a change in pull request #33695: URL: https://github.com/apache/spark/pull/33695#discussion_r688858338 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/ParquetReadState.java ## @@ -131,9 +157,10 @@ long

[GitHub] [spark] sunchao commented on a change in pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

sunchao commented on a change in pull request #33695: URL: https://github.com/apache/spark/pull/33695#discussion_r688858219 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/ParquetColumn.java ## @@ -0,0 +1,239 @@ +/* + * Licensed to the

[GitHub] [spark] sunchao commented on a change in pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

sunchao commented on a change in pull request #33695: URL: https://github.com/apache/spark/pull/33695#discussion_r688858168 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/ParquetReadState.java ## @@ -131,9 +157,10 @@ long

[GitHub] [spark] viirya commented on a change in pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

viirya commented on a change in pull request #33695: URL: https://github.com/apache/spark/pull/33695#discussion_r688857071 ## File path: sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/ParquetReadState.java ## @@ -131,9 +157,10 @@ long

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898811282 **[Test build #142462 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142462/testReport)** for PR 33695 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898809328 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142460/ -- This

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898809100 **[Test build #142460 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142460/testReport)** for PR 33695 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

AmplabJenkins removed a comment on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898808051 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46967/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898799387 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898808050 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46966/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

AmplabJenkins commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898808051 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46967/ --

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898807187 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46966/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

SparkQA removed a comment on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898736621 **[Test build #142455 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142455/testReport)** for PR 33739 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898780708 **[Test build #142458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142458/testReport)** for PR 33695 at commit

[GitHub] [spark] SparkQA commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

SparkQA commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898804972 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46967/ --

[GitHub] [spark] gengliangwang closed pull request #33737: [SPARK-36508][SQL] ANSI type coercion: disallow binary operations between Interval and String literal

gengliangwang closed pull request #33737: URL: https://github.com/apache/spark/pull/33737 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] gengliangwang commented on pull request #33737: [SPARK-36508][SQL] ANSI type coercion: disallow binary operations between Interval and String literal

gengliangwang commented on pull request #33737: URL: https://github.com/apache/spark/pull/33737#issuecomment-898802578 Merging to master/3.2. @MaxGekk Thanks for the review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [spark] gengliangwang commented on a change in pull request #33709: [SPARK-36418][SQL] Use CAST in parsing of dates/timestamps with default pattern

gengliangwang commented on a change in pull request #33709: URL: https://github.com/apache/spark/pull/33709#discussion_r688851936 ## File path: mllib/src/test/scala/org/apache/spark/ml/source/image/ImageFileFormatSuite.scala ## @@ -95,14 +96,14 @@ class ImageFileFormatSuite

[GitHub] [spark] AmplabJenkins commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898799387 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142458/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

AmplabJenkins commented on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898799299 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142455/ -- This

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898799181 **[Test build #142458 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142458/testReport)** for PR 33695 at commit

[GitHub] [spark] SparkQA commented on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

SparkQA commented on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898798927 **[Test build #142455 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142455/testReport)** for PR 33739 at commit

[GitHub] [spark] SparkQA commented on pull request #33736: [SPARK-35991][SQL] Add PlanStability suite for TPCH

SparkQA commented on pull request #33736: URL: https://github.com/apache/spark/pull/33736#issuecomment-898798085 **[Test build #142461 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142461/testReport)** for PR 33736 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898797293 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

AmplabJenkins removed a comment on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898797296 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142457/

[GitHub] [spark] AmplabJenkins commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898797294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [spark] AmplabJenkins commented on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

AmplabJenkins commented on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898797296 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142457/ -- This

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898796947 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46966/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898796180 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46965/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

SparkQA removed a comment on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898764905 **[Test build #142457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142457/testReport)** for PR 33672 at commit

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898795615 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46963/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898794680 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46964/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

SparkQA commented on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898791502 **[Test build #142457 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142457/testReport)** for PR 33672 at commit

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898789125 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46965/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898788593 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46964/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898787815 **[Test build #142460 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142460/testReport)** for PR 33695 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-898787710 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142453/

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-898787710 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142453/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-898705806 **[Test build #142453 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142453/testReport)** for PR 33650 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898787547 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

AmplabJenkins commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898787547 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142459/ -- This

[GitHub] [spark] SparkQA commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

SparkQA commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-898787512 **[Test build #142453 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142453/testReport)** for PR 33650 at commit

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898787125 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46963/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

SparkQA removed a comment on pull request #33721: URL: https://github.com/apache/spark/pull/33721#issuecomment-898750381 **[Test build #142456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142456/testReport)** for PR 33721 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA removed a comment on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898782134 **[Test build #142459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142459/testReport)** for PR 33695 at commit

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898783295 **[Test build #142459 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142459/testReport)** for PR 33695 at commit

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898782134 **[Test build #142459 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142459/testReport)** for PR 33695 at commit

[GitHub] [spark] sunchao commented on a change in pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

sunchao commented on a change in pull request #33695: URL: https://github.com/apache/spark/pull/33695#discussion_r688838613 ## File path: sql/core/src/main/java/org/apache/parquet/io/ColumnIOUtil.java ## @@ -0,0 +1,34 @@ +/* + * Licensed to the Apache Software Foundation (ASF)

[GitHub] [spark] HeartSaVioR commented on a change in pull request #33683: [SPARK-36041][SS][DOCS] Introduce the RocksDBStateStoreProvider in the programming guide

HeartSaVioR commented on a change in pull request #33683: URL: https://github.com/apache/spark/pull/33683#discussion_r688837959 ## File path: docs/structured-streaming-programming-guide.md ## @@ -1814,6 +1814,23 @@ Specifically for built-in HDFS state store provider, users

[GitHub] [spark] SparkQA commented on pull request #33695: [SPARK-34863][SQL] Support complex types for Parquet vectorized reader

SparkQA commented on pull request #33695: URL: https://github.com/apache/spark/pull/33695#issuecomment-898780708 **[Test build #142458 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142458/testReport)** for PR 33695 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

AmplabJenkins commented on pull request #33721: URL: https://github.com/apache/spark/pull/33721#issuecomment-898780360 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142456/ -- This

[GitHub] [spark] SparkQA commented on pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

SparkQA commented on pull request #33721: URL: https://github.com/apache/spark/pull/33721#issuecomment-898780171 **[Test build #142456 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142456/testReport)** for PR 33721 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

AmplabJenkins removed a comment on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898778126 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142452/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

AmplabJenkins removed a comment on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898778124 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46962/

[GitHub] [spark] AmplabJenkins commented on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

AmplabJenkins commented on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898778126 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142452/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

AmplabJenkins commented on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898778124 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46962/ --

[GitHub] [spark] github-actions[bot] closed pull request #32222: [SPARK-35126][SQL] Execute jdbc cancellation method when jdbc load job is interrupted

github-actions[bot] closed pull request #3: URL: https://github.com/apache/spark/pull/3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

SparkQA commented on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898775780 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46962/ --

[GitHub] [spark] SparkQA removed a comment on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

SparkQA removed a comment on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898675357 **[Test build #142452 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142452/testReport)** for PR 33739 at commit

[GitHub] [spark] SparkQA commented on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

SparkQA commented on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898775738 **[Test build #142452 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142452/testReport)** for PR 33739 at commit

[GitHub] [spark] SparkQA commented on pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

SparkQA commented on pull request #33721: URL: https://github.com/apache/spark/pull/33721#issuecomment-898771003 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46961/ -- This is an automated message from the

[GitHub] [spark] AmplabJenkins commented on pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

AmplabJenkins commented on pull request #33721: URL: https://github.com/apache/spark/pull/33721#issuecomment-898771013 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46961/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33683: [SPARK-36041][SS][DOCS] Introduce the RocksDBStateStoreProvider in the programming guide

AmplabJenkins removed a comment on pull request #33683: URL: https://github.com/apache/spark/pull/33683#issuecomment-894976783 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] xuanyuanking commented on a change in pull request #33683: [SPARK-36041][SS][DOCS] Introduce the RocksDBStateStoreProvider in the programming guide

xuanyuanking commented on a change in pull request #33683: URL: https://github.com/apache/spark/pull/33683#discussion_r688823506 ## File path: docs/structured-streaming-programming-guide.md ## @@ -1814,6 +1814,23 @@ Specifically for built-in HDFS state store provider, users

[GitHub] [spark] SparkQA commented on pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

SparkQA commented on pull request #33672: URL: https://github.com/apache/spark/pull/33672#issuecomment-898764905 **[Test build #142457 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142457/testReport)** for PR 33672 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33740: [SPARK-36510][DOCS] Add spark.redaction.string.regex property to the docs

AmplabJenkins commented on pull request #33740: URL: https://github.com/apache/spark/pull/33740#issuecomment-898764723 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

AmplabJenkins removed a comment on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898764265 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46960/

[GitHub] [spark] AmplabJenkins commented on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

AmplabJenkins commented on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898764265 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46960/ --

[GitHub] [spark] SparkQA commented on pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

SparkQA commented on pull request #33721: URL: https://github.com/apache/spark/pull/33721#issuecomment-898762156 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46961/ -- This is an automated message from the Apache

[GitHub] [spark] dnskr opened a new pull request #33740: [SPARK-36510][DOCS] Add spark.redaction.string.regex property to the docs

dnskr opened a new pull request #33740: URL: https://github.com/apache/spark/pull/33740 ### What changes were proposed in this pull request? The PR fixes [SPARK-36510](https://issues.apache.org/jira/browse/SPARK-36510) by adding missing `spark.redaction.string.regex` property to the

[GitHub] [spark] SparkQA commented on pull request #33739: [SPARK-34952][SQL][FOLLOWUP] Normalize pushed down aggregate col name and group by col name

SparkQA commented on pull request #33739: URL: https://github.com/apache/spark/pull/33739#issuecomment-898758831 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/46960/ --

[GitHub] [spark] planga82 commented on a change in pull request #33672: [SPARK-35320][SQL] Align error message for unsupported key types in MapType in Json reader

planga82 commented on a change in pull request #33672: URL: https://github.com/apache/spark/pull/33672#discussion_r688816434 ## File path: sql/core/src/test/scala/org/apache/spark/sql/DataFrameSuite.scala ## @@ -2943,6 +2943,33 @@ class DataFrameSuite extends QueryTest

[GitHub] [spark] SparkQA commented on pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

SparkQA commented on pull request #33721: URL: https://github.com/apache/spark/pull/33721#issuecomment-898750381 **[Test build #142456 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142456/testReport)** for PR 33721 at commit

[GitHub] [spark] kazuyukitanimura commented on a change in pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

kazuyukitanimura commented on a change in pull request #33721: URL: https://github.com/apache/spark/pull/33721#discussion_r688809492 ## File path: core/src/main/scala/org/apache/spark/MapOutputTracker.scala ## @@ -1335,22 +1334,23 @@ private[spark] object MapOutputTracker

[GitHub] [spark] kazuyukitanimura commented on a change in pull request #33721: [SPARK-32210][CORE] Fix NegativeArraySizeException in MapOutputTracker with large spark.default.parallelism

kazuyukitanimura commented on a change in pull request #33721: URL: https://github.com/apache/spark/pull/33721#discussion_r688809130 ## File path: core/src/main/scala/org/apache/spark/internal/config/package.scala ## @@ -1416,6 +1416,17 @@ package object config {

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33737: [SPARK-36508][SQL] ANSI type coercion: disallow binary operations between Interval and String literal

AmplabJenkins removed a comment on pull request #33737: URL: https://github.com/apache/spark/pull/33737#issuecomment-898746917 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142437/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins removed a comment on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-898746902 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46958/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33694: [SPARK-36469][PYTHON] Implement Index.map

AmplabJenkins removed a comment on pull request #33694: URL: https://github.com/apache/spark/pull/33694#issuecomment-898732743 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #33737: [SPARK-36508][SQL] ANSI type coercion: disallow binary operations between Interval and String literal

AmplabJenkins commented on pull request #33737: URL: https://github.com/apache/spark/pull/33737#issuecomment-898746917 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/142437/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33694: [SPARK-36469][PYTHON] Implement Index.map

AmplabJenkins commented on pull request #33694: URL: https://github.com/apache/spark/pull/33694#issuecomment-898746901 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46959/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33650: [SPARK-36351][SQL] Separate partition filters and data filters in PushDownUtils

AmplabJenkins commented on pull request #33650: URL: https://github.com/apache/spark/pull/33650#issuecomment-898746902 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/46958/ --

[GitHub] [spark] SparkQA removed a comment on pull request #33508: [SPARK-36058][K8S] Add support for statefulset APIs in K8s

SparkQA removed a comment on pull request #33508: URL: https://github.com/apache/spark/pull/33508#issuecomment-898646392 **[Test build #142449 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142449/testReport)** for PR 33508 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #33644: [SPARK-36419][CORE] Optionally move final aggregation in RDD.treeAggregate to executor

SparkQA removed a comment on pull request #33644: URL: https://github.com/apache/spark/pull/33644#issuecomment-898652298 **[Test build #142451 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/142451/testReport)** for PR 33644 at commit

  1   2   3   4   5   6   >