[GitHub] [spark] AmplabJenkins removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879423126 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45497/

[GitHub] [spark] AmplabJenkins commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879423126 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45497/ --

[GitHub] [spark] SparkQA commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
SparkQA commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879423105 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45497/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879421436 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140979/

[GitHub] [spark] AmplabJenkins commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879421436 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140979/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879278682 **[Test build #140979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140979/testReport)** for PR 33326 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879414907 **[Test build #140982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140982/testReport)** for PR 32049 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33286: [SPARK-36079][SQL] Null-based filter estimate should always be in the range [0, 1]

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33286: URL: https://github.com/apache/spark/pull/33286#issuecomment-879418798 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45496/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879418565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140982/

[GitHub] [spark] shardulm94 commented on a change in pull request #33328: [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` property when reading Hive tables

2021-07-13 Thread GitBox
shardulm94 commented on a change in pull request #33328: URL: https://github.com/apache/spark/pull/33328#discussion_r669126948 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala ## @@ -363,4 +363,33 @@ class

[GitHub] [spark] SparkQA commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
SparkQA commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879419291 **[Test build #140984 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140984/testReport)** for PR 32049 at commit

[GitHub] [spark] SparkQA commented on pull request #33286: [SPARK-36079][SQL] Null-based filter estimate should always be in the range [0, 1]

2021-07-13 Thread GitBox
SparkQA commented on pull request #33286: URL: https://github.com/apache/spark/pull/33286#issuecomment-879418781 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45496/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33286: [SPARK-36079][SQL] Null-based filter estimate should always be in the range [0, 1]

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33286: URL: https://github.com/apache/spark/pull/33286#issuecomment-879418798 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45496/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879418565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140982/ -- This

[GitHub] [spark] SparkQA commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
SparkQA commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879418533 **[Test build #140982 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140982/testReport)** for PR 32049 at commit

[GitHub] [spark] SparkQA commented on pull request #33286: [SPARK-36079][SQL] Null-based filter estimate should always be in the range [0, 1]

2021-07-13 Thread GitBox
SparkQA commented on pull request #33286: URL: https://github.com/apache/spark/pull/33286#issuecomment-879416458 **[Test build #140983 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140983/testReport)** for PR 33286 at commit

[GitHub] [spark] dongjoon-hyun closed pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
dongjoon-hyun closed pull request #33326: URL: https://github.com/apache/spark/pull/33326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] dongjoon-hyun closed pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
dongjoon-hyun closed pull request #33327: URL: https://github.com/apache/spark/pull/33327 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #32049: [SPARK-34952][SQL] Aggregate (Min/Max/Count) push down for Parquet

2021-07-13 Thread GitBox
SparkQA commented on pull request #32049: URL: https://github.com/apache/spark/pull/32049#issuecomment-879414907 **[Test build #140982 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140982/testReport)** for PR 32049 at commit

[GitHub] [spark] SparkQA commented on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
SparkQA commented on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879391268 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45495/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879391296 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45495/ --

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879386639 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140981/

[GitHub] [spark] SparkQA removed a comment on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879381320 **[Test build #140981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140981/testReport)** for PR 33077 at commit

[GitHub] [spark] SparkQA commented on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
SparkQA commented on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879386603 **[Test build #140981 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140981/testReport)** for PR 33077 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879386639 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140981/ -- This

[GitHub] [spark] SparkQA commented on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
SparkQA commented on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879381320 **[Test build #140981 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140981/testReport)** for PR 33077 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879379566 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45494/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879379568 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140977/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879379565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140976/

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879379565 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140976/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879379566 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45494/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879379568 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140977/ -- This

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879371155 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45494/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879197621 **[Test build #140976 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140976/testReport)** for PR 32959 at commit

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879369773 **[Test build #140976 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140976/testReport)** for PR 32959 at commit

[GitHub] [spark] viirya commented on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
viirya commented on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879368499 Thanks @HeartSaVioR. I will review this today. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] HeartSaVioR commented on pull request #33077: [SPARK-34892][SS] Introduce MergingSortWithSessionWindowStateIterator sorting input rows and rows in state efficiently

2021-07-13 Thread GitBox
HeartSaVioR commented on pull request #33077: URL: https://github.com/apache/spark/pull/33077#issuecomment-879367696 cc. @viirya @xuanyuanking Please take a look. Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA removed a comment on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879271462 **[Test build #140977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140977/testReport)** for PR 33309 at commit

[GitHub] [spark] SparkQA commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
SparkQA commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879365340 **[Test build #140977 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140977/testReport)** for PR 33309 at commit

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879348471 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45494/ -- This is an automated message from the Apache

[GitHub] [spark] HeartSaVioR commented on pull request #31989: [SPARK-34891][SS] Introduce state store manager for session window in streaming query

2021-07-13 Thread GitBox
HeartSaVioR commented on pull request #31989: URL: https://github.com/apache/spark/pull/31989#issuecomment-879347792 Thanks all for reviewing and merging! I'll update the next PR. We have two PRs now. -- This is an automated message from the Apache Git Service. To respond to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879342573 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45491/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879342572 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45493/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879342574 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140974/

[GitHub] [spark] AmplabJenkins commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879342574 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140974/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879342571 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45492/

[GitHub] [spark] AmplabJenkins commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879342571 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45492/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879342573 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45491/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879342572 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45493/ --

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879329554 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45492/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879328622 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45493/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879137241 **[Test build #140974 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140974/testReport)** for PR 33324 at commit

[GitHub] [spark] SparkQA commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

2021-07-13 Thread GitBox
SparkQA commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879325577 **[Test build #140974 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140974/testReport)** for PR 33324 at commit

[GitHub] [spark] SparkQA commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
SparkQA commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879321198 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45491/ -- This is an automated message from the

[GitHub] [spark] xkrogen commented on a change in pull request #33328: [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` property when reading Hive tables

2021-07-13 Thread GitBox
xkrogen commented on a change in pull request #33328: URL: https://github.com/apache/spark/pull/33328#discussion_r669022583 ## File path: sql/hive/src/test/scala/org/apache/spark/sql/hive/HiveMetastoreCatalogSuite.scala ## @@ -363,4 +363,33 @@ class

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879316709 **[Test build #140980 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140980/testReport)** for PR 33327 at commit

[GitHub] [spark] allisonwang-db commented on pull request #32488: [SPARK-35316][SQL] UnwrapCastInBinaryComparison support In/InSet predicate

2021-07-13 Thread GitBox
allisonwang-db commented on pull request #32488: URL: https://github.com/apache/spark/pull/32488#issuecomment-879315179 Hi @cfmcgrady this check

[GitHub] [spark] viirya commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
viirya commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879314809 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] SparkQA commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879313292 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45493/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879308629 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45492/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #33329: [WIP][SPARK-35917][SHUFFLE][CORE]Disable push-based shuffle feature to prevent it from being used

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33329: URL: https://github.com/apache/spark/pull/33329#issuecomment-879306799 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins commented on pull request #33328: [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` property when reading Hive tables

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33328: URL: https://github.com/apache/spark/pull/33328#issuecomment-879306828 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879306376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140978/

[GitHub] [spark] AmplabJenkins commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879306376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140978/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879278639 **[Test build #140978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140978/testReport)** for PR 33327 at commit

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879303777 **[Test build #140978 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140978/testReport)** for PR 33327 at commit

[GitHub] [spark] ekoifman commented on a change in pull request #32872: [SPARK-35639][SQL] Make hasCoalescedPartition return true if something was actually coalesced

2021-07-13 Thread GitBox
ekoifman commented on a change in pull request #32872: URL: https://github.com/apache/spark/pull/32872#discussion_r669006682 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffleReaderExec.scala ## @@ -87,8 +87,15 @@ case class

[GitHub] [spark] ekoifman commented on a change in pull request #32872: [SPARK-35639][SQL] Make hasCoalescedPartition return true if something was actually coalesced

2021-07-13 Thread GitBox
ekoifman commented on a change in pull request #32872: URL: https://github.com/apache/spark/pull/32872#discussion_r669006682 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/CustomShuffleReaderExec.scala ## @@ -87,8 +87,15 @@ case class

[GitHub] [spark] SparkQA commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
SparkQA commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879301685 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45491/ -- This is an automated message from the Apache

[GitHub] [spark] otterc commented on pull request #33329: [WIP][SPARK-35917][SHUFFLE][CORE]Disable push-based shuffle feature to prevent it from being used

2021-07-13 Thread GitBox
otterc commented on pull request #33329: URL: https://github.com/apache/spark/pull/33329#issuecomment-879299258 cc. @mridulm @Ngone51 @Victsm -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] otterc opened a new pull request #33329: [WIP][SPARK-35917][SHUFFLE][CORE]Disable push-based shuffle feature to prevent it from being used

2021-07-13 Thread GitBox
otterc opened a new pull request #33329: URL: https://github.com/apache/spark/pull/33329 This is WIP because #33118 (comment) What changes were proposed in this pull request? Push-based shuffle is partially merged in apache master but some of the tasks are still incomplete. Since

[GitHub] [spark] shardulm94 opened a new pull request #33328: [SPARK-28266][SQL] convertToLogicalRelation should not interpret `path` property when reading Hive tables

2021-07-13 Thread GitBox
shardulm94 opened a new pull request #33328: URL: https://github.com/apache/spark/pull/33328 ### What changes were proposed in this pull request? For non-datasource Hive tables, e.g. tables written outside of Spark (through Hive or Trino), we have certain optimzations in

[GitHub] [spark] SparkQA commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879278682 **[Test build #140979 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140979/testReport)** for PR 33326 at commit

[GitHub] [spark] SparkQA commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
SparkQA commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879278639 **[Test build #140978 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140978/testReport)** for PR 33327 at commit

[GitHub] [spark] viirya commented on pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
viirya commented on pull request #33327: URL: https://github.com/apache/spark/pull/33327#issuecomment-879278151 cc @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] viirya commented on pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
viirya commented on pull request #33326: URL: https://github.com/apache/spark/pull/33326#issuecomment-879278086 cc @dongjoon-hyun -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] viirya opened a new pull request #33326: [SPARK-36109][SS][TEST][3.0] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
viirya opened a new pull request #33326: URL: https://github.com/apache/spark/pull/33326 ### What changes were proposed in this pull request? This patch proposes to check data after adding data to topic in `KafkaSourceStressSuite`. ### Why are the changes needed?

[GitHub] [spark] viirya opened a new pull request #33327: [SPARK-36109][SS][TEST][3.1] Check data after adding data to topic in KafkaSourceStressSuite

2021-07-13 Thread GitBox
viirya opened a new pull request #33327: URL: https://github.com/apache/spark/pull/33327 ### What changes were proposed in this pull request? This patch proposes to check data after adding data to topic in `KafkaSourceStressSuite`. ### Why are the changes needed?

[GitHub] [spark] sunchao commented on pull request #32875: [WIP][SPARK-35703] Remove HashClusteredDistribution and relax constraint for bucket join

2021-07-13 Thread GitBox
sunchao commented on pull request #32875: URL: https://github.com/apache/spark/pull/32875#issuecomment-879273740 Thanks @rdblue for taking a look. Yes IMO these two are correlated, and I've just updated the "Why are the changes needed?" section above to clarify the motivation. Let me know

[GitHub] [spark] AmplabJenkins commented on pull request #33310: [SPARK-36105][SQL] OptimizeLocalShuffleReader support reading data of multiple mappers in one task

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33310: URL: https://github.com/apache/spark/pull/33310#issuecomment-879272271 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] SparkQA commented on pull request #33309: [SPARK-36106][SQL][CORE] Label error classes for subset of QueryCompilationErrors

2021-07-13 Thread GitBox
SparkQA commented on pull request #33309: URL: https://github.com/apache/spark/pull/33309#issuecomment-879271462 **[Test build #140977 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140977/testReport)** for PR 33309 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879268378 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45490/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879268376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140973/

[GitHub] [spark] AmplabJenkins commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879268378 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45490/ --

[GitHub] [spark] AmplabJenkins commented on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879268376 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/140973/ -- This

[GitHub] [spark] mridulm commented on pull request #33303: [SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle tests in DAGSchedulerSuite in ad-hoc manner

2021-07-13 Thread GitBox
mridulm commented on pull request #33303: URL: https://github.com/apache/spark/pull/33303#issuecomment-879265736 Merged to master and branch-3.2 Thanks for fixing this @venkata91 ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] mridulm commented on pull request #33303: [SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle tests in DAGSchedulerSuite in ad-hoc manner

2021-07-13 Thread GitBox
mridulm commented on pull request #33303: URL: https://github.com/apache/spark/pull/33303#issuecomment-879264054 +CC @gengliangwang, merged to branch-3.2 as well. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [spark] asfgit closed pull request #33303: [SPARK-32920][CORE][SHUFFLE][FOLLOW-UP] Fix to run push-based shuffle tests in DAGSchedulerSuite in ad-hoc manner

2021-07-13 Thread GitBox
asfgit closed pull request #33303: URL: https://github.com/apache/spark/pull/33303 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879258556 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45490/ -- This is an automated message from the

[GitHub] [spark] viirya closed pull request #31570: [SPARK-10816][SS] SessionWindow support for Structure Streaming

2021-07-13 Thread GitBox
viirya closed pull request #31570: URL: https://github.com/apache/spark/pull/31570 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] viirya closed pull request #32422: [DO-NOT-MERGE][WIP][SS] Custom stateful task scheduling

2021-07-13 Thread GitBox
viirya closed pull request #32422: URL: https://github.com/apache/spark/pull/32422 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [spark] SparkQA removed a comment on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

2021-07-13 Thread GitBox
SparkQA removed a comment on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879045983 **[Test build #140973 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140973/testReport)** for PR 33322 at commit

[GitHub] [spark] SparkQA commented on pull request #33322: [SPARK-36120][SQL] Support TimestampNTZ type in cache table

2021-07-13 Thread GitBox
SparkQA commented on pull request #33322: URL: https://github.com/apache/spark/pull/33322#issuecomment-879242998 **[Test build #140973 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/140973/testReport)** for PR 33322 at commit

[GitHub] [spark] stephanecollot commented on pull request #27861: [SPARK-30707][SQL]Window function set partitionSpec as order spec when orderSpec is empty

2021-07-13 Thread GitBox
stephanecollot commented on pull request #27861: URL: https://github.com/apache/spark/pull/27861#issuecomment-879238130 Hi I'm interested in this, I want to give a row number per group, without sorting for performance reason and because I don't mind about the order. Here:

[GitHub] [spark] dongjoon-hyun commented on pull request #33070: [SPARK-35551][SQL] Handle the COUNT bug for lateral subqueries

2021-07-13 Thread GitBox
dongjoon-hyun commented on pull request #33070: URL: https://github.com/apache/spark/pull/33070#issuecomment-879237641 Thank you so much, @allisonwang-db and @cloud-fan ! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #32959: [SPARK-35780][SQL] Support DATE/TIMESTAMP literals across the full range

2021-07-13 Thread GitBox
SparkQA commented on pull request #32959: URL: https://github.com/apache/spark/pull/32959#issuecomment-879234600 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/45490/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

2021-07-13 Thread GitBox
AmplabJenkins removed a comment on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879229381 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45488/

[GitHub] [spark] AmplabJenkins commented on pull request #33324: [SPARK-36093][SQL] RemoveRedundantAliases should not change Command's parameter's expression's name

2021-07-13 Thread GitBox
AmplabJenkins commented on pull request #33324: URL: https://github.com/apache/spark/pull/33324#issuecomment-879229381 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/45488/ --

[GitHub] [spark] mickjermsurawong-stripe commented on pull request #33205: [SPARK-20384][SQL] Support value class in nested schema for Dataset

2021-07-13 Thread GitBox
mickjermsurawong-stripe commented on pull request #33205: URL: https://github.com/apache/spark/pull/33205#issuecomment-879225200 hi @eejbyfeldt please feel free to drive this forward. Thank you for the work. Happy if you'd like to make a patch here :) On backward-compat, i think one

[GitHub] [spark] xinrong-databricks commented on pull request #33315: [SPARK-36104][PYTHON][FOLLOWUP] Remove unused import "typing.cast"

2021-07-13 Thread GitBox
xinrong-databricks commented on pull request #33315: URL: https://github.com/apache/spark/pull/33315#issuecomment-879223295 Thanks @sarutak! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

<    1   2   3   4   5   6   7   >