[GitHub] [spark] SparkQA commented on pull request #32807: [SPARK-35669][SQL] Quote the pushed column name only when nested column predicate pushdown is enabled

2021-06-15 Thread GitBox
SparkQA commented on pull request #32807: URL: https://github.com/apache/spark/pull/32807#issuecomment-861844508 **[Test build #139819 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139819/testReport)** for PR 32807 at commit

[GitHub] [spark] SparkQA commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
SparkQA commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861829656 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44355/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32912: [SPARK-35429][CORE][test-hadoop2.7] Remove commons-httpclient from Hadoop-3.2 profile due to EOL and CVEs

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32912: URL: https://github.com/apache/spark/pull/32912#issuecomment-861827924 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44354/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861827923 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44353/

[GitHub] [spark] AmplabJenkins commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861827923 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44353/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32912: [SPARK-35429][CORE][test-hadoop2.7] Remove commons-httpclient from Hadoop-3.2 profile due to EOL and CVEs

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32912: URL: https://github.com/apache/spark/pull/32912#issuecomment-861827924 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44354/ --

[GitHub] [spark] AnirudhVyas commented on pull request #22350: [SPARK-25356][SQL]Add Parquet block size option to SparkSQL configuration

2021-06-15 Thread GitBox
AnirudhVyas commented on pull request #22350: URL: https://github.com/apache/spark/pull/22350#issuecomment-861825493 Sorry its not clear what is the setting - how do we adjust this setting, I wish to adjust parquet block size. -- This is an automated message from the Apache Git Service.

[GitHub] [spark] SparkQA commented on pull request #32912: [SPARK-35429][CORE][test-hadoop2.7] Remove commons-httpclient from Hadoop-3.2 profile due to EOL and CVEs

2021-06-15 Thread GitBox
SparkQA commented on pull request #32912: URL: https://github.com/apache/spark/pull/32912#issuecomment-861821475 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44354/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
SparkQA commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861813646 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44353/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32912: [SPARK-35429][CORE][test-hadoop2.7] Remove commons-httpclient from Hadoop-3.2 profile due to EOL and CVEs

2021-06-15 Thread GitBox
SparkQA commented on pull request #32912: URL: https://github.com/apache/spark/pull/32912#issuecomment-861800349 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44354/ -- This is an automated message from the Apache

[GitHub] [spark] MaxGekk closed pull request #32825: [WIP][SPARK-35680][SQL] Support units by the year-month interval type

2021-06-15 Thread GitBox
MaxGekk closed pull request #32825: URL: https://github.com/apache/spark/pull/32825 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] MaxGekk closed pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
MaxGekk closed pull request #32909: URL: https://github.com/apache/spark/pull/32909 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] MaxGekk commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
MaxGekk commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861796885 Merging to master. Thank you, @cloud-fan for your review. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [spark] SparkQA commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
SparkQA commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861794437 **[Test build #139827 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139827/testReport)** for PR 32448 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861792532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44348/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861792539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44352/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861792533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861792531 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44350/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32918: [SPARK-35766][SQL][TESTS] Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32918: URL: https://github.com/apache/spark/pull/32918#issuecomment-861792534 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139815/

[GitHub] [spark] AmplabJenkins commented on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861792539 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44352/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861792531 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44350/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32918: [SPARK-35766][SQL][TESTS] Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32918: URL: https://github.com/apache/spark/pull/32918#issuecomment-861792534 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139815/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861792532 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44348/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861792533 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] dongjoon-hyun edited a comment on pull request #32826: [SPARK-35670][BUILD] Upgrade ZSTD-JNI to 1.5.0-1

2021-06-15 Thread GitBox
dongjoon-hyun edited a comment on pull request #32826: URL: https://github.com/apache/spark/pull/32826#issuecomment-861791665 Well, do you know that the feature freeze of Apache Spark 3.2.0 is [July 1st](https://spark.apache.org/versioning-policy.html) for now? It seems that that's the

[GitHub] [spark] SparkQA commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
SparkQA commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861791977 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44353/ -- This is an automated message from the Apache

[GitHub] [spark] dongjoon-hyun commented on pull request #32826: [SPARK-35670][BUILD] Upgrade ZSTD-JNI to 1.5.0-1

2021-06-15 Thread GitBox
dongjoon-hyun commented on pull request #32826: URL: https://github.com/apache/spark/pull/32826#issuecomment-861791665 Well, do you know that the feature freeze of Apache Spark 3.2.0 is [July 1st](https://spark.apache.org/versioning-policy.html) for now? It seems that that's the root

[GitHub] [spark] Kimahriman commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
Kimahriman commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861788921 I pushed the small fix that moves the compatibility analysis after the union resolving, making ResolveUnion no longer use StructType.merge. I updated the title and

[GitHub] [spark] SparkQA commented on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
SparkQA commented on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861783559 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44352/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32918: [SPARK-35766][SQL][TESTS] Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread GitBox
SparkQA removed a comment on pull request #32918: URL: https://github.com/apache/spark/pull/32918#issuecomment-861577296 **[Test build #139815 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139815/testReport)** for PR 32918 at commit

[GitHub] [spark] SparkQA commented on pull request #32918: [SPARK-35766][SQL][TESTS] Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread GitBox
SparkQA commented on pull request #32918: URL: https://github.com/apache/spark/pull/32918#issuecomment-861774509 **[Test build #139815 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139815/testReport)** for PR 32918 at commit

[GitHub] [spark] SparkQA commented on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
SparkQA commented on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861772740 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44351/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
SparkQA commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861771904 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44350/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
SparkQA removed a comment on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861719429 **[Test build #139823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139823/testReport)** for PR 32857 at commit

[GitHub] [spark] SparkQA commented on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
SparkQA commented on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861769918 **[Test build #139823 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139823/testReport)** for PR 32857 at commit

[GitHub] [spark] SparkQA commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
SparkQA commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861768751 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44348/ -- This is an automated message from the

[GitHub] [spark] SparkQA removed a comment on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
SparkQA removed a comment on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861757511 **[Test build #139825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139825/testReport)** for PR 32448 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861761450 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139824/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861761935 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139825/

[GitHub] [spark] SparkQA removed a comment on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
SparkQA removed a comment on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861719518 **[Test build #139824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139824/testReport)** for PR 32805 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861761935 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139825/ -- This

[GitHub] [spark] SparkQA commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
SparkQA commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861761897 **[Test build #139825 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139825/testReport)** for PR 32448 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861761450 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139824/ -- This

[GitHub] [spark] SparkQA commented on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
SparkQA commented on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861760930 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] dongjoon-hyun commented on pull request #32911: [SPARK-35760][SQL] Fix the max rows check for broadcast exchange

2021-06-15 Thread GitBox
dongjoon-hyun commented on pull request #32911: URL: https://github.com/apache/spark/pull/32911#issuecomment-861760258 Thank you for updating, @c21 . -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

[GitHub] [spark] SparkQA commented on pull request #32912: [SPARK-35429][CORE][test-hadoop2.7] Remove commons-httpclient from Hadoop-3.2 profile due to EOL and CVEs

2021-06-15 Thread GitBox
SparkQA commented on pull request #32912: URL: https://github.com/apache/spark/pull/32912#issuecomment-861759913 **[Test build #139826 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139826/testReport)** for PR 32912 at commit

[GitHub] [spark] dongjoon-hyun commented on pull request #32912: [SPARK-35429][CORE][test-hadoop2.7] Remove commons-httpclient from Hadoop-3.2 profile due to EOL and CVEs

2021-06-15 Thread GitBox
dongjoon-hyun commented on pull request #32912: URL: https://github.com/apache/spark/pull/32912#issuecomment-861758593 Thank you for updating, @sumeetgajjar . As a final test, I triggered a Jenkin run with `hadoop-2.7` profile. -- This is an automated message from the Apache Git

[GitHub] [spark] dongjoon-hyun commented on pull request #32912: [SPARK-35429][CORE][test-hadoop2.7] Remove commons-httpclient from Hadoop-3.2 profile due to EOL and CVEs

2021-06-15 Thread GitBox
dongjoon-hyun commented on pull request #32912: URL: https://github.com/apache/spark/pull/32912#issuecomment-861758270 Retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32448: [SPARK-35290][SQL] Append new nested struct fields rather than sort for unionByName with null filling

2021-06-15 Thread GitBox
SparkQA commented on pull request #32448: URL: https://github.com/apache/spark/pull/32448#issuecomment-861757511 **[Test build #139825 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139825/testReport)** for PR 32448 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32911: [SPARK-35760][SQL] Fix the max rows check for broadcast exchange

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32911: URL: https://github.com/apache/spark/pull/32911#issuecomment-861756113 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44349/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32645: [SPARK-35129][SQL] Construct year-month interval column from integral fields

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32645: URL: https://github.com/apache/spark/pull/32645#issuecomment-861756109 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139814/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861756111 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44346/

[GitHub] [spark] AmplabJenkins commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861756111 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44346/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32911: [SPARK-35760][SQL] Fix the max rows check for broadcast exchange

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32911: URL: https://github.com/apache/spark/pull/32911#issuecomment-861756113 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44349/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32645: [SPARK-35129][SQL] Construct year-month interval column from integral fields

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32645: URL: https://github.com/apache/spark/pull/32645#issuecomment-861756109 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139814/ -- This

[GitHub] [spark] dongjoon-hyun closed pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
dongjoon-hyun closed pull request #32920: URL: https://github.com/apache/spark/pull/32920 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] dongjoon-hyun commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
dongjoon-hyun commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861755174 Thank you, @andygrove and @tgravescs . Merged to master/3.1/3.0. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
SparkQA commented on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861751310 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44351/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
SparkQA commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861750785 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44350/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
SparkQA commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861746859 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44348/ -- This is an automated message from the Apache

[GitHub] [spark] EnricoMi commented on a change in pull request #31905: [SPARK-34806][SQL] Add Observation helper for Dataset.observe

2021-06-15 Thread GitBox
EnricoMi commented on a change in pull request #31905: URL: https://github.com/apache/spark/pull/31905#discussion_r652060893 ## File path: sql/core/src/main/scala/org/apache/spark/sql/Observation.scala ## @@ -0,0 +1,189 @@ +/* + * Licensed to the Apache Software Foundation

[GitHub] [spark] SparkQA commented on pull request #32911: [SPARK-35760][SQL] Fix the max rows check for broadcast exchange

2021-06-15 Thread GitBox
SparkQA commented on pull request #32911: URL: https://github.com/apache/spark/pull/32911#issuecomment-861744217 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44349/ --

[GitHub] [spark] SparkQA removed a comment on pull request #32645: [SPARK-35129][SQL] Construct year-month interval column from integral fields

2021-06-15 Thread GitBox
SparkQA removed a comment on pull request #32645: URL: https://github.com/apache/spark/pull/32645#issuecomment-861527505 **[Test build #139814 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139814/testReport)** for PR 32645 at commit

[GitHub] [spark] SparkQA commented on pull request #32645: [SPARK-35129][SQL] Construct year-month interval column from integral fields

2021-06-15 Thread GitBox
SparkQA commented on pull request #32645: URL: https://github.com/apache/spark/pull/32645#issuecomment-861738053 **[Test build #139814 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139814/testReport)** for PR 32645 at commit

[GitHub] [spark] SparkQA commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
SparkQA commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861734457 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44346/ -- This is an automated message from the

[GitHub] [spark] tgravescs commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
tgravescs commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861733083 +1 changes lgtm. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861671369 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[GitHub] [spark] SparkQA commented on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
SparkQA commented on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861719518 **[Test build #139824 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139824/testReport)** for PR 32805 at commit

[GitHub] [spark] SparkQA commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
SparkQA commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861719379 **[Test build #139822 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139822/testReport)** for PR 32909 at commit

[GitHub] [spark] SparkQA commented on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
SparkQA commented on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861719429 **[Test build #139823 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139823/testReport)** for PR 32857 at commit

[GitHub] [spark] SparkQA commented on pull request #32911: [SPARK-35760][SQL] Fix the max rows check for broadcast exchange

2021-06-15 Thread GitBox
SparkQA commented on pull request #32911: URL: https://github.com/apache/spark/pull/32911#issuecomment-861719273 **[Test build #139821 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139821/testReport)** for PR 32911 at commit

[GitHub] [spark] SparkQA commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
SparkQA commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861719283 **[Test build #139820 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139820/testReport)** for PR 32920 at commit

[GitHub] [spark] zhengruifeng commented on pull request #32857: [SPARK-35707][ML] optimize sparse GEMM by skipping bound checking

2021-06-15 Thread GitBox
zhengruifeng commented on pull request #32857: URL: https://github.com/apache/spark/pull/32857#issuecomment-861717995 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32845: [SPARK-35691][CORE] addFile/addJar/addDirectory should put CanonicalFile

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32845: URL: https://github.com/apache/spark/pull/32845#issuecomment-861717090 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139816/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32807: [SPARK-35669][SQL] Quote the pushed column name only when nested column predicate pushdown is enabled

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32807: URL: https://github.com/apache/spark/pull/32807#issuecomment-861717089 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44347/

[GitHub] [spark] zhengruifeng commented on pull request #32805: [SPARK-35666][ML] gemv skip array shape checking

2021-06-15 Thread GitBox
zhengruifeng commented on pull request #32805: URL: https://github.com/apache/spark/pull/32805#issuecomment-861717617 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] peter-toth commented on a change in pull request #32885: [SPARK-35742][SQL] Expression.semanticEquals should be symmetrical

2021-06-15 Thread GitBox
peter-toth commented on a change in pull request #32885: URL: https://github.com/apache/spark/pull/32885#discussion_r652028836 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala ## @@ -73,7 +73,9 @@ case class

[GitHub] [spark] AmplabJenkins commented on pull request #32845: [SPARK-35691][CORE] addFile/addJar/addDirectory should put CanonicalFile

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32845: URL: https://github.com/apache/spark/pull/32845#issuecomment-861717090 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139816/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32807: [SPARK-35669][SQL] Quote the pushed column name only when nested column predicate pushdown is enabled

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32807: URL: https://github.com/apache/spark/pull/32807#issuecomment-861717089 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44347/ --

[GitHub] [spark] SparkQA commented on pull request #32807: [SPARK-35669][SQL] Quote the pushed column name only when nested column predicate pushdown is enabled

2021-06-15 Thread GitBox
SparkQA commented on pull request #32807: URL: https://github.com/apache/spark/pull/32807#issuecomment-861712686 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44347/ --

[GitHub] [spark] cloud-fan commented on a change in pull request #32885: [SPARK-35742][SQL] Expression.semanticEquals should be symmetrical

2021-06-15 Thread GitBox
cloud-fan commented on a change in pull request #32885: URL: https://github.com/apache/spark/pull/32885#discussion_r652023192 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/aggregate/HashAggregateExec.scala ## @@ -73,7 +73,9 @@ case class

[GitHub] [spark] SparkQA commented on pull request #32909: [SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
SparkQA commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861711075 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44346/ -- This is an automated message from the Apache

[GitHub] [spark] c21 commented on a change in pull request #32911: [SPARK-35760][SQL] Fix the max rows check for broadcast exchange

2021-06-15 Thread GitBox
c21 commented on a change in pull request #32911: URL: https://github.com/apache/spark/pull/32911#discussion_r652018211 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/exchange/BroadcastExchangeExec.scala ## @@ -105,6 +106,17 @@ case class

[GitHub] [spark] SparkQA removed a comment on pull request #32845: [SPARK-35691][CORE] addFile/addJar/addDirectory should put CanonicalFile

2021-06-15 Thread GitBox
SparkQA removed a comment on pull request #32845: URL: https://github.com/apache/spark/pull/32845#issuecomment-861586024 **[Test build #139816 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139816/testReport)** for PR 32845 at commit

[GitHub] [spark] SparkQA commented on pull request #32845: [SPARK-35691][CORE] addFile/addJar/addDirectory should put CanonicalFile

2021-06-15 Thread GitBox
SparkQA commented on pull request #32845: URL: https://github.com/apache/spark/pull/32845#issuecomment-861704341 **[Test build #139816 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139816/testReport)** for PR 32845 at commit

[GitHub] [spark] c21 commented on pull request #32907: [SPARK-35757][CORE] Add bitwise AND operation and functionality for intersecting bloom filters

2021-06-15 Thread GitBox
c21 commented on pull request #32907: URL: https://github.com/apache/spark/pull/32907#issuecomment-861702257 @kudhru - thanks for more context here, and I am good with the change. cc bloom filter original author @cloud-fan as well. -- This is an automated message from the Apache Git

[GitHub] [spark] kudhru commented on a change in pull request #32907: [SPARK-35757][CORE] Add bitwise AND operation and functionality for intersecting bloom filters

2021-06-15 Thread GitBox
kudhru commented on a change in pull request #32907: URL: https://github.com/apache/spark/pull/32907#discussion_r652011593 ## File path: common/sketch/src/main/java/org/apache/spark/util/sketch/BloomFilterImpl.java ## @@ -193,14 +193,29 @@ public boolean

[GitHub] [spark] dongjoon-hyun commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
dongjoon-hyun commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861697018 cc @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] kudhru commented on pull request #32907: [SPARK-35757][CORE] Add bitwise AND operation and functionality for intersecting bloom filters

2021-06-15 Thread GitBox
kudhru commented on pull request #32907: URL: https://github.com/apache/spark/pull/32907#issuecomment-861695720 > The implementation here seems to be obviously looking correct, but could we add some unit test for it? (e.g. in `BloomFilterSuite.scala`) > Added a test as

[GitHub] [spark] dongjoon-hyun commented on pull request #32920: [SPARK-35767] [SQL] Avoid executing child plan twice in CoalesceExec

2021-06-15 Thread GitBox
dongjoon-hyun commented on pull request #32920: URL: https://github.com/apache/spark/pull/32920#issuecomment-861691292 ok to test -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32899: [SPARK-35652][SQL] joinWith on two table generated from same one

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-861682786 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139812/

[GitHub] [spark] AmplabJenkins commented on pull request #32899: [SPARK-35652][SQL] joinWith on two table generated from same one

2021-06-15 Thread GitBox
AmplabJenkins commented on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-861682786 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139812/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32899: [SPARK-35652][SQL] joinWith on two table generated from same one

2021-06-15 Thread GitBox
SparkQA removed a comment on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-861488447 **[Test build #139812 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139812/testReport)** for PR 32899 at commit

[GitHub] [spark] SparkQA commented on pull request #32899: [SPARK-35652][SQL] joinWith on two table generated from same one

2021-06-15 Thread GitBox
SparkQA commented on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-861681175 **[Test build #139812 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139812/testReport)** for PR 32899 at commit

[GitHub] [spark] cloud-fan commented on a change in pull request #32675: [SPARK-35531][SQL] Can not insert into hive bucket table if create table with upper case schema

2021-06-15 Thread GitBox
cloud-fan commented on a change in pull request #32675: URL: https://github.com/apache/spark/pull/32675#discussion_r651991064 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -1092,14 +1092,23 @@ private[hive] object

[GitHub] [spark] gengliangwang commented on pull request #32918: [SPARK-35766][SQL][TESTS] Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread GitBox
gengliangwang commented on pull request #32918: URL: https://github.com/apache/spark/pull/32918#issuecomment-861674490 @MaxGekk Sorry about that. Yes I just moved code around. I checked #32909 and I think you can consider removing/stashing the changes in `CastSuite.scala` and apply them

[GitHub] [spark] cloud-fan closed pull request #31947: [WIP][SPARK-34847][SQL] Simplify ResolveAggregateFunctions

2021-06-15 Thread GitBox
cloud-fan closed pull request #31947: URL: https://github.com/apache/spark/pull/31947 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] SparkQA commented on pull request #32807: [SPARK-35669][SQL] Quote the pushed column name only when nested column predicate pushdown is enabled

2021-06-15 Thread GitBox
SparkQA commented on pull request #32807: URL: https://github.com/apache/spark/pull/32807#issuecomment-861671859 **[Test build #139819 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139819/testReport)** for PR 32807 at commit

[GitHub] [spark] SparkQA commented on pull request #32909: [WIP][SPARK-35680][SQL] Add fields to `YearMonthIntervalType`

2021-06-15 Thread GitBox
SparkQA commented on pull request #32909: URL: https://github.com/apache/spark/pull/32909#issuecomment-861671638 **[Test build #139818 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139818/testReport)** for PR 32909 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32918: [SPARK-35766][SQL][TESTS] Break down CastSuite/AnsiCastSuite into multiple files

2021-06-15 Thread GitBox
AmplabJenkins removed a comment on pull request #32918: URL: https://github.com/apache/spark/pull/32918#issuecomment-861670293 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44343/

<    1   2   3   4   5   6   >