[GitHub] [spark] SparkQA commented on pull request #34551: [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI intervals in Hive compatible format

2021-11-11 Thread GitBox
SparkQA commented on pull request #34551: URL: https://github.com/apache/spark/pull/34551#issuecomment-966071540 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49556/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34476: [SPARK-37195][SQL][TESTS] Unify v1 and v2 SHOW TBLPROPERTIES tests

2021-11-11 Thread GitBox
SparkQA commented on pull request #34476: URL: https://github.com/apache/spark/pull/34476#issuecomment-966071929 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49560/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34548: [SPARK-37282][TESTS] Add `ExtendedLevelDBTest` and disable LevelDB tests on Apple Silicon

2021-11-11 Thread GitBox
SparkQA commented on pull request #34548: URL: https://github.com/apache/spark/pull/34548#issuecomment-966072518 **[Test build #145083 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145083/testReport)** for PR 34548 at commit [`3c3605e`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #34548: [SPARK-37282][TESTS] Add `ExtendedLevelDBTest` and disable LevelDB tests on Apple Silicon

2021-11-11 Thread GitBox
SparkQA removed a comment on pull request #34548: URL: https://github.com/apache/spark/pull/34548#issuecomment-965999081 **[Test build #145083 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145083/testReport)** for PR 34548 at commit [`3c3605e`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
SparkQA commented on pull request #34542: URL: https://github.com/apache/spark/pull/34542#issuecomment-966075515 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49558/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #34550: [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34550: URL: https://github.com/apache/spark/pull/34550#issuecomment-966075657 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [spark] AmplabJenkins commented on pull request #34435: [SPARK-37155][PYTHON] Inline type hints for python/pyspark/statcounter.py

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34435: URL: https://github.com/apache/spark/pull/34435#issuecomment-966075656 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145093/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34548: [SPARK-37282][TESTS] Add `ExtendedLevelDBTest` and disable LevelDB tests on Apple Silicon

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34548: URL: https://github.com/apache/spark/pull/34548#issuecomment-966075664 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

[GitHub] [spark] SparkQA commented on pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and numerics

2021-11-11 Thread GitBox
SparkQA commented on pull request #34494: URL: https://github.com/apache/spark/pull/34494#issuecomment-966073837 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49559/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34552: [SPARK-37284][BUILD] Upgrade Jekyll to 4.2.1

2021-11-11 Thread GitBox
SparkQA commented on pull request #34552: URL: https://github.com/apache/spark/pull/34552#issuecomment-966074035 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49555/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34550: [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class

2021-11-11 Thread GitBox
SparkQA commented on pull request #34550: URL: https://github.com/apache/spark/pull/34550#issuecomment-966074989 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49557/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34324: [SPARK-37015][PYTHON] Inline type hints for python/pyspark/streaming/dstream.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34324: URL: https://github.com/apache/spark/pull/34324#issuecomment-966076607 **[Test build #145100 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145100/testReport)** for PR 34324 at commit [`d19a72f`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34550: [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34550: URL: https://github.com/apache/spark/pull/34550#issuecomment-966075657 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34435: [SPARK-37155][PYTHON] Inline type hints for python/pyspark/statcounter.py

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34435: URL: https://github.com/apache/spark/pull/34435#issuecomment-966075656 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145093/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34433: [SPARK-37146][PYTHON] Inline type hints for python/pyspark/__init__.py

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34433: URL: https://github.com/apache/spark/pull/34433#issuecomment-966075658 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145099/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34548: [SPARK-37282][TESTS] Add `ExtendedLevelDBTest` and disable LevelDB tests on Apple Silicon

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34548: URL: https://github.com/apache/spark/pull/34548#issuecomment-966075663 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34439: [SPARK-37095][PYTHON] Inline type hints for files in python/pyspark/broadcast.py

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34439: URL: https://github.com/apache/spark/pull/34439#issuecomment-966075665 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145092/ -

[GitHub] [spark] SparkQA commented on pull request #34293: [SPARK-37014][PYTHON] Inline type hints for python/pyspark/streaming/context.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34293: URL: https://github.com/apache/spark/pull/34293#issuecomment-96607 **[Test build #145101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145101/testReport)** for PR 34293 at commit [`7a70727`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #34439: [SPARK-37095][PYTHON] Inline type hints for files in python/pyspark/broadcast.py

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34439: URL: https://github.com/apache/spark/pull/34439#issuecomment-966075665 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145092/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34433: [SPARK-37146][PYTHON] Inline type hints for python/pyspark/__init__.py

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34433: URL: https://github.com/apache/spark/pull/34433#issuecomment-966075658 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145099/ -- This

[GitHub] [spark] peter-toth commented on pull request #33281: [SPARK-36073][SQL] EquivalentExpressions fixes and improvements

2021-11-11 Thread GitBox
peter-toth commented on pull request #33281: URL: https://github.com/apache/spark/pull/33281#issuecomment-966086614 Thanks for the review @cloud-fan! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go

[GitHub] [spark] cloud-fan commented on a change in pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
cloud-fan commented on a change in pull request #34542: URL: https://github.com/apache/spark/pull/34542#discussion_r747293133 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -2192,6 +2192,37 @@ class AdaptiveQuer

[GitHub] [spark] cloud-fan commented on a change in pull request #34476: [SPARK-37195][SQL][TESTS] Unify v1 and v2 SHOW TBLPROPERTIES tests

2021-11-11 Thread GitBox
cloud-fan commented on a change in pull request #34476: URL: https://github.com/apache/spark/pull/34476#discussion_r747296244 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/ShowTblPropertiesSuite.scala ## @@ -0,0 +1,106 @@ +/* + * Licensed to t

[GitHub] [spark] SparkQA commented on pull request #34324: [SPARK-37015][PYTHON] Inline type hints for python/pyspark/streaming/dstream.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34324: URL: https://github.com/apache/spark/pull/34324#issuecomment-966090356 **[Test build #145100 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145100/testReport)** for PR 34324 at commit [`d19a72f`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #34293: [SPARK-37014][PYTHON] Inline type hints for python/pyspark/streaming/context.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34293: URL: https://github.com/apache/spark/pull/34293#issuecomment-966093232 **[Test build #145101 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145101/testReport)** for PR 34293 at commit [`7a70727`](https://github.co

[GitHub] [spark] MaxGekk commented on a change in pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and numerics

2021-11-11 Thread GitBox
MaxGekk commented on a change in pull request #34494: URL: https://github.com/apache/spark/pull/34494#discussion_r74727 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ## @@ -81,9 +82,13 @@ object Cast { case (StringType,

[GitHub] [spark] SparkQA commented on pull request #34540: [SPARK-37262][SQL] Don't log empty aggregate and group by in JDBCScan

2021-11-11 Thread GitBox
SparkQA commented on pull request #34540: URL: https://github.com/apache/spark/pull/34540#issuecomment-966097418 **[Test build #145078 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145078/testReport)** for PR 34540 at commit [`d4021a8`](https://github.co

[GitHub] [spark] Peng-Lei commented on a change in pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and numerics

2021-11-11 Thread GitBox
Peng-Lei commented on a change in pull request #34494: URL: https://github.com/apache/spark/pull/34494#discussion_r747307497 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ## @@ -81,9 +82,13 @@ object Cast { case (StringType

[GitHub] [spark] ulysses-you commented on a change in pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
ulysses-you commented on a change in pull request #34542: URL: https://github.com/apache/spark/pull/34542#discussion_r747307737 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -2192,6 +2192,37 @@ class AdaptiveQu

[GitHub] [spark] SparkQA commented on pull request #34552: [SPARK-37284][BUILD] Upgrade Jekyll to 4.2.1

2021-11-11 Thread GitBox
SparkQA commented on pull request #34552: URL: https://github.com/apache/spark/pull/34552#issuecomment-966100457 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49555/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and numerics

2021-11-11 Thread GitBox
SparkQA commented on pull request #34494: URL: https://github.com/apache/spark/pull/34494#issuecomment-966100984 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49559/ -- This is an automated message from the A

[GitHub] [spark] Peng-Lei commented on a change in pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and numerics

2021-11-11 Thread GitBox
Peng-Lei commented on a change in pull request #34494: URL: https://github.com/apache/spark/pull/34494#discussion_r747309723 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ## @@ -589,6 +594,9 @@ abstract class CastBase extends Un

[GitHub] [spark] SparkQA commented on pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
SparkQA commented on pull request #34542: URL: https://github.com/apache/spark/pull/34542#issuecomment-966102044 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49558/ -- This is an automated message from the A

[GitHub] [spark] Peng-Lei commented on a change in pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and numerics

2021-11-11 Thread GitBox
Peng-Lei commented on a change in pull request #34494: URL: https://github.com/apache/spark/pull/34494#discussion_r747311835 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ## @@ -645,6 +666,19 @@ abstract class CastBase extends U

[GitHub] [spark] mridulm commented on pull request #34461: [SPARK-37023][CORE] Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry

2021-11-11 Thread GitBox
mridulm commented on pull request #34461: URL: https://github.com/apache/spark/pull/34461#issuecomment-966105512 @rmcyang Can you please file a jira for the issue that @Ngone51 detailed ? Thanks ! Will merge this to master and branch-3.2 -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34439: [SPARK-37095][PYTHON] Inline type hints for files in python/pyspark/broadcast.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34439: URL: https://github.com/apache/spark/pull/34439#issuecomment-966106285 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49561/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #34324: [SPARK-37015][PYTHON] Inline type hints for python/pyspark/streaming/dstream.py

2021-11-11 Thread GitBox
SparkQA removed a comment on pull request #34324: URL: https://github.com/apache/spark/pull/34324#issuecomment-966076607 **[Test build #145100 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145100/testReport)** for PR 34324 at commit [`d19a72f`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #34540: [SPARK-37262][SQL] Don't log empty aggregate and group by in JDBCScan

2021-11-11 Thread GitBox
SparkQA removed a comment on pull request #34540: URL: https://github.com/apache/spark/pull/34540#issuecomment-965970335 **[Test build #145078 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145078/testReport)** for PR 34540 at commit [`d4021a8`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #34293: [SPARK-37014][PYTHON] Inline type hints for python/pyspark/streaming/context.py

2021-11-11 Thread GitBox
SparkQA removed a comment on pull request #34293: URL: https://github.com/apache/spark/pull/34293#issuecomment-96607 **[Test build #145101 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145101/testReport)** for PR 34293 at commit [`7a70727`](https://gi

[GitHub] [spark] asfgit closed pull request #34461: [SPARK-37023][CORE] Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry

2021-11-11 Thread GitBox
asfgit closed pull request #34461: URL: https://github.com/apache/spark/pull/34461 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsubsc

[GitHub] [spark] Peng-Lei commented on a change in pull request #34476: [SPARK-37195][SQL][TESTS] Unify v1 and v2 SHOW TBLPROPERTIES tests

2021-11-11 Thread GitBox
Peng-Lei commented on a change in pull request #34476: URL: https://github.com/apache/spark/pull/34476#discussion_r747315722 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/ShowTblPropertiesSuite.scala ## @@ -0,0 +1,106 @@ +/* + * Licensed to th

[GitHub] [spark] SparkQA commented on pull request #34551: [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI intervals in Hive compatible format

2021-11-11 Thread GitBox
SparkQA commented on pull request #34551: URL: https://github.com/apache/spark/pull/34551#issuecomment-966107608 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49556/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34476: [SPARK-37195][SQL][TESTS] Unify v1 and v2 SHOW TBLPROPERTIES tests

2021-11-11 Thread GitBox
SparkQA commented on pull request #34476: URL: https://github.com/apache/spark/pull/34476#issuecomment-966108132 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49560/ -- This is an automated message from the A

[GitHub] [spark] mridulm commented on pull request #34461: [SPARK-37023][CORE] Avoid fetching merge status when shuffleMergeEnabled is false for a shuffleDependency during retry

2021-11-11 Thread GitBox
mridulm commented on pull request #34461: URL: https://github.com/apache/spark/pull/34461#issuecomment-966111264 Merged to master and branch-3.2 Thanks for working on this @rmcyang ! Thanks for the reviews @dongjoon-hyun, @Ngone51 :-) -- This is an automated message from the Apache

[GitHub] [spark] taosiyuan163 opened a new pull request #34553: [SPARK-37285] [ML] Add Weight of Evidence and Information value to ml.feature

2021-11-11 Thread GitBox
taosiyuan163 opened a new pull request #34553: URL: https://github.com/apache/spark/pull/34553 JIRA Issue: https://issues.apache.org/jira/browse/SPARK-37285 The following shows the differences with this [PR-10803] : 1. More accurate algorithm to reduce the variance when the classif

[GitHub] [spark] AmplabJenkins commented on pull request #34293: [SPARK-37014][PYTHON] Inline type hints for python/pyspark/streaming/context.py

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34293: URL: https://github.com/apache/spark/pull/34293#issuecomment-966113105 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145101/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34476: [SPARK-37195][SQL][TESTS] Unify v1 and v2 SHOW TBLPROPERTIES tests

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34476: URL: https://github.com/apache/spark/pull/34476#issuecomment-966113101 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49560/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34540: [SPARK-37262][SQL] Don't log empty aggregate and group by in JDBCScan

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34540: URL: https://github.com/apache/spark/pull/34540#issuecomment-966113107 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145078/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34552: [SPARK-37284][BUILD] Upgrade Jekyll to 4.2.1

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34552: URL: https://github.com/apache/spark/pull/34552#issuecomment-966113106 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49555/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34542: URL: https://github.com/apache/spark/pull/34542#issuecomment-966113111 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49558/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and IntegralType

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34494: URL: https://github.com/apache/spark/pull/34494#issuecomment-966113108 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49559/

[GitHub] [spark] AmplabJenkins commented on pull request #34553: [SPARK-37285] [ML] Add Weight of Evidence and Information value to ml.feature

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34553: URL: https://github.com/apache/spark/pull/34553#issuecomment-966113267 Can one of the admins verify this patch? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

[GitHub] [spark] AmplabJenkins commented on pull request #34324: [SPARK-37015][PYTHON] Inline type hints for python/pyspark/streaming/dstream.py

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34324: URL: https://github.com/apache/spark/pull/34324#issuecomment-966113103 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145100/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #34551: [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI intervals in Hive compatible format

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34551: URL: https://github.com/apache/spark/pull/34551#issuecomment-966113104 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49556/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34540: [SPARK-37262][SQL] Don't log empty aggregate and group by in JDBCScan

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34540: URL: https://github.com/apache/spark/pull/34540#issuecomment-966113107 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145078/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34551: [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI intervals in Hive compatible format

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34551: URL: https://github.com/apache/spark/pull/34551#issuecomment-966113104 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49556/

[GitHub] [spark] AmplabJenkins commented on pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and IntegralType

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34494: URL: https://github.com/apache/spark/pull/34494#issuecomment-966113108 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49559/ -- T

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34552: [SPARK-37284][BUILD] Upgrade Jekyll to 4.2.1

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34552: URL: https://github.com/apache/spark/pull/34552#issuecomment-966113106 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34542: URL: https://github.com/apache/spark/pull/34542#issuecomment-966113111 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49558/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34324: [SPARK-37015][PYTHON] Inline type hints for python/pyspark/streaming/dstream.py

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34324: URL: https://github.com/apache/spark/pull/34324#issuecomment-966113103 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145100/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34293: [SPARK-37014][PYTHON] Inline type hints for python/pyspark/streaming/context.py

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34293: URL: https://github.com/apache/spark/pull/34293#issuecomment-966113105 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145101/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34476: [SPARK-37195][SQL][TESTS] Unify v1 and v2 SHOW TBLPROPERTIES tests

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34476: URL: https://github.com/apache/spark/pull/34476#issuecomment-966113101 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49560/

[GitHub] [spark] cloud-fan commented on a change in pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
cloud-fan commented on a change in pull request #34542: URL: https://github.com/apache/spark/pull/34542#discussion_r747323730 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -2192,6 +2192,37 @@ class AdaptiveQuer

[GitHub] [spark] SparkQA commented on pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
SparkQA commented on pull request #34542: URL: https://github.com/apache/spark/pull/34542#issuecomment-966115730 **[Test build #145102 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145102/testReport)** for PR 34542 at commit [`a27219e`](https://github.com

[GitHub] [spark] AmplabJenkins commented on pull request #34550: [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34550: URL: https://github.com/apache/spark/pull/34550#issuecomment-966117470 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49557/ -- T

[GitHub] [spark] SparkQA commented on pull request #34550: [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class

2021-11-11 Thread GitBox
SparkQA commented on pull request #34550: URL: https://github.com/apache/spark/pull/34550#issuecomment-966117381 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49557/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34546: [SPARK-37702][SQL] Use AnalysisContext to track referred temp functions

2021-11-11 Thread GitBox
SparkQA commented on pull request #34546: URL: https://github.com/apache/spark/pull/34546#issuecomment-966118685 **[Test build #145080 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145080/testReport)** for PR 34546 at commit [`aa9ef80`](https://github.co

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34550: [SPARK-37263][PYTHON] Add PandasAPIOnSparkAdviceWarning class

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34550: URL: https://github.com/apache/spark/pull/34550#issuecomment-966117470 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49557/

[GitHub] [spark] SparkQA removed a comment on pull request #34546: [SPARK-37702][SQL] Use AnalysisContext to track referred temp functions

2021-11-11 Thread GitBox
SparkQA removed a comment on pull request #34546: URL: https://github.com/apache/spark/pull/34546#issuecomment-965994628 **[Test build #145080 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145080/testReport)** for PR 34546 at commit [`aa9ef80`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34435: [SPARK-37155][PYTHON] Inline type hints for python/pyspark/statcounter.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34435: URL: https://github.com/apache/spark/pull/34435#issuecomment-966120320 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49562/ -- This is an automated message from the Apache

[GitHub] [spark] ulysses-you commented on a change in pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
ulysses-you commented on a change in pull request #34542: URL: https://github.com/apache/spark/pull/34542#discussion_r747326076 ## File path: sql/core/src/test/scala/org/apache/spark/sql/execution/adaptive/AdaptiveQueryExecSuite.scala ## @@ -2192,6 +2192,37 @@ class AdaptiveQu

[GitHub] [spark] AmplabJenkins commented on pull request #34546: [SPARK-37702][SQL] Use AnalysisContext to track referred temp functions

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34546: URL: https://github.com/apache/spark/pull/34546#issuecomment-966121585 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145080/ -- This

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34546: [SPARK-37702][SQL] Use AnalysisContext to track referred temp functions

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34546: URL: https://github.com/apache/spark/pull/34546#issuecomment-966121585 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145080/ -

[GitHub] [spark] SparkQA commented on pull request #34542: [SPARK-37267][SQL] OptimizeSkewInRebalancePartitions support optimize non-root node

2021-11-11 Thread GitBox
SparkQA commented on pull request #34542: URL: https://github.com/apache/spark/pull/34542#issuecomment-966123573 **[Test build #145103 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145103/testReport)** for PR 34542 at commit [`082a40a`](https://github.com

[GitHub] [spark] cloud-fan commented on pull request #34540: [SPARK-37262][SQL] Don't log empty aggregate and group by in JDBCScan

2021-11-11 Thread GitBox
cloud-fan commented on pull request #34540: URL: https://github.com/apache/spark/pull/34540#issuecomment-966133986 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] cloud-fan closed pull request #34540: [SPARK-37262][SQL] Don't log empty aggregate and group by in JDBCScan

2021-11-11 Thread GitBox
cloud-fan closed pull request #34540: URL: https://github.com/apache/spark/pull/34540 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: reviews-unsu

[GitHub] [spark] SparkQA commented on pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and IntegralType

2021-11-11 Thread GitBox
SparkQA commented on pull request #34494: URL: https://github.com/apache/spark/pull/34494#issuecomment-966138038 **[Test build #145104 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145104/testReport)** for PR 34494 at commit [`b170f78`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #34551: [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI intervals in Hive compatible format

2021-11-11 Thread GitBox
SparkQA commented on pull request #34551: URL: https://github.com/apache/spark/pull/34551#issuecomment-966143909 **[Test build #145087 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145087/testReport)** for PR 34551 at commit [`28b2bff`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #34551: [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI intervals in Hive compatible format

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34551: URL: https://github.com/apache/spark/pull/34551#issuecomment-966145197 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/145087/ -- This

[GitHub] [spark] zero323 commented on a change in pull request #34433: [SPARK-37146][PYTHON] Inline type hints for python/pyspark/__init__.py

2021-11-11 Thread GitBox
zero323 commented on a change in pull request #34433: URL: https://github.com/apache/spark/pull/34433#discussion_r747340446 ## File path: python/pyspark/__init__.py ## @@ -63,44 +64,56 @@ from pyspark.version import __version__ from pyspark._globals import _NoValue # noqa: F

[GitHub] [spark] dh20 commented on pull request #34549: [SPARK-37274][SQL]When the value of this parameter is greater than the maximum value of int type, the value will be thrown out of bounds. The do

2021-11-11 Thread GitBox
dh20 commented on pull request #34549: URL: https://github.com/apache/spark/pull/34549#issuecomment-966151107 @sarutak Hi, can you take a look at this PR, thank you -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[GitHub] [spark] linhongliu-db commented on pull request #34546: [SPARK-37702][SQL] Use AnalysisContext to track referred temp functions

2021-11-11 Thread GitBox
linhongliu-db commented on pull request #34546: URL: https://github.com/apache/spark/pull/34546#issuecomment-966154251 cc @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] beliefer opened a new pull request #34554: [SPARK-37286] Move compileAggregates from JDBCRDD to JdbcDialect

2021-11-11 Thread GitBox
beliefer opened a new pull request #34554: URL: https://github.com/apache/spark/pull/34554 ### What changes were proposed in this pull request? Currently, the method `compileAggregates` is a member of `JDBCRDD`. But it is not reasonable, because the JDBC source knowns how to compile aggr

[GitHub] [spark] beliefer commented on pull request #34543: [SPARK-37266][SQL] Optimize the analysis for view text of persistent view and fix security vulnerabilities caused by sql tampering

2021-11-11 Thread GitBox
beliefer commented on pull request #34543: URL: https://github.com/apache/spark/pull/34543#issuecomment-966157729 ping @MaxGekk @gengliangwang cc @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [spark] Peng-Lei commented on a change in pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and IntegralType

2021-11-11 Thread GitBox
Peng-Lei commented on a change in pull request #34494: URL: https://github.com/apache/spark/pull/34494#discussion_r747350973 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/Cast.scala ## @@ -598,6 +606,15 @@ abstract class CastBase extends U

[GitHub] [spark] SparkQA commented on pull request #34546: [SPARK-37702][SQL] Use AnalysisContext to track referred temp functions

2021-11-11 Thread GitBox
SparkQA commented on pull request #34546: URL: https://github.com/apache/spark/pull/34546#issuecomment-966161776 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49566/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34433: [SPARK-37146][PYTHON] Inline type hints for python/pyspark/__init__.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34433: URL: https://github.com/apache/spark/pull/34433#issuecomment-966162345 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49567/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #33588: [SPARK-36346][SQL] Support TimestampNTZ type in Orc file source

2021-11-11 Thread GitBox
SparkQA commented on pull request #33588: URL: https://github.com/apache/spark/pull/33588#issuecomment-966163009 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49563/ -- This is an automated message from the Apache

[GitHub] [spark] zero323 commented on a change in pull request #34433: [SPARK-37146][PYTHON] Inline type hints for python/pyspark/__init__.py

2021-11-11 Thread GitBox
zero323 commented on a change in pull request #34433: URL: https://github.com/apache/spark/pull/34433#discussion_r747342243 ## File path: python/pyspark/__init__.py ## @@ -63,44 +64,56 @@ from pyspark.version import __version__ from pyspark._globals import _NoValue # noqa: F

[GitHub] [spark] SparkQA removed a comment on pull request #34551: [SPARK-37283][SQL] Don't try to store a V1 table which contains ANSI intervals in Hive compatible format

2021-11-11 Thread GitBox
SparkQA removed a comment on pull request #34551: URL: https://github.com/apache/spark/pull/34551#issuecomment-966045285 **[Test build #145087 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145087/testReport)** for PR 34551 at commit [`28b2bff`](https://gi

[GitHub] [spark] SparkQA commented on pull request #34439: [SPARK-37095][PYTHON] Inline type hints for files in python/pyspark/broadcast.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34439: URL: https://github.com/apache/spark/pull/34439#issuecomment-966165831 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49561/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #34433: [SPARK-37146][PYTHON] Inline type hints for python/pyspark/__init__.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34433: URL: https://github.com/apache/spark/pull/34433#issuecomment-966165825 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49568/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34494: [SPARK-36924][SQL] CAST between ANSI intervals and IntegralType

2021-11-11 Thread GitBox
SparkQA commented on pull request #34494: URL: https://github.com/apache/spark/pull/34494#issuecomment-966165904 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49564/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #34435: [SPARK-37155][PYTHON] Inline type hints for python/pyspark/statcounter.py

2021-11-11 Thread GitBox
SparkQA commented on pull request #34435: URL: https://github.com/apache/spark/pull/34435#issuecomment-966168921 Kubernetes integration test status failure URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49562/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #33588: [SPARK-36346][SQL] Support TimestampNTZ type in Orc file source

2021-11-11 Thread GitBox
SparkQA commented on pull request #33588: URL: https://github.com/apache/spark/pull/33588#issuecomment-966169237 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/49565/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #34439: [SPARK-37095][PYTHON] Inline type hints for files in python/pyspark/broadcast.py

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34439: URL: https://github.com/apache/spark/pull/34439#issuecomment-966172142 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49561/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #34435: [SPARK-37155][PYTHON] Inline type hints for python/pyspark/statcounter.py

2021-11-11 Thread GitBox
AmplabJenkins commented on pull request #34435: URL: https://github.com/apache/spark/pull/34435#issuecomment-966172141 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49562/ -- T

[GitHub] [spark] SparkQA commented on pull request #34554: [SPARK-37286] Move compileAggregates from JDBCRDD to JdbcDialect

2021-11-11 Thread GitBox
SparkQA commented on pull request #34554: URL: https://github.com/apache/spark/pull/34554#issuecomment-966172641 **[Test build #145105 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/145105/testReport)** for PR 34554 at commit [`3c238b4`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34435: [SPARK-37155][PYTHON] Inline type hints for python/pyspark/statcounter.py

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34435: URL: https://github.com/apache/spark/pull/34435#issuecomment-966172141 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49562/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #34439: [SPARK-37095][PYTHON] Inline type hints for files in python/pyspark/broadcast.py

2021-11-11 Thread GitBox
AmplabJenkins removed a comment on pull request #34439: URL: https://github.com/apache/spark/pull/34439#issuecomment-966172142 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/49561/

  1   2   3   4   5   6   7   >