[GitHub] [spark] MaxGekk commented on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

MaxGekk commented on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862230734 @AngersZh Thanks for the ping. I will look at it today slightly later. -- This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [spark] SparkQA commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

SparkQA commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-862229797 **[Test build #139871 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139871/testReport)** for PR 31179 at commit [`7fdf7d0`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32907: [SPARK-35757][CORE] Add bitwise AND operation and functionality for intersecting bloom filters

SparkQA commented on pull request #32907: URL: https://github.com/apache/spark/pull/32907#issuecomment-862228955 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44382/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

SparkQA commented on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862228687 **[Test build #139870 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139870/testReport)** for PR 32929 at commit [`2be136b`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32930: [SPARK-35732][SQL] Parse DayTimeIntervalType from JSON

SparkQA commented on pull request #32930: URL: https://github.com/apache/spark/pull/32930#issuecomment-862228649 **[Test build #139869 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139869/testReport)** for PR 32930 at commit [`1d2193d`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

AmplabJenkins removed a comment on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862226857 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139864/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32927: [SPARK-35678][ML][FOLLOWUP] use softmax in NB

AmplabJenkins removed a comment on pull request #32927: URL: https://github.com/apache/spark/pull/32927#issuecomment-862226855 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139863/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

AmplabJenkins removed a comment on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862226859 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139868/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

AmplabJenkins removed a comment on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-862226856 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44385/

[GitHub] [spark] AmplabJenkins commented on pull request #32927: [SPARK-35678][ML][FOLLOWUP] use softmax in NB

AmplabJenkins commented on pull request #32927: URL: https://github.com/apache/spark/pull/32927#issuecomment-862226855 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139863/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

AmplabJenkins commented on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862226857 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139864/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

AmplabJenkins commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-862226856 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44385/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

AmplabJenkins commented on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862226859 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139868/ -- This

[GitHub] [spark] SparkQA commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

SparkQA commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-862224107 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44388/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

SparkQA commented on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862223280 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44387/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

SparkQA removed a comment on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862187754 **[Test build #139864 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139864/testReport)** for PR 32926 at commit [`0b649ba`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

SparkQA commented on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-86630 **[Test build #139864 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139864/testReport)** for PR 32926 at commit [`0b649ba`](https://github.co

[GitHub] [spark] cloud-fan closed pull request #32470: [SPARK-35712][SQL] Simplify ResolveAggregateFunctions

cloud-fan closed pull request #32470: URL: https://github.com/apache/spark/pull/32470 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, plea

[GitHub] [spark] cloud-fan commented on pull request #32470: [SPARK-35712][SQL] Simplify ResolveAggregateFunctions

cloud-fan commented on pull request #32470: URL: https://github.com/apache/spark/pull/32470#issuecomment-862219789 thanks for the review, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abov

[GitHub] [spark] SparkQA commented on pull request #28885: [WIP][SPARK-29375][SPARK-28940][SPARK-32041][SQL] Whole plan exchange and subquery reuse

SparkQA commented on pull request #28885: URL: https://github.com/apache/spark/pull/28885#issuecomment-862218197 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44386/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

SparkQA commented on pull request #32867: URL: https://github.com/apache/spark/pull/32867#issuecomment-862217134 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44383/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-862217075 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44384/ -- This is an automated message from the Apache

[GitHub] [spark] AngersZhuuuu commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

AngersZh commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-862214478 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [spark] SparkQA commented on pull request #31179: [SPARK-34113][SQL] Use metric data update metadata statistic's size and rowCount

SparkQA commented on pull request #31179: URL: https://github.com/apache/spark/pull/31179#issuecomment-862214361 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44385/ -- This

[GitHub] [spark] AngersZhuuuu commented on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

AngersZh commented on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862212968 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [spark] SparkQA removed a comment on pull request #32927: [SPARK-35678][ML][FOLLOWUP] use softmax in NB

SparkQA removed a comment on pull request #32927: URL: https://github.com/apache/spark/pull/32927#issuecomment-862157119 **[Test build #139863 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139863/testReport)** for PR 32927 at commit [`cbcb584`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32927: [SPARK-35678][ML][FOLLOWUP] use softmax in NB

SparkQA commented on pull request #32927: URL: https://github.com/apache/spark/pull/32927#issuecomment-862206128 **[Test build #139863 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139863/testReport)** for PR 32927 at commit [`cbcb584`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

SparkQA removed a comment on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862196650 **[Test build #139868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139868/testReport)** for PR 32929 at commit [`93c998e`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

SparkQA commented on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862200646 **[Test build #139868 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139868/testReport)** for PR 32929 at commit [`93c998e`](https://github.co

[GitHub] [spark] AngersZhuuuu commented on pull request #32930: [SPARK-35732][SQL] Parse DayTimeIntervalType from JSON

AngersZh commented on pull request #32930: URL: https://github.com/apache/spark/pull/32930#issuecomment-862199627 ping @MaxGekk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AngersZhuuuu opened a new pull request #32930: [SPARK-35732][SQL] Parse DayTimeIntervalType from JSON

AngersZh opened a new pull request #32930: URL: https://github.com/apache/spark/pull/32930 ### What changes were proposed in this pull request? Support Parse DayTimeIntervalType from JSON ### Why are the changes needed? Support Parse DayTimeIntervalType from JSON

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-862199008 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139851/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-862199008 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139851/ -- This

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-86219 **[Test build #139851 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139851/testReport)** for PR 32031 at commit [`c0de2d9`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

SparkQA removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-862077784 **[Test build #139851 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139851/testReport)** for PR 32031 at commit [`c0de2d9`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

SparkQA commented on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862196650 **[Test build #139868 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139868/testReport)** for PR 32929 at commit [`93c998e`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32914: [SPARK-35763][SS] Add a new copy method to StateStoreCustomMetric

AmplabJenkins removed a comment on pull request #32914: URL: https://github.com/apache/spark/pull/32914#issuecomment-862194355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139839/ -

[GitHub] [spark] SparkQA removed a comment on pull request #32914: [SPARK-35763][SS] Add a new copy method to StateStoreCustomMetric

SparkQA removed a comment on pull request #32914: URL: https://github.com/apache/spark/pull/32914#issuecomment-862041004 **[Test build #139839 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139839/testReport)** for PR 32914 at commit [`7211c4b`](https://gi

[GitHub] [spark] SparkQA removed a comment on pull request #32899: [SPARK-35652][SQL][3.0] joinWith on two table generated from same one

SparkQA removed a comment on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-862041113 **[Test build #139841 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139841/testReport)** for PR 32899 at commit [`b5c7706`](https://gi

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32899: [SPARK-35652][SQL][3.0] joinWith on two table generated from same one

AmplabJenkins removed a comment on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-862192423 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139841/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32928: [WIP][SPARK-35784] Implementation for RocksDB instance

AmplabJenkins removed a comment on pull request #32928: URL: https://github.com/apache/spark/pull/32928#issuecomment-862194908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139867/ -

[GitHub] [spark] SparkQA removed a comment on pull request #32928: [WIP][SPARK-35784] Implementation for RocksDB instance

SparkQA removed a comment on pull request #32928: URL: https://github.com/apache/spark/pull/32928#issuecomment-862190762 **[Test build #139867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139867/testReport)** for PR 32928 at commit [`bbb534e`](https://gi

[GitHub] [spark] AngersZhuuuu commented on pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

AngersZh commented on pull request #32929: URL: https://github.com/apache/spark/pull/32929#issuecomment-862195327 ping @MaxGekk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AngersZhuuuu opened a new pull request #32929: [SPARK-35770][SQL] Parse YearMonthIntervalType from JSON

AngersZh opened a new pull request #32929: URL: https://github.com/apache/spark/pull/32929 ### What changes were proposed in this pull request? Parse YearMonthIntervalType from JSON ### Why are the changes needed? Parse YearMonthIntervalType from JSON ###

[GitHub] [spark] AmplabJenkins commented on pull request #32928: [WIP][SPARK-35784] Implementation for RocksDB instance

AmplabJenkins commented on pull request #32928: URL: https://github.com/apache/spark/pull/32928#issuecomment-862194908 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139867/ -- This

[GitHub] [spark] SparkQA commented on pull request #32928: [WIP][SPARK-35784] Implementation for RocksDB instance

SparkQA commented on pull request #32928: URL: https://github.com/apache/spark/pull/32928#issuecomment-862194866 **[Test build #139867 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139867/testReport)** for PR 32928 at commit [`bbb534e`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #32914: [SPARK-35763][SS] Add a new copy method to StateStoreCustomMetric

AmplabJenkins commented on pull request #32914: URL: https://github.com/apache/spark/pull/32914#issuecomment-862194355 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139839/ -- This

[GitHub] [spark] SparkQA commented on pull request #32914: [SPARK-35763][SS] Add a new copy method to StateStoreCustomMetric

SparkQA commented on pull request #32914: URL: https://github.com/apache/spark/pull/32914#issuecomment-862192731 **[Test build #139839 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139839/testReport)** for PR 32914 at commit [`7211c4b`](https://github.co

[GitHub] [spark] AmplabJenkins commented on pull request #32899: [SPARK-35652][SQL][3.0] joinWith on two table generated from same one

AmplabJenkins commented on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-862192423 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139841/ -- This

[GitHub] [spark] SparkQA commented on pull request #32928: [WIP][SPARK-35784] Implementation for RocksDB instance

SparkQA commented on pull request #32928: URL: https://github.com/apache/spark/pull/32928#issuecomment-862190762 **[Test build #139867 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139867/testReport)** for PR 32928 at commit [`bbb534e`](https://github.com

[GitHub] [spark] SparkQA commented on pull request #32899: [SPARK-35652][SQL][3.0] joinWith on two table generated from same one

SparkQA commented on pull request #32899: URL: https://github.com/apache/spark/pull/32899#issuecomment-862190904 **[Test build #139841 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139841/testReport)** for PR 32899 at commit [`b5c7706`](https://github.co

[GitHub] [spark] Yikun commented on a change in pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun commented on a change in pull request #32867: URL: https://github.com/apache/spark/pull/32867#discussion_r652488153 ## File path: dev/sparktestsupport/modules.py ## @@ -16,13 +16,65 @@ # from functools import total_ordering +from importlib import import_module +import

[GitHub] [spark] SparkQA commented on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.logStageExecutorM

SparkQA commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862188623 **[Test build #139866 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139866/testReport)** for PR 31992 at commit [`87a079e`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

AmplabJenkins removed a comment on pull request #32867: URL: https://github.com/apache/spark/pull/32867#issuecomment-862187930 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139865/ -

[GitHub] [spark] SparkQA removed a comment on pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

SparkQA removed a comment on pull request #32867: URL: https://github.com/apache/spark/pull/32867#issuecomment-862187894 **[Test build #139865 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139865/testReport)** for PR 32867 at commit [`22015a5`](https://gi

[GitHub] [spark] xuanyuanking opened a new pull request #32928: [WIP][SPARK-35784] Implementation for RocksDB instance

xuanyuanking opened a new pull request #32928: URL: https://github.com/apache/spark/pull/32928 ### What changes were proposed in this pull request? The implementation for the RocksDB instance, which is used in the RocksDB state store. It plays a role as a handler for the RocksDB instance

[GitHub] [spark] SparkQA commented on pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

SparkQA commented on pull request #32867: URL: https://github.com/apache/spark/pull/32867#issuecomment-862187894 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries

[GitHub] [spark] AmplabJenkins commented on pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

AmplabJenkins commented on pull request #32867: URL: https://github.com/apache/spark/pull/32867#issuecomment-862187930 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139865/ -- This

[GitHub] [spark] SparkQA commented on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

SparkQA commented on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862187754 **[Test build #139864 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139864/testReport)** for PR 32926 at commit [`0b649ba`](https://github.com

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32882: [WIP][SPARK-35724][SQL] Support traversal pruning in extendedResolutionRules and postHocResolutionRules

AmplabJenkins removed a comment on pull request #32882: URL: https://github.com/apache/spark/pull/32882#issuecomment-862186558 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44376/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

AmplabJenkins removed a comment on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862186550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32919: [SPARK-35378][SQL][FOLLOWUP] Restore the command execution name for DataFrameWriterV2

AmplabJenkins removed a comment on pull request #32919: URL: https://github.com/apache/spark/pull/32919#issuecomment-862186549 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139838/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins removed a comment on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-862186552 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44380/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32924: [SPARK-35771][SQL] Format year-month intervals using type fields

AmplabJenkins removed a comment on pull request #32924: URL: https://github.com/apache/spark/pull/32924#issuecomment-862186548 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44374/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32907: [SPARK-35757][CORE] Add bitwise AND operation and functionality for intersecting bloom filters

AmplabJenkins removed a comment on pull request #32907: URL: https://github.com/apache/spark/pull/32907#issuecomment-862186561 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44375/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

AmplabJenkins removed a comment on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-862186559 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139855/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32693: [SPARK-35556][SQL][TESTS] Avoid log NoSuchMethodError when running multiple Hive version related tests

AmplabJenkins removed a comment on pull request #32693: URL: https://github.com/apache/spark/pull/32693#issuecomment-862186557 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139849/ -

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.log

AmplabJenkins removed a comment on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862186551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32801: [SPARK-12567][SQL] Add aes_encrypt and aes_decrypt builtin functions

AmplabJenkins removed a comment on pull request #32801: URL: https://github.com/apache/spark/pull/32801#issuecomment-862186554 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139836/ -

[GitHub] [spark] AmplabJenkins commented on pull request #32801: [SPARK-12567][SQL] Add aes_encrypt and aes_decrypt builtin functions

AmplabJenkins commented on pull request #32801: URL: https://github.com/apache/spark/pull/32801#issuecomment-862186554 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139836/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32907: [SPARK-35757][CORE] Add bitwise AND operation and functionality for intersecting bloom filters

AmplabJenkins commented on pull request #32907: URL: https://github.com/apache/spark/pull/32907#issuecomment-862186561 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44375/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

AmplabJenkins commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-862186552 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44380/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32882: [WIP][SPARK-35724][SQL] Support traversal pruning in extendedResolutionRules and postHocResolutionRules

AmplabJenkins commented on pull request #32882: URL: https://github.com/apache/spark/pull/32882#issuecomment-862186558 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44376/ -- T

[GitHub] [spark] AmplabJenkins commented on pull request #32919: [SPARK-35378][SQL][FOLLOWUP] Restore the command execution name for DataFrameWriterV2

AmplabJenkins commented on pull request #32919: URL: https://github.com/apache/spark/pull/32919#issuecomment-862186549 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139838/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

AmplabJenkins commented on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862186550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For q

[GitHub] [spark] AmplabJenkins commented on pull request #32693: [SPARK-35556][SQL][TESTS] Avoid log NoSuchMethodError when running multiple Hive version related tests

AmplabJenkins commented on pull request #32693: URL: https://github.com/apache/spark/pull/32693#issuecomment-862186557 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139849/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.logStageExe

AmplabJenkins commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862186551 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For q

[GitHub] [spark] AmplabJenkins commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

AmplabJenkins commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-862186559 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139855/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32924: [SPARK-35771][SQL] Format year-month intervals using type fields

AmplabJenkins commented on pull request #32924: URL: https://github.com/apache/spark/pull/32924#issuecomment-862186548 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44374/ -- T

[GitHub] [spark] SparkQA commented on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

SparkQA commented on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862184715 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44381/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

SparkQA removed a comment on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862145664 **[Test build #139861 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139861/testReport)** for PR 32926 at commit [`004c6b2`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32926: [SPARK-35644][PYTHON][DOCS] Merge contents and remove obsolete pages in Development section

SparkQA commented on pull request #32926: URL: https://github.com/apache/spark/pull/32926#issuecomment-862183143 **[Test build #139861 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139861/testReport)** for PR 32926 at commit [`004c6b2`](https://github.co

[GitHub] [spark] Yikun commented on a change in pull request #32867: [SPARK-35721][PYTHON] Path level discover for python unittests

Yikun commented on a change in pull request #32867: URL: https://github.com/apache/spark/pull/32867#discussion_r652488153 ## File path: dev/sparktestsupport/modules.py ## @@ -16,13 +16,65 @@ # from functools import total_ordering +from importlib import import_module +import

[GitHub] [spark] SparkQA removed a comment on pull request #32919: [SPARK-35378][SQL][FOLLOWUP] Restore the command execution name for DataFrameWriterV2

SparkQA removed a comment on pull request #32919: URL: https://github.com/apache/spark/pull/32919#issuecomment-862041045 **[Test build #139838 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139838/testReport)** for PR 32919 at commit [`297c43d`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32919: [SPARK-35378][SQL][FOLLOWUP] Restore the command execution name for DataFrameWriterV2

SparkQA commented on pull request #32919: URL: https://github.com/apache/spark/pull/32919#issuecomment-862175612 **[Test build #139838 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139838/testReport)** for PR 32919 at commit [`297c43d`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32801: [SPARK-12567][SQL] Add aes_encrypt and aes_decrypt builtin functions

SparkQA removed a comment on pull request #32801: URL: https://github.com/apache/spark/pull/32801#issuecomment-862021191 **[Test build #139836 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139836/testReport)** for PR 32801 at commit [`996f787`](https://gi

[GitHub] [spark] SparkQA commented on pull request #32801: [SPARK-12567][SQL] Add aes_encrypt and aes_decrypt builtin functions

SparkQA commented on pull request #32801: URL: https://github.com/apache/spark/pull/32801#issuecomment-862174910 **[Test build #139836 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139836/testReport)** for PR 32801 at commit [`996f787`](https://github.co

[GitHub] [spark] SparkQA removed a comment on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

SparkQA removed a comment on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-862107995 **[Test build #139855 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139855/testReport)** for PR 32787 at commit [`e0460c5`](https://gi

[GitHub] [spark] cloud-fan commented on a change in pull request #32883: [SPARK-35725][SQL] Support repartition expand partitions in AQE

cloud-fan commented on a change in pull request #32883: URL: https://github.com/apache/spark/pull/32883#discussion_r652481286 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/adaptive/ExpandShufflePartitions.scala ## @@ -0,0 +1,98 @@ +/* + * Licensed to the

[GitHub] [spark] SparkQA commented on pull request #32787: [SPARK-35618][SQL] Resolve star expressions in subqueries using outer query plans

SparkQA commented on pull request #32787: URL: https://github.com/apache/spark/pull/32787#issuecomment-862174258 **[Test build #139855 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139855/testReport)** for PR 32787 at commit [`e0460c5`](https://github.co

[GitHub] [spark] SparkQA commented on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.logStageExecutorM

SparkQA commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862173600 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44378/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #32907: [SPARK-35757][CORE] Add bitwise AND operation and functionality for intersecting bloom filters

SparkQA commented on pull request #32907: URL: https://github.com/apache/spark/pull/32907#issuecomment-862170065 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44375/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #32031: [WIP] Initial work of Remote Shuffle Service on Kubernetes

SparkQA commented on pull request #32031: URL: https://github.com/apache/spark/pull/32031#issuecomment-862167911 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44380/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.logStageExecutorM

SparkQA commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862166549 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44379/ -- This is an automated message from the A

[GitHub] [spark] AngersZhuuuu commented on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.logStageExec

AngersZh commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862166587 retest this please -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

[GitHub] [spark] SparkQA commented on pull request #32924: [SPARK-35771][SQL] Format year-month intervals using type fields

SparkQA commented on pull request #32924: URL: https://github.com/apache/spark/pull/32924#issuecomment-862164583 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44374/ -- This is an automated message from the A

[GitHub] [spark] SparkQA commented on pull request #32882: [WIP][SPARK-35724][SQL] Support traversal pruning in extendedResolutionRules and postHocResolutionRules

SparkQA commented on pull request #32882: URL: https://github.com/apache/spark/pull/32882#issuecomment-862163712 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44376/ -- This is an automated message from the A

[GitHub] [spark] q2w commented on pull request #32902: [SPARK-35754][CORE] Add config to put migrating blocks on disk only

q2w commented on pull request #32902: URL: https://github.com/apache/spark/pull/32902#issuecomment-862163632 @Ngone51 Please have a look. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

[GitHub] [spark] SparkQA removed a comment on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.logStageE

SparkQA removed a comment on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862073263 **[Test build #139850 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139850/testReport)** for PR 31992 at commit [`87a079e`](https://gi

[GitHub] [spark] SparkQA commented on pull request #31992: [SPARK-34898][CORE] We should log SparkListenerExecutorMetricsUpdateEvent of `driver` appropriately when `spark.eventLog.logStageExecutorM

SparkQA commented on pull request #31992: URL: https://github.com/apache/spark/pull/31992#issuecomment-862158957 **[Test build #139850 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139850/testReport)** for PR 31992 at commit [`87a079e`](https://github.co

  1   2   >