[GitHub] [spark] cloud-fan commented on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
cloud-fan commented on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857707545 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] SparkQA commented on pull request #32837: [SPARK-35692][K8S] Use AtomicInteger for executor id generating

2021-06-09 Thread GitBox
SparkQA commented on pull request #32837: URL: https://github.com/apache/spark/pull/32837#issuecomment-857704985 **[Test build #139576 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139576/testReport)** for PR 32837 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857704008 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139560/

[GitHub] [spark] AmplabJenkins commented on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857704008 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139560/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857496811 **[Test build #139560 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139560/testReport)** for PR 32786 at commit

[GitHub] [spark] SparkQA commented on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857702147 **[Test build #139560 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139560/testReport)** for PR 32786 at commit

[GitHub] [spark] SparkQA commented on pull request #32610: [SPARK-35460][K8S] verify the content of`spark.kubernetes.executor.podNamePrefix` ahead before post it to k8s api-server

2021-06-09 Thread GitBox
SparkQA commented on pull request #32610: URL: https://github.com/apache/spark/pull/32610#issuecomment-857701929 **[Test build #139575 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139575/testReport)** for PR 32610 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857699406 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44099/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857699602 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139561/

[GitHub] [spark] AmplabJenkins commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857699602 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139561/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857699406 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44099/ --

[GitHub] [spark] SparkQA commented on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
SparkQA commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857699377 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44099/ --

[GitHub] [spark] tgravescs commented on pull request #32385: [WIP][SPARK-35275][CORE] Add checksum for shuffle blocks and diagnose corruption

2021-06-09 Thread GitBox
tgravescs commented on pull request #32385: URL: https://github.com/apache/spark/pull/32385#issuecomment-857698644 thanks @Ngone51, I'm very busy this week, so will take a look early next week. -- This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [spark] SparkQA removed a comment on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857496840 **[Test build #139561 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139561/testReport)** for PR 32764 at commit

[GitHub] [spark] SparkQA commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857697792 **[Test build #139561 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139561/testReport)** for PR 32764 at commit

[GitHub] [spark] MaxGekk commented on pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
MaxGekk commented on pull request #32839: URL: https://github.com/apache/spark/pull/32839#issuecomment-857696850 @dgd-contributor Regarding PR's description. Could you fix indentations in code examples according to the code style. -- This is an automated message from the Apache Git

[GitHub] [spark] SparkQA commented on pull request #32843: [SPARK-35697][SQL][TESTS] Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread GitBox
SparkQA commented on pull request #32843: URL: https://github.com/apache/spark/pull/32843#issuecomment-857694822 **[Test build #139574 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139574/testReport)** for PR 32843 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857694760 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139559/

[GitHub] [spark] AmplabJenkins commented on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857694760 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139559/ -- This

[GitHub] [spark] MaxGekk commented on a change in pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
MaxGekk commented on a change in pull request #32839: URL: https://github.com/apache/spark/pull/32839#discussion_r648300427 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -385,9 +385,16 @@ object DateTimeUtils { *

[GitHub] [spark] SparkQA removed a comment on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857496598 **[Test build #139559 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139559/testReport)** for PR 32836 at commit

[GitHub] [spark] SparkQA commented on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
SparkQA commented on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857692880 **[Test build #139559 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139559/testReport)** for PR 32836 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857692349 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857692350 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857692355 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins removed a comment on pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #31847: URL: https://github.com/apache/spark/pull/31847#issuecomment-857692364 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44093/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857692354 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

[GitHub] [spark] AmplabJenkins commented on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857692580 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44094/ --

[GitHub] [spark] AmplabJenkins commented on pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #31847: URL: https://github.com/apache/spark/pull/31847#issuecomment-857692364 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44093/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857692350 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] AmplabJenkins commented on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857692361 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] cloud-fan commented on a change in pull request #32842: [MINOR][SQL] No need to normolize name for built-in functions

2021-06-09 Thread GitBox
cloud-fan commented on a change in pull request #32842: URL: https://github.com/apache/spark/pull/32842#discussion_r648298604 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala ## @@ -198,12 +198,23 @@ trait

[GitHub] [spark] AmplabJenkins commented on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857692349 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44085/ --

[GitHub] [spark] AmplabJenkins commented on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857692355 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For

[GitHub] [spark] cloud-fan commented on a change in pull request #32842: [MINOR][SQL] No need to normolize name for built-in functions

2021-06-09 Thread GitBox
cloud-fan commented on a change in pull request #32842: URL: https://github.com/apache/spark/pull/32842#discussion_r648297988 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala ## @@ -198,12 +198,23 @@ trait

[GitHub] [spark] MaxGekk commented on a change in pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
MaxGekk commented on a change in pull request #32839: URL: https://github.com/apache/spark/pull/32839#discussion_r648298080 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -385,9 +385,16 @@ object DateTimeUtils { *

[GitHub] [spark] MaxGekk commented on a change in pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
MaxGekk commented on a change in pull request #32839: URL: https://github.com/apache/spark/pull/32839#discussion_r648296129 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -385,9 +385,16 @@ object DateTimeUtils { *

[GitHub] [spark] cloud-fan closed pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
cloud-fan closed pull request #32764: URL: https://github.com/apache/spark/pull/32764 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] cloud-fan commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
cloud-fan commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857689782 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] gengliangwang commented on pull request #32843: [SPARK-35697][SQL][TESTS] Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread GitBox
gengliangwang commented on pull request #32843: URL: https://github.com/apache/spark/pull/32843#issuecomment-857689272 This one is to follow https://github.com/apache/spark/pull/31782 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [spark] gengliangwang opened a new pull request #32843: [SPARK-35697][SQL][TESTS] Test TimestampWithoutTZType as ordered and atomic type

2021-06-09 Thread GitBox
gengliangwang opened a new pull request #32843: URL: https://github.com/apache/spark/pull/32843 ### What changes were proposed in this pull request? Add `TimestampWithoutTZType` to `DataTypeTestUtils.ordered`/`atomicTypes`, and implement values generation of those types in

[GitHub] [spark] SparkQA commented on pull request #31847: [SPARK-34755][SQL] Support the utils for transform number format

2021-06-09 Thread GitBox
SparkQA commented on pull request #31847: URL: https://github.com/apache/spark/pull/31847#issuecomment-857688420 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44093/ --

[GitHub] [spark] SparkQA commented on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857685385 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44092/ -- This is an automated message from the

[GitHub] [spark] cloud-fan closed pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
cloud-fan closed pull request #32781: URL: https://github.com/apache/spark/pull/32781 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service,

[GitHub] [spark] cloud-fan commented on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
cloud-fan commented on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857685133 thanks, merging to master! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] dgd-contributor commented on a change in pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
dgd-contributor commented on a change in pull request #32839: URL: https://github.com/apache/spark/pull/32839#discussion_r648289867 ## File path: sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/util/DateTimeUtilsSuite.scala ## @@ -820,4 +820,9 @@ class

[GitHub] [spark] dgd-contributor commented on a change in pull request #32839: [SPARK-35679][SQL] instantToMicros overflow

2021-06-09 Thread GitBox
dgd-contributor commented on a change in pull request #32839: URL: https://github.com/apache/spark/pull/32839#discussion_r648290046 ## File path: sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/util/DateTimeUtils.scala ## @@ -385,9 +385,15 @@ object DateTimeUtils {

[GitHub] [spark] SparkQA removed a comment on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857502656 **[Test build #139563 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139563/testReport)** for PR 32781 at commit

[GitHub] [spark] SparkQA commented on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
SparkQA commented on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857682849 **[Test build #139563 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139563/testReport)** for PR 32781 at commit

[GitHub] [spark] SparkQA commented on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857679613 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44087/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
SparkQA commented on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857677696 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44090/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
SparkQA commented on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857674819 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44085/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857673089 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44084/ -- This is an automated message from the

[GitHub] [spark] SparkQA commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857670157 Kubernetes integration test status success URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44088/ -- This is an automated message from the

[GitHub] [spark] Ngone51 commented on a change in pull request #32007: [SPARK-33350][SHUFFLE] Add support to DiskBlockManager to create merge directory and to get the local shuffle merged data

2021-06-09 Thread GitBox
Ngone51 commented on a change in pull request #32007: URL: https://github.com/apache/spark/pull/32007#discussion_r648261185 ## File path: core/src/main/scala/org/apache/spark/storage/DiskBlockManager.scala ## @@ -153,6 +185,82 @@ private[spark] class DiskBlockManager(conf:

[GitHub] [spark] wangyum commented on a change in pull request #32410: [SPARK-35286][SQL] Replace SessionState.start with SessionState.setCurrentSessionState

2021-06-09 Thread GitBox
wangyum commented on a change in pull request #32410: URL: https://github.com/apache/spark/pull/32410#discussion_r648265495 ## File path: sql/hive/src/main/scala/org/apache/spark/sql/hive/client/HiveClientImpl.scala ## @@ -190,7 +190,7 @@ private[hive] class HiveClientImpl(

[GitHub] [spark] SparkQA commented on pull request #32842: [MINOR][SQL] No need to normolize name for built-in functions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32842: URL: https://github.com/apache/spark/pull/32842#issuecomment-857662782 **[Test build #139573 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139573/testReport)** for PR 32842 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857661606 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139572/

[GitHub] [spark] SparkQA removed a comment on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857657092 **[Test build #139572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139572/testReport)** for PR 32832 at commit

[GitHub] [spark] SparkQA commented on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
SparkQA commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857661540 **[Test build #139572 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139572/testReport)** for PR 32832 at commit

[GitHub] [spark] AmplabJenkins commented on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857661606 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139572/ -- This

[GitHub] [spark] SparkQA commented on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857661202 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44092/ -- This is an automated message from the Apache

[GitHub] [spark] linhongliu-db opened a new pull request #32842: [MINOR][SQL] No need to normolize name for built-in functions

2021-06-09 Thread GitBox
linhongliu-db opened a new pull request #32842: URL: https://github.com/apache/spark/pull/32842 ### What changes were proposed in this pull request? Add an `internalRegisterFunction` for the built-in function registry. So that we can skip the unnecessary function normalization.

[GitHub] [spark] linhongliu-db commented on pull request #32842: [MINOR][SQL] No need to normolize name for built-in functions

2021-06-09 Thread GitBox
linhongliu-db commented on pull request #32842: URL: https://github.com/apache/spark/pull/32842#issuecomment-857660647 cc @cloud-fan -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857660022 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139554/

[GitHub] [spark] AmplabJenkins commented on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857660022 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139554/ -- This

[GitHub] [spark] SparkQA removed a comment on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857456902 **[Test build #139554 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139554/testReport)** for PR 32781 at commit

[GitHub] [spark] SparkQA commented on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
SparkQA commented on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857658224 **[Test build #139554 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139554/testReport)** for PR 32781 at commit

[GitHub] [spark] SparkQA commented on pull request #32832: [WIP][SPARK-35686][SQL] Not allow using auto-generated alias when creating view

2021-06-09 Thread GitBox
SparkQA commented on pull request #32832: URL: https://github.com/apache/spark/pull/32832#issuecomment-857657092 **[Test build #139572 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139572/testReport)** for PR 32832 at commit

[GitHub] [spark] SparkQA commented on pull request #32786: [SPARK-35296][SQL] Allow Dataset.observe to work even if CollectMetricsExec in a task handles multiple partitions.

2021-06-09 Thread GitBox
SparkQA commented on pull request #32786: URL: https://github.com/apache/spark/pull/32786#issuecomment-857654656 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44087/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32781: [SPARK-35650][SQL] Enhance `RepartitionByExpression` to make it coalesce partitions efficiently by AQE

2021-06-09 Thread GitBox
SparkQA commented on pull request #32781: URL: https://github.com/apache/spark/pull/32781#issuecomment-857654044 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44090/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32303: URL: https://github.com/apache/spark/pull/32303#issuecomment-857652499 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44089/

[GitHub] [spark] AmplabJenkins commented on pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32303: URL: https://github.com/apache/spark/pull/32303#issuecomment-857652499 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder-K8s/44089/ --

[GitHub] [spark] SparkQA commented on pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

2021-06-09 Thread GitBox
SparkQA commented on pull request #32303: URL: https://github.com/apache/spark/pull/32303#issuecomment-857652469 Kubernetes integration test unable to build dist. exiting with code: 1 URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44089/ --

[GitHub] [spark] SparkQA commented on pull request #32769: [SPARK-35630][SQL] ExpandExec should not introduce unnecessary exchanges

2021-06-09 Thread GitBox
SparkQA commented on pull request #32769: URL: https://github.com/apache/spark/pull/32769#issuecomment-857651784 **[Test build #139571 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139571/testReport)** for PR 32769 at commit

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857650251 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139567/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32610: [SPARK-35460][K8S] verify the content of`spark.kubernetes.executor.podNamePrefix` ahead before post it to k8s api-server

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32610: URL: https://github.com/apache/spark/pull/32610#issuecomment-857650248 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139570/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32303: URL: https://github.com/apache/spark/pull/32303#issuecomment-857650250 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139562/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32815: [SPARK-35675][SQL] EnsureRequirements remove shuffle should respect PartitioningCollection

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32815: URL: https://github.com/apache/spark/pull/32815#issuecomment-857650246 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139552/

[GitHub] [spark] AmplabJenkins removed a comment on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
AmplabJenkins removed a comment on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857650249 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139549/

[GitHub] [spark] AmplabJenkins commented on pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32303: URL: https://github.com/apache/spark/pull/32303#issuecomment-857650250 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139562/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32610: [SPARK-35460][K8S] verify the content of`spark.kubernetes.executor.podNamePrefix` ahead before post it to k8s api-server

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32610: URL: https://github.com/apache/spark/pull/32610#issuecomment-857650248 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139570/ -- This

[GitHub] [spark] SparkQA commented on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
SparkQA commented on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857650126 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44085/ -- This is an automated message from the Apache

[GitHub] [spark] AmplabJenkins commented on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857650249 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139549/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857650251 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139567/ -- This

[GitHub] [spark] AmplabJenkins commented on pull request #32815: [SPARK-35675][SQL] EnsureRequirements remove shuffle should respect PartitioningCollection

2021-06-09 Thread GitBox
AmplabJenkins commented on pull request #32815: URL: https://github.com/apache/spark/pull/32815#issuecomment-857650246 Refer to this link for build results (access rights to CI server needed): https://amplab.cs.berkeley.edu/jenkins//job/SparkPullRequestBuilder/139552/ -- This

[GitHub] [spark] SparkQA commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857649446 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44084/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857546297 **[Test build #139567 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139567/testReport)** for PR 32838 at commit

[GitHub] [spark] SparkQA commented on pull request #32838: [SPARK-35694][INFRA] Increase the default JVM stack size of SBT/Maven

2021-06-09 Thread GitBox
SparkQA commented on pull request #32838: URL: https://github.com/apache/spark/pull/32838#issuecomment-857648389 **[Test build #139567 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139567/testReport)** for PR 32838 at commit

[GitHub] [spark] SparkQA commented on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
SparkQA commented on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857647808 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44086/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA commented on pull request #32764: [SPARK-35390][SQL] Handle type coercion when resolving V2 functions

2021-06-09 Thread GitBox
SparkQA commented on pull request #32764: URL: https://github.com/apache/spark/pull/32764#issuecomment-857647499 Kubernetes integration test starting URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/44088/ -- This is an automated message from the Apache

[GitHub] [spark] SparkQA removed a comment on pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32303: URL: https://github.com/apache/spark/pull/32303#issuecomment-857497315 **[Test build #139562 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139562/testReport)** for PR 32303 at commit

[GitHub] [spark] SparkQA commented on pull request #32303: [SPARK-34382][SQL] Support LATERAL subqueries

2021-06-09 Thread GitBox
SparkQA commented on pull request #32303: URL: https://github.com/apache/spark/pull/32303#issuecomment-857646477 **[Test build #139562 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139562/testReport)** for PR 32303 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32815: [SPARK-35675][SQL] EnsureRequirements remove shuffle should respect PartitioningCollection

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32815: URL: https://github.com/apache/spark/pull/32815#issuecomment-857456869 **[Test build #139552 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139552/testReport)** for PR 32815 at commit

[GitHub] [spark] SparkQA commented on pull request #32815: [SPARK-35675][SQL] EnsureRequirements remove shuffle should respect PartitioningCollection

2021-06-09 Thread GitBox
SparkQA commented on pull request #32815: URL: https://github.com/apache/spark/pull/32815#issuecomment-857643756 **[Test build #139552 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139552/testReport)** for PR 32815 at commit

[GitHub] [spark] SparkQA removed a comment on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857456693 **[Test build #139549 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139549/testReport)** for PR 32836 at commit

[GitHub] [spark] SparkQA commented on pull request #32836: [SPARK-35693][SS][TEST] Add plan check for stream-stream join unit test

2021-06-09 Thread GitBox
SparkQA commented on pull request #32836: URL: https://github.com/apache/spark/pull/32836#issuecomment-857640630 **[Test build #139549 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139549/testReport)** for PR 32836 at commit

[GitHub] [spark] tanelk commented on a change in pull request #32769: [SPARK-35630][SQL] ExpandExec should not introduce unnecessary exchanges

2021-06-09 Thread GitBox
tanelk commented on a change in pull request #32769: URL: https://github.com/apache/spark/pull/32769#discussion_r648238282 ## File path: sql/core/src/main/scala/org/apache/spark/sql/execution/ExpandExec.scala ## @@ -42,9 +42,33 @@ case class ExpandExec( override lazy val

[GitHub] [spark] SparkQA removed a comment on pull request #32610: [SPARK-35460][K8S] verify the content of`spark.kubernetes.executor.podNamePrefix` ahead before post it to k8s api-server

2021-06-09 Thread GitBox
SparkQA removed a comment on pull request #32610: URL: https://github.com/apache/spark/pull/32610#issuecomment-857615346 **[Test build #139570 has started](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139570/testReport)** for PR 32610 at commit

[GitHub] [spark] SparkQA commented on pull request #32610: [SPARK-35460][K8S] verify the content of`spark.kubernetes.executor.podNamePrefix` ahead before post it to k8s api-server

2021-06-09 Thread GitBox
SparkQA commented on pull request #32610: URL: https://github.com/apache/spark/pull/32610#issuecomment-857627138 **[Test build #139570 has finished](https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder/139570/testReport)** for PR 32610 at commit

<    2   3   4   5   6   7   8   9   10   11   >