[jira] [Commented] (SPARK-40852) Implement `DataFrame.summary`

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644199#comment-17644199 ] Apache Spark commented on SPARK-40852: -- User 'beliefer' has created a pull request for this issue:

[jira] [Commented] (SPARK-40852) Implement `DataFrame.summary`

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-40852?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644200#comment-17644200 ] Apache Spark commented on SPARK-40852: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41381) Implement count_distinct and sum_distinct functions

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41381: - Assignee: Ruifeng Zheng > Implement count_distinct and sum_distinct functions >

[jira] [Resolved] (SPARK-41381) Implement count_distinct and sum_distinct functions

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41381?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41381. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38914

[jira] [Commented] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644185#comment-17644185 ] Apache Spark commented on SPARK-41437: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41437: Assignee: (was: Apache Spark) > Do not optimize the input query twice for v1 write

[jira] [Assigned] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41437?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41437: Assignee: Apache Spark > Do not optimize the input query twice for v1 write fallback >

[jira] [Created] (SPARK-41437) Do not optimize the input query twice for v1 write fallback

2022-12-06 Thread Wenchen Fan (Jira)
Wenchen Fan created SPARK-41437: --- Summary: Do not optimize the input query twice for v1 write fallback Key: SPARK-41437 URL: https://issues.apache.org/jira/browse/SPARK-41437 Project: Spark

[jira] [Updated] (SPARK-41283) Feature parity: Functions API in Spark Connect

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41283?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41283: -- Summary: Feature parity: Functions API in Spark Connect (was: Feature parity: functions API

[jira] [Commented] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644175#comment-17644175 ] Zhe Dong commented on SPARK-41386: -- Hi. [~podongfeng]  That was my mistake. I removed it. sorry for

[jira] [Assigned] (SPARK-41436) Implement `collection` functions: A~C

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41436: Assignee: (was: Apache Spark) > Implement `collection` functions: A~C >

[jira] [Assigned] (SPARK-41436) Implement `collection` functions: A~C

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41436?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41436: Assignee: Apache Spark > Implement `collection` functions: A~C >

[jira] [Commented] (SPARK-41436) Implement `collection` functions: A~C

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644174#comment-17644174 ] Apache Spark commented on SPARK-41436: -- User 'zhengruifeng' has created a pull request for this

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Epic Link: (was: SPARK-39375) > There are some small files when using rebalance(column) >

[jira] [Created] (SPARK-41436) Implement `collection` functions: A~C

2022-12-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41436: - Summary: Implement `collection` functions: A~C Key: SPARK-41436 URL: https://issues.apache.org/jira/browse/SPARK-41436 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644173#comment-17644173 ] Apache Spark commented on SPARK-41435: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41435: Assignee: (was: Apache Spark) > Make `curdate()` throw `WRONG_NUM_ARGS ` instead of

[jira] [Assigned] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41435?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41435: Assignee: Apache Spark > Make `curdate()` throw `WRONG_NUM_ARGS ` instead of

[jira] [Commented] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41435?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644172#comment-17644172 ] Apache Spark commented on SPARK-41435: -- User 'LuciferYang' has created a pull request for this

[jira] [Created] (SPARK-41435) Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41435: Summary: Make `curdate()` throw `WRONG_NUM_ARGS ` instead of `_LEGACY_ERROR_TEMP_1043 ` when args is not null Key: SPARK-41435 URL: https://issues.apache.org/jira/browse/SPARK-41435

[jira] [Commented] (SPARK-41298) Getting Count on data frame is giving the performance issue

2022-12-06 Thread Ramakrishna (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644164#comment-17644164 ] Ramakrishna commented on SPARK-41298: - Can some one please check behavior and update me asap. >

[jira] [Assigned] (SPARK-41415) SASL Request Retries

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41415: Assignee: Apache Spark > SASL Request Retries > > >

[jira] [Assigned] (SPARK-41415) SASL Request Retries

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41415: Assignee: (was: Apache Spark) > SASL Request Retries > > >

[jira] [Commented] (SPARK-41415) SASL Request Retries

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644152#comment-17644152 ] Apache Spark commented on SPARK-41415: -- User 'akpatnam25' has created a pull request for this

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Affects Version/s: 3.3.1 (was: 3.4.0) > There are some small files when

[jira] [Created] (SPARK-41434) Support LambdaFunction expresssion

2022-12-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41434: - Summary: Support LambdaFunction expresssion Key: SPARK-41434 URL: https://issues.apache.org/jira/browse/SPARK-41434 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41433) Make Max Arrow BatchSize configurable

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41433: Assignee: (was: Apache Spark) > Make Max Arrow BatchSize configurable >

[jira] [Commented] (SPARK-41433) Make Max Arrow BatchSize configurable

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644145#comment-17644145 ] Apache Spark commented on SPARK-41433: -- User 'zhengruifeng' has created a pull request for this

[jira] [Commented] (SPARK-41433) Make Max Arrow BatchSize configurable

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644146#comment-17644146 ] Apache Spark commented on SPARK-41433: -- User 'zhengruifeng' has created a pull request for this

[jira] [Assigned] (SPARK-41433) Make Max Arrow BatchSize configurable

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41433?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41433: Assignee: Apache Spark > Make Max Arrow BatchSize configurable >

[jira] [Created] (SPARK-41433) Make Max Arrow BatchSize configurable

2022-12-06 Thread Ruifeng Zheng (Jira)
Ruifeng Zheng created SPARK-41433: - Summary: Make Max Arrow BatchSize configurable Key: SPARK-41433 URL: https://issues.apache.org/jira/browse/SPARK-41433 Project: Spark Issue Type: Sub-task

[jira] [Commented] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644144#comment-17644144 ] Ruifeng Zheng commented on SPARK-41386: --- [~dongz] I think this ticket is irrelevant to

[jira] [Commented] (SPARK-41053) Better Spark UI scalability and Driver stability for large applications

2022-12-06 Thread Gengliang Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644143#comment-17644143 ] Gengliang Wang commented on SPARK-41053: [~beliefer]  [~yangjie01] [~panbingkun] If you are

[jira] [Created] (SPARK-41432) Protobuf serializer for SparkPlanGraphWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41432: -- Summary: Protobuf serializer for SparkPlanGraphWrapper Key: SPARK-41432 URL: https://issues.apache.org/jira/browse/SPARK-41432 Project: Spark Issue

[jira] [Created] (SPARK-41431) Protobuf serializer for SQLExecutionUIData

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41431: -- Summary: Protobuf serializer for SQLExecutionUIData Key: SPARK-41431 URL: https://issues.apache.org/jira/browse/SPARK-41431 Project: Spark Issue Type:

[jira] [Created] (SPARK-41430) Protobuf serializer for ProcessSummaryWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41430: -- Summary: Protobuf serializer for ProcessSummaryWrapper Key: SPARK-41430 URL: https://issues.apache.org/jira/browse/SPARK-41430 Project: Spark Issue

[jira] [Created] (SPARK-41429) Protobuf serializer for RDDOperationGraphWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41429: -- Summary: Protobuf serializer for RDDOperationGraphWrapper Key: SPARK-41429 URL: https://issues.apache.org/jira/browse/SPARK-41429 Project: Spark Issue

[jira] [Commented] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644141#comment-17644141 ] Zhe Dong commented on SPARK-41386: --   {noformat}   if (mapStats.isEmpty ||      

[jira] [Created] (SPARK-41427) Protobuf serializer for ExecutorStageSummaryWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41427: -- Summary: Protobuf serializer for ExecutorStageSummaryWrapper Key: SPARK-41427 URL: https://issues.apache.org/jira/browse/SPARK-41427 Project: Spark

[jira] [Created] (SPARK-41428) Protobuf serializer for SpeculationStageSummaryWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41428: -- Summary: Protobuf serializer for SpeculationStageSummaryWrapper Key: SPARK-41428 URL: https://issues.apache.org/jira/browse/SPARK-41428 Project: Spark

[jira] [Created] (SPARK-41426) Protobuf serializer for ResourceProfileWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41426: -- Summary: Protobuf serializer for ResourceProfileWrapper Key: SPARK-41426 URL: https://issues.apache.org/jira/browse/SPARK-41426 Project: Spark Issue

[jira] [Created] (SPARK-41422) Protobuf serializer for ExecutorSummaryWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41422: -- Summary: Protobuf serializer for ExecutorSummaryWrapper Key: SPARK-41422 URL: https://issues.apache.org/jira/browse/SPARK-41422 Project: Spark Issue

[jira] [Created] (SPARK-41425) Protobuf serializer for RDDStorageInfoWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41425: -- Summary: Protobuf serializer for RDDStorageInfoWrapper Key: SPARK-41425 URL: https://issues.apache.org/jira/browse/SPARK-41425 Project: Spark Issue

[jira] [Created] (SPARK-41424) Protobuf serializer for TaskDataWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41424: -- Summary: Protobuf serializer for TaskDataWrapper Key: SPARK-41424 URL: https://issues.apache.org/jira/browse/SPARK-41424 Project: Spark Issue Type:

[jira] [Created] (SPARK-41423) Protobuf serializer for StageDataWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41423: -- Summary: Protobuf serializer for StageDataWrapper Key: SPARK-41423 URL: https://issues.apache.org/jira/browse/SPARK-41423 Project: Spark Issue Type:

[jira] [Created] (SPARK-41420) Protobuf serializer for ApplicationInfoWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41420: -- Summary: Protobuf serializer for ApplicationInfoWrapper Key: SPARK-41420 URL: https://issues.apache.org/jira/browse/SPARK-41420 Project: Spark Issue

[jira] [Created] (SPARK-41421) Protobuf serializer for ApplicationEnvironmentInfoWrapper

2022-12-06 Thread Gengliang Wang (Jira)
Gengliang Wang created SPARK-41421: -- Summary: Protobuf serializer for ApplicationEnvironmentInfoWrapper Key: SPARK-41421 URL: https://issues.apache.org/jira/browse/SPARK-41421 Project: Spark

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Description: *Problem ( REBALANCE(column)* {*}){*}:  SparkSession config: {noformat}

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644135#comment-17644135 ] Apache Spark commented on SPARK-41369: -- User 'amaliujia' has created a pull request for this issue:

[jira] [Commented] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644131#comment-17644131 ] Zhe Dong commented on SPARK-41386: -- we may change this part to avoid files that are smaller than 

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Description: *Problem ( REBALANCE(column)* {*}){*}:  SparkSession config: {noformat}

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Description: *Problem ( REBALANCE(column)* {*}){*}:  SparkSession config: {noformat}

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Description: *Problem ( REBALANCE(column)* {*}){*}:  SparkSession config:   {noformat}

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Description: *Problem ( REBALANCE(column)* {*}){*}:  SparkSession config: {noformat}

[jira] [Updated] (SPARK-41386) There are some small files when using rebalance(column)

2022-12-06 Thread Zhe Dong (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Zhe Dong updated SPARK-41386: - Description: {*}Problem (/*+ REBALANCE(bot_mid) */){*}:  sparksession config: {noformat}

[jira] [Assigned] (SPARK-41397) Implement part of string/binary functions

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41397: - Assignee: Xinrong Meng > Implement part of string/binary functions >

[jira] [Resolved] (SPARK-41397) Implement part of string/binary functions

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41397. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38921

[jira] [Updated] (SPARK-41391) The output column name of `groupBy.agg(count_distinct)` is incorrect

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41391?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng updated SPARK-41391: -- Description: scala> val df = spark.range(1, 10).withColumn("value", lit(1)) df:

[jira] [Resolved] (SPARK-41382) implement `product` function

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41382. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38915

[jira] [Assigned] (SPARK-41382) implement `product` function

2022-12-06 Thread Ruifeng Zheng (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41382?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41382: - Assignee: Ruifeng Zheng > implement `product` function >

[jira] [Assigned] (SPARK-41419) [K8S] Decrement PVC_COUNTER when the pod deletion happens

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41419: Assignee: Apache Spark > [K8S] Decrement PVC_COUNTER when the pod deletion happens >

[jira] [Assigned] (SPARK-41419) [K8S] Decrement PVC_COUNTER when the pod deletion happens

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41419: Assignee: (was: Apache Spark) > [K8S] Decrement PVC_COUNTER when the pod deletion

[jira] [Commented] (SPARK-41419) [K8S] Decrement PVC_COUNTER when the pod deletion happens

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644104#comment-17644104 ] Apache Spark commented on SPARK-41419: -- User 'tedyu' has created a pull request for this issue:

[jira] [Created] (SPARK-41419) [K8S] Decrement PVC_COUNTER when the pod deletion happens

2022-12-06 Thread Ted Yu (Jira)
Ted Yu created SPARK-41419: -- Summary: [K8S] Decrement PVC_COUNTER when the pod deletion happens Key: SPARK-41419 URL: https://issues.apache.org/jira/browse/SPARK-41419 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41418: Assignee: Apache Spark > Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 >

[jira] [Assigned] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41418: Assignee: (was: Apache Spark) > Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 >

[jira] [Commented] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644102#comment-17644102 ] Apache Spark commented on SPARK-41418: -- User 'panbingkun' has created a pull request for this

[jira] [Created] (SPARK-41418) Upgrade scala-maven-plugin from 4.7.2 to 4.8.0

2022-12-06 Thread BingKun Pan (Jira)
BingKun Pan created SPARK-41418: --- Summary: Upgrade scala-maven-plugin from 4.7.2 to 4.8.0 Key: SPARK-41418 URL: https://issues.apache.org/jira/browse/SPARK-41418 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41417?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644101#comment-17644101 ] Apache Spark commented on SPARK-41417: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41417: Assignee: Apache Spark > Assign a name to the error class _LEGACY_ERROR_TEMP_0019 >

[jira] [Assigned] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41417?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41417: Assignee: (was: Apache Spark) > Assign a name to the error class

[jira] [Resolved] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41369. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38953

[jira] [Assigned] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Hyukjin Kwon (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41369: Assignee: Hyukjin Kwon > Refactor connect directory structure >

[jira] [Created] (SPARK-41417) Assign a name to the error class _LEGACY_ERROR_TEMP_0019

2022-12-06 Thread Yang Jie (Jira)
Yang Jie created SPARK-41417: Summary: Assign a name to the error class _LEGACY_ERROR_TEMP_0019 Key: SPARK-41417 URL: https://issues.apache.org/jira/browse/SPARK-41417 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41369) Refactor connect directory structure

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644094#comment-17644094 ] Apache Spark commented on SPARK-41369: -- User 'hvanhovell' has created a pull request for this

[jira] [Commented] (SPARK-39865) Show proper error messages on the overflow errors of table insert

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-39865?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644092#comment-17644092 ] Apache Spark commented on SPARK-39865: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41416: Assignee: (was: Apache Spark) > Rewrite self join in in predicate to aggregate >

[jira] [Assigned] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41416?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41416: Assignee: Apache Spark > Rewrite self join in in predicate to aggregate >

[jira] [Commented] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41416?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644091#comment-17644091 ] Apache Spark commented on SPARK-41416: -- User 'wankunde' has created a pull request for this issue:

[jira] [Created] (SPARK-41416) Rewrite self join in in predicate to aggregate

2022-12-06 Thread Wan Kun (Jira)
Wan Kun created SPARK-41416: --- Summary: Rewrite self join in in predicate to aggregate Key: SPARK-41416 URL: https://issues.apache.org/jira/browse/SPARK-41416 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-41366) DF.groupby.agg() API should be compatible

2022-12-06 Thread Jira
[ https://issues.apache.org/jira/browse/SPARK-41366?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Herman van Hövell resolved SPARK-41366. --- Fix Version/s: 3.4.0 Resolution: Fixed > DF.groupby.agg() API should be

[jira] [Assigned] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41413: Assignee: (was: Apache Spark) > Storage-Partitioned Join should avoid shuffle when

[jira] [Commented] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644088#comment-17644088 ] Apache Spark commented on SPARK-41413: -- User 'sunchao' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41413) Storage-Partitioned Join should avoid shuffle when partition keys mismatch, but join expressions are compatible

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41413: Assignee: Apache Spark > Storage-Partitioned Join should avoid shuffle when partition

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

2022-12-06 Thread Zhen Wang (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644087#comment-17644087 ] Zhen Wang commented on SPARK-41344: --- [~planga82]  Thanks for your reply, I have submitted a PR

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644083#comment-17644083 ] Apache Spark commented on SPARK-41410: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644082#comment-17644082 ] Apache Spark commented on SPARK-41410: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Updated] (SPARK-41415) SASL Request Retries

2022-12-06 Thread Aravind Patnam (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41415?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Aravind Patnam updated SPARK-41415: --- Summary: SASL Request Retries (was: SASL Request Retry) > SASL Request Retries >

[jira] [Created] (SPARK-41415) SASL Request Retry

2022-12-06 Thread Aravind Patnam (Jira)
Aravind Patnam created SPARK-41415: -- Summary: SASL Request Retry Key: SPARK-41415 URL: https://issues.apache.org/jira/browse/SPARK-41415 Project: Spark Issue Type: Task

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644079#comment-17644079 ] Apache Spark commented on SPARK-41410: -- User 'tedyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644080#comment-17644080 ] Apache Spark commented on SPARK-41410: -- User 'tedyu' has created a pull request for this issue:

[jira] [Commented] (SPARK-41233) High-order function: array_prepend

2022-12-06 Thread Navin Viswanath (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41233?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644070#comment-17644070 ] Navin Viswanath commented on SPARK-41233: - PR : [https://github.com/apache/spark/pull/38947]  

[jira] [Assigned] (SPARK-41231) Built-in SQL Function Improvement

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41231: Assignee: Apache Spark > Built-in SQL Function Improvement >

[jira] [Commented] (SPARK-41231) Built-in SQL Function Improvement

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644066#comment-17644066 ] Apache Spark commented on SPARK-41231: -- User 'navinvishy' has created a pull request for this

[jira] [Assigned] (SPARK-41231) Built-in SQL Function Improvement

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41231?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41231: Assignee: (was: Apache Spark) > Built-in SQL Function Improvement >

[jira] [Resolved] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-41411. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38945

[jira] [Assigned] (SPARK-41411) Multi-Stateful Operator watermark support bug fix

2022-12-06 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-41411: Assignee: Wei Liu > Multi-Stateful Operator watermark support bug fix >

[jira] [Commented] (SPARK-41344) Reading V2 datasource masks underlying error

2022-12-06 Thread Pablo Langa Blanco (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41344?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644061#comment-17644061 ] Pablo Langa Blanco commented on SPARK-41344: In this case the provider has been detected as

[jira] [Commented] (SPARK-41414) Implement date/timestamp functions

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41414?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17644049#comment-17644049 ] Apache Spark commented on SPARK-41414: -- User 'xinrong-meng' has created a pull request for this

[jira] [Assigned] (SPARK-41414) Implement date/timestamp functions

2022-12-06 Thread Apache Spark (Jira)
[ https://issues.apache.org/jira/browse/SPARK-41414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41414: Assignee: (was: Apache Spark) > Implement date/timestamp functions >

  1   2   >