[jira] [Resolved] (SPARK-41538) Metadata column should be appended at the end of project list

[ https://issues.apache.org/jira/browse/SPARK-41538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41538. -- Fix Version/s: 3.3.2 3.4.0 Resolution: Fixed Issue resolved by pull request

[jira] [Resolved] (SPARK-41518) Assign a name to the error class _LEGACY_ERROR_TEMP_2422

[ https://issues.apache.org/jira/browse/SPARK-41518?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41518. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39061

[jira] [Resolved] (SPARK-41424) Protobuf serializer for TaskDataWrapper

[ https://issues.apache.org/jira/browse/SPARK-41424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41424. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39048

[jira] [Assigned] (SPARK-41424) Protobuf serializer for TaskDataWrapper

[ https://issues.apache.org/jira/browse/SPARK-41424?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41424: -- Assignee: Gengliang Wang > Protobuf serializer for TaskDataWrapper >

[jira] [Created] (SPARK-41545) Implement json functions

Deng Ziming created SPARK-41545: --- Summary: Implement json functions Key: SPARK-41545 URL: https://issues.apache.org/jira/browse/SPARK-41545 Project: Spark Issue Type: Sub-task

[jira] [Assigned] (SPARK-41387) Add assertion on end offset range for Kafka data source with Trigger.AvailableNow

[ https://issues.apache.org/jira/browse/SPARK-41387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-41387: Assignee: Jungtaek Lim > Add assertion on end offset range for Kafka data source with >

[jira] [Resolved] (SPARK-41387) Add assertion on end offset range for Kafka data source with Trigger.AvailableNow

[ https://issues.apache.org/jira/browse/SPARK-41387?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-41387. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38911

[jira] [Assigned] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41543: - Assignee: Dongjoon Hyun > Add `TOTAL_SHUFFLE_WRITE` executor roll policy >

[jira] [Resolved] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41543. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39088

[jira] [Assigned] (SPARK-41508) Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable

[ https://issues.apache.org/jira/browse/SPARK-41508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41508: Assignee: Yang Jie > Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing

[jira] [Resolved] (SPARK-41508) Assign name to _LEGACY_ERROR_TEMP_1179 and unwrap the existing SparkThrowable

[ https://issues.apache.org/jira/browse/SPARK-41508?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41508. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39063

[jira] [Commented] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1

[ https://issues.apache.org/jira/browse/SPARK-41544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648347#comment-17648347 ] Apache Spark commented on SPARK-41544: -- User 'LuciferYang' has created a pull request for this

[jira] [Commented] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1

[ https://issues.apache.org/jira/browse/SPARK-41544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648346#comment-17648346 ] Apache Spark commented on SPARK-41544: -- User 'LuciferYang' has created a pull request for this

[jira] [Assigned] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1

[ https://issues.apache.org/jira/browse/SPARK-41544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41544: Assignee: (was: Apache Spark) > Upgrade `versions-maven-plugin` to 2.14.1 >

[jira] [Assigned] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1

[ https://issues.apache.org/jira/browse/SPARK-41544?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41544: Assignee: Apache Spark > Upgrade `versions-maven-plugin` to 2.14.1 >

[jira] [Created] (SPARK-41544) Upgrade `versions-maven-plugin` to 2.14.1

Yang Jie created SPARK-41544: Summary: Upgrade `versions-maven-plugin` to 2.14.1 Key: SPARK-41544 URL: https://issues.apache.org/jira/browse/SPARK-41544 Project: Spark Issue Type: Improvement

[jira] [Resolved] (SPARK-41542) Run Coverage report for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41542. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39085

[jira] [Assigned] (SPARK-41542) Run Coverage report for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41542: - Assignee: Hyukjin Kwon > Run Coverage report for Spark Connect >

[jira] [Commented] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648337#comment-17648337 ] Apache Spark commented on SPARK-41543: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41543: Assignee: (was: Apache Spark) > Add `TOTAL_SHUFFLE_WRITE` executor roll policy >

[jira] [Commented] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41543?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648338#comment-17648338 ] Apache Spark commented on SPARK-41543: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41543?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41543: Assignee: Apache Spark > Add `TOTAL_SHUFFLE_WRITE` executor roll policy >

[jira] [Created] (SPARK-41543) Add `TOTAL_SHUFFLE_WRITE` executor roll policy

Dongjoon Hyun created SPARK-41543: - Summary: Add `TOTAL_SHUFFLE_WRITE` executor roll policy Key: SPARK-41543 URL: https://issues.apache.org/jira/browse/SPARK-41543 Project: Spark Issue Type:

[jira] [Commented] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648335#comment-17648335 ] Apache Spark commented on SPARK-41365: -- User 'yabola' has created a pull request for this issue:

[jira] [Commented] (SPARK-41365) Stages UI page fails to load for proxy in some yarn versions

[ https://issues.apache.org/jira/browse/SPARK-41365?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648333#comment-17648333 ] Apache Spark commented on SPARK-41365: -- User 'yabola' has created a pull request for this issue:

[jira] [Commented] (SPARK-41541) Fix wrong child call in SQLShuffleWriteMetricsReporter.decRecordsWritten()

[ https://issues.apache.org/jira/browse/SPARK-41541?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648332#comment-17648332 ] Apache Spark commented on SPARK-41541: -- User 'JoshRosen' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41540) Add `DISK_USED` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41540. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39083

[jira] [Resolved] (SPARK-41319) when-otherwise support

[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng resolved SPARK-41319. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38956

[jira] [Assigned] (SPARK-41319) when-otherwise support

[ https://issues.apache.org/jira/browse/SPARK-41319?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruifeng Zheng reassigned SPARK-41319: - Assignee: Ruifeng Zheng > when-otherwise support > -- > >

[jira] [Assigned] (SPARK-41542) Run Coverage report for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41542: Assignee: (was: Apache Spark) > Run Coverage report for Spark Connect >

[jira] [Commented] (SPARK-41542) Run Coverage report for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41542?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648327#comment-17648327 ] Apache Spark commented on SPARK-41542: -- User 'HyukjinKwon' has created a pull request for this

[jira] [Assigned] (SPARK-41542) Run Coverage report for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41542?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41542: Assignee: Apache Spark > Run Coverage report for Spark Connect >

[jira] [Created] (SPARK-41542) Run Coverage report for Spark Connect

Hyukjin Kwon created SPARK-41542: Summary: Run Coverage report for Spark Connect Key: SPARK-41542 URL: https://issues.apache.org/jira/browse/SPARK-41542 Project: Spark Issue Type: Sub-task

[jira] [Created] (SPARK-41541) Fix wrong child call in SQLShuffleWriteMetricsReporter.decRecordsWritten()

Josh Rosen created SPARK-41541: -- Summary: Fix wrong child call in SQLShuffleWriteMetricsReporter.decRecordsWritten() Key: SPARK-41541 URL: https://issues.apache.org/jira/browse/SPARK-41541 Project:

[jira] [Assigned] (SPARK-41464) Implement DataFrame.to

[ https://issues.apache.org/jira/browse/SPARK-41464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41464: Assignee: (was: Apache Spark) > Implement DataFrame.to > -- > >

[jira] [Assigned] (SPARK-41464) Implement DataFrame.to

[ https://issues.apache.org/jira/browse/SPARK-41464?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41464: Assignee: Apache Spark > Implement DataFrame.to > -- > >

[jira] [Commented] (SPARK-41464) Implement DataFrame.to

[ https://issues.apache.org/jira/browse/SPARK-41464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648324#comment-17648324 ] Apache Spark commented on SPARK-41464: -- User 'beliefer' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41520) Split AND_OR TreePattern to separate AND and OR TreePatterns

[ https://issues.apache.org/jira/browse/SPARK-41520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-41520: -- Assignee: Kelvin Jiang > Split AND_OR TreePattern to separate AND and OR

[jira] [Resolved] (SPARK-41520) Split AND_OR TreePattern to separate AND and OR TreePatterns

[ https://issues.apache.org/jira/browse/SPARK-41520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-41520. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39064

[jira] [Assigned] (SPARK-41540) Add `DISK_USED` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41540: - Assignee: Dongjoon Hyun > Add `DISK_USED` executor roll policy >

[jira] [Updated] (SPARK-41540) Add `DISK_USED` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41540: -- Parent: SPARK-41515 Issue Type: Sub-task (was: Improvement) > Add `DISK_USED`

[jira] [Assigned] (SPARK-41540) Add `DISK_USED` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41540: Assignee: (was: Apache Spark) > Add `DISK_USED` executor roll policy >

[jira] [Assigned] (SPARK-41540) Add `DISK_USED` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41540?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41540: Assignee: Apache Spark > Add `DISK_USED` executor roll policy >

[jira] [Commented] (SPARK-41540) Add `DISK_USED` executor roll policy

[ https://issues.apache.org/jira/browse/SPARK-41540?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648313#comment-17648313 ] Apache Spark commented on SPARK-41540: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Assigned] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes

[ https://issues.apache.org/jira/browse/SPARK-41539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41539: Assignee: (was: Apache Spark) > stats and constraints in LogicalRDD may not be in

[jira] [Assigned] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes

[ https://issues.apache.org/jira/browse/SPARK-41539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41539: Assignee: Apache Spark > stats and constraints in LogicalRDD may not be in sync with

[jira] [Commented] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes

[ https://issues.apache.org/jira/browse/SPARK-41539?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648312#comment-17648312 ] Apache Spark commented on SPARK-41539: -- User 'HeartSaVioR' has created a pull request for this

[jira] [Created] (SPARK-41540) Add `DISK_USED` executor roll policy

Dongjoon Hyun created SPARK-41540: - Summary: Add `DISK_USED` executor roll policy Key: SPARK-41540 URL: https://issues.apache.org/jira/browse/SPARK-41540 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-40687) Support data masking built-in Function 'mask'

[ https://issues.apache.org/jira/browse/SPARK-40687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang reassigned SPARK-40687: -- Assignee: Vinod KC > Support data masking built-in Function 'mask' >

[jira] [Resolved] (SPARK-40687) Support data masking built-in Function 'mask'

[ https://issues.apache.org/jira/browse/SPARK-40687?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gengliang Wang resolved SPARK-40687. Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 38146

[jira] [Created] (SPARK-41539) stats and constraints in LogicalRDD may not be in sync with output attributes

Jungtaek Lim created SPARK-41539: Summary: stats and constraints in LogicalRDD may not be in sync with output attributes Key: SPARK-41539 URL: https://issues.apache.org/jira/browse/SPARK-41539

[jira] [Updated] (SPARK-41094) The saveAsTable method fails to be executed, resulting in data file loss

[ https://issues.apache.org/jira/browse/SPARK-41094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengfei zhao updated SPARK-41094: - Affects Version/s: (was: 3.3.1) > The saveAsTable method fails to be executed, resulting in

[jira] [Updated] (SPARK-41094) The saveAsTable method fails to be executed, resulting in data file loss

[ https://issues.apache.org/jira/browse/SPARK-41094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengfei zhao updated SPARK-41094: - Affects Version/s: 3.3.1 (was: 2.4.4) > The saveAsTable method fails

[jira] [Updated] (SPARK-41531) Debugging and Stability

[ https://issues.apache.org/jira/browse/SPARK-41531?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41531: - Epic Link: SPARK-39375 > Debugging and Stability > --- > >

[jira] [Updated] (SPARK-41094) The saveAsTable method fails to be executed, resulting in data file loss

[ https://issues.apache.org/jira/browse/SPARK-41094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] pengfei zhao updated SPARK-41094: - Affects Version/s: 3.3.1 > The saveAsTable method fails to be executed, resulting in data file

[jira] [Resolved] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work

[ https://issues.apache.org/jira/browse/SPARK-41536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-41536. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39080

[jira] [Commented] (SPARK-41538) Metadata column should be appended at the end of project list

[ https://issues.apache.org/jira/browse/SPARK-41538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648299#comment-17648299 ] Apache Spark commented on SPARK-41538: -- User 'gengliangwang' has created a pull request for this

[jira] [Assigned] (SPARK-41538) Metadata column should be appended at the end of project list

[ https://issues.apache.org/jira/browse/SPARK-41538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41538: Assignee: Gengliang Wang (was: Apache Spark) > Metadata column should be appended at

[jira] [Assigned] (SPARK-41538) Metadata column should be appended at the end of project list

[ https://issues.apache.org/jira/browse/SPARK-41538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41538: Assignee: Apache Spark (was: Gengliang Wang) > Metadata column should be appended at

[jira] [Commented] (SPARK-41538) Metadata column should be appended at the end of project list

[ https://issues.apache.org/jira/browse/SPARK-41538?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648298#comment-17648298 ] Apache Spark commented on SPARK-41538: -- User 'gengliangwang' has created a pull request for this

[jira] [Created] (SPARK-41538) Metadata column should be appended at the end of project list

Gengliang Wang created SPARK-41538: -- Summary: Metadata column should be appended at the end of project list Key: SPARK-41538 URL: https://issues.apache.org/jira/browse/SPARK-41538 Project: Spark

[jira] [Created] (SPARK-41537) Protobuf backwards compatibility testing

Martin Grund created SPARK-41537: Summary: Protobuf backwards compatibility testing Key: SPARK-41537 URL: https://issues.apache.org/jira/browse/SPARK-41537 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41537) Protobuf backwards compatibility testing

[ https://issues.apache.org/jira/browse/SPARK-41537?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Rui Wang reassigned SPARK-41537: Assignee: Rui Wang > Protobuf backwards compatibility testing >

[jira] [Assigned] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work

[ https://issues.apache.org/jira/browse/SPARK-41536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-41536: - Assignee: Dongjoon Hyun > Remove `Dynamic Resource Allocation` from K8s Future Work >

[jira] [Updated] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work

[ https://issues.apache.org/jira/browse/SPARK-41536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-41536: -- Parent: SPARK-41515 Issue Type: Sub-task (was: Documentation) > Remove `Dynamic

[jira] [Assigned] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work

[ https://issues.apache.org/jira/browse/SPARK-41536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41536: Assignee: (was: Apache Spark) > Remove `Dynamic Resource Allocation` from K8s Future

[jira] [Assigned] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work

[ https://issues.apache.org/jira/browse/SPARK-41536?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41536: Assignee: Apache Spark > Remove `Dynamic Resource Allocation` from K8s Future Work >

[jira] [Commented] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work

[ https://issues.apache.org/jira/browse/SPARK-41536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648275#comment-17648275 ] Apache Spark commented on SPARK-41536: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Created] (SPARK-41536) Remove `Dynamic Resource Allocation` from K8s Future Work

Dongjoon Hyun created SPARK-41536: - Summary: Remove `Dynamic Resource Allocation` from K8s Future Work Key: SPARK-41536 URL: https://issues.apache.org/jira/browse/SPARK-41536 Project: Spark

[jira] [Commented] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data

[ https://issues.apache.org/jira/browse/SPARK-41535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648251#comment-17648251 ] Bruce Robbins commented on SPARK-41535: --- I will take a stab at fixing this shortly. >

[jira] [Created] (SPARK-41535) InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data

Bruce Robbins created SPARK-41535: - Summary: InterpretedUnsafeProjection and InterpretedMutableProjection can corrupt unsafe buffer when used with calendar interval data Key: SPARK-41535 URL:

[jira] [Resolved] (SPARK-41524) Expose SQL confs and extraOptions separately in o.a.s.sql.execution.streaming.state.RocksDBConf

[ https://issues.apache.org/jira/browse/SPARK-41524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim resolved SPARK-41524. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39069

[jira] [Assigned] (SPARK-41524) Expose SQL confs and extraOptions separately in o.a.s.sql.execution.streaming.state.RocksDBConf

[ https://issues.apache.org/jira/browse/SPARK-41524?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim reassigned SPARK-41524: Assignee: Huanli Wang > Expose SQL confs and extraOptions separately in >

[jira] [Resolved] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235

[ https://issues.apache.org/jira/browse/SPARK-41465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk resolved SPARK-41465. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39003

[jira] [Assigned] (SPARK-41465) Assign a name to the error class _LEGACY_ERROR_TEMP_1235

[ https://issues.apache.org/jira/browse/SPARK-41465?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Max Gekk reassigned SPARK-41465: Assignee: BingKun Pan > Assign a name to the error class _LEGACY_ERROR_TEMP_1235 >

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648188#comment-17648188 ] Apache Spark commented on SPARK-41410: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-41410) Support PVC-oriented executor pod allocation

[ https://issues.apache.org/jira/browse/SPARK-41410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648187#comment-17648187 ] Apache Spark commented on SPARK-41410: -- User 'dongjoon-hyun' has created a pull request for this

[jira] [Commented] (SPARK-41534) Setup initial client module for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41534?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648145#comment-17648145 ] Apache Spark commented on SPARK-41534: -- User 'vicennial' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41534) Setup initial client module for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41534: Assignee: Apache Spark > Setup initial client module for Spark Connect >

[jira] [Assigned] (SPARK-41534) Setup initial client module for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41534?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41534: Assignee: (was: Apache Spark) > Setup initial client module for Spark Connect >

[jira] [Created] (SPARK-41534) Setup initial client module for Spark Connect

Venkata Sai Akhil Gudesa created SPARK-41534: Summary: Setup initial client module for Spark Connect Key: SPARK-41534 URL: https://issues.apache.org/jira/browse/SPARK-41534 Project: Spark

[jira] [Created] (SPARK-41533) GRPC Errors on the client should be cleaned up

Martin Grund created SPARK-41533: Summary: GRPC Errors on the client should be cleaned up Key: SPARK-41533 URL: https://issues.apache.org/jira/browse/SPARK-41533 Project: Spark Issue Type:

[jira] [Created] (SPARK-41532) DF operations that involve multiple data frames should fail if sessions don't match

Martin Grund created SPARK-41532: Summary: DF operations that involve multiple data frames should fail if sessions don't match Key: SPARK-41532 URL: https://issues.apache.org/jira/browse/SPARK-41532

[jira] [Created] (SPARK-41531) Debugging and Stability

Martin Grund created SPARK-41531: Summary: Debugging and Stability Key: SPARK-41531 URL: https://issues.apache.org/jira/browse/SPARK-41531 Project: Spark Issue Type: Umbrella

[jira] [Commented] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

[ https://issues.apache.org/jira/browse/SPARK-41350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648078#comment-17648078 ] Apache Spark commented on SPARK-41350: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-41350) allow simple name access of using join hidden columns after subquery alias

[ https://issues.apache.org/jira/browse/SPARK-41350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648076#comment-17648076 ] Apache Spark commented on SPARK-41350: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Resolved] (SPARK-41511) LongToUnsafeRowMap support ignoresDuplicatedKey

[ https://issues.apache.org/jira/browse/SPARK-41511?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wenchen Fan resolved SPARK-41511. - Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39051

[jira] [Updated] (SPARK-41498) Union does not propagate Metadata output

[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fredrik Klauß updated SPARK-41498: -- Description: Currently, the Union operator does not propagate any metadata output. This

[jira] [Updated] (SPARK-41498) Union does not propagate Metadata output

[ https://issues.apache.org/jira/browse/SPARK-41498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fredrik Klauß updated SPARK-41498: -- Description: Currently, the Union operator does not propagate any metadata output. This

[jira] [Commented] (SPARK-41530) extend MedianHeap to support percentile

[ https://issues.apache.org/jira/browse/SPARK-41530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648024#comment-17648024 ] Apache Spark commented on SPARK-41530: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Commented] (SPARK-41530) extend MedianHeap to support percentile

[ https://issues.apache.org/jira/browse/SPARK-41530?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17648025#comment-17648025 ] Apache Spark commented on SPARK-41530: -- User 'cloud-fan' has created a pull request for this issue:

[jira] [Assigned] (SPARK-41530) extend MedianHeap to support percentile

[ https://issues.apache.org/jira/browse/SPARK-41530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41530: Assignee: (was: Apache Spark) > extend MedianHeap to support percentile >

[jira] [Assigned] (SPARK-41530) extend MedianHeap to support percentile

[ https://issues.apache.org/jira/browse/SPARK-41530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-41530: Assignee: Apache Spark > extend MedianHeap to support percentile >

[jira] [Created] (SPARK-41530) extend MedianHeap to support percentile

Wenchen Fan created SPARK-41530: --- Summary: extend MedianHeap to support percentile Key: SPARK-41530 URL: https://issues.apache.org/jira/browse/SPARK-41530 Project: Spark Issue Type:

[jira] [Assigned] (SPARK-41526) Implement `Column.isin`

[ https://issues.apache.org/jira/browse/SPARK-41526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon reassigned SPARK-41526: Assignee: Ruifeng Zheng > Implement `Column.isin` > --- > >

[jira] [Resolved] (SPARK-41526) Implement `Column.isin`

[ https://issues.apache.org/jira/browse/SPARK-41526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon resolved SPARK-41526. -- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 39074

[jira] [Updated] (SPARK-40452) Developer documentation

[ https://issues.apache.org/jira/browse/SPARK-40452?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40452: - Shepherd: Hyukjin Kwon (was: hyukjin.kwon) > Developer documentation > ---

[jira] [Updated] (SPARK-41286) Build, package and infrastructure for Spark Connect

[ https://issues.apache.org/jira/browse/SPARK-41286?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41286: - Shepherd: Hyukjin Kwon (was: hyukjin.kwon) > Build, package and infrastructure for Spark

[jira] [Updated] (SPARK-41288) Server-specific improvement, error handling and API

[ https://issues.apache.org/jira/browse/SPARK-41288?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-41288: - Shepherd: Hyukjin Kwon (was: hyukjin.kwon) > Server-specific improvement, error handling and

[jira] [Updated] (SPARK-40451) Type annotations for Spark Connect Python client

[ https://issues.apache.org/jira/browse/SPARK-40451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hyukjin Kwon updated SPARK-40451: - Shepherd: Hyukjin Kwon (was: hyukjin.kwon) > Type annotations for Spark Connect Python client

  1   2   >