[jira] [Commented] (SPARK-38102) Supporting custom commitProtocolClass when using saveAsNewAPIHadoopDataset

[ https://issues.apache.org/jira/browse/SPARK-38102?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570397#comment-17570397 ] Apache Spark commented on SPARK-38102: -- User 'ocworld' has created a pull request f

[jira] [Resolved] (SPARK-39846) Enable spark.dynamicAllocation.shuffleTracking.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-39846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39846. --- Fix Version/s: 3.4.0 Resolution: Fixed Issue resolved by pull request 37257 [https://

[jira] [Assigned] (SPARK-39846) Enable spark.dynamicAllocation.shuffleTracking.enabled by default

[ https://issues.apache.org/jira/browse/SPARK-39846?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun reassigned SPARK-39846: - Assignee: Dongjoon Hyun > Enable spark.dynamicAllocation.shuffleTracking.enabled by def

[jira] [Resolved] (SPARK-39847) Race condition related to interruption of task threads while they are in RocksDBLoader.loadLibrary()

[ https://issues.apache.org/jira/browse/SPARK-39847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun resolved SPARK-39847. --- Fix Version/s: 3.3.1 3.2.3 3.4.0 Resolution: Fix

[jira] [Resolved] (SPARK-39812) Simplify code to construct AggregateExpression with toAggregateExpression

[ https://issues.apache.org/jira/browse/SPARK-39812?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Huaxin Gao resolved SPARK-39812. Fix Version/s: 3.4.0 Assignee: jiaan.geng Resolution: Fixed > Simplify code to con

[jira] [Resolved] (SPARK-39843) Prohibit UDF expressions in DEFAULT values for now

[ https://issues.apache.org/jira/browse/SPARK-39843?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel resolved SPARK-39843. Resolution: Fixed > Prohibit UDF expressions in DEFAULT values for now > -

[jira] [Commented] (SPARK-39843) Prohibit UDF expressions in DEFAULT values for now

[ https://issues.apache.org/jira/browse/SPARK-39843?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570373#comment-17570373 ] Daniel commented on SPARK-39843: Update on this: it turns out that UDF definitions are n

[jira] [Commented] (SPARK-39848) Upgrade Kafka to 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-39848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570365#comment-17570365 ] Apache Spark commented on SPARK-39848: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-39848) Upgrade Kafka to 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-39848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39848: Assignee: (was: Apache Spark) > Upgrade Kafka to 3.2.1 > -- > >

[jira] [Commented] (SPARK-39848) Upgrade Kafka to 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-39848?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570364#comment-17570364 ] Apache Spark commented on SPARK-39848: -- User 'dongjoon-hyun' has created a pull req

[jira] [Assigned] (SPARK-39848) Upgrade Kafka to 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-39848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Apache Spark reassigned SPARK-39848: Assignee: Apache Spark > Upgrade Kafka to 3.2.1 > -- > >

[jira] [Updated] (SPARK-39848) Upgrade Kafka to 3.2.1

[ https://issues.apache.org/jira/browse/SPARK-39848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Dongjoon Hyun updated SPARK-39848: -- Component/s: Build > Upgrade Kafka to 3.2.1 > -- > > Key:

[jira] [Created] (SPARK-39848) Upgrade Kafka to 3.2.1

Dongjoon Hyun created SPARK-39848: - Summary: Upgrade Kafka to 3.2.1 Key: SPARK-39848 URL: https://issues.apache.org/jira/browse/SPARK-39848 Project: Spark Issue Type: Bug Components

[jira] [Commented] (SPARK-39847) Race condition related to interruption of task threads while they are in RocksDBLoader.loadLibrary()

[ https://issues.apache.org/jira/browse/SPARK-39847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570345#comment-17570345 ] Apache Spark commented on SPARK-39847: -- User 'JoshRosen' has created a pull request

[jira] [Commented] (SPARK-39847) Race condition related to interruption of task threads while they are in RocksDBLoader.loadLibrary()

[ https://issues.apache.org/jira/browse/SPARK-39847?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17570343#comment-17570343 ] Apache Spark commented on SPARK-39847: -- User 'JoshRosen' has created a pull request

[jira] [Updated] (SPARK-39847) Race condition related to interruption of task threads while they are in RocksDBLoader.loadLibrary()

[ https://issues.apache.org/jira/browse/SPARK-39847?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jungtaek Lim updated SPARK-39847: - Description: One of our workloads experienced a rare failure in `RocksDBLoader` {code:java} Caus