[jira] [Updated] (SPARK-47941) Propagate ForeachBatch worker initialization errors to users for PySpark

[ https://issues.apache.org/jira/browse/SPARK-47941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Marnadi updated SPARK-47941: - Summary: Propagate ForeachBatch worker initialization errors to users for PySpark (was:

[jira] [Updated] (SPARK-47805) [Arbitrary State Support] State TTL support - MapState

[ https://issues.apache.org/jira/browse/SPARK-47805?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Marnadi updated SPARK-47805: - Description: Add support for expiring state value based on ttl for Map State in

[jira] [Created] (SPARK-47805) [Arbitrary State Support] State TTL support - MapState

Eric Marnadi created SPARK-47805: Summary: [Arbitrary State Support] State TTL support - MapState Key: SPARK-47805 URL: https://issues.apache.org/jira/browse/SPARK-47805 Project: Spark Issue

[jira] [Created] (SPARK-47673) [Arbitrary State Support] State TTL support - ListState

Eric Marnadi created SPARK-47673: Summary: [Arbitrary State Support] State TTL support - ListState Key: SPARK-47673 URL: https://issues.apache.org/jira/browse/SPARK-47673 Project: Spark

[jira] [Created] (SPARK-46961) Adding processorHandle as a Context Variable

Eric Marnadi created SPARK-46961: Summary: Adding processorHandle as a Context Variable Key: SPARK-46961 URL: https://issues.apache.org/jira/browse/SPARK-46961 Project: Spark Issue Type:

[jira] [Created] (SPARK-46960) Testing Multiple Input Streams for TransformWithState operator

Eric Marnadi created SPARK-46960: Summary: Testing Multiple Input Streams for TransformWithState operator Key: SPARK-46960 URL: https://issues.apache.org/jira/browse/SPARK-46960 Project: Spark

[jira] [Created] (SPARK-46911) Add deleteIfExists operator to StatefulProcessorHandle

Eric Marnadi created SPARK-46911: Summary: Add deleteIfExists operator to StatefulProcessorHandle Key: SPARK-46911 URL: https://issues.apache.org/jira/browse/SPARK-46911 Project: Spark Issue

[jira] [Updated] (SPARK-46865) Add Batch Support for TransformWithState Operator

[ https://issues.apache.org/jira/browse/SPARK-46865?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Marnadi updated SPARK-46865: - Description: Add Batch support for the TransformWithState operator to maintain parity between

[jira] [Created] (SPARK-46865) Add Batch Support for TransformWithState Operator

Eric Marnadi created SPARK-46865: Summary: Add Batch Support for TransformWithState Operator Key: SPARK-46865 URL: https://issues.apache.org/jira/browse/SPARK-46865 Project: Spark Issue

[jira] [Created] (SPARK-46864) Onboard Arbtirary State V2 onto New Error Class Framework

Eric Marnadi created SPARK-46864: Summary: Onboard Arbtirary State V2 onto New Error Class Framework Key: SPARK-46864 URL: https://issues.apache.org/jira/browse/SPARK-46864 Project: Spark

[jira] [Created] (SPARK-44480) Add option for thread pool to perform maintenance for RocksDB/HDFS State Store Providers

Eric Marnadi created SPARK-44480: Summary: Add option for thread pool to perform maintenance for RocksDB/HDFS State Store Providers Key: SPARK-44480 URL: https://issues.apache.org/jira/browse/SPARK-44480

[jira] [Updated] (SPARK-44440) Use thread pool to perform maintenance activity for hdfs/rocksdb state store providers

[ https://issues.apache.org/jira/browse/SPARK-0?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Eric Marnadi updated SPARK-0: - Shepherd: Jungtaek Lim > Use thread pool to perform maintenance activity for hdfs/rocksdb state

[jira] [Created] (SPARK-44440) Use thread pool to perform maintenance activity for hdfs/rocksdb state store providers

Eric Marnadi created SPARK-0: Summary: Use thread pool to perform maintenance activity for hdfs/rocksdb state store providers Key: SPARK-0 URL: https://issues.apache.org/jira/browse/SPARK-0

[jira] [Created] (SPARK-43542) Define a new error class and apply for the case where streaming query fails due to concurrent run of streaming query with same checkpoint

Eric Marnadi created SPARK-43542: Summary: Define a new error class and apply for the case where streaming query fails due to concurrent run of streaming query with same checkpoint Key: SPARK-43542 URL: