[ https://issues.apache.org/jira/browse/SPARK-50017?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Jungtaek Lim reassigned SPARK-50017: ------------------------------------ Assignee: Eric Marnadi > Support Avro encoding for TransformWithState operator - ValueState > ------------------------------------------------------------------ > > Key: SPARK-50017 > URL: https://issues.apache.org/jira/browse/SPARK-50017 > Project: Spark > Issue Type: New Feature > Components: Structured Streaming > Affects Versions: 4.0.0 > Reporter: Eric Marnadi > Assignee: Eric Marnadi > Priority: Major > Labels: pull-request-available > > Currently, we use UnsafeRow to store all state in the StateStores. This > change will add StateStore APIs that support byte array operations on the > StateStore, and to enable Avro encoding to be used for the TransformWithState > operator, only for ValueState. Subsequent state variable types will be > supported in future PRs. -- This message was sent by Atlassian Jira (v8.20.10#820010) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org