[
https://issues.apache.org/jira/browse/SPARK-51922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Jungtaek Lim reassigned SPARK-51922:
------------------------------------
Assignee: Livia Zhu
> Fix UTFDataFormatException thrown from StateStoreChangelogReaderFactory for v1
> ------------------------------------------------------------------------------
>
> Key: SPARK-51922
> URL: https://issues.apache.org/jira/browse/SPARK-51922
> Project: Spark
> Issue Type: Task
> Components: Structured Streaming
> Affects Versions: 4.0.0
> Reporter: Livia Zhu
> Assignee: Livia Zhu
> Priority: Major
> Labels: pull-request-available
>
> As part of StateStoreChangelogReaderFactory, we try to read the file using
> readUTF to get the version string. However, v1 does not write the version
> string to the file as a UTF and instead the first few bytes are an Int. For a
> sufficiently large key, this will throw a UTFDataFormatException. We should
> catch this exception so it doesn't fail the query.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
