[
https://issues.apache.org/jira/browse/SPARK-51587?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Bo Gao updated SPARK-51587:
---------------------------
Description:
Fix an issue where timestamp cannot be used in ListState when multiple state
data is involved.
Right now below error will be thrown
{code:python}
Error updating value state: [UNSUPPORTED_ARROWTYPE] Unsupported arrow type
Timestamp(NANOSECOND, null). SQLSTATE: 0A000
{code}
was:
Fix an issue where timestamp cannot be used in ListState when multiple state
data is involved.
Right now below error will be thrown
```
Error updating value state: [UNSUPPORTED_ARROWTYPE] Unsupported arrow type
Timestamp(NANOSECOND, null). SQLSTATE: 0A000
```
> [PySpark] Fix an issue where timestamp cannot be used in ListState when
> multiple state data is involved
> -------------------------------------------------------------------------------------------------------
>
> Key: SPARK-51587
> URL: https://issues.apache.org/jira/browse/SPARK-51587
> Project: Spark
> Issue Type: Task
> Components: Structured Streaming
> Affects Versions: 4.0.0
> Reporter: Bo Gao
> Priority: Major
>
> Fix an issue where timestamp cannot be used in ListState when multiple state
> data is involved.
> Right now below error will be thrown
> {code:python}
> Error updating value state: [UNSUPPORTED_ARROWTYPE] Unsupported arrow type
> Timestamp(NANOSECOND, null). SQLSTATE: 0A000
> {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
