Dylan Wong created SPARK-52989:
----------------------------------
Summary: Add explicit close API to RocksDB State store iterator
and fix current usage
Key: SPARK-52989
URL: https://issues.apache.org/jira/browse/SPARK-52989
Project: Spark
Issue Type: Task
Components: Structured Streaming
Affects Versions: 4.1.0
Reporter: Dylan Wong
The iterator returned from RocksDB method does not expose close method
(requires change of method signature - current it's {{{}Iterator{}}}) hence
either caller has to ensure the iterator to be fully consumed or wait until end
of task when task completion listener closes it. We need to add ability for the
caller to close the iterator when the iterator is no longer needed.
Also fix current usage of the iterator, to explicitly close when it is no
longer needed.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
