Jungtaek Lim created SPARK-36667:
------------------------------------
Summary: Close resources properly in
StateStoreSuite/RocksDBStateStoreSuite
Key: SPARK-36667
URL: https://issues.apache.org/jira/browse/SPARK-36667
Project: Spark
Issue Type: Bug
Components: Structured Streaming
Affects Versions: 3.2.0
Reporter: Jungtaek Lim
The StateStoreProvider instances created from "newStoreProvider" are NOT
automatically closed.
While this is trivial for HDFSBackedStateStoreProvider, for
RocksDBStateStoreProvider we leak RocksDB instance as well which should have
closed. Most tests in the RocksDBStateStoreSuite initialize
RocksDBStateStoreProvider, meaning that 60+ RocksDB instances are not closed in
the suite.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
