[jira] [Commented] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory

2023-04-27 Thread Jungtaek Lim (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717418#comment-17717418 ] Jungtaek Lim commented on SPARK-43244: -- [~kimahriman] Great to hear that [~anishshri-db] 's

[jira] [Commented] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory

2023-04-27 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717407#comment-17717407 ] Anish Shrigondekar commented on SPARK-43244: Yes correct. All the usage will be accounted

[jira] [Commented] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory

2023-04-27 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717394#comment-17717394 ] Adam Binford commented on SPARK-43244: -- Yeah I just saw that PR and was looking through that, I can

[jira] [Commented] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory

2023-04-27 Thread Anish Shrigondekar (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17717393#comment-17717393 ] Anish Shrigondekar commented on SPARK-43244: [~kimahriman] - we did some investigation here

[jira] [Commented] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory

2023-04-23 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715525#comment-17715525 ] Adam Binford commented on SPARK-43244: -- Read through [https://github.com/apache/spark/pull/30344]

[jira] [Commented] (SPARK-43244) RocksDB State Store can accumulate unbounded native memory

2023-04-23 Thread Adam Binford (Jira)
[ https://issues.apache.org/jira/browse/SPARK-43244?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17715495#comment-17715495 ] Adam Binford commented on SPARK-43244: -- [~kabhwan] curious your thoughts on this. Seems somewhat