[
https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Igor Berman updated SPARK-46125:
Attachment: screenshot-1.png
> Memory leak when using createDataFrame with persist
> -
[
https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Josh Rosen updated SPARK-46125:
---
Attachment: image-2023-11-28-12-55-58-461.png
> Memory leak when using createDataFrame with persist
[
https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arman Yazdani updated SPARK-46125:
--
Description:
When I create a dataset from pandas data frame and persisting it (DISK_ONLY),
so
[
https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arman Yazdani updated SPARK-46125:
--
Attachment: CreateDataFrameWithUnpersist.png
ReadParquetWithoutUnpersist.png