[jira] [Updated] (SPARK-46125) Memory leak when using createDataFrame with persist

2023-11-28 Thread Arman Yazdani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arman Yazdani updated SPARK-46125: -- Description: When I create a dataset from pandas data frame and persisting it (DISK_ONLY), so

[jira] [Updated] (SPARK-46125) Memory leak when using createDataFrame with persist

2023-11-28 Thread Arman Yazdani (Jira)
[ https://issues.apache.org/jira/browse/SPARK-46125?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arman Yazdani updated SPARK-46125: -- Attachment: CreateDataFrameWithUnpersist.png ReadParquetWithoutUnpersist.png

[jira] [Created] (SPARK-46125) Memory leak when using createDataFrame with persist

2023-11-27 Thread Arman Yazdani (Jira)
Arman Yazdani created SPARK-46125: - Summary: Memory leak when using createDataFrame with persist Key: SPARK-46125 URL: https://issues.apache.org/jira/browse/SPARK-46125 Project: Spark Issue T

[jira] [Created] (SPARK-25882) Add a function to join two datasets using one column with join type parameter

2018-10-30 Thread Arman Yazdani (JIRA)
Arman Yazdani created SPARK-25882: - Summary: Add a function to join two datasets using one column with join type parameter Key: SPARK-25882 URL: https://issues.apache.org/jira/browse/SPARK-25882 Proje

[jira] [Commented] (SPARK-21177) df.saveAsTable slows down linearly, with number of appends

2018-02-25 Thread Arman Yazdani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-21177?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16375995#comment-16375995 ] Arman Yazdani commented on SPARK-21177: --- I configured spark with hive. in my case w

[jira] [Closed] (SPARK-19236) Add createOrReplaceGlobalTempView

2017-06-05 Thread Arman Yazdani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arman Yazdani closed SPARK-19236. - > Add createOrReplaceGlobalTempView > - > > Key: SPAR

[jira] [Updated] (SPARK-19236) Add createOrReplaceGlobalTempView

2017-01-16 Thread Arman Yazdani (JIRA)
[ https://issues.apache.org/jira/browse/SPARK-19236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Arman Yazdani updated SPARK-19236: -- Component/s: (was: SQL) (was: Java API) > Add createOrReplaceGlobalTem

[jira] [Created] (SPARK-19236) Add createOrReplaceGlobalTempView

2017-01-15 Thread Arman Yazdani (JIRA)
Arman Yazdani created SPARK-19236: - Summary: Add createOrReplaceGlobalTempView Key: SPARK-19236 URL: https://issues.apache.org/jira/browse/SPARK-19236 Project: Spark Issue Type: Improvement