[
https://issues.apache.org/jira/browse/SPARK-26006?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16698121#comment-16698121
]
idan Levi commented on SPARK-26006:
-----------------------------------
1. Wouldn't the added count increase the execution time? did you do a benchmark?
2. I am currently using it with spark 2.3 as maven dependency:
org.apache.spark
spark-mllib_2.11
How can i get this fix?
| |
> mllib Prefixspan
> ----------------
>
> Key: SPARK-26006
> URL: https://issues.apache.org/jira/browse/SPARK-26006
> Project: Spark
> Issue Type: Improvement
> Components: MLlib
> Affects Versions: 2.3.0
> Environment: Unit test running on windows
> Reporter: idan Levi
> Assignee: shahid
> Priority: Minor
> Fix For: 3.0.0
>
>
> Mllib's Prefixspan - run method - cached RDD stays in cache.
> val dataInternalRepr = toDatabaseInternalRepr(data, itemToInt)
> .persist(StorageLevel.MEMORY_AND_DISK)
> After run is comlpeted , rdd remain in cache.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
