phaniarnab opened a new pull request #905: URL: https://github.com/apache/systemml/pull/905
This patch contains a new eviction policy for lineage cache. A min-heap based priority queue over a function of computation time and size is maintained to define the order of evictions.The idea is to evict large matrices, which take little time to recompute. This weighted scheme significantly reduces the number of evictions (including disk spilling). This patch also refactors the LineageCache class to hide the eviction policy related maintenance. ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
