phaniarnab opened a new pull request, #1853: URL: https://github.com/apache/systemds/pull/1853
This commits adds a small but useful extension to lineage-base reuse. We now also reuse the lineage traces corresponding to the reused intermediates by replacing the live lineage traces with the cached ones. This change increases the use of same lineage items in many lineage DAGs, which in turn reduces probing cost and memory overhead. This extension is disabled for parfor and deduplicated lineage traces. Integrating with those require more thoughts. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
