[
https://issues.apache.org/jira/browse/SYSTEMML-747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Matthias Boehm updated SYSTEMML-747:
------------------------------------
Description: The decision on cp in-memory reblock for text input matrices
is made based on the estimated size in memory. For csv reblock, we support
persistent reads with unknown dimension sizes. In scenarios with unknown
dimensions the memory estimate is always negative, resulting always in
in-memory reblocks which either take very long or even run out of memory.
> Wrong in-memory csv reblock decision w/ unknowns
> ------------------------------------------------
>
> Key: SYSTEMML-747
> URL: https://issues.apache.org/jira/browse/SYSTEMML-747
> Project: SystemML
> Issue Type: Bug
> Components: Runtime
> Affects Versions: SystemML 0.10
> Reporter: Matthias Boehm
>
> The decision on cp in-memory reblock for text input matrices is made based on
> the estimated size in memory. For csv reblock, we support persistent reads
> with unknown dimension sizes. In scenarios with unknown dimensions the memory
> estimate is always negative, resulting always in in-memory reblocks which
> either take very long or even run out of memory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
