OlgaOvcharenko commented on PR #1857: URL: https://github.com/apache/systemds/pull/1857#issuecomment-1620027636
> I don't fully understand the use case of a ragged array-based frame. Is the metatadata from a `transformencode `the only case where this feature helps? Will splitting a metadata frame into a list of frames (one per column) not serve the purpose? The ragged array is intended to save mem since the metadata frame is mostly nulls. We probably do not want to change the API of `transformencode`; therefore, I do not think a list of frames would be a suitable solution. This change makes no outside API changes and reduces memory allocation and the on-disk size of the metadata that we save after `transformencode`. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
