Ashutosh Mestry created ATLAS-3396: -------------------------------------- Summary: ZipSource: Usage of In-memory Maps Limits the Size of Imports Performed Key: ATLAS-3396 URL: https://issues.apache.org/jira/browse/ATLAS-3396 Project: Atlas Issue Type: Bug Reporter: Ashutosh Mestry Assignee: Ashutosh Mestry
*Background* _ZipSource_ is the container for working with Atlas-exported ZIP files. The current implementation fetches the contents of the entire ZIP file in memory. This greatly limits the size of ZIP files that can be imported. *Solution Guidance* New class _ZipSourceWIthBackingDirectory_, this will use a user-specified (or default) temporary directory to preserve the contents of the ZIP file. This will reduce the memory burden and large ZIP files can be imported. Minor refactoring to _ImportService_ will be necessary to support the new variation of _EntityImportStream._ -- This message was sent by Atlassian Jira (v8.3.2#803003)