[
https://issues.apache.org/jira/browse/ATLAS-2926?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656594#comment-16656594
]
Nikhil Bonte commented on ATLAS-2926:
-------------------------------------
[~ashutoshm],
I tried export/import with patch (ATLAS-2926-ZipSink-OOM.patch) with various
scenarios.
Seems that it is working fine.
+1 for the [^ATLAS-2926-ZipSink-OOM.patch]
Thanks!
> ZipSink: Very Large Entities Cause Out Of Memory Exception
> ----------------------------------------------------------
>
> Key: ATLAS-2926
> URL: https://issues.apache.org/jira/browse/ATLAS-2926
> Project: Atlas
> Issue Type: Bug
> Components: atlas-core
> Affects Versions: 0.8.2, trunk, 0.8.3
> Reporter: Ashutosh Mestry
> Assignee: Ashutosh Mestry
> Priority: Major
> Fix For: trunk, 0.8.3
>
> Attachments: ATLAS-2926-ZipSink-OOM.patch
>
>
> *Steps to Duplicate*
> # Setup Atlas with very large data. Atlas one entity should be about 300 MB
> in size.
> # Perform export with parameters that will include the large entity.
> Following error will be encountered:
> {code:java}
> java.lang.OutOfMemoryError: Requested array size exceeds VM limit at
> java.lang.StringCoding$StringEncoder.encode(StringCoding.java:300) at
> java.lang.StringCoding.encode(StringCoding.java:344) at
> java.lang.StringCoding.encode(StringCoding.java:387) at
> java.lang.String.getBytes(String.java:958) at
> org.apache.atlas.repository.impexp.ZipSink.addToZipStream(ZipSink.java:106)
> at org.apache.atlas.repository.impexp.ZipSink.saveToZip(ZipSink.java:95)
> at org.apache.atlas.repository.impexp.ZipSink.add(ZipSink.java:55) at
> org.apache.atlas.repository.impexp.ExportService.addEntity(ExportService.java:467)
> {code}
> *Additional Information*
> During conversion of entity string to bytes, a known JDK error is encountered.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
