Hi, Sorry for the confusion.
When I increase the -Xmx and -Xms in the onboading service I still got an out of memory. I'm going to try increase it more and see if that works. /Andrew On 13/11/2019 08:48, Sonsino, Ofir wrote: > Honestly I never tried to onboard such large CSARs. > What do you mean by "it still gave OOM" ? > I'd try to increase memory some more just for the testing if possible. > > Ofir > > -----Original Message----- > From: ROSE, DANIEL V <[email protected]> > Sent: Tuesday, November 12, 2019 8:06 PM > To: [email protected]; FREEMAN, BRIAN D <[email protected]>; > [email protected]; Sonsino, Ofir <[email protected]> > Subject: RE: [onap-discuss] [sdc] Onboarding BIG csars > > Yeah we don’t assume that they are that large in robot today > > Daniel Rose > com.att.ecomp / org.onap > 732-420-7308 > > -----Original Message----- > From: [email protected] <[email protected]> On Behalf Of > FREEMAN, BRIAN D > Sent: Tuesday, November 12, 2019 12:56 PM > To: [email protected]; [email protected]; SONSINO, OFIR > <[email protected]> > Subject: Re: [onap-discuss] [sdc] Onboarding BIG csars > > *** Security Advisory: This Message Originated Outside of AT&T ***. > Reference http://cso.att.com/EmailSecurity/IDSP.html for more information. > > Oh my - robot downloads the csar's during distribution tests so I really hope > we arent trying to make these CSAR's into multi-Gigabyte monsters. > > Not that robot should limit what we do but its a thing that would have to > change if we want to support such large CSARs. > > Seems like the CSAR should have a pointer to a repository not the actual > artifact when they are that large but I am not a feature designer. > > > Brian > > > -----Original Message----- > From: [email protected] <[email protected]> On Behalf Of > Andrew Fenner > Sent: Tuesday, November 12, 2019 12:48 PM > To: [email protected]; SONSINO, OFIR <[email protected]> > Subject: [onap-discuss] [sdc] Onboarding BIG csars > > Hi, > > I want to onboard a big to very big package into SDC. > > My package is formatted OK and then I just increased the size of the "image" > file to see what happened. > > At ~50MB I had to increase the parameter commitlog_segment_size_in_mb in > cassandra. > > Then I tried ~500MB (I'm aiming for 5GB) and I've consistently got an out of > memory error in sdc-onboarding (see below) > > I have increased the size of the container to 8GB and the memory allowed to > the jvm to 6g and it still gave OOM > > The question is > > is there a limit to the size of a package we can onboard so these can be seen > as faults or am I just trying to do something impossible. > > Thanks > > /Andrew > > > Caused by: java.lang.OutOfMemoryError: Java heap space > at java.util.Arrays.copyOf(Arrays.java:3236) > at java.io.ByteArrayOutputStream.grow(ByteArrayOutputStream.java:118) > at > java.io.ByteArrayOutputStream.ensureCapacity(ByteArrayOutputStream.java:93) > at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:153) > at > com.amdocs.zusammen.utils.fileutils.FileUtils.copyLarge(FileUtils.java:208) > at > com.amdocs.zusammen.utils.fileutils.FileUtils.copyLarge(FileUtils.java:196) > at > com.amdocs.zusammen.utils.fileutils.FileUtils.copy(FileUtils.java:190) > at > com.amdocs.zusammen.utils.fileutils.FileUtils.toByteArray(FileUtils.java:166) > at > com.amdocs.zusammen.plugin.ZusammenPluginUtil.convertToElementEntity(ZusammenPluginUtil.java:111) > at > com.amdocs.zusammen.plugin.main.CassandraCollaborationStorePluginImpl.createElement(CassandraCollaborationStorePluginImpl.java:377) > at > com.amdocs.zusammen.adaptor.outbound.impl.CollaborationAdaptorImpl.createElement(CollaborationAdaptorImpl.java:618) > at > com.amdocs.zusammen.core.impl.item.CollaborativeElementCommandFactory.lambda$init$2(CollaborativeElementCommandFactory.java:45) > at > com.amdocs.zusammen.core.impl.item.CollaborativeElementCommandFactory$$Lambda$143/1578021023.apply(Unknown > Source) > at > com.amdocs.zusammen.core.impl.item.ElementCommandAbstarctFactory.executeCommand(ElementCommandAbstarctFactory.java:38) > at > com.amdocs.zusammen.core.impl.item.CollaborativeStoreElementVisitor.visit(CollaborativeStoreElementVisitor.java:42) > at > com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser.traverse(ElementHierarchyTraverser.java:36) > at > com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser.lambda$traverse$0(ElementHierarchyTraverser.java:38) > at > com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser$$Lambda$162/1775979591.accept(Unknown > Source) > at java.util.ArrayList.forEach(ArrayList.java:1257) > at > com.amdocs.zusammen.core.impl.item.ElementHierarchyTraverser.traverse(ElementHierarchyTraverser.java:37) > at > com.amdocs.zusammen.core.impl.item.ElementManagerImpl.save(ElementManagerImpl.java:168) > at > com.amdocs.zusammen.adaptor.inbound.impl.item.ElementAdaptorImpl.save(ElementAdaptorImpl.java:127) > at > org.openecomp.core.zusammen.db.impl.ZusammenConnectorImpl.saveElement(ZusammenConnectorImpl.java:369) > at > org.openecomp.core.zusammen.impl.ZusammenAdaptorImpl.saveElement(ZusammenAdaptorImpl.java:132) > at > org.openecomp.sdc.vendorsoftwareproduct.dao.impl.zusammen.OrchestrationTemplateCandidateDaoZusammenImpl.update(OrchestrationTemplateCandidateDaoZusammenImpl.java:210) > at > org.openecomp.sdc.vendorsoftwareproduct.services.impl.filedatastructuremodule.CandidateServiceImpl.updateCandidateUploadData(CandidateServiceImpl.java:310) > at > org.openecomp.sdc.vendorsoftwareproduct.impl.orchestration.OrchestrationTemplateCSARHandler.updateCandidateData(OrchestrationTemplateCSARHandler.java:84) > at > org.openecomp.sdc.vendorsoftwareproduct.impl.orchestration.BaseOrchestrationTemplateHandler.upload(BaseOrchestrationTemplateHandler.java:76) > at > org.openecomp.sdc.vendorsoftwareproduct.impl.OrchestrationTemplateCandidateManagerImpl.upload(OrchestrationTemplateCandidateManagerImpl.java:71) > at > org.openecomp.sdcrests.vsp.rest.services.OrchestrationTemplateCandidateImpl.processOnboardPackage(OrchestrationTemplateCandidateImpl.java:156) > at > org.openecomp.sdcrests.vsp.rest.services.OrchestrationTemplateCandidateImpl.upload(OrchestrationTemplateCandidateImpl.java:105) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > > > > > > > > > -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#19455): https://lists.onap.org/g/onap-discuss/message/19455 Mute This Topic: https://lists.onap.org/mt/54467928/21656 Group Owner: [email protected] Unsubscribe: https://lists.onap.org/g/onap-discuss/unsub [[email protected]] -=-=-=-=-=-=-=-=-=-=-=-
