[jira] [Commented] (IVY-1197) OutOfMemoryError during ivy:publish
[ https://issues.apache.org/jira/browse/IVY-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620549#comment-17620549 ] Andrew Norman commented on IVY-1197: the file size in my usecase just barely exceeds the 512m size and used to work when it was less than that size so I think that the 512M is a hard limit of the jenkins ivy plugin > OutOfMemoryError during ivy:publish > --- > > Key: IVY-1197 > URL: https://issues.apache.org/jira/browse/IVY-1197 > Project: Ivy > Issue Type: Bug > Components: Core >Affects Versions: 2.0 >Reporter: Michael Rumpf >Priority: Major > Attachments: ASF.LICENSE.NOT.GRANTED--clipboard.txt, ivylarge.zip, > org.apache.ivy.util.url.HttpClientHandler.patch > > > When publishing a large file, an OutOfMemoryError occurs. > {code} > [ivy:publish] published ppg to > > BUILD FAILED > /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152: > The following error occurred while executing this line: > /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277: > java.lang.OutOfMemoryError: Java heap space > at java.util.Arrays.copyOf(Arrays.java:2786) > at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94) > at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61) > at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168) > at > org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200) > at > org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82) > at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140) > at > org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85) > at > org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130) > at > org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219) > at > org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170) > at org.apache.ivy.Ivy.publish(Ivy.java:600) > at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299) > at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277) > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) > at org.apache.tools.ant.Task.perform(Task.java:348) > at org.apache.tools.ant.Target.execute(Target.java:390) > at org.apache.tools.ant.Target.performTasks(Target.java:411) > at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397) > at > org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38) > at org.apache.tools.ant.Project.executeTargets(Project.java:1249) > at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442) > at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105) > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > Total time: 14 minutes 24 seconds > Finished: FAILURE > {code} > The size of the file that is being uploaded is: 687712714, so around > 650-700MB. > The publish task is part of a Hudson Ant build where the artefacts are > published to an Artifactory repository at the end. > I have given the Job 1300MB for the max heap size. > It seems as if the whole file is loaded into memory for the upload. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Comment Edited] (IVY-1197) OutOfMemoryError during ivy:publish
[ https://issues.apache.org/jira/browse/IVY-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620530#comment-17620530 ] Andrew Norman edited comment on IVY-1197 at 10/19/22 7:39 PM: -- any chance this gets fixed soon? My use case is this out of memory failure when running an "sbt publish" of a large zip file >512M on jenkins was (Author: JIRAUSER297261): any chance this gets fixed soon? My use case is this out of memory failing when running an "sbt publish" of a large zip file >512M on jenkins > OutOfMemoryError during ivy:publish > --- > > Key: IVY-1197 > URL: https://issues.apache.org/jira/browse/IVY-1197 > Project: Ivy > Issue Type: Bug > Components: Core >Affects Versions: 2.0 >Reporter: Michael Rumpf >Priority: Major > Attachments: ASF.LICENSE.NOT.GRANTED--clipboard.txt, ivylarge.zip, > org.apache.ivy.util.url.HttpClientHandler.patch > > > When publishing a large file, an OutOfMemoryError occurs. > {code} > [ivy:publish] published ppg to > > BUILD FAILED > /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152: > The following error occurred while executing this line: > /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277: > java.lang.OutOfMemoryError: Java heap space > at java.util.Arrays.copyOf(Arrays.java:2786) > at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94) > at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61) > at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168) > at > org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200) > at > org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82) > at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140) > at > org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85) > at > org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130) > at > org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219) > at > org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170) > at org.apache.ivy.Ivy.publish(Ivy.java:600) > at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299) > at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277) > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) > at org.apache.tools.ant.Task.perform(Task.java:348) > at org.apache.tools.ant.Target.execute(Target.java:390) > at org.apache.tools.ant.Target.performTasks(Target.java:411) > at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397) > at > org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38) > at org.apache.tools.ant.Project.executeTargets(Project.java:1249) > at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442) > at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105) > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > Total time: 14 minutes 24 seconds > Finished: FAILURE > {code} > The size of the file that is being uploaded is: 687712714, so around > 650-700MB. > The publish task is part of a Hudson Ant build where the artefacts are > published to an Artifactory repository at the end. > I have given the Job 1300MB for the max heap size. > It seems as if the whole file is loaded into memory for the upload. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (IVY-1197) OutOfMemoryError during ivy:publish
[ https://issues.apache.org/jira/browse/IVY-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17620530#comment-17620530 ] Andrew Norman commented on IVY-1197: any chance this gets fixed soon? My use case is this out of memory failing when running an "sbt publish" of a large zip file >512M on jenkins > OutOfMemoryError during ivy:publish > --- > > Key: IVY-1197 > URL: https://issues.apache.org/jira/browse/IVY-1197 > Project: Ivy > Issue Type: Bug > Components: Core >Affects Versions: 2.0 >Reporter: Michael Rumpf >Priority: Major > Attachments: ASF.LICENSE.NOT.GRANTED--clipboard.txt, ivylarge.zip, > org.apache.ivy.util.url.HttpClientHandler.patch > > > When publishing a large file, an OutOfMemoryError occurs. > {code} > [ivy:publish] published ppg to > > BUILD FAILED > /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152: > The following error occurred while executing this line: > /export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277: > java.lang.OutOfMemoryError: Java heap space > at java.util.Arrays.copyOf(Arrays.java:2786) > at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94) > at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61) > at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168) > at > org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200) > at > org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82) > at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140) > at > org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85) > at > org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130) > at > org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219) > at > org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261) > at > org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170) > at org.apache.ivy.Ivy.publish(Ivy.java:600) > at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299) > at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277) > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source) > at > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106) > at org.apache.tools.ant.Task.perform(Task.java:348) > at org.apache.tools.ant.Target.execute(Target.java:390) > at org.apache.tools.ant.Target.performTasks(Target.java:411) > at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397) > at > org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38) > at org.apache.tools.ant.Project.executeTargets(Project.java:1249) > at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442) > at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105) > at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291) > at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) > Total time: 14 minutes 24 seconds > Finished: FAILURE > {code} > The size of the file that is being uploaded is: 687712714, so around > 650-700MB. > The publish task is part of a Hudson Ant build where the artefacts are > published to an Artifactory repository at the end. > I have given the Job 1300MB for the max heap size. > It seems as if the whole file is loaded into memory for the upload. -- This message was sent by Atlassian Jira (v8.20.10#820010)