[jira] [Commented] (IVY-1197) OutOfMemoryError during ivy:publish
[
https://issues.apache.org/jira/browse/IVY-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=14386098#comment-14386098
]
Antoine Levy-Lambert commented on IVY-1197:
---
I have taken a look at the patch. The only difference I see with ivy's
FileUtil#copy is that FileUtil#copy is calling dest.flush() . Is that what is
causing the Out of Memory Exception ?
Also I would like to have a setup to reproduce the out of memory exception so
that we can be confident about the existence of the problem and of the fix.
OutOfMemoryError during ivy:publish
---
Key: IVY-1197
URL: https://issues.apache.org/jira/browse/IVY-1197
Project: Ivy
Issue Type: Bug
Components: Core
Affects Versions: 2.0
Reporter: Michael Rumpf
Attachments: ASF.LICENSE.NOT.GRANTED--clipboard.txt,
org.apache.ivy.util.url.HttpClientHandler.patch
When publishing a large file, an OutOfMemoryError occurs.
{code}
[ivy:publish] published ppg to
BUILD FAILED
/export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152:
The following error occurred while executing this line:
/export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277:
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2786)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61)
at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168)
at
org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200)
at
org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82)
at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140)
at
org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85)
at
org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130)
at
org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219)
at
org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209)
at
org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282)
at
org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261)
at
org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170)
at org.apache.ivy.Ivy.publish(Ivy.java:600)
at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299)
at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
at org.apache.tools.ant.Task.perform(Task.java:348)
at org.apache.tools.ant.Target.execute(Target.java:390)
at org.apache.tools.ant.Target.performTasks(Target.java:411)
at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
at
org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Total time: 14 minutes 24 seconds
Finished: FAILURE
{code}
The size of the file that is being uploaded is: 687712714, so around
650-700MB.
The publish task is part of a Hudson Ant build where the artefacts are
published to an Artifactory repository at the end.
I have given the Job 1300MB for the max heap size.
It seems as if the whole file is loaded into memory for the upload.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Updated] (IVY-1197) OutOfMemoryError during ivy:publish
[
https://issues.apache.org/jira/browse/IVY-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Antoine Levy-Lambert updated IVY-1197:
--
Summary: OutOfMemoryError during ivy:publish (was: OutOfMemoryError
duriong ivy:publish)
OutOfMemoryError during ivy:publish
---
Key: IVY-1197
URL: https://issues.apache.org/jira/browse/IVY-1197
Project: Ivy
Issue Type: Bug
Components: Core
Affects Versions: 2.0
Reporter: Michael Rumpf
Attachments: ASF.LICENSE.NOT.GRANTED--clipboard.txt,
org.apache.ivy.util.url.HttpClientHandler.patch
When publishing a large file, an OutOfMemoryError occurs.
{code}
[ivy:publish] published ppg to
BUILD FAILED
/export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:152:
The following error occurred while executing this line:
/export/build/hudson/jobs/ppg-rcp/workspace/ppg-rcp/com.daimler.ppg.rcp.builder/build-wrapper.xml:277:
java.lang.OutOfMemoryError: Java heap space
at java.util.Arrays.copyOf(Arrays.java:2786)
at java.io.ByteArrayOutputStream.write(ByteArrayOutputStream.java:94)
at sun.net.www.http.PosterOutputStream.write(PosterOutputStream.java:61)
at org.apache.ivy.util.FileUtil.copy(FileUtil.java:168)
at
org.apache.ivy.util.url.BasicURLHandler.upload(BasicURLHandler.java:200)
at
org.apache.ivy.util.url.URLHandlerDispatcher.upload(URLHandlerDispatcher.java:82)
at org.apache.ivy.util.FileUtil.copy(FileUtil.java:140)
at
org.apache.ivy.plugins.repository.url.URLRepository.put(URLRepository.java:85)
at
org.apache.ivy.plugins.repository.AbstractRepository.put(AbstractRepository.java:130)
at
org.apache.ivy.plugins.resolver.RepositoryResolver.put(RepositoryResolver.java:219)
at
org.apache.ivy.plugins.resolver.RepositoryResolver.publish(RepositoryResolver.java:209)
at
org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:282)
at
org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:261)
at
org.apache.ivy.core.publish.PublishEngine.publish(PublishEngine.java:170)
at org.apache.ivy.Ivy.publish(Ivy.java:600)
at org.apache.ivy.ant.IvyPublish.doExecute(IvyPublish.java:299)
at org.apache.ivy.ant.IvyTask.execute(IvyTask.java:277)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.GeneratedMethodAccessor101.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at
org.apache.tools.ant.dispatch.DispatchUtils.execute(DispatchUtils.java:106)
at org.apache.tools.ant.Task.perform(Task.java:348)
at org.apache.tools.ant.Target.execute(Target.java:390)
at org.apache.tools.ant.Target.performTasks(Target.java:411)
at org.apache.tools.ant.Project.executeSortedTargets(Project.java:1397)
at
org.apache.tools.ant.helper.SingleCheckExecutor.executeTargets(SingleCheckExecutor.java:38)
at org.apache.tools.ant.Project.executeTargets(Project.java:1249)
at org.apache.tools.ant.taskdefs.Ant.execute(Ant.java:442)
at org.apache.tools.ant.taskdefs.CallTarget.execute(CallTarget.java:105)
at org.apache.tools.ant.UnknownElement.execute(UnknownElement.java:291)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
Total time: 14 minutes 24 seconds
Finished: FAILURE
{code}
The size of the file that is being uploaded is: 687712714, so around
650-700MB.
The publish task is part of a Hudson Ant build where the artefacts are
published to an Artifactory repository at the end.
I have given the Job 1300MB for the max heap size.
It seems as if the whole file is loaded into memory for the upload.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
ant git commit: fix classname
Repository: ant Updated Branches: refs/heads/master 71715055c - 28cfaa46c fix classname Project: http://git-wip-us.apache.org/repos/asf/ant/repo Commit: http://git-wip-us.apache.org/repos/asf/ant/commit/28cfaa46 Tree: http://git-wip-us.apache.org/repos/asf/ant/tree/28cfaa46 Diff: http://git-wip-us.apache.org/repos/asf/ant/diff/28cfaa46 Branch: refs/heads/master Commit: 28cfaa46cd40ddf651bd890d235b08ccfc158f10 Parents: 7171505 Author: Stefan Bodewig bode...@apache.org Authored: Sat Mar 28 20:17:24 2015 +0100 Committer: Stefan Bodewig bode...@apache.org Committed: Sat Mar 28 20:17:24 2015 +0100 -- WHATSNEW | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/ant/blob/28cfaa46/WHATSNEW -- diff --git a/WHATSNEW b/WHATSNEW index 187bd2b..b3ffb29 100644 --- a/WHATSNEW +++ b/WHATSNEW @@ -81,7 +81,7 @@ Fixed bugs: when tasks spawned new child threads that accessed the properties. Bugzilla Report 55074 - * TarArchiveEntry's constructor with a File and a String arg didn't + * TarEntry's constructor with a File and a String arg didn't normalize the name. Other changes:
Jenkins build became unstable: Ant-Build-Matrix ยป Open JDK 1.8 (Only on ubuntu nodes),Ubuntu #774
See https://builds.apache.org/job/Ant-Build-Matrix/jdk=Open%20JDK%201.8%20(Only%20on%20ubuntu%20nodes),label=Ubuntu/774/changes
