[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051876#comment-17051876 ] Geoff Soutter commented on MASSEMBLY-774: - OK, love being wrong, so with sample size of 1, an upgrade to 3.1 and my CI build worked. So it _maybe_ fixed. YMMV. > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust >Priority: Major > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17051849#comment-17051849 ] Geoff Soutter commented on MASSEMBLY-774: - Confirmed present in 2.6. Trying 3.1 now. Suspect not fixed, since this ticket is open and no action for years. > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust >Priority: Major > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17000254#comment-17000254 ] Elliotte Rusty Harold commented on MASSEMBLY-774: - Is this fixed at head? > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust >Assignee: Kristian Rosenvold >Priority: Major > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15397856#comment-15397856 ] Claude Warren commented on MASSEMBLY-774: - I am attempting a build under Jenkins/Linux we set the number of files to 4096 We are using the latest assembly plugin (2.6) as well as the latest plexus-archive plugin (3.4) and yet I still get a too many open files error. We eventually upped the number of file to 20K and got past it. We are packaging up a dojo implementation so there are lots of files, but I would still expect it to work. [ERROR] Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.6:single (make-assembly) on project dashboard-dojo: Failed to create assembly: Error creating assembly archive sources: Problem creating zip: /opt/jenkins/workspace/NOI-Solutions/noi-dashboard/dashboard-dojo/target/dojo/dojo/release/dojo/cldr/nls/fil/number.js.uncompressed.js (Too many open files) -> [Help 1] org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-assembly-plugin:2.6:single (make-assembly) on project dashboard-dojo: Failed to create assembly: Error creating assembly archive sources: Problem creating zip: /opt/jenkins/workspace/NOI-Solutions/noi-dashboard/dashboard-dojo/target/dojo/dojo/release/dojo/cldr/nls/fil/number.js.uncompressed.js (Too many open files) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:212) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:116) at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:80) at org.apache.maven.lifecycle.internal.builder.singlethreaded.SingleThreadedBuilder.build(SingleThreadedBuilder.java:51) at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:128) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307) at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193) at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106) at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863) at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288) at org.apache.maven.cli.MavenCli.main(MavenCli.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:95) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:56) at java.lang.reflect.Method.invoke(Method.java:620) at org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:289) at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:229) at org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:415) at org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:356) Caused by: org.apache.maven.plugin.MojoExecutionException: Failed to create assembly: Error creating assembly archive sources: Problem creating zip: /opt/jenkins/workspace/NOI-Solutions/noi-dashboard/dashboard-dojo/target/dojo/dojo/release/dojo/cldr/nls/fil/number.js.uncompressed.js (Too many open files) at org.apache.maven.plugin.assembly.mojos.AbstractAssemblyMojo.execute(AbstractAssemblyMojo.java:541) at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:134) at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:207) ... 20 more Caused by: org.apache.maven.plugin.assembly.archive.ArchiveCreationException: Error creating assembly archive sources: Problem creating zip: /opt/jenkins/workspace/NOI-Solutions/noi-dashboard/dashboard-dojo/target/dojo/dojo/release/dojo/cldr/nls/fil/number.js.uncompressed.js (Too many open files) at org.apache.maven.plugin.assembly.archive.DefaultAssemblyArchiver.createArchive(DefaultAssemblyArchiver.java:185) at org.apache.maven.plugin.assembly.mojos.AbstractAssemblyMojo.execute(AbstractAssemblyMojo.java:484) ... 22 more Caused by: org.codehaus.plexus.archiver.ArchiverException: Problem creating zip: /opt/jenkins/workspace/NOI-Solutions/noi-dashboard/dashboard-dojo/target/dojo/dojo/release/dojo/cldr/nls/fil/number.js.uncompressed.js (Too many open files) at org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:933) at org.apache.maven.plugin.assembly.archive.archiver.AssemblyProxyArchiver.createArchive(AssemblyProxyArchiver.jav
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243075#comment-15243075 ] Karl Heinz Marbaise commented on MASSEMBLY-774: --- The only versions which exists can be found in Maven Central: http://search.maven.org/#search%7Cgav%7C1%7Cg%3A%22org.apache.maven.plugins%22%20AND%20a%3A%22maven-assembly-plugin%22 There does not exist a version 2.10.3 of maven-assembly-plugin... > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust >Assignee: Kristian Rosenvold > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15243062#comment-15243062 ] Charles Gould commented on MASSEMBLY-774: - Forgive my dullness, but where can I find version 2.10.3 (or later) of the Maven Assembly Plugin? According to Maven Central and the [plugin page|https://maven.apache.org/plugins/maven-assembly-plugin] the latest version is 2.6. > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust >Assignee: Kristian Rosenvold > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593499#comment-14593499 ] Dan Armbrust commented on MASSEMBLY-774: Yes - it looks good on 2.10.3. Thanks! > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593305#comment-14593305 ] Kristian Rosenvold commented on MASSEMBLY-774: -- It would appear I fixed this on the 2.x branch *âfter* releasing 3.0.1. If you switch to version 2.10.3 it should work fine. Once you confirm this I'll release 3.0.2 > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MASSEMBLY-774) too many open files
[
https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593122#comment-14593122
]
Dan Armbrust commented on MASSEMBLY-774:
Looks consistent:
{code}
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project
snomed: Failed to create assembly: Error creating assembly archive all.cradle:
Problem creating zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.1990.sememe.map
(Too many open files) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project
snomed: Failed to create assembly: Error creating assembly archive all.cradle:
Problem creating zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.1990.sememe.map
(Too many open files)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.MojoExecutionException: Failed to create
assembly: Error creating assembly archive all.cradle: Problem creating zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.1990.sememe.map
(Too many open files)
at
org.apache.maven.plugin.assembly.mojos.AbstractAssemblyMojo.execute(AbstractAssemblyMojo.java:541)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
Caused by: org.apache.maven.plugin.assembly.archive.ArchiveCreationException:
Error creating assembly archive all.cradle: Problem creating zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.1990.sememe.map
(Too many open files)
at
org.apache.maven.plugin.assembly.archive.DefaultAssemblyArchiver.createArchive(DefaultAssemblyArchiver.java:185)
at
org.apache.maven.plugin.assembly.mojos.AbstractAssemblyMojo.execute(AbstractAssemblyMojo.java:484)
... 21 more
Caused by: org.codehaus.plexus.archiver.ArchiverException: Problem creating
zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.1990.sememe.map
(Too many open files)
at
org.codehaus.plexus.archiver.AbstractArchiver.createArchive(AbstractArchiver.java:933)
at
org.apache.maven.plugin.assembly.archive.archiver.AssemblyProxyArchiver.createArchive(AssemblyProxyArchiver.java:437)
at
org.apache.maven.plugin.assembly.archive.DefaultAssemblyArchiver.createArchive(DefaultAssemblyArchiver.java:181)
... 22 more
Caused by: java.io.FileNotFoundException:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.1990.sememe.map
(Too man
[jira] [Commented] (MASSEMBLY-774) too many open files
[
https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593113#comment-14593113
]
Dan Armbrust commented on MASSEMBLY-774:
Sure - here are some details:
{code}
[DEBUG] All known ContainerDescriptorHandler components: [plexus,
metaInf-services, metaInf-spring, file-aggregator]
[DEBUG] No ArtifactResolver with hint project-cache-aware
[DEBUG] FileSet[object-chronicles/] dir perms: -1 file perms: -1
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles
[DEBUG] Adding file-set in:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles
to archive location: snomed-1.10-SNAPSHOT-all.data/object-chronicles/
[DEBUG] FileSet[META-INF/] dir perms: -1 file perms: -1
[DEBUG] The archive base directory is 'null'
[DEBUG] NOT reformatting any files in
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/META-INF
[DEBUG] Adding file-set in:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/META-INF
to archive location: snomed-1.10-SNAPSHOT-all.data/META-INF/
[INFO] Building zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.cradle.zip
--snip--
[ERROR] Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project
snomed: Failed to create assembly: Error creating assembly archive all.cradle:
Problem creating zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.2168.sememe.map
(Too many open files) -> [Help 1]
org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal
org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project
snomed: Failed to create assembly: Error creating assembly archive all.cradle:
Problem creating zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.2168.sememe.map
(Too many open files)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:217)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
at
org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
at
org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:320)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
at org.apache.maven.cli.MavenCli.execute(MavenCli.java:537)
at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:196)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:141)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:483)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launchEnhanced(Launcher.java:290)
at
org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:230)
at
org.codehaus.plexus.classworlds.launcher.Launcher.mainWithExitCode(Launcher.java:409)
at
org.codehaus.plexus.classworlds.launcher.Launcher.main(Launcher.java:352)
Caused by: org.apache.maven.plugin.MojoExecutionException: Failed to create
assembly: Error creating assembly archive all.cradle: Problem creating zip:
/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods/snomed/target/snomed-1.10-SNAPSHOT-all.data/object-chronicles/cradle/sememe/seg.2168.sememe.map
(Too many open files)
at
org.apache.maven.plugin.assembly.mojos.AbstractAssemblyMojo.execute(AbstractAssemblyMojo.java:541)
at
org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
at
org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
... 19 more
Caused by: org.apache.maven.plugin.assembly.archive.ArchiveCreationException:
Error creating assembly archive all.cradle: Problem creat
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14593010#comment-14593010 ] Kristian Rosenvold commented on MASSEMBLY-774: -- Can you run with mvn -e and include the stacktrace of where the file allocation is failing ? > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Commented] (MASSEMBLY-774) too many open files
[ https://issues.apache.org/jira/browse/MASSEMBLY-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592780#comment-14592780 ] Dan Armbrust commented on MASSEMBLY-774: As a side note, the performance of the multi-threaded zip is a nice improvement - one of our build cycles went from 22 minutes to 16 with this change. But I can't use it until it will work without mucking with file limits on linux. > too many open files > --- > > Key: MASSEMBLY-774 > URL: https://issues.apache.org/jira/browse/MASSEMBLY-774 > Project: Maven Assembly Plugin > Issue Type: Bug >Affects Versions: 2.5.5 >Reporter: Dan Armbrust > > I ran across this - > http://mail-archives.apache.org/mod_mbox/maven-dev/201501.mbox/%3ca2ee0d04-04e3-4c99-8842-673463862...@takari.io%3E > - and since I'm making huge zip files, I thought I would give it a try. > I configured as: > > org.apache.maven.plugins > maven-assembly-plugin > 2.5.5 > > > org.codehaus.plexus > plexus-archiver > 3.0.1 > > > org.codehaus.plexus > plexus-io > 2.6 > > > > But this lead to a failure: > [ERROR] Failed to execute goal > org.apache.maven.plugins:maven-assembly-plugin:2.5.5:single (zip) on project > ... sememe/seg.3182.sememe.map (Too many open files) -> [Help 1] > I certainly could raise my ulimit: > darmbrust@overkill:/mnt/STORAGE/Work/Apelon/Workspaces/ISAAC-Core-2/va-solor-goods$ > ulimit -a > ... > open files (-n) 1024 > But it seems it would be better if the zip process limited itself to a > reasonable number of open files. I don't know the algorithm... but it seems > that double or triple the processor count would be more than enough. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
