When running Ivy from Ant, you can set the loglevel by adding the option '-v' (verbose) or '-d' (debug).
I don't think that adding "!javadoc" or "!source" will help, it will only prevent Ivy from downloading the jars, not from checking if they exist. Please try first with getting the verbose or debug logs and if that doesn't give us more information, we could try to disable javadoc/source discovery for the maven repositories. Maarten ----- Original Message ---- From: Sebastian Gozin <[email protected]> To: [email protected] Sent: Fri, June 11, 2010 7:39:00 AM Subject: Re: very slow dependency resolution when running ivy from gant I'm not exactly sure how to set the log level when running ivy from ant. Couldn't find much in the overview of ant targets on the apache website. I figured out how to do it when running ivy standalone but then I lose the timestamp logs and I figure we want to see those. Running it without the timestamps though I did notice a lot of failures for javadoc and sources on libraries which do not have any (might be partly related to archiva not serving them). I tried to figure out how to disable resolution of these secondary artifacts but so far have been unsuccesful. Seems like I need to do something with !javadoc and !source in the dependency conf but just what is not clear to me. Sebastian ----- Original Message ----- From: "Maarten Coene" <[email protected]> To: [email protected] Sent: Wednesday, June 9, 2010 10:26:01 PM GMT +01:00 Amsterdam / Berlin / Bern / Rome / Stockholm / Vienna Subject: Re: very slow dependency resolution when running ivy from gant Oh yes, please do this with a recent Ivy snapshot. You can download one here: http://hudson.zones.apache.org/hudson/view/Ant/job/Ivy/ Maarten ----- Original Message ---- From: Maarten Coene <[email protected]> To: [email protected] Sent: Wed, June 9, 2010 9:00:54 PM Subject: Re: very slow dependency resolution when running ivy from gant Could you set the Ivy loglevel to verbose (or debug)? Maybe this gives more information where the slowness comes from? Maarten ----- Original Message ---- From: Sebastian Gozin <[email protected]> To: [email protected] Sent: Wed, June 9, 2010 3:27:52 PM Subject: very slow dependency resolution when running ivy from gant I have a gant script which resolves an ivy.xml file with just 2 dependencies defined but a fair amount of transitive dependencies. These dependencies are then copied to a local folder. I did some debugging and noticed that the actual downloading takes almost no time at all but still there is a lot of delay between downloading of individual dependencies. Almost like parsing the Maven pom files is very slow (speculation). To give an indication of how bad it is if I delete the .ivy2/cache folder and run the task again it takes around 15 minutes just to get to the point where ivy actually downloads the dependencies. Has anyone observed this problem before? Any ideas? I can reproduce this on pretty much any system going from ubuntu, fedora, centos, osx. Only thing I didn't try was windows. gant task definition: target('get-dependencies':'Install dependencies') { def lib = new File("lib") lib.mkdirs() ivy.settings(file:"${System.getProperty('user.home')}/.ivy2/ivysettings-newtec.xml") ivy.resolve(file:'ivy.xml') ivy.retrieve(pattern:"$lib.absolutePath/[artifact].[ext]") } stdout log: 03-May-2010 08:44:26 get-dependencies: 03-May-2010 08:44:26 Clearing old library folder /home/bob/bamboo-agent-home/xml-data/build-dir/S3PVAL-S3PVT/lib... done! 03-May-2010 08:44:27 Copying libraries to /home/bob/bamboo-agent-home/xml-data/build-dir/S3PVAL-S3PVT/lib...:: Ivy 2.1.0 - 20090925235825 :: http://ant.apache.org/ivy/ :: 03-May-2010 08:44:27 [antlib:org.apache.ivy.ant:resolve] :: loading settings :: file = /home/bob/.ivy2/ivysettings-newtec.xml 03-May-2010 08:44:27 [antlib:org.apache.ivy.ant:resolve] :: resolving dependencies :: ntc.val.sat3play-tests#sat3play-tests;[email protected] 03-May-2010 08:44:27 [antlib:org.apache.ivy.ant:resolve] confs: [build, compile, test, runtime] 03-May-2010 08:45:06 [antlib:org.apache.ivy.ant:resolve] found commons-lang#commons-lang;2.4 in maven-newtec 03-May-2010 08:45:52 [antlib:org.apache.ivy.ant:resolve] found ntc.val.sat3play-tests#sat3play-tests-jar;1.2.2-RC3 in maven-newtec 03-May-2010 08:46:32 [antlib:org.apache.ivy.ant:resolve] found ntc.nms.sat3play#cli-resource-scripts-jar;2.0.11 in maven-newtec 03-May-2010 08:46:33 [antlib:org.apache.ivy.ant:resolve] found org.easyb#easyb;0.9.6 in maven-newtec 03-May-2010 08:46:33 [antlib:org.apache.ivy.ant:resolve] found commons-cli#commons-cli;1.1 in maven-newtec 03-May-2010 08:46:33 [antlib:org.apache.ivy.ant:resolve] found ntc.nms.sat3play.cmt#co-cmt-interface;2.0.10 in maven-newtec 03-May-2010 08:46:33 [antlib:org.apache.ivy.ant:resolve] found ntc.nms.datatypes#datatypes;1.0.8 in maven-newtec 03-May-2010 08:46:45 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring;2.5.5 in maven-newtec 03-May-2010 08:46:46 [antlib:org.apache.ivy.ant:resolve] found ntc.val#cpe-portal-interface;1.0.5 in maven-newtec 03-May-2010 08:47:23 [antlib:org.apache.ivy.ant:resolve] found org.grails#grails-spring;1.2.0 in maven-newtec 03-May-2010 08:47:50 [antlib:org.apache.ivy.ant:resolve] found org.slf4j#jcl-over-slf4j;1.5.8 in maven-newtec 03-May-2010 08:48:02 [antlib:org.apache.ivy.ant:resolve] found org.slf4j#slf4j-api;1.5.8 in maven-newtec 03-May-2010 08:48:14 [antlib:org.apache.ivy.ant:resolve] found org.slf4j#jul-to-slf4j;1.5.8 in maven-newtec 03-May-2010 08:48:46 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-core;3.0.0.RELEASE in maven-newtec 03-May-2010 08:48:57 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-asm;3.0.0.RELEASE in maven-newtec 03-May-2010 08:49:10 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-beans;3.0.0.RELEASE in maven-newtec 03-May-2010 08:49:22 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-context;3.0.0.RELEASE in maven-newtec 03-May-2010 08:49:35 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-expression;3.0.0.RELEASE in maven-newtec 03-May-2010 08:49:47 [antlib:org.apache.ivy.ant:resolve] found org.slf4j#slf4j-log4j12;1.5.8 in maven-newtec 03-May-2010 08:49:57 [antlib:org.apache.ivy.ant:resolve] found log4j#log4j;1.2.14 in maven-newtec 03-May-2010 08:49:58 [antlib:org.apache.ivy.ant:resolve] found org.codehaus.groovy#groovy-all;1.7.1 in maven-newtec 03-May-2010 08:50:09 [antlib:org.apache.ivy.ant:resolve] found jline#jline;0.9.94 in maven-newtec 03-May-2010 08:50:41 [antlib:org.apache.ivy.ant:resolve] found org.codehaus.gant#gant_groovy1.6;1.7.0 in maven-newtec 03-May-2010 08:50:54 [antlib:org.apache.ivy.ant:resolve] found commons-cli#commons-cli;1.2 in maven-newtec 03-May-2010 08:51:17 [antlib:org.apache.ivy.ant:resolve] found org.apache.ant#ant;1.7.1 in maven-newtec 03-May-2010 08:51:45 [antlib:org.apache.ivy.ant:resolve] found org.apache.ant#ant-launcher;1.7.1 in maven-newtec 03-May-2010 08:52:10 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-ant-tasks;2.0.10 in maven-newtec 03-May-2010 08:52:34 [antlib:org.apache.ivy.ant:resolve] found classworlds#classworlds;1.1-alpha-2 in maven-newtec 03-May-2010 08:52:58 [antlib:org.apache.ivy.ant:resolve] found org.codehaus.plexus#plexus-container-default;1.0-alpha-9-stable-1 in maven-newtec 03-May-2010 08:53:10 [antlib:org.apache.ivy.ant:resolve] found org.codehaus.plexus#plexus-utils;1.5.5 in maven-newtec 03-May-2010 08:53:35 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-artifact;2.0.10 in maven-newtec 03-May-2010 08:53:35 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-artifact-manager;2.0.10 in maven-newtec 03-May-2010 08:53:35 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-repository-metadata;2.0.10 in maven-newtec 03-May-2010 08:54:20 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven.wagon#wagon-provider-api;1.0-beta-2 in maven-newtec 03-May-2010 08:54:20 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-model;2.0.10 in maven-newtec 03-May-2010 08:54:20 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-project;2.0.10 in maven-newtec 03-May-2010 08:54:20 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-settings;2.0.10 in maven-newtec 03-May-2010 08:54:20 [antlib:org.apache.ivy.ant:resolve] found org.codehaus.plexus#plexus-interpolation;1.1 in maven-newtec 03-May-2010 08:54:20 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-profile;2.0.10 in maven-newtec 03-May-2010 08:54:21 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-plugin-registry;2.0.10 in maven-newtec 03-May-2010 08:54:21 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven#maven-error-diagnostics;2.0.10 in maven-newtec 03-May-2010 08:54:36 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven.wagon#wagon-file;1.0-beta-2 in maven-newtec 03-May-2010 08:54:36 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven.wagon#wagon-http-lightweight;1.0-beta-2 in maven-newtec 03-May-2010 08:54:36 [antlib:org.apache.ivy.ant:resolve] found org.apache.maven.wagon#wagon-http-shared;1.0-beta-2 in maven-newtec 03-May-2010 08:54:36 [antlib:org.apache.ivy.ant:resolve] found org.apache.ivy#ivy;2.1.0-rc2 in maven-newtec 03-May-2010 08:55:01 [antlib:org.apache.ivy.ant:resolve] found org.apache.ant#ant-jsch;1.7.1 in maven-newtec 03-May-2010 08:55:13 [antlib:org.apache.ivy.ant:resolve] found com.jcraft#jsch;0.1.29 in maven-newtec 03-May-2010 08:55:13 [antlib:org.apache.ivy.ant:resolve] jsch#jsch;0.1.29 is relocated to com.jcraft#jsch;0.1.29. Please update your dependencies. 03-May-2010 08:55:13 [antlib:org.apache.ivy.ant:resolve] found jsch#jsch;0.1.29 in maven-newtec 03-May-2010 08:55:25 [antlib:org.apache.ivy.ant:resolve] found joda-time#joda-time;1.4 in maven-newtec 03-May-2010 08:55:41 [antlib:org.apache.ivy.ant:resolve] found org.springframework.ws#spring-ws-core;1.5.8 in maven-newtec 03-May-2010 08:55:41 [antlib:org.apache.ivy.ant:resolve] found org.springframework.ws#spring-xml;1.5.8 in maven-newtec 03-May-2010 08:55:41 [antlib:org.apache.ivy.ant:resolve] found org.springframework.ws#spring-oxm;1.5.8 in maven-newtec 03-May-2010 08:55:54 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-aop;2.5.6 in maven-newtec 03-May-2010 08:56:07 [antlib:org.apache.ivy.ant:resolve] found aopalliance#aopalliance;1.0 in maven-newtec 03-May-2010 08:56:18 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-web;2.5.6 in maven-newtec 03-May-2010 08:56:30 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-webmvc;2.5.6 in maven-newtec 03-May-2010 08:56:45 [antlib:org.apache.ivy.ant:resolve] found org.springframework#spring-context-support;2.5.6 in maven-newtec 03-May-2010 08:56:45 [antlib:org.apache.ivy.ant:resolve] found wsdl4j#wsdl4j;1.6.1 in maven-newtec 03-May-2010 08:57:14 [antlib:org.apache.ivy.ant:resolve] found org.codehaus.gpars#gpars;0.9 in maven-newtec 03-May-2010 08:58:06 [antlib:org.apache.ivy.ant:resolve] found org.coconut.forkjoin#jsr166y;070108 in maven-newtec 03-May-2010 08:58:18 [antlib:org.apache.ivy.ant:resolve] found org.jboss.netty#netty;3.1.5.GA in maven-newtec 03-May-2010 08:58:29 [antlib:org.apache.ivy.ant:resolve] found net.sourceforge.htmlunit#htmlunit;2.7 in maven-newtec 03-May-2010 08:58:41 [antlib:org.apache.ivy.ant:resolve] found xalan#xalan;2.7.1 in maven-newtec 03-May-2010 08:59:06 [antlib:org.apache.ivy.ant:resolve] found xalan#serializer;2.7.1 in maven-newtec 03-May-2010 08:59:07 [antlib:org.apache.ivy.ant:resolve] found commons-collections#commons-collections;3.2.1 in maven-newtec 03-May-2010 08:59:20 [antlib:org.apache.ivy.ant:resolve] found commons-httpclient#commons-httpclient;3.1 in maven-newtec 03-May-2010 08:59:21 [antlib:org.apache.ivy.ant:resolve] found commons-codec#commons-codec;1.4 in maven-newtec 03-May-2010 08:59:32 [antlib:org.apache.ivy.ant:resolve] found net.sourceforge.htmlunit#htmlunit-core-js;2.7 in maven-newtec 03-May-2010 08:59:58 [antlib:org.apache.ivy.ant:resolve] found xerces#xercesImpl;2.9.1 in maven-newtec 03-May-2010 08:59:58 [antlib:org.apache.ivy.ant:resolve] found net.sourceforge.nekohtml#nekohtml;1.9.14 in maven-newtec 03-May-2010 09:00:17 [antlib:org.apache.ivy.ant:resolve] found net.sourceforge.cssparser#cssparser;0.9.5 in maven-newtec 03-May-2010 09:00:30 [antlib:org.apache.ivy.ant:resolve] found org.w3c.css#sac;1.3 in maven-newtec 03-May-2010 09:00:42 [antlib:org.apache.ivy.ant:resolve] found commons-io#commons-io;1.4 in maven-newtec 03-May-2010 09:00:42 [antlib:org.apache.ivy.ant:resolve] downloading http://archiva.eng-it.newtec.be/repository/ntc-repo/commons-lang/commons-lang/2.4/commons-lang-2.4.jar ... 03-May-2010 09:00:42 [antlib:org.apache.ivy.ant:resolve] .................................................................................................... (255kB) Newtec’s MENOS system awarded IBC Innovation Award for Content Delivery & the IBC Judges’ Award Newtec’s FlexACM awarded 2009 Teleport Technology of the Year by WTA *** e-mail confidentiality footer *** This message and any attachments thereto are confidential. They may also be privileged or otherwise protected by work product immunity or other legal rules. If you have received it by mistake, please let us know by e-mail reply and delete it from your system; you may not copy this message or disclose its contents to anyone. E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore is in no way liable for any errors or omissions in the content of this message, which may arise as a result of e-mail transmission. If verification is required, please request a hard copy. Newtec’s MENOS system awarded IBC Innovation Award for Content Delivery & the IBC Judges’ Award Newtec’s FlexACM awarded 2009 Teleport Technology of the Year by WTA *** e-mail confidentiality footer *** This message and any attachments thereto are confidential. They may also be privileged or otherwise protected by work product immunity or other legal rules. If you have received it by mistake, please let us know by e-mail reply and delete it from your system; you may not copy this message or disclose its contents to anyone. E-mail transmission cannot be guaranteed to be secure or error free as information could be intercepted, corrupted, lost, destroyed, arrive late or incomplete, or contain viruses. The sender therefore is in no way liable for any errors or omissions in the content of this message, which may arise as a result of e-mail transmission. If verification is required, please request a hard copy.
