Re: help - how to reduce the build time using mvn and cargo
You could deploy in place or unpacked or something similar, there is more than one way to deploy or test your webapp without it having to be packed into the WAR, which is what takes most of the build time for us too. Em 13-05-2011 01:42, Ron Wheeler escreveu: On 12/05/2011 12:53 PM, javadaisy wrote: Hi, I am using maven 2.2.1 with cargo plugin to deploy into the local and remote host. It takes around 7 to 8 minutes to build and deploy the war. I would like to reduce the time to 3 minutes or less than 3 minutes. can anybody please tell me how to do that?. I tried adding set MAVEN_OPTS=-DXms_1024M -DXmx=1024M in mvn.bat. It didn't work How big is the WAR file? There are physical limits to the speed at which disk drives work. How long does it take on other machines? Is it only slow on some workstations? One of the most effective tricks is to segregate third party libraries into sharable JARs that you only build once and deploy to the servlet engine (Tomcat) once. You set these as provided in the WAR file's POM and suddenly the build creates a WAR that is 20 Mb smaller and builds 10 times faster. Things like CXF (Web Services) add 20Mb to each WAR. If you make it shareable and scope it as provided in the POM, the WAR drops to a few tens of kilobytes that builds PDQ. We have done this is 10+ cases to get common third-party and our own utilities out of our 60+ WAR files that implement services and servlets. - Spring, Hibernate, MySQL in one shared jar - CXF - JasperReports - Apache Commons - lots of modules that everyone uses. - our messaging/e-mail utility - our facades that simplify our internal connections - API and core functions that define the ORM and business processes The WARs now contain only the code and resources that uniquely exist to support the WAR's functionality. It also eliminates the jar hell of conflicting versions of common dependencies. Once you decide which version of commons-logging you want to use, everyone gets it. POM files get really small since they only refer to 10 dependencies or less (typically 5 dependencies) to get all of the 90+ officially sanctioned libraries. Big help at run-time as well. Ron Thanks in advance. -- View this message in context: http://maven.40175.n5.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp4390836p4390836.html Sent from the Maven - Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
Re: help - how to reduce the build time using mvn and cargo
Java memory settings are not defined like system properties - You shouldn't use '-D'. Try this: set MAVEN_OPTS=-Xms=1024M -Xmx=1024M This might not solve Your problem, but it should fix the memory reservation/allocation. BTW: I wouldn't modify the mvn.bat. Just set the MAVEN_OPTS as an environment var. On 12/05/11 18:53, javadaisy wrote: I tried adding set MAVEN_OPTS=-DXms_1024M -DXmx=1024M in mvn.bat. It didn't work - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
Re: help - how to reduce the build time using mvn and cargo
Bunch of thanks to all for sharing the info. Yes my war is very big. Its size is almost 62MB. It builds in 7 mins than other machines. It uses 30 dependencies and xml resources. -- View this message in context: http://maven-users.828.n2.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp6356451p6360977.html Sent from the maven users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
Re: help - how to reduce the build time using mvn and cargo
Bunch of thanks to all for sharing the info. Yes my war is very big. Its size is almost 62MB. It builds in 7 mins than other machines. It uses 30 dependencies and xml resources. 7 minutes is a long time just to build what is essentially a zip file. Perhaps invest in some SSD hardware and perform your builds on server-class machines rather than pokey laptops via a CI server like Jenkins/Hudson or something along those lines. Wayne - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
RE: help - how to reduce the build time using mvn and cargo
Or, revisit what is going in there... Are there images and files that the end user no longer can access? How much cruft is in there exactly and how much can you yank out? Are there dependencies that can be removed? Are you saying the actual zipping process takes 7 min or the entire warfile build takes 7 min? Could you break that apart and extract portions to a different build and just rely on dependencies? -Original Message- From: Wayne Fay [mailto:wayne...@gmail.com] Sent: Friday, May 13, 2011 4:30 PM To: Maven Users List Subject: Re: help - how to reduce the build time using mvn and cargo Bunch of thanks to all for sharing the info. Yes my war is very big. Its size is almost 62MB. It builds in 7 mins than other machines. It uses 30 dependencies and xml resources. 7 minutes is a long time just to build what is essentially a zip file. Perhaps invest in some SSD hardware and perform your builds on server-class machines rather than pokey laptops via a CI server like Jenkins/Hudson or something along those lines. Wayne - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org CONFIDENTIALITY NOTICE: This e-mail and the information transmitted within including any attachments is only for the recipient(s) to which it is intended and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of; or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please send the e-mail back by replying to the sender and permanently delete the entire message and its attachments from all computers and network systems involved in its receipt.
Re: help - how to reduce the build time using mvn and cargo
Getting the 70 dependencies out of the build will yield the biggest ROI. Ron On 13/05/2011 4:29 PM, Wayne Fay wrote: Bunch of thanks to all for sharing the info. Yes my war is very big. Its size is almost 62MB. It builds in 7 mins than other machines. It uses 30 dependencies and xml resources. 7 minutes is a long time just to build what is essentially a zip file. Perhaps invest in some SSD hardware and perform your builds on server-class machines rather than pokey laptops via a CI server like Jenkins/Hudson or something along those lines. Wayne - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
RE: help - how to reduce the build time using mvn and cargo
Heh - I see 30 dependencies mentioned below, is this a trick answer? (sorry, trolling as I wait for posts to my questions) -Original Message- From: Ron Wheeler [mailto:rwhee...@artifact-software.com] Sent: Friday, May 13, 2011 5:08 PM To: users@maven.apache.org Subject: Re: help - how to reduce the build time using mvn and cargo Getting the 70 dependencies out of the build will yield the biggest ROI. Ron On 13/05/2011 4:29 PM, Wayne Fay wrote: Bunch of thanks to all for sharing the info. Yes my war is very big. Its size is almost 62MB. It builds in 7 mins than other machines. It uses 30 dependencies and xml resources. 7 minutes is a long time just to build what is essentially a zip file. Perhaps invest in some SSD hardware and perform your builds on server-class machines rather than pokey laptops via a CI server like Jenkins/Hudson or something along those lines. Wayne - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org CONFIDENTIALITY NOTICE: This e-mail and the information transmitted within including any attachments is only for the recipient(s) to which it is intended and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of; or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please send the e-mail back by replying to the sender and permanently delete the entire message and its attachments from all computers and network systems involved in its receipt.
Re: help - how to reduce the build time using mvn and cargo
By this time on a Friday 3s look like 7s. We had to remove over 70 out of our build. It made lots of things better. Some dependencies such as CXF for Web services are huge and getting them as provided was a big help since we had a dozen or so webapps in our LMS portal that used web services. If 70 can be removed will the WAR file be a negative size and give you back disk space when you build it? Ron On 13/05/2011 5:10 PM, EJ Ciramella wrote: Heh - I see 30 dependencies mentioned below, is this a trick answer? (sorry, trolling as I wait for posts to my questions) -Original Message- From: Ron Wheeler [mailto:rwhee...@artifact-software.com] Sent: Friday, May 13, 2011 5:08 PM To: users@maven.apache.org Subject: Re: help - how to reduce the build time using mvn and cargo Getting the 70 dependencies out of the build will yield the biggest ROI. Ron On 13/05/2011 4:29 PM, Wayne Fay wrote: Bunch of thanks to all for sharing the info. Yes my war is very big. Its size is almost 62MB. It builds in 7 mins than other machines. It uses 30 dependencies and xml resources. 7 minutes is a long time just to build what is essentially a zip file. Perhaps invest in some SSD hardware and perform your builds on server-class machines rather than pokey laptops via a CI server like Jenkins/Hudson or something along those lines. Wayne - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org CONFIDENTIALITY NOTICE: This e-mail and the information transmitted within including any attachments is only for the recipient(s) to which it is intended and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of; or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please send the e-mail back by replying to the sender and permanently delete the entire message and its attachments from all computers and network systems involved in its receipt. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
Re: help - how to reduce the build time using mvn and cargo
In addition to trimming the war (definitely a good idea)...
In your first post, you mentioned mvn.bat - so I will assume you are in a
Windows environment. Where is your ${user.home} located: local or remote?
I have seen at least one corporate environment where (for Sysadmin
convenience) home directories were kept on a central server. This was not a
big deal to Word and PowerPoint users, who only download one file at a time,
but a huge hit to maven as people were constantly hitting .m2/repository
*ACROSS-THE-WIRE*.
On Fri, May 13, 2011 at 5:10 PM, EJ Ciramella ecirame...@casenetinc.comwrote:
Heh - I see 30 dependencies mentioned below, is this a trick answer?
(sorry, trolling as I wait for posts to my questions)
-Original Message-
From: Ron Wheeler [mailto:rwhee...@artifact-software.com]
Sent: Friday, May 13, 2011 5:08 PM
To: users@maven.apache.org
Subject: Re: help - how to reduce the build time using mvn and cargo
Getting the 70 dependencies out of the build will yield the biggest ROI.
Ron
On 13/05/2011 4:29 PM, Wayne Fay wrote:
Bunch of thanks to all for sharing the info. Yes my war is very big.
Its
size is almost 62MB. It builds in 7 mins than other machines. It uses
30
dependencies and xml resources.
7 minutes is a long time just to build what is essentially a zip file.
Perhaps invest in some SSD hardware and perform your builds on
server-class machines rather than pokey laptops via a CI server like
Jenkins/Hudson or something along those lines.
Wayne
-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org
-
To unsubscribe, e-mail: users-unsubscr...@maven.apache.org
For additional commands, e-mail: users-h...@maven.apache.org
CONFIDENTIALITY NOTICE: This e-mail and the information transmitted within
including any attachments is only for the recipient(s) to which it is
intended and may contain confidential and/or privileged material. Any
review, retransmission, dissemination or other use of; or taking of any
action in reliance upon this information by persons or entities other than
the intended recipient is prohibited. If you received this in error, please
send the e-mail back by replying to the sender and permanently delete the
entire message and its attachments from all computers and network systems
involved in its receipt.
RE: help - how to reduce the build time using mvn and cargo
100 points to Ron. Ron touched on something here - not sure if you can look at any of the transitive dependencies you may be pulling in and see if you can exclude some of those as well. -Original Message- From: Ron Wheeler [mailto:rwhee...@artifact-software.com] Sent: Friday, May 13, 2011 5:24 PM To: users@maven.apache.org Subject: Re: help - how to reduce the build time using mvn and cargo By this time on a Friday 3s look like 7s. We had to remove over 70 out of our build. It made lots of things better. Some dependencies such as CXF for Web services are huge and getting them as provided was a big help since we had a dozen or so webapps in our LMS portal that used web services. If 70 can be removed will the WAR file be a negative size and give you back disk space when you build it? Ron CONFIDENTIALITY NOTICE: This e-mail and the information transmitted within including any attachments is only for the recipient(s) to which it is intended and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of; or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please send the e-mail back by replying to the sender and permanently delete the entire message and its attachments from all computers and network systems involved in its receipt.
Re: help - how to reduce the build time using mvn and cargo
Seriously, what kind of answer are you expecting to this question? There isn't any magic configuration like -DreduceBuildTime=true. /Anders On Thu, May 12, 2011 at 18:53, javadaisy javada...@gmail.com wrote: Hi, I am using maven 2.2.1 with cargo plugin to deploy into the local and remote host. It takes around 7 to 8 minutes to build and deploy the war. I would like to reduce the time to 3 minutes or less than 3 minutes. can anybody please tell me how to do that?. I tried adding set MAVEN_OPTS=-DXms_1024M -DXmx=1024M in mvn.bat. It didn't work Thanks in advance. -- View this message in context: http://maven.40175.n5.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp4390836p4390836.html Sent from the Maven - Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
RE: help - how to reduce the build time using mvn and cargo
-DGetPaidForSomeoneElseDoingMyJobForMe=true Only in Amerika! Martin __ Verzicht und Vertraulichkeitanmerkung/Note de déni et de confidentialité Diese Nachricht ist vertraulich. Sollten Sie nicht der vorgesehene Empfaenger sein, so bitten wir hoeflich um eine Mitteilung. Jede unbefugte Weiterleitung oder Fertigung einer Kopie ist unzulaessig. Diese Nachricht dient lediglich dem Austausch von Informationen und entfaltet keine rechtliche Bindungswirkung. Aufgrund der leichten Manipulierbarkeit von E-Mails koennen wir keine Haftung fuer den Inhalt uebernehmen. Ce message est confidentiel et peut être privilégié. Si vous n'êtes pas le destinataire prévu, nous te demandons avec bonté que pour satisfaire informez l'expéditeur. N'importe quelle diffusion non autorisée ou la copie de ceci est interdite. Ce message sert à l'information seulement et n'aura pas n'importe quel effet légalement obligatoire. Étant donné que les email peuvent facilement être sujets à la manipulation, nous ne pouvons accepter aucune responsabilité pour le contenu fourni. Date: Thu, 12 May 2011 19:18:48 +0200 Subject: Re: help - how to reduce the build time using mvn and cargo From: and...@hammar.net To: users@maven.apache.org Seriously, what kind of answer are you expecting to this question? There isn't any magic configuration like -DreduceBuildTime=true. /Anders On Thu, May 12, 2011 at 18:53, javadaisy javada...@gmail.com wrote: Hi, I am using maven 2.2.1 with cargo plugin to deploy into the local and remote host. It takes around 7 to 8 minutes to build and deploy the war. I would like to reduce the time to 3 minutes or less than 3 minutes. can anybody please tell me how to do that?. I tried adding set MAVEN_OPTS=-DXms_1024M -DXmx=1024M in mvn.bat. It didn't work Thanks in advance. -- View this message in context: http://maven.40175.n5.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp4390836p4390836.html Sent from the Maven - Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
Re: help - how to reduce the build time using mvn and cargo
Well, the first step would be determining exactly where your build is spending its time - compiling, building the war, deploying the war (locally and/or remotely)? If your current build output doesn't give enough information, try mvn -X for more verbose output. Then you will have a better idea where to look for improvement. I doubt that the maven memory footprint is the source of your speed issues. On Thu, May 12, 2011 at 12:53 PM, javadaisy javada...@gmail.com wrote: Hi, I am using maven 2.2.1 with cargo plugin to deploy into the local and remote host. It takes around 7 to 8 minutes to build and deploy the war. I would like to reduce the time to 3 minutes or less than 3 minutes. can anybody please tell me how to do that?. I tried adding set MAVEN_OPTS=-DXms_1024M -DXmx=1024M in mvn.bat. It didn't work Thanks in advance. -- View this message in context: http://maven.40175.n5.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp4390836p4390836.html Sent from the Maven - Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
RE: help - how to reduce the build time using mvn and cargo
I giggled at the first few replies to this thread, but now I'm curious - when you're finished building, and maven presents the summary output, which modules are taking the longest time and what exactly are they doing? Hi, I am using maven 2.2.1 with cargo plugin to deploy into the local and remote host. It takes around 7 to 8 minutes to build and deploy the war. I would like to reduce the time to 3 minutes or less than 3 minutes. can anybody please tell me how to do that?. I tried adding set MAVEN_OPTS=-DXms_1024M -DXmx=1024M in mvn.bat. It didn't work Thanks in advance. -- View this message in context: http://maven.40175.n5.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp4390836p4390836.html Sent from the Maven - Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org CONFIDENTIALITY NOTICE: This e-mail and the information transmitted within including any attachments is only for the recipient(s) to which it is intended and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of; or taking of any action in reliance upon this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please send the e-mail back by replying to the sender and permanently delete the entire message and its attachments from all computers and network systems involved in its receipt. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
Re: help - how to reduce the build time using mvn and cargo
Thanks for pointing me to the right direction. For clean and compile it takes around 1Min and it takes around 3 1/2 mins for packaging the war file. -- View this message in context: http://maven.40175.n5.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp4390836p4391561.html Sent from the Maven - Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
Re: help - how to reduce the build time using mvn and cargo
On 12/05/2011 12:53 PM, javadaisy wrote: Hi, I am using maven 2.2.1 with cargo plugin to deploy into the local and remote host. It takes around 7 to 8 minutes to build and deploy the war. I would like to reduce the time to 3 minutes or less than 3 minutes. can anybody please tell me how to do that?. I tried adding set MAVEN_OPTS=-DXms_1024M -DXmx=1024M in mvn.bat. It didn't work How big is the WAR file? There are physical limits to the speed at which disk drives work. How long does it take on other machines? Is it only slow on some workstations? One of the most effective tricks is to segregate third party libraries into sharable JARs that you only build once and deploy to the servlet engine (Tomcat) once. You set these as provided in the WAR file's POM and suddenly the build creates a WAR that is 20 Mb smaller and builds 10 times faster. Things like CXF (Web Services) add 20Mb to each WAR. If you make it shareable and scope it as provided in the POM, the WAR drops to a few tens of kilobytes that builds PDQ. We have done this is 10+ cases to get common third-party and our own utilities out of our 60+ WAR files that implement services and servlets. - Spring, Hibernate, MySQL in one shared jar - CXF - JasperReports - Apache Commons - lots of modules that everyone uses. - our messaging/e-mail utility - our facades that simplify our internal connections - API and core functions that define the ORM and business processes The WARs now contain only the code and resources that uniquely exist to support the WAR's functionality. It also eliminates the jar hell of conflicting versions of common dependencies. Once you decide which version of commons-logging you want to use, everyone gets it. POM files get really small since they only refer to 10 dependencies or less (typically 5 dependencies) to get all of the 90+ officially sanctioned libraries. Big help at run-time as well. Ron Thanks in advance. -- View this message in context: http://maven.40175.n5.nabble.com/help-how-to-reduce-the-build-time-using-mvn-and-cargo-tp4390836p4390836.html Sent from the Maven - Users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org - To unsubscribe, e-mail: users-unsubscr...@maven.apache.org For additional commands, e-mail: users-h...@maven.apache.org
