Re: jenkins build hangs while trying to check for modifications on git
Thanks Scott, no we are not on windows, it's a SmartOs box (an OS I never used before): I have some fear that there might be a bug in the git version over there, but as I replied to Jonathan we need to find out first if it's a network issue.. cheers On Fri, Apr 5, 2013 at 8:54 PM, Scott Evans wrote: > Antonio, > > Is this on a Windows box with more than one agent configured to run on it > and possibly more than one agent is trying to do a git pull at the same > time? If so, it may be ssh hanging on you. I recently went through this > myself, and found the following reference a great help. > > > http://darrell.mozingo.net/2011/09/29/painfully-slow-clone-speeds-with-msysgit-gitextensions/ > > Since I changed my ssh to the one from cygwin, I have had absolutely no > git hangs (over probably 20K pulls), whereas before I was getting a hang > about 2% of the time. > > Scott > > > On Fri, Apr 5, 2013 at 2:36 PM, JonathanRRogers > wrote: > >> On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote: >>> >>> Hi all, >>> >>> we are occasionally incurring a problem with our builds, basically the >>> build process hangs till a timeout occurs while doing git clone. >>> >>> This problem is affecting us more and more frequent, our jenkins has >>> just four standard build, the code is all in git. >>> >>> If I try to clone from command line everything works fine, the git >>> plugin is at version 1.5 >>> >>> >> I'm not sure what exactly timed out in your setup, but assuming it was >> something outside the git plugin itself, I'd bet the problem was just that >> the git plugin was taking a really long time to determine what changed. I >> had this problem in my setup. >> >> Our git repository has a very large number of branches and I discovered >> that limiting the number of branches the git plugin should consider sped it >> up a lot. However, since we needed to be able to have Jenkins build out of >> new branches as they are created, this was difficult to manage. I >> eventually gave up on the git plugin entirely and now do everything with >> direct git commands or scripts which call git commands. Unfortunately, the >> git plugin just doesn't seem to be able to scale efficiently to a large >> number of branches as git itself does. >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Jenkins Users" group. >> To unsubscribe from this group and stop receiving emails from it, send an >> email to jenkinsci-users+unsubscr...@googlegroups.com. >> For more options, visit https://groups.google.com/groups/opt_out. >> >> >> > > -- > You received this message because you are subscribed to the Google Groups > "Jenkins Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to jenkinsci-users+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > > > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: jenkins build hangs while trying to check for modifications on git
Cheers Jonathan, we don't have any branch, just about 7 tags at the moment, a team mate wrote a script to loop over git, doing few git operations and sometimes some of them fail. We will pass the issue to our ops, it might be network related. So for now we just do a build every 5 minutes, not super stable, not great but better than nothing. On Fri, Apr 5, 2013 at 8:36 PM, JonathanRRogers wrote: > On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote: >> >> Hi all, >> >> we are occasionally incurring a problem with our builds, basically the >> build process hangs till a timeout occurs while doing git clone. >> >> This problem is affecting us more and more frequent, our jenkins has just >> four standard build, the code is all in git. >> >> If I try to clone from command line everything works fine, the git plugin >> is at version 1.5 >> >> > I'm not sure what exactly timed out in your setup, but assuming it was > something outside the git plugin itself, I'd bet the problem was just that > the git plugin was taking a really long time to determine what changed. I > had this problem in my setup. > > Our git repository has a very large number of branches and I discovered > that limiting the number of branches the git plugin should consider sped it > up a lot. However, since we needed to be able to have Jenkins build out of > new branches as they are created, this was difficult to manage. I > eventually gave up on the git plugin entirely and now do everything with > direct git commands or scripts which call git commands. Unfortunately, the > git plugin just doesn't seem to be able to scale efficiently to a large > number of branches as git itself does. > > -- > You received this message because you are subscribed to the Google Groups > "Jenkins Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to jenkinsci-users+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > > > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: jenkins build hangs while trying to check for modifications on git
Antonio, Is this on a Windows box with more than one agent configured to run on it and possibly more than one agent is trying to do a git pull at the same time? If so, it may be ssh hanging on you. I recently went through this myself, and found the following reference a great help. http://darrell.mozingo.net/2011/09/29/painfully-slow-clone-speeds-with-msysgit-gitextensions/ Since I changed my ssh to the one from cygwin, I have had absolutely no git hangs (over probably 20K pulls), whereas before I was getting a hang about 2% of the time. Scott On Fri, Apr 5, 2013 at 2:36 PM, JonathanRRogers wrote: > On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote: >> >> Hi all, >> >> we are occasionally incurring a problem with our builds, basically the >> build process hangs till a timeout occurs while doing git clone. >> >> This problem is affecting us more and more frequent, our jenkins has just >> four standard build, the code is all in git. >> >> If I try to clone from command line everything works fine, the git plugin >> is at version 1.5 >> >> > I'm not sure what exactly timed out in your setup, but assuming it was > something outside the git plugin itself, I'd bet the problem was just that > the git plugin was taking a really long time to determine what changed. I > had this problem in my setup. > > Our git repository has a very large number of branches and I discovered > that limiting the number of branches the git plugin should consider sped it > up a lot. However, since we needed to be able to have Jenkins build out of > new branches as they are created, this was difficult to manage. I > eventually gave up on the git plugin entirely and now do everything with > direct git commands or scripts which call git commands. Unfortunately, the > git plugin just doesn't seem to be able to scale efficiently to a large > number of branches as git itself does. > > -- > You received this message because you are subscribed to the Google Groups > "Jenkins Users" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to jenkinsci-users+unsubscr...@googlegroups.com. > For more options, visit https://groups.google.com/groups/opt_out. > > > -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.
Re: jenkins build hangs while trying to check for modifications on git
On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote: > > Hi all, > > we are occasionally incurring a problem with our builds, basically the > build process hangs till a timeout occurs while doing git clone. > > This problem is affecting us more and more frequent, our jenkins has just > four standard build, the code is all in git. > > If I try to clone from command line everything works fine, the git plugin > is at version 1.5 > > I'm not sure what exactly timed out in your setup, but assuming it was something outside the git plugin itself, I'd bet the problem was just that the git plugin was taking a really long time to determine what changed. I had this problem in my setup. Our git repository has a very large number of branches and I discovered that limiting the number of branches the git plugin should consider sped it up a lot. However, since we needed to be able to have Jenkins build out of new branches as they are created, this was difficult to manage. I eventually gave up on the git plugin entirely and now do everything with direct git commands or scripts which call git commands. Unfortunately, the git plugin just doesn't seem to be able to scale efficiently to a large number of branches as git itself does. -- You received this message because you are subscribed to the Google Groups "Jenkins Users" group. To unsubscribe from this group and stop receiving emails from it, send an email to jenkinsci-users+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/groups/opt_out.