Re: jenkins build hangs while trying to check for modifications on git

2013-04-06 Thread Antonio Terreno
Thanks Scott,
no we are not on windows, it's a SmartOs box (an OS I never used before): I
have some fear that there might be a bug in the git version over there, but
as I replied to Jonathan we need to find out first if it's a network
issue..

cheers


On Fri, Apr 5, 2013 at 8:54 PM, Scott Evans  wrote:

> Antonio,
>
> Is this on a Windows box with more than one agent configured to run on it
> and possibly more than one agent is trying to do a git pull at the same
> time?  If so, it may be ssh hanging on you.  I recently went through this
> myself, and found the following reference a great help.
>
>
> http://darrell.mozingo.net/2011/09/29/painfully-slow-clone-speeds-with-msysgit-gitextensions/
>
> Since I changed my ssh to the one from cygwin, I have had absolutely no
> git hangs (over probably 20K pulls), whereas before I was getting a hang
> about 2% of the time.
>
> Scott
>
>
> On Fri, Apr 5, 2013 at 2:36 PM, JonathanRRogers  > wrote:
>
>> On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote:
>>>
>>> Hi all,
>>>
>>> we are occasionally incurring a problem with our builds, basically the
>>> build process hangs till a timeout occurs while doing git clone.
>>>
>>> This problem is affecting us more and more frequent, our jenkins has
>>> just four standard build, the code is all in git.
>>>
>>> If I try to clone from command line everything works fine, the git
>>> plugin is at version 1.5
>>>
>>>
>> I'm not sure what exactly timed out in your setup, but assuming it was
>> something outside the git plugin itself, I'd bet the problem was just that
>> the git plugin was taking a really long time to  determine what changed. I
>> had this problem in my setup.
>>
>> Our git repository has a very large number of branches and I discovered
>> that limiting the number of branches the git plugin should consider sped it
>> up a lot. However, since we needed to be able to have Jenkins build out of
>> new branches as they are created, this was difficult to manage. I
>> eventually gave up on the git plugin entirely and now do everything with
>> direct git commands or scripts which call git commands. Unfortunately, the
>> git plugin just doesn't seem to be able to scale efficiently to a large
>> number of branches as git itself does.
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Jenkins Users" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to jenkinsci-users+unsubscr...@googlegroups.com.
>> For more options, visit https://groups.google.com/groups/opt_out.
>>
>>
>>
>
>  --
> You received this message because you are subscribed to the Google Groups
> "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to jenkinsci-users+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.




Re: jenkins build hangs while trying to check for modifications on git

2013-04-06 Thread Antonio Terreno
Cheers Jonathan,
we don't have any branch, just about 7 tags at the moment, a team mate
wrote a script to loop over git, doing few git operations and sometimes
some of them fail. We will pass the issue to our ops, it might be network
related.
So for now we just do a build every 5 minutes, not super stable, not great
but better than nothing.


On Fri, Apr 5, 2013 at 8:36 PM, JonathanRRogers
wrote:

> On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote:
>>
>> Hi all,
>>
>> we are occasionally incurring a problem with our builds, basically the
>> build process hangs till a timeout occurs while doing git clone.
>>
>> This problem is affecting us more and more frequent, our jenkins has just
>> four standard build, the code is all in git.
>>
>> If I try to clone from command line everything works fine, the git plugin
>> is at version 1.5
>>
>>
> I'm not sure what exactly timed out in your setup, but assuming it was
> something outside the git plugin itself, I'd bet the problem was just that
> the git plugin was taking a really long time to  determine what changed. I
> had this problem in my setup.
>
> Our git repository has a very large number of branches and I discovered
> that limiting the number of branches the git plugin should consider sped it
> up a lot. However, since we needed to be able to have Jenkins build out of
> new branches as they are created, this was difficult to manage. I
> eventually gave up on the git plugin entirely and now do everything with
> direct git commands or scripts which call git commands. Unfortunately, the
> git plugin just doesn't seem to be able to scale efficiently to a large
> number of branches as git itself does.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to jenkinsci-users+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.




Re: jenkins build hangs while trying to check for modifications on git

2013-04-05 Thread Scott Evans
Antonio,

Is this on a Windows box with more than one agent configured to run on it
and possibly more than one agent is trying to do a git pull at the same
time?  If so, it may be ssh hanging on you.  I recently went through this
myself, and found the following reference a great help.

http://darrell.mozingo.net/2011/09/29/painfully-slow-clone-speeds-with-msysgit-gitextensions/

Since I changed my ssh to the one from cygwin, I have had absolutely no git
hangs (over probably 20K pulls), whereas before I was getting a hang about
2% of the time.

Scott

On Fri, Apr 5, 2013 at 2:36 PM, JonathanRRogers
wrote:

> On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote:
>>
>> Hi all,
>>
>> we are occasionally incurring a problem with our builds, basically the
>> build process hangs till a timeout occurs while doing git clone.
>>
>> This problem is affecting us more and more frequent, our jenkins has just
>> four standard build, the code is all in git.
>>
>> If I try to clone from command line everything works fine, the git plugin
>> is at version 1.5
>>
>>
> I'm not sure what exactly timed out in your setup, but assuming it was
> something outside the git plugin itself, I'd bet the problem was just that
> the git plugin was taking a really long time to  determine what changed. I
> had this problem in my setup.
>
> Our git repository has a very large number of branches and I discovered
> that limiting the number of branches the git plugin should consider sped it
> up a lot. However, since we needed to be able to have Jenkins build out of
> new branches as they are created, this was difficult to manage. I
> eventually gave up on the git plugin entirely and now do everything with
> direct git commands or scripts which call git commands. Unfortunately, the
> git plugin just doesn't seem to be able to scale efficiently to a large
> number of branches as git itself does.
>
> --
> You received this message because you are subscribed to the Google Groups
> "Jenkins Users" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to jenkinsci-users+unsubscr...@googlegroups.com.
> For more options, visit https://groups.google.com/groups/opt_out.
>
>
>

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.




Re: jenkins build hangs while trying to check for modifications on git

2013-04-05 Thread JonathanRRogers
On Friday, April 5, 2013 3:55:24 AM UTC-4, Antonio Terreno wrote:
>
> Hi all, 
>
> we are occasionally incurring a problem with our builds, basically the 
> build process hangs till a timeout occurs while doing git clone. 
>
> This problem is affecting us more and more frequent, our jenkins has just 
> four standard build, the code is all in git. 
>
> If I try to clone from command line everything works fine, the git plugin 
> is at version 1.5
>
>
I'm not sure what exactly timed out in your setup, but assuming it was 
something outside the git plugin itself, I'd bet the problem was just that 
the git plugin was taking a really long time to  determine what changed. I 
had this problem in my setup.

Our git repository has a very large number of branches and I discovered 
that limiting the number of branches the git plugin should consider sped it 
up a lot. However, since we needed to be able to have Jenkins build out of 
new branches as they are created, this was difficult to manage. I 
eventually gave up on the git plugin entirely and now do everything with 
direct git commands or scripts which call git commands. Unfortunately, the 
git plugin just doesn't seem to be able to scale efficiently to a large 
number of branches as git itself does.

-- 
You received this message because you are subscribed to the Google Groups 
"Jenkins Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to jenkinsci-users+unsubscr...@googlegroups.com.
For more options, visit https://groups.google.com/groups/opt_out.