Re: [Puppet Users] Puppet system deployment hanging ..
Well, I wonder if there is a way to make puppet turn off the updater before starting it's run ? On Tue, Aug 17, 2010 at 2:00 PM, Eric Shamow wrote: > I have seen this behavior before as well. I've also seen it where > yum-updater (which is evil and shouldn't be running, but in some cases > hasn't been turned off yet by kickstart or puppet) will switch on and > demolish a bootstrap Puppet run. > > It would help if the yum handler was a little more verbose or had some > kind of watchdog that could reap stale processes after a while. The > hardest thing about this kind of problem is actually figuring out what > causes the issue, since Puppet/Yum only log the action after it's > completed. > > -Eric > > > On Tue, Aug 17, 2010 at 2:04 AM, Adrian Snyman wrote: >> On Fri, Aug 13, 2010 at 8:46 AM, Adrian Snyman wrote: >>> On Fri, Aug 13, 2010 at 8:02 AM, Adrian Snyman wrote: >>>> On Thu, Aug 12, 2010 at 1:38 PM, Trevor Hemsley >>>> wrote: >>>>> You're not exec'ing some install program that is stopping and waiting for >>>>> input? When we deploy Platform Symphony, we have to do something like an >>>>> exec that runs "echo Y | symphony-installer" or we get a similar problem. >>>>> >>>> >>>> Hmm, I am not aware of any installers running ... I will take a look >>>> and see if there are >>>> any background processes waiting for input .. thanks ! >>>> >>> >>> Well, I have run through the installation, and it appears to be >>> hanging on the installation of our grid software. >>> The commandline is executing, but the rpm's aren't downloading - so I >>> will keep looking ... >>> >>>>> Adrian Snyman wrote: >>>>>> >>>>>> On Thu, Aug 12, 2010 at 12:49 PM, Ohad Levy wrote: >>>>>> >>>>>>> >>>>>>> Does the puppet run starts at all? >>>>>>> I've seen similar case when the clock were out of sync, ntp started and >>>>>>> aligned it, but puppet got hanged because of it (or sleeping for a >>>>>>> really >>>>>>> long time). >>>>>>> does debug mode provide more info? >>>>>>> Ohad >>>>>>> >>>>>>> On Thu, Aug 12, 2010 at 9:11 AM, MadX wrote: >>>>>>> >>>>>>>> >>>>>>>> We have successfully installed puppet on a CentOS Server, but I am >>>>>>>> battling with a deployment. >>>>>>>> >>>>>>>> It has to do with grid software. The repository gets created, then >>>>>>>> begins installation. >>>>>>>> The problem is that it just hangs - no errors, no network activity. I >>>>>>>> can see puppet is running, but nothing it being updated. >>>>>>>> >>>>>>>> Any pointers ? >>>>>>>> >>>>>>>> -- >>>>>>>> You received this message because you are subscribed to the Google >>>>>>>> Groups >>>>>>>> "Puppet Users" group. >>>>>>>> To post to this group, send email to puppet-us...@googlegroups.com. >>>>>>>> To unsubscribe from this group, send email to >>>>>>>> puppet-users+unsubscr...@googlegroups.com. >>>>>>>> For more options, visit this group at >>>>>>>> http://groups.google.com/group/puppet-users?hl=en. >>>>>>>> >>>>>>>> >>>>>>> >>>>>>> -- >>>>>>> You received this message because you are subscribed to the Google >>>>>>> Groups >>>>>>> "Puppet Users" group. >>>>>>> To post to this group, send email to puppet-us...@googlegroups.com. >>>>>>> To unsubscribe from this group, send email to >>>>>>> puppet-users+unsubscr...@googlegroups.com. >>>>>>> For more options, visit this group at >>>>>>> http://groups.google.com/group/puppet-users?hl=en. >>>>>>> >>>>>>> >>>>>> >>>>>> Well, This is happening at about 50% of the installation - so it is >>>>>> definitely deploying .. >>>>>> I am running
Re: [Puppet Users] Puppet system deployment hanging ..
On Fri, Aug 13, 2010 at 8:46 AM, Adrian Snyman wrote: > On Fri, Aug 13, 2010 at 8:02 AM, Adrian Snyman wrote: >> On Thu, Aug 12, 2010 at 1:38 PM, Trevor Hemsley >> wrote: >>> You're not exec'ing some install program that is stopping and waiting for >>> input? When we deploy Platform Symphony, we have to do something like an >>> exec that runs "echo Y | symphony-installer" or we get a similar problem. >>> >> >> Hmm, I am not aware of any installers running ... I will take a look >> and see if there are >> any background processes waiting for input .. thanks ! >> > > Well, I have run through the installation, and it appears to be > hanging on the installation of our grid software. > The commandline is executing, but the rpm's aren't downloading - so I > will keep looking ... > >>> Adrian Snyman wrote: >>>> >>>> On Thu, Aug 12, 2010 at 12:49 PM, Ohad Levy wrote: >>>> >>>>> >>>>> Does the puppet run starts at all? >>>>> I've seen similar case when the clock were out of sync, ntp started and >>>>> aligned it, but puppet got hanged because of it (or sleeping for a really >>>>> long time). >>>>> does debug mode provide more info? >>>>> Ohad >>>>> >>>>> On Thu, Aug 12, 2010 at 9:11 AM, MadX wrote: >>>>> >>>>>> >>>>>> We have successfully installed puppet on a CentOS Server, but I am >>>>>> battling with a deployment. >>>>>> >>>>>> It has to do with grid software. The repository gets created, then >>>>>> begins installation. >>>>>> The problem is that it just hangs - no errors, no network activity. I >>>>>> can see puppet is running, but nothing it being updated. >>>>>> >>>>>> Any pointers ? >>>>>> >>>>>> -- >>>>>> You received this message because you are subscribed to the Google >>>>>> Groups >>>>>> "Puppet Users" group. >>>>>> To post to this group, send email to puppet-us...@googlegroups.com. >>>>>> To unsubscribe from this group, send email to >>>>>> puppet-users+unsubscr...@googlegroups.com. >>>>>> For more options, visit this group at >>>>>> http://groups.google.com/group/puppet-users?hl=en. >>>>>> >>>>>> >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google Groups >>>>> "Puppet Users" group. >>>>> To post to this group, send email to puppet-us...@googlegroups.com. >>>>> To unsubscribe from this group, send email to >>>>> puppet-users+unsubscr...@googlegroups.com. >>>>> For more options, visit this group at >>>>> http://groups.google.com/group/puppet-users?hl=en. >>>>> >>>>> >>>> >>>> Well, This is happening at about 50% of the installation - so it is >>>> definitely deploying .. >>>> I am running : >>>> >>>> puppetd --test --verbose >>>> >>>> And, as listed above - that's the last message I am seeing .. :S Any >>>> other logs etc. I could give ? >>>> >>> Okay, just a heads up here ... I found the issue to be a faulty rpm. The user/group did not exist on the target system, and so after about 300 warnings, yum simply freezes. Installing the rpm manually showed the error. After creating the user and group - the deployment was successful. Unfortunately, puppet simply hangs while waiting for the rpm transaction to finish, and there is no indication as to what is holding up the install ... -- Regards, Adrian -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-us...@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Re: [Puppet Users] Puppet system deployment hanging ..
On Fri, Aug 13, 2010 at 8:02 AM, Adrian Snyman wrote: > On Thu, Aug 12, 2010 at 1:38 PM, Trevor Hemsley > wrote: >> You're not exec'ing some install program that is stopping and waiting for >> input? When we deploy Platform Symphony, we have to do something like an >> exec that runs "echo Y | symphony-installer" or we get a similar problem. >> > > Hmm, I am not aware of any installers running ... I will take a look > and see if there are > any background processes waiting for input .. thanks ! > Well, I have run through the installation, and it appears to be hanging on the installation of our grid software. The commandline is executing, but the rpm's aren't downloading - so I will keep looking ... >> Adrian Snyman wrote: >>> >>> On Thu, Aug 12, 2010 at 12:49 PM, Ohad Levy wrote: >>> >>>> >>>> Does the puppet run starts at all? >>>> I've seen similar case when the clock were out of sync, ntp started and >>>> aligned it, but puppet got hanged because of it (or sleeping for a really >>>> long time). >>>> does debug mode provide more info? >>>> Ohad >>>> >>>> On Thu, Aug 12, 2010 at 9:11 AM, MadX wrote: >>>> >>>>> >>>>> We have successfully installed puppet on a CentOS Server, but I am >>>>> battling with a deployment. >>>>> >>>>> It has to do with grid software. The repository gets created, then >>>>> begins installation. >>>>> The problem is that it just hangs - no errors, no network activity. I >>>>> can see puppet is running, but nothing it being updated. >>>>> >>>>> Any pointers ? >>>>> >>>>> -- >>>>> You received this message because you are subscribed to the Google >>>>> Groups >>>>> "Puppet Users" group. >>>>> To post to this group, send email to puppet-us...@googlegroups.com. >>>>> To unsubscribe from this group, send email to >>>>> puppet-users+unsubscr...@googlegroups.com. >>>>> For more options, visit this group at >>>>> http://groups.google.com/group/puppet-users?hl=en. >>>>> >>>>> >>>> >>>> -- >>>> You received this message because you are subscribed to the Google Groups >>>> "Puppet Users" group. >>>> To post to this group, send email to puppet-us...@googlegroups.com. >>>> To unsubscribe from this group, send email to >>>> puppet-users+unsubscr...@googlegroups.com. >>>> For more options, visit this group at >>>> http://groups.google.com/group/puppet-users?hl=en. >>>> >>>> >>> >>> Well, This is happening at about 50% of the installation - so it is >>> definitely deploying .. >>> I am running : >>> >>> puppetd --test --verbose >>> >>> And, as listed above - that's the last message I am seeing .. :S Any >>> other logs etc. I could give ? >>> >> >> -- >> >> Trevor Hemsley >> Infrastructure Engineer >> . >> * C A L Y P S O >> * 4th Floor, Tower Point, >> 44 North Road, >> Brighton, BN1 1YR, UK >> OFFICE +44 (0) 1273 666 350 >> FAX +44 (0) 1273 666 351 >> >> . >> www.calypso.com >> >> This electronic-mail might contain confidential information intended only >> for the use by the entity named. If the reader of this message is not the >> intended recipient, the reader is hereby notified that any dissemination, >> distribution or copying is strictly prohibited. >> >> * P * /*/ Please consider the environment before printing this e-mail /*/ >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Puppet Users" group. >> To post to this group, send email to puppet-us...@googlegroups.com. >> To unsubscribe from this group, send email to >> puppet-users+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/puppet-users?hl=en. >> >> > > > > -- > Regards, > > > Adrian > -- Regards, Adrian -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-us...@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Re: [Puppet Users] Puppet system deployment hanging ..
On Thu, Aug 12, 2010 at 1:38 PM, Trevor Hemsley wrote: > You're not exec'ing some install program that is stopping and waiting for > input? When we deploy Platform Symphony, we have to do something like an > exec that runs "echo Y | symphony-installer" or we get a similar problem. > Hmm, I am not aware of any installers running ... I will take a look and see if there are any background processes waiting for input .. thanks ! > Adrian Snyman wrote: >> >> On Thu, Aug 12, 2010 at 12:49 PM, Ohad Levy wrote: >> >>> >>> Does the puppet run starts at all? >>> I've seen similar case when the clock were out of sync, ntp started and >>> aligned it, but puppet got hanged because of it (or sleeping for a really >>> long time). >>> does debug mode provide more info? >>> Ohad >>> >>> On Thu, Aug 12, 2010 at 9:11 AM, MadX wrote: >>> >>>> >>>> We have successfully installed puppet on a CentOS Server, but I am >>>> battling with a deployment. >>>> >>>> It has to do with grid software. The repository gets created, then >>>> begins installation. >>>> The problem is that it just hangs - no errors, no network activity. I >>>> can see puppet is running, but nothing it being updated. >>>> >>>> Any pointers ? >>>> >>>> -- >>>> You received this message because you are subscribed to the Google >>>> Groups >>>> "Puppet Users" group. >>>> To post to this group, send email to puppet-us...@googlegroups.com. >>>> To unsubscribe from this group, send email to >>>> puppet-users+unsubscr...@googlegroups.com. >>>> For more options, visit this group at >>>> http://groups.google.com/group/puppet-users?hl=en. >>>> >>>> >>> >>> -- >>> You received this message because you are subscribed to the Google Groups >>> "Puppet Users" group. >>> To post to this group, send email to puppet-us...@googlegroups.com. >>> To unsubscribe from this group, send email to >>> puppet-users+unsubscr...@googlegroups.com. >>> For more options, visit this group at >>> http://groups.google.com/group/puppet-users?hl=en. >>> >>> >> >> Well, This is happening at about 50% of the installation - so it is >> definitely deploying .. >> I am running : >> >> puppetd --test --verbose >> >> And, as listed above - that's the last message I am seeing .. :S Any >> other logs etc. I could give ? >> > > -- > > Trevor Hemsley > Infrastructure Engineer > . > * C A L Y P S O > * 4th Floor, Tower Point, > 44 North Road, > Brighton, BN1 1YR, UK > OFFICE +44 (0) 1273 666 350 > FAX +44 (0) 1273 666 351 > > . > www.calypso.com > > This electronic-mail might contain confidential information intended only > for the use by the entity named. If the reader of this message is not the > intended recipient, the reader is hereby notified that any dissemination, > distribution or copying is strictly prohibited. > > * P * /*/ Please consider the environment before printing this e-mail /*/ > > -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To post to this group, send email to puppet-us...@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > > -- Regards, Adrian -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-us...@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Re: [Puppet Users] Puppet system deployment hanging ..
On Thu, Aug 12, 2010 at 1:05 PM, Daniel Maher wrote: > On 08/12/2010 12:49 PM, Ohad Levy wrote: >> >> Does the puppet run starts at all? >> I've seen similar case when the clock were out of sync, ntp started and >> aligned it, but puppet got hanged because of it (or sleeping for a >> really long time). > > Just the other day we had a problem with the config on the DNS servers that > appeared first in the (puppet-controlled) resolv.conf of our machines. > Puppet initialized just fine, but sat and waited for DNS resolution (read: > timeout) at each step, which took forever. > > Might want to check into that, too. > > Yep, thought about that .. The box has DNS resolution - no problems. It pulls repos from redhat epel, as well as some scientific linux stuff .. It populates the yum.repos.d directory, and then does : yum update -y This completes no problems, so I think it's deeper than that. But good point ... :-) > -- > Daniel Maher > "The Internet is completely over." -- Prince > > -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To post to this group, send email to puppet-us...@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > > -- Regards, Adrian -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-us...@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
Re: [Puppet Users] Puppet system deployment hanging ..
On Thu, Aug 12, 2010 at 12:49 PM, Ohad Levy wrote: > Does the puppet run starts at all? > I've seen similar case when the clock were out of sync, ntp started and > aligned it, but puppet got hanged because of it (or sleeping for a really > long time). > does debug mode provide more info? > Ohad > > On Thu, Aug 12, 2010 at 9:11 AM, MadX wrote: >> >> We have successfully installed puppet on a CentOS Server, but I am >> battling with a deployment. >> >> It has to do with grid software. The repository gets created, then >> begins installation. >> The problem is that it just hangs - no errors, no network activity. I >> can see puppet is running, but nothing it being updated. >> >> Any pointers ? >> >> -- >> You received this message because you are subscribed to the Google Groups >> "Puppet Users" group. >> To post to this group, send email to puppet-us...@googlegroups.com. >> To unsubscribe from this group, send email to >> puppet-users+unsubscr...@googlegroups.com. >> For more options, visit this group at >> http://groups.google.com/group/puppet-users?hl=en. >> > > -- > You received this message because you are subscribed to the Google Groups > "Puppet Users" group. > To post to this group, send email to puppet-us...@googlegroups.com. > To unsubscribe from this group, send email to > puppet-users+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/puppet-users?hl=en. > Well, This is happening at about 50% of the installation - so it is definitely deploying .. I am running : puppetd --test --verbose And, as listed above - that's the last message I am seeing .. :S Any other logs etc. I could give ? -- Regards, Adrian -- You received this message because you are subscribed to the Google Groups "Puppet Users" group. To post to this group, send email to puppet-us...@googlegroups.com. To unsubscribe from this group, send email to puppet-users+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/puppet-users?hl=en.
