Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-27 Thread Felix Barbeira
Same here.

El miércoles, 26 de agosto de 2015, 15:45:07 (UTC+2), Pete Harvey escribió:

 On 26 August 2015 at 09:16, Fabrice Bacchella 
 fabrice@orange.fr javascript: wrote: 
  My biggest problem: there isn't any working dashboard working with 
 Puppet 4. 

 This. Our upgrade to 4 is essentially blocked until Foreman supports it. 

 Pete 


-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/0ceb69f1-4a5d-49d4-a970-38f31146d395%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-27 Thread Jeffrey Watts
Agreed.

Between the AIO packaging, change in configuration file locations, lack of
dashboards, and the many other minor annoyances I do not feel the benefits
of 4 outweigh the hassle of upgrading.  2-3 was much, much less painful.

Jeffrey.

On Thu, Aug 27, 2015 at 1:46 PM, Felix Barbeira fbarbe...@gmail.com wrote:

 Same here.

 El miércoles, 26 de agosto de 2015, 15:45:07 (UTC+2), Pete Harvey escribió:

 On 26 August 2015 at 09:16, Fabrice Bacchella
 fabrice@orange.fr wrote:
  My biggest problem: there isn't any working dashboard working with
 Puppet 4.

 This. Our upgrade to 4 is essentially blocked until Foreman supports it.

 Pete



-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/CAMvPdm1dFEOT4T8yP1TojV4jcoc1o2ERjJKZnyurA1Rp_QEAiw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-26 Thread Fabrice Bacchella

 Le 24 août 2015 à 21:59, Christopher Wood christopher_w...@pobox.com a 
 écrit :
 
 I am not seeing a large amount of blog entries complaining about this 
 upgrade, how has that gone for you? Is there anything you found particularly 
 painful? Would you have done anything different in retrospect?
 
 I'm staring down a 3.7.2 - 4.2.1 upgrade and after reading a number of docs 
 the back-of-the-envelope optimal upgrade path is as follows. If any of you 
 have commentary I am quite interested, otherwise I will try it and see what 
 happens. I feel like this might be more time-consuming work but less 
 brainpower effort than just yanking everything to 4.2.
 
 1) rpms up to puppet 3.8
 
 PostgreSQL 8.4 to 9.4
 PuppetDB 2.2.2 to 2.3.7
 (puppetdb-terminus from 2.2.2 to 2.3.7)
 Puppet 3.7.2 to 3.8.2
 
 2) enable the future parser
 
 3) replace puppet 3.8.2, passenger 5 with puppetserver 1.1.1
 
 4) replace puppetserver 1.1.1 with puppetserver 2.1.1
 
 5) upgrade PuppetDB from 2.3.7 to 3.0.2
 
 6) use the puppetlabs-puppet_agent forge module to upgrade agents to 4.2.1
 
 

My biggest problem: there isn't any working dashboard working with Puppet 4. 
The puppetdb APIv4 in puppet db 3.1 is not the same as the APIv4 in puppetdb 2, 
so all of them are now broken, even the one that thought they uses the v4 API.

I had a lot of trouble with facter, it's rewritten but not tested on older 
release, a few things were broken on Redhat 5 :
https://tickets.puppetlabs.com/browse/FACT-1152
https://tickets.puppetlabs.com/browse/FACT-1137

If you use mcollective there is a bug that prevent installation of both 
mcollective and puppet on the same server on Redhat 6 :
https://tickets.puppetlabs.com/browse/PUP-4970
and no one take care for this bug at puppetlabs.

All the path change /etc/puppet, /usr/bin to /etc/puppetlab, /opt/puppetlabs. 
Minor problems might arise from that, if you don't prepare that on puppet 
modules, other management scripts.

I hade no problem with embedded PKI, rsync -av /var/lib/puppet/ssl  
/etc/puppetlabs/puppet/ is enough to keep it.

Check your:
[master]
certname =...

in puppet.conf. Rules changes slightly and I had problem with that.

If you wrote you own modules, expect a lot of warning and broken modules becase 
of new variable typing.

Once the new server was up and running, I used this simple script on all the 
nodes:
[ -x  /opt/puppetlabs/bin/puppet ] || (\
[ -x $(type -p facter) ]  \
rpm -e puppetlabs-release  \
rpm -Uvh  http://.../puppetlabs/$(facter 
operatingsystemmajrelease)/PC1/x86_64/puppetlabs-release-pc1-0.9.2-1.el$(facter 
operatingsystemmajrelease).noarch.rpm  \
yum install -y puppet-agent  \
rsync -av /var/lib/puppet/ssl  /etc/puppetlabs/puppet/  \
/opt/puppetlabs/bin/puppet agent -v --onetime --no-daemonize --no-show_diff 
--pluginsource puppet:///plugins --use_srv_records  \
service mcollective restart


-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/88164374-6100-425D-B7D1-C4C944B35642%40orange.fr.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-26 Thread Fabrice Bacchella

 Le 26 août 2015 à 11:30, Stefan Heijmans heijm...@gmail.com a écrit :
 
 
 On Wednesday, August 26, 2015 at 10:16:59 AM UTC+2, Fabrice Bacchella wrote:
 
  Le 24 août 2015 à 21:59, Christopher Wood christop...@pobox.com 
  javascript: a écrit : 
  
 My biggest problem: there isn't any working dashboard working with Puppet 4. 
 The puppetdb APIv4 in puppet db 3.1 is not the same as the APIv4 in puppetdb 
 2, so all of them are now broken, even the one that thought they uses the v4 
 API. 
  
 Hopefully PuppetDB 3.x.x will support Puppet 3 clients again, like 
 PuppetServer.
  
 In the PuppetDB release notes is says that version 2.3.0 supports Puppet 4 
 [1], so will this not work together with PuppetExplorer 1.5.0 [2]?
They don't give a lot of details, that's puppetbd 2.3 release notes any way. 
The API v4 changed between puppetdb 2 and puppetdb 3. So this release note 
don't apply any more.

For puppet explorer, good news: 
https://github.com/spotify/puppetexplorer/issues/34 
https://github.com/spotify/puppetexplorer/issues/34

Good news with puppet explorer any way :
https://github.com/spotify/puppetexplorer/releases/tag/2.0.0 
https://github.com/spotify/puppetexplorer/releases/tag/2.0.0


 
  
 1. https://docs.puppetlabs.com/puppetdb/latest/release_notes.html#section-11 
 https://docs.puppetlabs.com/puppetdb/latest/release_notes.html#section-11
 2. https://github.com/spotify/puppetexplorer/releases/tag/1.5.0 
 https://github.com/spotify/puppetexplorer/releases/tag/1.5.0
  
 Stefan
  
  
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Puppet Users group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to puppet-users+unsubscr...@googlegroups.com 
 mailto:puppet-users+unsubscr...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/puppet-users/f359ca60-1b0d-4fac-96c3-dfba460995fc%40googlegroups.com
  
 https://groups.google.com/d/msgid/puppet-users/f359ca60-1b0d-4fac-96c3-dfba460995fc%40googlegroups.com?utm_medium=emailutm_source=footer.
 For more options, visit https://groups.google.com/d/optout 
 https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/C569E049-6183-4B97-A174-7CD1E609B7DE%40orange.fr.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-26 Thread Christopher Wood
On Wed, Aug 26, 2015 at 10:16:28AM +0200, Fabrice Bacchella wrote:
 
  Le 24 août 2015 à 21:59, Christopher Wood christopher_w...@pobox.com a 
  écrit :
  
  I am not seeing a large amount of blog entries complaining about this 
  upgrade, how has that gone for you? Is there anything you found 
  particularly painful? Would you have done anything different in retrospect?
  
  I'm staring down a 3.7.2 - 4.2.1 upgrade and after reading a number of 
  docs the back-of-the-envelope optimal upgrade path is as follows. If any of 
  you have commentary I am quite interested, otherwise I will try it and see 
  what happens. I feel like this might be more time-consuming work but less 
  brainpower effort than just yanking everything to 4.2.
  
  1) rpms up to puppet 3.8
  
  PostgreSQL 8.4 to 9.4
  PuppetDB 2.2.2 to 2.3.7
  (puppetdb-terminus from 2.2.2 to 2.3.7)
  Puppet 3.7.2 to 3.8.2
  
  2) enable the future parser
  
  3) replace puppet 3.8.2, passenger 5 with puppetserver 1.1.1
  
  4) replace puppetserver 1.1.1 with puppetserver 2.1.1
  
  5) upgrade PuppetDB from 2.3.7 to 3.0.2
  
  6) use the puppetlabs-puppet_agent forge module to upgrade agents to 4.2.1
  
  
 
 My biggest problem: there isn't any working dashboard working with Puppet 4. 
 The puppetdb APIv4 in puppet db 3.1 is not the same as the APIv4 in puppetdb 
 2, so all of them are now broken, even the one that thought they uses the v4 
 API.

 I had a lot of trouble with facter, it's rewritten but not tested on older 
 release, a few things were broken on Redhat 5 :
 https://tickets.puppetlabs.com/browse/FACT-1152
 https://tickets.puppetlabs.com/browse/FACT-1137
 
 If you use mcollective there is a bug that prevent installation of both 
 mcollective and puppet on the same server on Redhat 6 :
 https://tickets.puppetlabs.com/browse/PUP-4970
 and no one take care for this bug at puppetlabs.

That would have been a bit of a gotcha, but I don't manage repos with release 
rpms. It interferes with purging /etc/yum.repos.d.

 All the path change /etc/puppet, /usr/bin to /etc/puppetlab, /opt/puppetlabs. 
 Minor problems might arise from that, if you don't prepare that on puppet 
 modules, other management scripts.

I figure just adding some sync'ing before the upgrade would do it. Have to 
check if the puppet-agent rpm does anything to these files after the sync. 
Thank you!

 I hade no problem with embedded PKI, rsync -av /var/lib/puppet/ssl  
 /etc/puppetlabs/puppet/ is enough to keep it.
 
 Check your:
 [master]
 certname =...
 
 in puppet.conf. Rules changes slightly and I had problem with that.
 
 If you wrote you own modules, expect a lot of warning and broken modules 
 becase of new variable typing.
 
 Once the new server was up and running, I used this simple script on all the 
 nodes:
 [ -x  /opt/puppetlabs/bin/puppet ] || (\
 [ -x $(type -p facter) ]  \
 rpm -e puppetlabs-release  \
 rpm -Uvh  http://.../puppetlabs/$(facter 
 operatingsystemmajrelease)/PC1/x86_64/puppetlabs-release-pc1-0.9.2-1.el$(facter
  operatingsystemmajrelease).noarch.rpm  \
 yum install -y puppet-agent  \
 rsync -av /var/lib/puppet/ssl  /etc/puppetlabs/puppet/  \
 /opt/puppetlabs/bin/puppet agent -v --onetime --no-daemonize --no-show_diff 
 --pluginsource puppet:///plugins --use_srv_records  \
 service mcollective restart
 
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Puppet Users group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to puppet-users+unsubscr...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/puppet-users/88164374-6100-425D-B7D1-C4C944B35642%40orange.fr.
 For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/20150826111034.GA14773%40iniquitous.heresiarch.ca.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-26 Thread Christopher Wood
(Following up to myself.)

My current set of puppetdb classes do not have an easy upgrade path, especially 
given how I macgyvered in the capacity to manage certificate whitelisting. 
However I'm still not sure I care about past data in (appliance'y) puppetdb 
enough to upgrade anything. I may just build a new puppetdb server and point 
the puppetmasters at it.

-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/20150826111940.GA15065%40iniquitous.heresiarch.ca.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-26 Thread Stefan Heijmans

On Wednesday, August 26, 2015 at 10:16:59 AM UTC+2, Fabrice Bacchella wrote:


  Le 24 août 2015 à 21:59, Christopher Wood christop...@pobox.com 
 javascript: a écrit : 
  
 My biggest problem: there isn't any working dashboard working with Puppet 
 4. The puppetdb APIv4 in puppet db 3.1 is not the same as the APIv4 in 
 puppetdb 2, so all of them are now broken, even the one that thought they 
 uses the v4 API. 

 
Hopefully PuppetDB 3.x.x will support Puppet 3 clients again, like 
PuppetServer.
 
In the PuppetDB release notes is says that version 2.3.0 supports Puppet 4 
[1], so will this not work together with PuppetExplorer 1.5.0 [2]?
 
1. https://docs.puppetlabs.com/puppetdb/latest/release_notes.html#section-11 
2. https://github.com/spotify/puppetexplorer/releases/tag/1.5.0
 
Stefan
 
 

-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/f359ca60-1b0d-4fac-96c3-dfba460995fc%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-26 Thread Pete Harvey
On 26 August 2015 at 09:16, Fabrice Bacchella
fabrice.bacche...@orange.fr wrote:
 My biggest problem: there isn't any working dashboard working with Puppet 4.

This. Our upgrade to 4 is essentially blocked until Foreman supports it.

Pete

-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/CADZuy8jTTM9OrgCKY%2B85oLbb5E%2BOrXPKyE8iKtyu6%3D7tqvPRfw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-24 Thread Wyatt Alt

On 8/24/15 12:59 PM, Christopher Wood wrote:

(Although I may dump/restore the data via puppetdb since that's the actual api 
to the data, we do not log in via PostgreSQL.)

Others can speak to the rest of the plan, but just to clarify in case 
I'm understanding you right: the PuppetDB import/export tools are not 
intended to work across different versions of PDB, so an export of 2.x 
data will not be importable on 3.x. I can see that this is a hole in our 
documentation, which I'll fix up in a minute.


Instead, the necessary data migrations will be handled by the upgrade 
itself on the first startup of PuppetDB 3.0. Taking a pg_dump or 
PuppetDB export for a backup prior to the upgrade is still a prudent 
thing to do in case a downgrade is required, but that will only allow 
you to restore from the version you came from (possibly earlier ones too 
in the export case, but only by happenstance). For your use case I'd 
recommend pg_dump over PuppetDB export since it'll run a lot faster, but 
either one will get the job done.


Wyatt

--
You received this message because you are subscribed to the Google Groups Puppet 
Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/55DB8009.6080300%40puppetlabs.com.
For more options, visit https://groups.google.com/d/optout.


[Puppet Users] how were your puppet 3-4 upgrades?

2015-08-24 Thread Christopher Wood
I am not seeing a large amount of blog entries complaining about this upgrade, 
how has that gone for you? Is there anything you found particularly painful? 
Would you have done anything different in retrospect?

I'm staring down a 3.7.2 - 4.2.1 upgrade and after reading a number of docs 
the back-of-the-envelope optimal upgrade path is as follows. If any of you have 
commentary I am quite interested, otherwise I will try it and see what happens. 
I feel like this might be more time-consuming work but less brainpower effort 
than just yanking everything to 4.2.

1) rpms up to puppet 3.8

PostgreSQL 8.4 to 9.4
PuppetDB 2.2.2 to 2.3.7
(puppetdb-terminus from 2.2.2 to 2.3.7)
Puppet 3.7.2 to 3.8.2

2) enable the future parser

3) replace puppet 3.8.2, passenger 5 with puppetserver 1.1.1

4) replace puppetserver 1.1.1 with puppetserver 2.1.1

5) upgrade PuppetDB from 2.3.7 to 3.0.2

6) use the puppetlabs-puppet_agent forge module to upgrade agents to 4.2.1


My reading:

https://docs.puppetlabs.com/puppet/latest/reference/

https://docs.puppetlabs.com/puppet/4.2/reference/upgrade_major_pre.html
https://docs.puppetlabs.com/puppet/4.2/reference/upgrade_major_server.html
https://docs.puppetlabs.com/puppet/4.2/reference/upgrade_major_agent.html
https://docs.puppetlabs.com/puppet/4.2/reference/upgrade_major_post.html

https://forge.puppetlabs.com/puppetlabs/puppet_agent

https://docs.puppetlabs.com/puppetdb/2.3/upgrade.html

http://docs.puppetlabs.com/puppetdb/3.0/upgrade.html

http://www.postgresql.org/docs/9.4/static/upgrading.html

(Although I may dump/restore the data via puppetdb since that's the actual api 
to the data, we do not log in via PostgreSQL.)

-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/20150824195938.GA28076%40iniquitous.heresiarch.ca.
For more options, visit https://groups.google.com/d/optout.


Re: [Puppet Users] how were your puppet 3-4 upgrades?

2015-08-24 Thread Christopher Wood
I will be snapshotting the VM to lower the rollback effort there, but good 
point at that. Otherwise that saves me a bunch of preprod fiddling, thank you.

On Mon, Aug 24, 2015 at 01:35:21PM -0700, Wyatt Alt wrote:
 On 8/24/15 12:59 PM, Christopher Wood wrote:
 (Although I may dump/restore the data via puppetdb since that's the actual 
 api to the data, we do not log in via PostgreSQL.)
 
 Others can speak to the rest of the plan, but just to clarify in case I'm
 understanding you right: the PuppetDB import/export tools are not intended
 to work across different versions of PDB, so an export of 2.x data will not
 be importable on 3.x. I can see that this is a hole in our documentation,
 which I'll fix up in a minute.
 
 Instead, the necessary data migrations will be handled by the upgrade itself
 on the first startup of PuppetDB 3.0. Taking a pg_dump or PuppetDB export
 for a backup prior to the upgrade is still a prudent thing to do in case a
 downgrade is required, but that will only allow you to restore from the
 version you came from (possibly earlier ones too in the export case, but
 only by happenstance). For your use case I'd recommend pg_dump over PuppetDB
 export since it'll run a lot faster, but either one will get the job done.
 
 Wyatt
 
 -- 
 You received this message because you are subscribed to the Google Groups 
 Puppet Users group.
 To unsubscribe from this group and stop receiving emails from it, send an 
 email to puppet-users+unsubscr...@googlegroups.com.
 To view this discussion on the web visit 
 https://groups.google.com/d/msgid/puppet-users/55DB8009.6080300%40puppetlabs.com.
 For more options, visit https://groups.google.com/d/optout.

-- 
You received this message because you are subscribed to the Google Groups 
Puppet Users group.
To unsubscribe from this group and stop receiving emails from it, send an email 
to puppet-users+unsubscr...@googlegroups.com.
To view this discussion on the web visit 
https://groups.google.com/d/msgid/puppet-users/20150824222044.GA28904%40iniquitous.heresiarch.ca.
For more options, visit https://groups.google.com/d/optout.