Re: [ansible-project] Playbook organization with var files
you can already set plugins paths in ansible.cfg, as for group/host_vars they are also relative to inventory, which I guess you share across plays, so it all can already be organized 'globally' -- Brian Coca -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CAJ5XC8k6qtU0x8NQe9Jet5xntLr1KkQ1743V55U0kb5sghJORQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
[ansible-project] Playbook organization with var files
I have the same issues trying to manage a ton of playbooks that all use the same resources (which is how I stumbled upon this). However, after reading the comments, I think I better understand where Ansible is coming from. (people who know I'm sure will correct me if I'm wrong) It seems as though Ansible considers each playbook tied to an inventory and group_vars are also explicitly tied to inventory. Therefore, it would reason that if you want to logically separate your playbooks into subdirectories, the separation should be along inventory boundaries such that the group_vars/ mostly do not need to be shared between playbook subdirs. Furthermore, if you do have resources that are shared (./group_vars/all, ./library/, ./filter_plugins/, &c), then you can accomplish this with symlinks. That being said, it would be nice to have an option for ansible-playbook that set a reference directory. e.g. $ ansible-playbook -i thesehosts playbooks/thesehosts/this_playbook.yml --shared_dir=. or $ ANISBLE_PATH=. ansible-playbook -i thesehosts playbooks/thesehosts/this_playbook.yml which would avoid the need for symlinks. Of course ... could all of this be avoided if we put ALL shared resources in /etc/ansible/ ? roles, group_vars, filter_plugins, &c? -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CADBUY_iXJw7Bie%3DMZhrqFSdCo1FyH5oFhN-iXL%2BbZYsFUVsFvQ%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [ansible-project] Playbook organization with var files
group_vars are inventory related, vars_files are play related, I'm not sure what the confusion or hardship comes from. I do mostly use group_vars relative to the inventory dir, not the plays. -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CADn%2BHsxE%3Dw3kU4kEmSARB_ikSoTKSLgtmfTUMHt-vD-wacR_Qg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [ansible-project] Playbook organization with var files
So how do you solve loading group_vars automatically? Or if you don't, how do you resolve the differences between how group_vars are treated when automatically loaded vs loading them explicitly with vars_files ? That's the issue that led me on this wild chase. On Fri, Jul 18, 2014 at 10:46 AM, Brian Coca wrote: > I have many more playbooks than that, I use subdirs and symlinks for common > resource files and directories, I don't see it as a big issue. I have also > been consolidating many tings into roles, which simplifies the sharing. > > -- > You received this message because you are subscribed to the Google Groups > "Ansible Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to ansible-project+unsubscr...@googlegroups.com. > To post to this group, send email to ansible-project@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/ansible-project/CADn%2BHswC_LkgYbCvXpp-rHyE7%3DGFdOsEsRQFm-coPBHCvax%3DoA%40mail.gmail.com. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CAJQqANeVhXNdVTOpBH35EiKLMzZnBpDqPkPgEOveoycSwryTbA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [ansible-project] Playbook organization with var files
I have many more playbooks than that, I use subdirs and symlinks for common resource files and directories, I don't see it as a big issue. I have also been consolidating many tings into roles, which simplifies the sharing. -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CADn%2BHswC_LkgYbCvXpp-rHyE7%3DGFdOsEsRQFm-coPBHCvax%3DoA%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [ansible-project] Playbook organization with var files
I don't want to change the current behavior, just add to it. This wouldn't stop using the playbook basedir as the primary place to look. But you're right, it would change the execution based on where you execute the command. But only if you were using the cwd feature. This wouldn't stop using the playbook basedir as the primary place to look. If there's a better way than I'm open to it. Maybe it's a flag that can be turned on per playbook? Or maybe a playbook can have a search_paths parameter to list places to look. Or something else? All of this cwd discussion comes out of the fact that I'm trying to avoid having 50+ (now, likely closer to 100 later on) playbooks littering a single directory. If there's a better way, I'm open to it. On Fri, Jul 18, 2014 at 10:23 AM, Brian Coca wrote: > You want to change behavior from relative to playbook to relative to where > you run them from? I find that less intuitive, having it relative to > playbook gives you clear 'packaging', if I decide to run the playbook when > I'm in /var/tmp and now it behaves differently, I would find that very > confusing. > > -- > You received this message because you are subscribed to the Google Groups > "Ansible Project" group. > To unsubscribe from this group and stop receiving emails from it, send an > email to ansible-project+unsubscr...@googlegroups.com. > To post to this group, send email to ansible-project@googlegroups.com. > To view this discussion on the web visit > https://groups.google.com/d/msgid/ansible-project/CADn%2BHsxe7fv4S1r470LOc4SZrioDZQLf5P6rZBhH4uxQC7n%2B0A%40mail.gmail.com. > For more options, visit https://groups.google.com/d/optout. -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CAJQqANe%3DW6Dzh33%2BV-xPBC9WcSgm77wKAZhm%2B8m%2BZptKJAsAOg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [ansible-project] Playbook organization with var files
You want to change behavior from relative to playbook to relative to where you run them from? I find that less intuitive, having it relative to playbook gives you clear 'packaging', if I decide to run the playbook when I'm in /var/tmp and now it behaves differently, I would find that very confusing. -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CADn%2BHsxe7fv4S1r470LOc4SZrioDZQLf5P6rZBhH4uxQC7n%2B0A%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [ansible-project] Playbook organization with var files
On Thu, Jul 17, 2014 at 9:38 PM, Michael DeHaan wrote: > This is not because of cwd at all, but because of the playbook basedir. You're right that the cwd isn't causing the difference in behavior. I was trying to point out that it seems weird that playbooks behave differently depending on where they are located. And these differences are more than just path differences. And that using the cwd in addition to the playbook basedir would remove these differences for lots of cases. But you're right that it wouldn't remove them for all cases because things could still not work if your cwd wasn't the same between executions. At the very least the docs should mention that you shouldn't put playbooks in subdirectories if that's an unsupported setup or at least mention what things won't work right if you do. -- You received this message because you are subscribed to the Google Groups "Ansible Project" group. To unsubscribe from this group and stop receiving emails from it, send an email to ansible-project+unsubscr...@googlegroups.com. To post to this group, send email to ansible-project@googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ansible-project/CAJQqANcvd_%3DM-tigKEpDNo7JNWGigPAQHFnL%3Dnz0HMX06TvYAg%40mail.gmail.com. For more options, visit https://groups.google.com/d/optout.
Re: [ansible-project] Playbook organization with var files
"But it does matter in some. I can't get playbooks that aren't in the same directory as group_vars to behave like those that are." This is not because of cwd at all, but because of the playbook basedir. On Thu, Jul 17, 2014 at 2:03 PM, Michael Peters wrote: > On Thu, Jul 17, 2014 at 1:45 PM, Michael DeHaan > wrote: > > I don't feel the cwd should matter in most cases and it should not be > > significant. > > But it does matter in some. I can't get playbooks that aren't in the > same directory as group_vars to behave like those that are. And > there's nothing in the documentation that makes this obvious as to why > or that says that using subdirectories to organize playbooks is a bad > idea. > > > Ansible already looks for group_vars relative to the playbook dir, so > > keeping your top level playbooks in the same directory is recommended. > > Am I doing something wrong by having so many playbooks? This is a > fairly smallish project with 20 roles, a site.yml, and 20+ other > playbooks for orchestrating other common tasks. And that's not > counting any of the multiple task files in roles that are included. > That right there is getting close to 50 playbook files sitting at the > top level if I did it that way. And this project is just getting > started. > > Using the cwd as an extra path lookup seems like a pretty easy way to > add this capability without any problems that I can see. > > > On Thu, Jul 17, 2014 at 9:21 AM, Michael Peters < > michael00pet...@gmail.com> > > wrote: > >> > >> I do use roles rather extensively for configuration management tasks. > >> But for other (more orchestration related) tasks it doesn't seem to > >> make much sense or at least I'm not seeing how best to organize that. > >> For a more concrete example I have some mysql databases, some acting > >> as master nodes some as read-only slaves. There is a mysql role and a > >> mysql slave role that takes care of making sure the servers are > >> provisioned and configured correctly. But I also have a playbook used > >> when setting up (or resetting) replication between a master and a > >> slave. This playbook uses some local actions, delegate_to takes and > >> some templates and variables from both of those other roles. So it > >> doesn't really belong to either role and making it it's own role would > >> involve duplicating the things it currently shares with those roles > >> (for instance, roles can't share templates). > >> > >> But even turning all these orchestration playbooks into roles doesn't > >> reduce the clutter at the top level since roles can't be executed by > >> themselves. I'd still need lots of top-level playbooks that called > >> these roles. And I'm not sure different repos really help that much > >> either. I'm trying to keep things simple and reduce copy-paste. Having > >> things in separate repos would increase the amount of things that need > >> to be copied between those repos. > >> > >> A lot of these problems could be solved if ansible could look for > >> group_vars in the CWD. Would that cause other problems? > >> > >> On Wed, Jul 16, 2014 at 7:52 PM, Michael DeHaan > >> wrote: > >> > I'd consider using roles and just making your role path configurable, > >> > which > >> > would still make it easy to keep all your plays in whatever location > you > >> > like. > >> > > >> > (You could even keep roles in different repos, etc) > >> > > >> > > >> > > >> > On Wed, Jul 16, 2014 at 5:57 PM, Michael Peters > >> > > >> > wrote: > >> >> > >> >> I'm looking for advice about how to organize my playbooks. Not so > much > >> >> the content as their structure on the file system. > >> >> > >> >> Currently I have all of my configuration management (role-level) > >> >> playbooks at the top level with things like common.yml, app.yml, > >> >> db.yml, etc. These correspond directly to roles and are pretty much > >> >> just like the examples in > >> >> > http://docs.ansible.com/playbooks_best_practices.html#directory-layout > >> >> (along with a site.yml to run through them all for the whole > cluster). > >> >> > >> >> But I also have a bunch of playbooks for doing various things like > >> >> rolling upgrades of certain applications, updating configurations of > >> >> other applications, creating DB snapshots and replication, AWS server > >> >> creation, etc. I've started to accumulate a lot of these and have > >> >> started to put them into a plays/ directory organized into per-topic > >> >> subdirectories. This involved a little bit of rewriting so that all > of > >> >> the paths (files, templates, etc) need "../../" path prefixes since > >> >> they were being loaded relative to the playbook and not the cwd. Not > >> >> too bad. > >> >> > >> >> But this means that the variables in group_vars, host_vars, etc > aren't > >> >> loaded automatically. I've tried putting boilerplate "vars_files" to > >> >> load everything it needs that looks something like this: > >> >> > >> >> vars_files: > >> >> - ../../group_vars/
Re: [ansible-project] Playbook organization with var files
On Thu, Jul 17, 2014 at 1:45 PM, Michael DeHaan wrote:
> I don't feel the cwd should matter in most cases and it should not be
> significant.
But it does matter in some. I can't get playbooks that aren't in the
same directory as group_vars to behave like those that are. And
there's nothing in the documentation that makes this obvious as to why
or that says that using subdirectories to organize playbooks is a bad
idea.
> Ansible already looks for group_vars relative to the playbook dir, so
> keeping your top level playbooks in the same directory is recommended.
Am I doing something wrong by having so many playbooks? This is a
fairly smallish project with 20 roles, a site.yml, and 20+ other
playbooks for orchestrating other common tasks. And that's not
counting any of the multiple task files in roles that are included.
That right there is getting close to 50 playbook files sitting at the
top level if I did it that way. And this project is just getting
started.
Using the cwd as an extra path lookup seems like a pretty easy way to
add this capability without any problems that I can see.
> On Thu, Jul 17, 2014 at 9:21 AM, Michael Peters
> wrote:
>>
>> I do use roles rather extensively for configuration management tasks.
>> But for other (more orchestration related) tasks it doesn't seem to
>> make much sense or at least I'm not seeing how best to organize that.
>> For a more concrete example I have some mysql databases, some acting
>> as master nodes some as read-only slaves. There is a mysql role and a
>> mysql slave role that takes care of making sure the servers are
>> provisioned and configured correctly. But I also have a playbook used
>> when setting up (or resetting) replication between a master and a
>> slave. This playbook uses some local actions, delegate_to takes and
>> some templates and variables from both of those other roles. So it
>> doesn't really belong to either role and making it it's own role would
>> involve duplicating the things it currently shares with those roles
>> (for instance, roles can't share templates).
>>
>> But even turning all these orchestration playbooks into roles doesn't
>> reduce the clutter at the top level since roles can't be executed by
>> themselves. I'd still need lots of top-level playbooks that called
>> these roles. And I'm not sure different repos really help that much
>> either. I'm trying to keep things simple and reduce copy-paste. Having
>> things in separate repos would increase the amount of things that need
>> to be copied between those repos.
>>
>> A lot of these problems could be solved if ansible could look for
>> group_vars in the CWD. Would that cause other problems?
>>
>> On Wed, Jul 16, 2014 at 7:52 PM, Michael DeHaan
>> wrote:
>> > I'd consider using roles and just making your role path configurable,
>> > which
>> > would still make it easy to keep all your plays in whatever location you
>> > like.
>> >
>> > (You could even keep roles in different repos, etc)
>> >
>> >
>> >
>> > On Wed, Jul 16, 2014 at 5:57 PM, Michael Peters
>> >
>> > wrote:
>> >>
>> >> I'm looking for advice about how to organize my playbooks. Not so much
>> >> the content as their structure on the file system.
>> >>
>> >> Currently I have all of my configuration management (role-level)
>> >> playbooks at the top level with things like common.yml, app.yml,
>> >> db.yml, etc. These correspond directly to roles and are pretty much
>> >> just like the examples in
>> >> http://docs.ansible.com/playbooks_best_practices.html#directory-layout
>> >> (along with a site.yml to run through them all for the whole cluster).
>> >>
>> >> But I also have a bunch of playbooks for doing various things like
>> >> rolling upgrades of certain applications, updating configurations of
>> >> other applications, creating DB snapshots and replication, AWS server
>> >> creation, etc. I've started to accumulate a lot of these and have
>> >> started to put them into a plays/ directory organized into per-topic
>> >> subdirectories. This involved a little bit of rewriting so that all of
>> >> the paths (files, templates, etc) need "../../" path prefixes since
>> >> they were being loaded relative to the playbook and not the cwd. Not
>> >> too bad.
>> >>
>> >> But this means that the variables in group_vars, host_vars, etc aren't
>> >> loaded automatically. I've tried putting boilerplate "vars_files" to
>> >> load everything it needs that looks something like this:
>> >>
>> >> vars_files:
>> >> - ../../group_vars/all.yml
>> >> - ../../group_vars/{{ ec2_tag_environment }}.yml
>> >> - ../../group_vars/{{ ec2_tag_role }}.yml
>> >>
>> >> (where ec2_tag_environment and ec2_tag_role are facts provided by
>> >> ec2.py that correspond to groups)
>> >>
>> >> Not only would that be annoying to have to copy/paste into each of
>> >> these playbooks, but this doesn't quite seem to work. Variables loaded
>> >> by vars_files don't seem to go into hostvars for that host. I assume
>> >> they are just gl
Re: [ansible-project] Playbook organization with var files
I don't feel the cwd should matter in most cases and it should not be
significant.
Ansible already looks for group_vars relative to the playbook dir, so
keeping your top level playbooks in the same directory is recommended.
On Thu, Jul 17, 2014 at 9:21 AM, Michael Peters
wrote:
> I do use roles rather extensively for configuration management tasks.
> But for other (more orchestration related) tasks it doesn't seem to
> make much sense or at least I'm not seeing how best to organize that.
> For a more concrete example I have some mysql databases, some acting
> as master nodes some as read-only slaves. There is a mysql role and a
> mysql slave role that takes care of making sure the servers are
> provisioned and configured correctly. But I also have a playbook used
> when setting up (or resetting) replication between a master and a
> slave. This playbook uses some local actions, delegate_to takes and
> some templates and variables from both of those other roles. So it
> doesn't really belong to either role and making it it's own role would
> involve duplicating the things it currently shares with those roles
> (for instance, roles can't share templates).
>
> But even turning all these orchestration playbooks into roles doesn't
> reduce the clutter at the top level since roles can't be executed by
> themselves. I'd still need lots of top-level playbooks that called
> these roles. And I'm not sure different repos really help that much
> either. I'm trying to keep things simple and reduce copy-paste. Having
> things in separate repos would increase the amount of things that need
> to be copied between those repos.
>
> A lot of these problems could be solved if ansible could look for
> group_vars in the CWD. Would that cause other problems?
>
> On Wed, Jul 16, 2014 at 7:52 PM, Michael DeHaan
> wrote:
> > I'd consider using roles and just making your role path configurable,
> which
> > would still make it easy to keep all your plays in whatever location you
> > like.
> >
> > (You could even keep roles in different repos, etc)
> >
> >
> >
> > On Wed, Jul 16, 2014 at 5:57 PM, Michael Peters <
> michael00pet...@gmail.com>
> > wrote:
> >>
> >> I'm looking for advice about how to organize my playbooks. Not so much
> >> the content as their structure on the file system.
> >>
> >> Currently I have all of my configuration management (role-level)
> >> playbooks at the top level with things like common.yml, app.yml,
> >> db.yml, etc. These correspond directly to roles and are pretty much
> >> just like the examples in
> >> http://docs.ansible.com/playbooks_best_practices.html#directory-layout
> >> (along with a site.yml to run through them all for the whole cluster).
> >>
> >> But I also have a bunch of playbooks for doing various things like
> >> rolling upgrades of certain applications, updating configurations of
> >> other applications, creating DB snapshots and replication, AWS server
> >> creation, etc. I've started to accumulate a lot of these and have
> >> started to put them into a plays/ directory organized into per-topic
> >> subdirectories. This involved a little bit of rewriting so that all of
> >> the paths (files, templates, etc) need "../../" path prefixes since
> >> they were being loaded relative to the playbook and not the cwd. Not
> >> too bad.
> >>
> >> But this means that the variables in group_vars, host_vars, etc aren't
> >> loaded automatically. I've tried putting boilerplate "vars_files" to
> >> load everything it needs that looks something like this:
> >>
> >> vars_files:
> >> - ../../group_vars/all.yml
> >> - ../../group_vars/{{ ec2_tag_environment }}.yml
> >> - ../../group_vars/{{ ec2_tag_role }}.yml
> >>
> >> (where ec2_tag_environment and ec2_tag_role are facts provided by
> >> ec2.py that correspond to groups)
> >>
> >> Not only would that be annoying to have to copy/paste into each of
> >> these playbooks, but this doesn't quite seem to work. Variables loaded
> >> by vars_files don't seem to go into hostvars for that host. I assume
> >> they are just globally scoped but I have other plays and included
> >> files that rely on things to be in hostvars and I'd rather not rewrite
> >> those just because the playbooks moved around (and sometimes they
> >> can't be changed because they are included in top-level playbooks
> >> too). I guess changing paths to files seems reasonable when moving
> >> things, but not the scope of variables.
> >>
> >> So, what am I doing wrong? Should I just have dozens (and in the
> >> future likely hundreds) or playbooks littered at the top level? Could
> >> ansible look for group_vars in the CWD as well as the location of the
> >> playbook? Something else?
> >>
> >> Thanks,
> >>
> >> --
> >> You received this message because you are subscribed to the Google
> Groups
> >> "Ansible Project" group.
> >> To unsubscribe from this group and stop receiving emails from it, send
> an
> >> email to ansible-project+unsubscr...@googlegroups.com.
> >> To post
Re: [ansible-project] Playbook organization with var files
I do use roles rather extensively for configuration management tasks.
But for other (more orchestration related) tasks it doesn't seem to
make much sense or at least I'm not seeing how best to organize that.
For a more concrete example I have some mysql databases, some acting
as master nodes some as read-only slaves. There is a mysql role and a
mysql slave role that takes care of making sure the servers are
provisioned and configured correctly. But I also have a playbook used
when setting up (or resetting) replication between a master and a
slave. This playbook uses some local actions, delegate_to takes and
some templates and variables from both of those other roles. So it
doesn't really belong to either role and making it it's own role would
involve duplicating the things it currently shares with those roles
(for instance, roles can't share templates).
But even turning all these orchestration playbooks into roles doesn't
reduce the clutter at the top level since roles can't be executed by
themselves. I'd still need lots of top-level playbooks that called
these roles. And I'm not sure different repos really help that much
either. I'm trying to keep things simple and reduce copy-paste. Having
things in separate repos would increase the amount of things that need
to be copied between those repos.
A lot of these problems could be solved if ansible could look for
group_vars in the CWD. Would that cause other problems?
On Wed, Jul 16, 2014 at 7:52 PM, Michael DeHaan wrote:
> I'd consider using roles and just making your role path configurable, which
> would still make it easy to keep all your plays in whatever location you
> like.
>
> (You could even keep roles in different repos, etc)
>
>
>
> On Wed, Jul 16, 2014 at 5:57 PM, Michael Peters
> wrote:
>>
>> I'm looking for advice about how to organize my playbooks. Not so much
>> the content as their structure on the file system.
>>
>> Currently I have all of my configuration management (role-level)
>> playbooks at the top level with things like common.yml, app.yml,
>> db.yml, etc. These correspond directly to roles and are pretty much
>> just like the examples in
>> http://docs.ansible.com/playbooks_best_practices.html#directory-layout
>> (along with a site.yml to run through them all for the whole cluster).
>>
>> But I also have a bunch of playbooks for doing various things like
>> rolling upgrades of certain applications, updating configurations of
>> other applications, creating DB snapshots and replication, AWS server
>> creation, etc. I've started to accumulate a lot of these and have
>> started to put them into a plays/ directory organized into per-topic
>> subdirectories. This involved a little bit of rewriting so that all of
>> the paths (files, templates, etc) need "../../" path prefixes since
>> they were being loaded relative to the playbook and not the cwd. Not
>> too bad.
>>
>> But this means that the variables in group_vars, host_vars, etc aren't
>> loaded automatically. I've tried putting boilerplate "vars_files" to
>> load everything it needs that looks something like this:
>>
>> vars_files:
>> - ../../group_vars/all.yml
>> - ../../group_vars/{{ ec2_tag_environment }}.yml
>> - ../../group_vars/{{ ec2_tag_role }}.yml
>>
>> (where ec2_tag_environment and ec2_tag_role are facts provided by
>> ec2.py that correspond to groups)
>>
>> Not only would that be annoying to have to copy/paste into each of
>> these playbooks, but this doesn't quite seem to work. Variables loaded
>> by vars_files don't seem to go into hostvars for that host. I assume
>> they are just globally scoped but I have other plays and included
>> files that rely on things to be in hostvars and I'd rather not rewrite
>> those just because the playbooks moved around (and sometimes they
>> can't be changed because they are included in top-level playbooks
>> too). I guess changing paths to files seems reasonable when moving
>> things, but not the scope of variables.
>>
>> So, what am I doing wrong? Should I just have dozens (and in the
>> future likely hundreds) or playbooks littered at the top level? Could
>> ansible look for group_vars in the CWD as well as the location of the
>> playbook? Something else?
>>
>> Thanks,
>>
>> --
>> You received this message because you are subscribed to the Google Groups
>> "Ansible Project" group.
>> To unsubscribe from this group and stop receiving emails from it, send an
>> email to ansible-project+unsubscr...@googlegroups.com.
>> To post to this group, send email to ansible-project@googlegroups.com.
>> To view this discussion on the web visit
>> https://groups.google.com/d/msgid/ansible-project/CAJQqANc0O8Ga42UxRLcgcJJrCcRGZ%3D8bj%3DSpEyNop5ftSMZXPw%40mail.gmail.com.
>> For more options, visit https://groups.google.com/d/optout.
>
>
> --
> You received this message because you are subscribed to the Google Groups
> "Ansible Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to ansible
Re: [ansible-project] Playbook organization with var files
I'd consider using roles and just making your role path configurable, which
would still make it easy to keep all your plays in whatever location you
like.
(You could even keep roles in different repos, etc)
On Wed, Jul 16, 2014 at 5:57 PM, Michael Peters
wrote:
> I'm looking for advice about how to organize my playbooks. Not so much
> the content as their structure on the file system.
>
> Currently I have all of my configuration management (role-level)
> playbooks at the top level with things like common.yml, app.yml,
> db.yml, etc. These correspond directly to roles and are pretty much
> just like the examples in
> http://docs.ansible.com/playbooks_best_practices.html#directory-layout
> (along with a site.yml to run through them all for the whole cluster).
>
> But I also have a bunch of playbooks for doing various things like
> rolling upgrades of certain applications, updating configurations of
> other applications, creating DB snapshots and replication, AWS server
> creation, etc. I've started to accumulate a lot of these and have
> started to put them into a plays/ directory organized into per-topic
> subdirectories. This involved a little bit of rewriting so that all of
> the paths (files, templates, etc) need "../../" path prefixes since
> they were being loaded relative to the playbook and not the cwd. Not
> too bad.
>
> But this means that the variables in group_vars, host_vars, etc aren't
> loaded automatically. I've tried putting boilerplate "vars_files" to
> load everything it needs that looks something like this:
>
> vars_files:
> - ../../group_vars/all.yml
> - ../../group_vars/{{ ec2_tag_environment }}.yml
> - ../../group_vars/{{ ec2_tag_role }}.yml
>
> (where ec2_tag_environment and ec2_tag_role are facts provided by
> ec2.py that correspond to groups)
>
> Not only would that be annoying to have to copy/paste into each of
> these playbooks, but this doesn't quite seem to work. Variables loaded
> by vars_files don't seem to go into hostvars for that host. I assume
> they are just globally scoped but I have other plays and included
> files that rely on things to be in hostvars and I'd rather not rewrite
> those just because the playbooks moved around (and sometimes they
> can't be changed because they are included in top-level playbooks
> too). I guess changing paths to files seems reasonable when moving
> things, but not the scope of variables.
>
> So, what am I doing wrong? Should I just have dozens (and in the
> future likely hundreds) or playbooks littered at the top level? Could
> ansible look for group_vars in the CWD as well as the location of the
> playbook? Something else?
>
> Thanks,
>
> --
> You received this message because you are subscribed to the Google Groups
> "Ansible Project" group.
> To unsubscribe from this group and stop receiving emails from it, send an
> email to ansible-project+unsubscr...@googlegroups.com.
> To post to this group, send email to ansible-project@googlegroups.com.
> To view this discussion on the web visit
> https://groups.google.com/d/msgid/ansible-project/CAJQqANc0O8Ga42UxRLcgcJJrCcRGZ%3D8bj%3DSpEyNop5ftSMZXPw%40mail.gmail.com
> .
> For more options, visit https://groups.google.com/d/optout.
>
--
You received this message because you are subscribed to the Google Groups
"Ansible Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to ansible-project+unsubscr...@googlegroups.com.
To post to this group, send email to ansible-project@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/ansible-project/CA%2BnsWgw78bwGP-f-YvMeyVBpEJM9WL9xw1eWYQryy1zMPbgYEw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
[ansible-project] Playbook organization with var files
I'm looking for advice about how to organize my playbooks. Not so much
the content as their structure on the file system.
Currently I have all of my configuration management (role-level)
playbooks at the top level with things like common.yml, app.yml,
db.yml, etc. These correspond directly to roles and are pretty much
just like the examples in
http://docs.ansible.com/playbooks_best_practices.html#directory-layout
(along with a site.yml to run through them all for the whole cluster).
But I also have a bunch of playbooks for doing various things like
rolling upgrades of certain applications, updating configurations of
other applications, creating DB snapshots and replication, AWS server
creation, etc. I've started to accumulate a lot of these and have
started to put them into a plays/ directory organized into per-topic
subdirectories. This involved a little bit of rewriting so that all of
the paths (files, templates, etc) need "../../" path prefixes since
they were being loaded relative to the playbook and not the cwd. Not
too bad.
But this means that the variables in group_vars, host_vars, etc aren't
loaded automatically. I've tried putting boilerplate "vars_files" to
load everything it needs that looks something like this:
vars_files:
- ../../group_vars/all.yml
- ../../group_vars/{{ ec2_tag_environment }}.yml
- ../../group_vars/{{ ec2_tag_role }}.yml
(where ec2_tag_environment and ec2_tag_role are facts provided by
ec2.py that correspond to groups)
Not only would that be annoying to have to copy/paste into each of
these playbooks, but this doesn't quite seem to work. Variables loaded
by vars_files don't seem to go into hostvars for that host. I assume
they are just globally scoped but I have other plays and included
files that rely on things to be in hostvars and I'd rather not rewrite
those just because the playbooks moved around (and sometimes they
can't be changed because they are included in top-level playbooks
too). I guess changing paths to files seems reasonable when moving
things, but not the scope of variables.
So, what am I doing wrong? Should I just have dozens (and in the
future likely hundreds) or playbooks littered at the top level? Could
ansible look for group_vars in the CWD as well as the location of the
playbook? Something else?
Thanks,
--
You received this message because you are subscribed to the Google Groups
"Ansible Project" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to ansible-project+unsubscr...@googlegroups.com.
To post to this group, send email to ansible-project@googlegroups.com.
To view this discussion on the web visit
https://groups.google.com/d/msgid/ansible-project/CAJQqANc0O8Ga42UxRLcgcJJrCcRGZ%3D8bj%3DSpEyNop5ftSMZXPw%40mail.gmail.com.
For more options, visit https://groups.google.com/d/optout.
