[ansible-devel] Why does ansible-test pylint consider "_" to be a "bad-name"?

2021-03-08 Thread Rich Megginson
Question about ansible-test sanity pylint - https://github.com/ansible/ansible/blob/stable-2.9/test/lib/ansible_test/_data/sanity/pylint/config/ansible-test.cfg#L28 - why is _ considered a bad variable name?  It is the standard, or at least de facto, way to ignore one of the return values from

Re: [ansible-project] intersection of groups in inventory

2021-02-19 Thread Rich Megginson
Something like this? https://docs.ansible.com/ansible/2.9/user_guide/intro_patterns.html#common-patterns On 2/19/21 11:15 AM, Mike Eggleston wrote: Hi, In my inventory file I have “[linux]” and “[development]” groups. I want to patch the intersection of those groups. I know for one I can

Re: [ansible-project] [WARNING]: - linux-system-roles.network was NOT installed successfully: Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/':

2021-02-02 Thread Rich Megginson
On 2/2/21 10:01 AM, ursa Brown wrote: in rhel-system-roles package the geerlinguy or haproxy role is not there. How will I use a geerlinguy haproxy role? I don't know, but I'm curious as to why you thought the "geerlinguy haproxy" role was provided by the linux-system-roles or

Re: [ansible-project] [WARNING]: - linux-system-roles.network was NOT installed successfully: Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/':

2021-02-02 Thread Rich Megginson
On 2/2/21 8:27 AM, ursa Brown wrote: For start I only have a RHEL7 iso. In RHEL the package is called `rhel-system-roles`. On Tuesday, February 2, 2021 at 9:02:12 AM UTC-6 Richard Megginson wrote: On 2/1/21 7:33 PM, ursa Brown wrote: So the yum install linux-system-roles wont

Re: [ansible-project] [WARNING]: - linux-system-roles.network was NOT installed successfully: Unknown error when attempting to call Galaxy at 'https://galaxy.ansible.com/api/':

2021-02-02 Thread Rich Megginson
On 2/1/21 7:33 PM, ursa Brown wrote: So the yum install linux-system-roles wont fix this? Yes, you can use `yum install linux-system-roles` - what platform are you using for your Ansible controller node?  Fedora 32/33? On Monday, February 1, 2021 at 4:34:17 PM UTC-6 jbor...@gmail.com

Re: [ansible-project] How to handle multi-host roles?

2021-01-21 Thread Rich Megginson
On 1/20/21 9:12 PM, Vladimir Botka wrote: On Wed, 20 Jan 2021 19:18:40 -0700 Rich Megginson wrote: shell> cat hosts hosta vpn=enabled hostb vpn=disabled hostc vpn=enabled The playbook - hosts: all gather_facts: false tasks: - add_h

Re: [ansible-project] How to handle multi-host roles?

2021-01-20 Thread Rich Megginson
On 1/20/21 6:16 PM, Vladimir Botka wrote: On Wed, 20 Jan 2021 15:45:00 -0700 Rich Megginson wrote: - hosts: some_arbitrary_name_of_my_group_of_vpn_hosts  roles:    - linux-system-roles.vpn or you can specify the hosts manually: - hosts: hosta,hostb,hostc roles:   - linux-system

Re: [ansible-project] How to handle multi-host roles?

2021-01-20 Thread Rich Megginson
On 1/20/21 6:40 PM, Vladimir Botka wrote: On Wed, 20 Jan 2021 15:45:00 -0700 Rich Megginson wrote: The use case is that e.g. some sort of per-host key could be defined as a host fact, and if the role is running on host b, and it needs to set up a tunnel with host a, it can look up the key

Re: [ansible-project] How to handle multi-host roles?

2021-01-20 Thread Rich Megginson
ually want a multi play playbook, where the first play minimally just is there to gather facts that the 2nd play needs.  You can then use `groups.whatever` and `hostvars` to access info about other hosts within a certain group. Do you have examples of this? On Wed, Jan 20, 2021 at 4:20 PM Rich

[ansible-project] How to handle multi-host roles?

2021-01-20 Thread Rich Megginson
I am unfamiliar with how administrators structure their inventories and playbooks with respect to roles that run against multiple hosts as a group.  We have two new system roles - vpn https://github.com/linux-system-roles/vpn and ha_cluster https://github.com/linux-system-roles/ha_cluster -

[ansible-devel] molecule with ansible 2.10?

2021-01-20 Thread Rich Megginson
Does molecule support ansible 2.10? I figured out that I have to `pip install molecule[docker]` and `ansible-galaxy collection install community.docker` to get the docker functionality, but molecule still fails: `ERROR! couldn't resolve module/action 'docker_container'. This often indicates a

[ansible-devel] How to catch and re-raise errors from inner blocks

2020-11-13 Thread Rich Megginson
I don't know if anyone else has run into this, or if this is the right way to handle this case, but it works for me in Ansible 2.9 and 2.10: https://richm.github.io/how-to-catch-and-reraise-errors-in-ansible -- You received this message because you are subscribed to the Google Groups "Ansible

Re: Orphaning 'hub' (the git wrapper for Github)

2020-09-29 Thread Rich Megginson
On 9/29/20 8:55 AM, Stephen Gallagher wrote: Upstream is slowly dying out, since the official Github CLI[1] was announced. The latest upstream release doesn't pass the test suite on Golang 1.15[2] and I don't have the time to spare these days, so I'm going to orphan it and let someone else take

Re: [ansible-devel] Is there a way to denote modules/plugins that are private to a collection?

2020-09-24 Thread Rich Megginson
in a collection must handle the case where a user will use it directly? On Thu, Sep 24, 2020 at 12:12 PM Rich Megginson <mailto:rmegg...@redhat.com>> wrote: The linux-system-roles project has several roles that have modules that are used in the implementation of the role.

[ansible-devel] Is there a way to denote modules/plugins that are private to a collection?

2020-09-24 Thread Rich Megginson
The linux-system-roles project has several roles that have modules that are used in the implementation of the role.  However, once we convert to collections, all of these modules will be part of the public API of the collection.  Is there some way we can mark these modules as not usable or not

[ansible-devel] Converting roles to collections semantically with Ansible and ruamel

2020-09-22 Thread Rich Megginson
If you are converting your roles into a collection, and have to keep supporting the old roles format for the foreseeable future, and want to change your Ansible YAML files into collections format such that they match the roles format as closely as possible, you might be interested in

Re: [ansible-devel] Best way to provide vault password in CI

2020-09-17 Thread Rich Megginson
On 9/17/20 3:52 PM, 'Luke Schlather' via Ansible Development wrote: At the least, the overloading of --vault-password-file seems wrong. There should be a separate option --vault-password-script. (Though again, this seems like a very complicated way to avoid adding a simpler feature that would

Re: [ansible-devel] json parsing help

2020-08-30 Thread Rich Megginson
uot; see the examples under https://jinja.palletsprojects.com/en/2.11.x/templates/#map Thanks, Kevin On Sun, Aug 30, 2020 at 12:51 PM Rich Megginson <mailto:rmegg...@redhat.com>> wrote: On 8/29/20 3:18 PM, Kevin Hoyt wrote: Ahh got it!  ok, that worked.  1 m

Re: [ansible-devel] json parsing help

2020-08-30 Thread Rich Megginson
to each item? https://jinja.palletsprojects.com/en/2.11.x/templates/#map or https://docs.ansible.com/ansible/latest/user_guide/playbooks_filters.html#list-filters Thanks for the help! Kevin On Sat, Aug 29, 2020 at 3:32 PM Rich Megginson <mailto:rmegg...@redhat.com>> wrote: On

Re: [ansible-devel] json parsing help

2020-08-29 Thread Rich Megginson
On 8/29/20 1:20 PM, Kevin Hoyt wrote: Hi John, Thank you for the response.  I just tried it and got the following error: "msg": "template error while templating string: unexpected char u'\\u2018' at 63. String: {{ hc_pim_info.dpListProcessesReply.dpServiceList.dpService[0][‘@Name’] }}" Must

How to get updated Fedora 31 Cloud Image?

2020-05-27 Thread Rich Megginson
The Fedora 31 qcow2 cloud image e.g. http://mirrors.rit.edu/fedora/fedora/linux/releases/31/Cloud/x86_64/images/ was built with a buggy grub bootloader which causes problems like https://bugzilla.redhat.com/show_bug.cgi?id=1669252 How do I request a new Fedora 31 cloud image to be built and

Re: [ansible-devel] How to pass 'hosts' value to an included/imiported playbook?

2020-05-18 Thread Rich Megginson
On 5/18/20 12:48 PM, Peter Bi wrote:  I've playbook A to include roles to conduct an operation. Now I want to create playbook B to import/include playbook A but want to pass 'hosts' value to A. In other words, I want to make A to work dynamically with different hosts depending on the

Re: [ansible-devel] How to pylint and unit test module_utils code in my local module/role?

2020-03-06 Thread Rich Megginson
On 3/6/20 11:27 AM, Rich Megginson wrote: On 3/6/20 10:22 AM, Alan Rominger wrote: If you convert it to a collection you can use relative imports. I am in a very similar situation to you with the PYTHONPATH manipulation for testing. https://github.com/ansible/awx/blob

Re: [ansible-devel] How to pylint and unit test module_utils code in my local module/role?

2020-03-06 Thread Rich Megginson
, 2020 at 12:01 PM Rich Megginson <mailto:rmegg...@redhat.com>> wrote: When developing a role that has a local module with some code split into module_utils, how do you set up your pythonpath or venv so that pylint and unit testing resolves the imports correctly? Fo

[ansible-devel] How to pylint and unit test module_utils code in my local module/role?

2020-03-06 Thread Rich Megginson
When developing a role that has a local module with some code split into module_utils, how do you set up your pythonpath or venv so that pylint and unit testing resolves the imports correctly? For example: https://github.com/linux-system-roles/network/ The module code is in

[ansible-devel] script to scan projects for ansible 2.10 compatibility issues?

2020-03-02 Thread Rich Megginson
Is there a script to scan projects for ansible 2.10 compatibility issues? For example: - use of non-core ansible modules - use of "bare" module/role name where FQCN will be needed I'd like to add something like that to my CI. -- You received this message because you are subscribed to the

Re: [ansible-devel] How to run ansible 2.10 in a tox venv?

2020-02-28 Thread Rich Megginson
). This works. Thanks! On Thu, Feb 27, 2020 at 7:58 PM Rich Megginson <mailto:rmegg...@redhat.com>> wrote: https://github.com/ansible-collections/overview/blob/master/README.rst#pre-release-versions-of-ansible-base I think this should work? "Checkout and run the so

[ansible-devel] How to run ansible 2.10 in a tox venv?

2020-02-27 Thread Rich Megginson
https://github.com/ansible-collections/overview/blob/master/README.rst#pre-release-versions-of-ansible-base I think this should work? "Checkout and run the source https://github.com/ansible-collection-migration/ansible-base (pip install in a Python virtual environment, or do source

Re: The cluster-logging pods (Elasticsearch, Kibana, Fluentd) don't start - Openshift 4.1

2019-11-06 Thread Rich Megginson
e the minKubeVersion there, but if that doesn't trigger a redeployment, I'm not sure how to do that. Thank you. -Original Message- From: "Rich Megginson" [rmegg...@redhat.com] Date: 11/06/2019 01:21 PM To: users@lists.openshift.redhat.com Subject: Re: The cluster-logging pods (Elastic

Re: The cluster-logging pods (Elasticsearch, Kibana, Fluentd) don't start - Openshift 4.1

2019-11-06 Thread Rich Megginson
are you running into https://bugzilla.redhat.com/show_bug.cgi?id=1766343 ? On 11/6/19 9:19 AM, Full Name wrote: Hi all, I'm trying to deploy logging on Openshift cluster 4.1.21 using the procedure described in the following link

[389-devel] Re: Future of nunc-stans

2019-10-22 Thread Rich Megginson
On 10/22/19 8:28 PM, William Brown wrote: I think turbo mode was to try and shortcut returning to the conntable and then having the blocking on the connections poll because the locking strategies before weren't as good. I think there is still some value in turbo "for now" but if we can bring

[389-devel] Re: Future of nunc-stans

2019-10-08 Thread Rich Megginson
On 10/8/19 4:55 PM, William Brown wrote: Hi everyone, In our previous catch up (about 4/5 weeks ago when I was visiting Matus/Simon), we talked about nunc-stans and getting it at least cleaned up and into the code base. I've been looking at it again, and really thinking about it and

Re: [rsyslog] json properties

2019-09-17 Thread Rich Megginson via rsyslog
On 9/17/19 7:48 AM, Brian Candler via rsyslog wrote: On 17/09/2019 00:42, David Lang wrote: Just to confirm what I *think* is going on: $! is only the content which was parsed by mmjsonparse (otherwise empty or does not exist) $!all-json and $!all-json-plain are $! re-serialized as a JSON

Re: Elasticsearch Restart taking too long

2019-07-01 Thread Rich Megginson
What version of OKD are you using?  Did you check the Elasticsearch elastic.co docs? On 6/26/19 3:54 PM, bahhooo wrote: Hi all, When the elasticsearch pod within the logging stack is restarted, it takes a considerable amount  of time until the elastic cluster becomes green. The cluster

[389-devel] Re: Porting Perl scripts

2019-06-24 Thread Rich Megginson
On 6/24/19 10:00 AM, Mark Reynolds wrote: On 6/24/19 11:46 AM, Simon Pichugin wrote: Hi team, I am working on porting our admin Perl scripts to Python CLI. Please, check the list and share your opinion: - cl-dump.pl - dumps and decodes changelog. Is it used often (if at all)?

Re: [rsyslog] building rsyslog from cloned https://github.com/rsyslog/rsyslog.git issue on AmazonLinux

2019-06-13 Thread Rich Megginson via rsyslog
On 6/13/19 1:43 PM, Li, Mike via rsyslog wrote: Hi all, cat /etc/os-release NAME="Amazon Linux AMI" VERSION="2018.03" ID_LIKE="rhel fedora" VERSION_ID="2018.03" PRETTY_NAME="Amazon Linux AMI 2018.03" CPE_NAME="cpe:/o:amazon:linux:2018.03:ga"

Re: [rsyslog] Can we move various count of fields to the different level?

2019-05-29 Thread Rich Megginson via rsyslog
On 5/29/19 1:27 PM, Noriko Hosoi via rsyslog wrote: Hello rsyslog list, [1] is an example of pre-processed log.  We'd like to keep fields defined in the environment variable [3] in the top level, and move the rest to one level down as in [2].  In this example, 2 fields "test0" and "test1" are

[389-devel] Re: Logging future direction and ideas.

2019-05-10 Thread Rich Megginson
On 5/9/19 9:13 PM, William Brown wrote: Hi all, So I think it's time for me to write some logging code to improve the situation. Relevant links before we start: https://pagure.io/389-ds-base/issue/49415 http://www.port389.org/docs/389ds/design/logging-performance-improvement.html

Re: Redirect logs of a namespace to ops logging

2019-04-29 Thread Rich Megginson
You might try setting the env var OCP_OPERATIONS_PROJECTS in the fluentd daemonset: oc set env OCP_OPERATIONS_PROJECTS="default openshift openshift- kube-" https://github.com/openshift/origin-aggregated-logging/blob/release-3.10/fluentd/run.sh On 4/29/19 7:48 AM, bahhooo wrote: Hi all, In a

Re: [rsyslog] Rsyslog and elasticsearch

2019-04-12 Thread Rich Megginson via rsyslog
On 4/12/19 3:24 AM, David Lang via rsyslog wrote: to clarify, what elasticsearch and Splunk call an 'index' is not the same thing that you know of as an index under any other systems. An "Index" in Splunk or Elasticsearch is what Postgres/MYSql/Oracle/etc call a databass or table (it blurs

Re: [rsyslog] [E] Re: Help with newer syntax a ruleset and forwarding

2019-04-03 Thread Rich Megginson via rsyslog
: rsyslog [mailto:rsyslog-boun...@lists.adiscon.com] On Behalf Of Rich Megginson via rsyslog Sent: Wednesday, April 03, 2019 12:25 PM To: rsyslog@lists.adiscon.com Cc: Rich Megginson Subject: Re: [rsyslog] [E] Re: Help with newer syntax a ruleset and forwarding On 4/3/19 11:19 AM, Gorman, Kevin vi

Re: [rsyslog] [E] Re: Help with newer syntax a ruleset and forwarding

2019-04-03 Thread Rich Megginson via rsyslog
On 4/3/19 11:19 AM, Gorman, Kevin via rsyslog wrote: The *.* call linux_forward was the key. Much cleaner. Thanks! I also see the audit logs in the debug log and at the other end in tcpdump. I don't see the messages in the remote log system data, but that's another issue and product receiving

Re: How to use libcurl with a config file?

2019-03-22 Thread Rich Megginson via curl-library
On 3/22/19 3:51 PM, Daniel Stenberg wrote: On Wed, 20 Mar 2019, Rich Megginson via curl-library wrote: I'm writing a C application (rsyslog) which uses libcurl and I would like to be able to pass in a lot of parameters to libcurl without having to implement support for every single option

Re: Elasticsearch - 5.x

2019-03-21 Thread Rich Megginson
On 3/21/19 2:31 PM, Neale Ferguson wrote: Are you asking how to erase everything and start over? - No, just how to get information out of the elasticsearch container to tell me why it's failing. Can you share your inventory files with the logging parameters (be sure to redact

Re: Elasticsearch - 5.x

2019-03-21 Thread Rich Megginson
On 3/21/19 1:56 PM, Neale Ferguson wrote: > - So this leads to the question of how to debug the elasticsearch container not coming up. The console log information in the 1st email came from me running it manually so I could add the -v option to the elasticsearch command. Setting the

Re: Elasticsearch - 5.x

2019-03-21 Thread Rich Megginson
On 3/21/19 1:41 PM, Neale Ferguson wrote: elasticsearch 5 is not tech preview in 3.11 - it is fully supported - and 2.x is gone - Understood. Did that change with the move from 3.10 to 3.11? Yes I must've been scanning another host which was running 3.10 to spot those preview vars.

Re: Elasticsearch - 5.x

2019-03-21 Thread Rich Megginson
On 3/21/19 1:33 PM, Neale Ferguson wrote: On 3/21/19, 15:33, "Neale Ferguson" wrote: Right. The image is now https://hub.docker.com/r/openshift/origin-logging-elasticsearch5/tags - there are similar changes for origin-logging-curator5, origin-logging-kibana5,

Re: Elasticsearch - 5.x

2019-03-21 Thread Rich Megginson
On 3/21/19 1:23 PM, Neale Ferguson wrote: If I want to use the techpreview elasticsearch5 images are there any other changes I need to make as I am seeing this on startup: Found index level settings on node level configuration. Since elasticsearch 5.x index level settings can NOT be set on

How to use libcurl with a config file?

2019-03-20 Thread Rich Megginson via curl-library
I'm writing a C application (rsyslog) which uses libcurl and I would like to be able to pass in a lot of parameters to libcurl without having to implement support for every single option to pass in separately to curl_easy_setopt().  The curl cli has a -K option which you can use to pass in a

[389-devel] Re: [discuss] Entry cache and backend txn plugin problems

2019-02-26 Thread Rich Megginson
On 2/26/19 4:26 PM, William Brown wrote: On 26 Feb 2019, at 18:32, Ludwig Krispenz wrote: Hi, I need a bit of time to read the docs and clear my thoughts, but one comment below On 02/25/2019 01:49 AM, William Brown wrote: On 23 Feb 2019, at 02:46, Mark Reynolds wrote: I want to start a

Re: [rsyslog] Rsyslog vs syslog-ng

2019-02-05 Thread Rich Megginson via rsyslog
On 2/5/19 2:40 AM, Peter Viskup via rsyslog wrote: To be honest, the main reason Debian chosen rsyslog as primary syslog daemon was that it does work with "standard syslog" configuration (more information can be read on https://wiki.debian.org/Rsyslog ). Nevertheless in newest versions of

Re: [rsyslog] Parse & use date

2019-01-22 Thread Rich Megginson via rsyslog
Use a lookup table - https://www.rsyslog.com/doc/v8-stable/rainerscript/lookup_tables.html here are some examples of using a lookup table to map priority numeric values to log level string values, and log level values to their canonical representation:

Re: [rsyslog] Parse unstructured text using mmnormalize

2018-12-11 Thread Rich Megginson via rsyslog
Indeed there is http://www.liblognorm.com/files/manual/lognormalizer.html and it is incredibly useful On 12/11/18 4:18 PM, Joe Blow via rsyslog wrote: Isn't there a lognormalize command you can use to test this stuff with? I seem to remember being able to specify a rules file, and a log file,

Re: [rsyslog] mmnormalize - unable to load module

2018-12-05 Thread Rich Megginson via rsyslog
On 12/5/18 10:11 AM, Lavanya Kanchanapalli via rsyslog wrote: Hi, I am trying to use rsyslog to parse and structure unstructured text application logs (tomcat logs). Based on the documentation and example rsyslog recipes

Re: Regarding Logging

2018-11-21 Thread Rich Megginson
/* for evidence that fluentd is up and doing something. Thanks kasturi On Mon, Nov 19, 2018 at 9:21 PM Rich Megginson mailto:rmegg...@redhat.com>> wrote: Try unlabeling then relabeling the nodes: oc label node --all logging-infra-fluentd- wait a minute oc label node --all logging

Re: [rsyslog] Missing messages in our databases

2018-11-20 Thread Rich Megginson via rsyslog
Jacob's answer is better, but I'll answer your questions below. On 11/20/18 8:49 AM, Mike Schleif wrote: What am I missing? On Tue, Nov 20, 2018 at 9:15 AM Rich Megginson via rsyslog < rsyslog@lists.adiscon.com> wrote: You could try this: # debug output module(load="builtin:o

Re: [rsyslog] Missing messages in our databases

2018-11-20 Thread Rich Megginson via rsyslog
On 11/20/18 8:06 AM, Mike Schleif wrote: David, On Mon, Nov 19, 2018 at 2:52 PM David Lang wrote: On Mon, 19 Nov 2018, Mike Schleif wrote: How can I do that? in your config for writing to mysql you specify a template to use, use that same template to write to a file old syntax

Re: Regarding Logging

2018-11-19 Thread Rich Megginson
Try unlabeling then relabeling the nodes: oc label node --all logging-infra-fluentd- wait a minute oc label node --all logging-infra-fluentd=true On 11/19/18 8:44 AM, Kasturi Narra wrote: Hello,   Please find replies line On Mon, Nov 19, 2018 at 9:12 PM Rich Megginson mailto:rmegg

Re: Regarding Logging

2018-11-19 Thread Rich Megginson
On 11/19/18 8:32 AM, Kasturi Narra wrote: Hello Jeff,    yes , i do have it. Here is the output i have got. dhcp46-68.lab.eng.blr.redhat.com    Ready        6d        v1.9.1+a0ce1bc657

[ovirt-users] Re: Metrics Store installation - ansible playbook "deploy_cluster" - docker_image_availability

2018-11-15 Thread Rich Megginson
On 11/15/18 12:32 AM, Shirly Radco wrote: Hi, The user is trying to install OpenShift OKD 3.11 but hit the below error. TASK [openshift_logging : include_tasks]

Re: Logging module settings when installing okd 3.11.

2018-11-13 Thread Rich Megginson
https://github.com/openshift/release/pull/2042 On 11/13/18 6:17 AM, devops036 devops036 wrote: When installing okd 3.11 with the recently made available CentOS PaaS repo (http://mirror.centos.org/centos/7/paas/x86_64/openshift-origin311/), I can't activate the logging module

Re: [CentOS-devel] [CentOS PaaS SIG]: Origin v3.11 rpms available for testing

2018-10-18 Thread Rich Megginson
On 10/17/18 3:38 AM, Daniel Comnea wrote: Hi, We would like to announce that OKD v3.11 rpms are available for testing at [1]. As such we are calling for help from community to start testing and let us know if there are issues with the rpms and its dependencies. And in the spirit of

Re: [CentOS-devel] [CentOS PaaS SIG]: Origin v3.11 rpms available for testing

2018-10-18 Thread Rich Megginson
On 10/17/18 3:38 AM, Daniel Comnea wrote: Hi, We would like to announce that OKD v3.11 rpms are available for testing at [1]. As such we are calling for help from community to start testing and let us know if there are issues with the rpms and its dependencies. And in the spirit of

Re: CI automation location for RPMs is moving

2018-10-09 Thread Rich Megginson
fine. Thanks! On Oct 9, 2018, at 10:10 PM, Rich Megginson wrote: Was this ever fixed? Is this the cause of the website being currently unresponsive? On 9/10/18 2:33 PM, Clayton Coleman wrote: Interesting, might be an HAProxy router bug. Can you file one? On Mon, Sep 10, 2018 at 3:08 PM

Re: CI automation location for RPMs is moving

2018-10-09 Thread Rich Megginson
Was this ever fixed?  Is this the cause of the website being currently unresponsive? On 9/10/18 2:33 PM, Clayton Coleman wrote: Interesting, might be an HAProxy router bug.  Can you file one? On Mon, Sep 10, 2018 at 3:08 PM Seth Jennings mailto:sjenn...@redhat.com>> wrote: There is a

Re: Node names as IPs not hostnames

2018-10-09 Thread Rich Megginson
Are you hitting https://github.com/openshift/openshift-ansible/pull/9598 ? On 10/9/18 11:25 AM, Dan Pungă wrote: Thanks for the reply Scott! I've used the release branches for both 3.9 and 3.10 of the openshift-ansible project, yes. I've initially checked the openshift_facts.py script flow in

Re: Best file system for elasticsearch

2018-10-05 Thread Rich Megginson
The best filesystem for Elasticsearch is local disk.  Our performance team has tested on Gluster block storage and it does work, and it might perform well enough for your particular use case, but you'll have to do some testing to find out if it is suitable for your workload. On 10/5/18 3:06 AM,

Re: [rsyslog] Forwarding date folder named logs on an rsyslog server

2018-10-02 Thread Rich Megginson via rsyslog
On 10/2/18 4:39 AM, John Cooper via rsyslog wrote: Hi, our incoming syslogs are stored in date folders on the rsyslog server. We also want some of those logs forwarding to another server. Using imfile, the "File" name will change for the next day meaning we would have to update the config each

[rsyslog] Ansible role for rsyslog

2018-09-17 Thread Rich Megginson via rsyslog
As part of the linux system roles project, there has recently been activity in the area of a role for a system log collector.  Notably, there has been a recent contribution of an rsyslog role: https://github.com/linux-system-roles/logging/tree/master/roles/rsyslog - the work is based on the

Re: [rsyslog] Question on multiline log messages

2018-09-11 Thread Rich Megginson via rsyslog
https://github.com/rsyslog/rsyslog/pull/3014 On 09/06/2018 05:07 PM, Rich Megginson via rsyslog wrote: On 09/06/2018 12:49 PM, Rich Megginson wrote: On 09/06/2018 11:30 AM, David Lang wrote: On Thu, 6 Sep 2018, Rich Megginson wrote: On 09/06/2018 12:00 PM, Noriko Hosoi via rsyslog wrote

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
On 09/06/2018 12:49 PM, Rich Megginson wrote: On 09/06/2018 11:30 AM, David Lang wrote: On Thu, 6 Sep 2018, Rich Megginson wrote: On 09/06/2018 12:00 PM, Noriko Hosoi via rsyslog wrote: Thank you for your response, David. On 09/06/2018 06:18 AM, David Lang wrote: There is an option

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
On 09/06/2018 03:45 PM, David Lang wrote: On Thu, 6 Sep 2018, Rich Megginson wrote: Just to clarify - rsyslog does not currently support "multiline" docker json-file nor crio logs because there is no endmsg.regex - we would need to add support for that first in order to use mmnormal

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
On 09/06/2018 11:57 AM, David Lang wrote: On Thu, 6 Sep 2018, Rich Megginson wrote: That is, if multiline specifically means records like this: first line of recordA    recordA second line    recordA third line first line of recordB Perhaps Noriko and I mean something slightly different

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
On 09/06/2018 11:30 AM, David Lang wrote: On Thu, 6 Sep 2018, Rich Megginson wrote: On 09/06/2018 12:00 PM, Noriko Hosoi via rsyslog wrote: Thank you for your response, David. On 09/06/2018 06:18 AM, David Lang wrote: There is an option for imfile to split a file into multiline messages

Re: [rsyslog] Question on multiline log messages

2018-09-06 Thread Rich Megginson via rsyslog
On 09/06/2018 12:00 PM, Noriko Hosoi via rsyslog wrote: Thank you for your response, David. On 09/06/2018 06:18 AM, David Lang wrote: There is an option for imfile to split a file into multiline messages based on a regex, that is probably the right starting point. Yes, we also expected

Re: [rsyslog] mmkubernetes: how to handle 429 Busy response?

2018-08-30 Thread Rich Megginson via rsyslog
On 08/28/2018 08:20 PM, David Lang wrote: On Tue, 28 Aug 2018, Rich Megginson wrote: It would have to be done inside the module, rsyslog has back-off capabilities, but only when the entire pipeline is suspended. Another option is to handle 429 in mmkubernetes similar to how it is handled

Re: [rsyslog] mmkubernetes: how to handle 429 Busy response?

2018-08-28 Thread Rich Megginson via rsyslog
On 08/28/2018 06:56 PM, David Lang wrote: On Tue, 28 Aug 2018, Rich Megginson wrote: On 08/28/2018 06:20 PM, David Lang wrote: On Tue, 28 Aug 2018, Rich Megginson via rsyslog wrote: As part of the fix for https://github.com/rsyslog/rsyslog/pull/2962 I've added handling for error 429 Busy

Re: [rsyslog] mmkubernetes: how to handle 429 Busy response?

2018-08-28 Thread Rich Megginson via rsyslog
On 08/28/2018 06:20 PM, David Lang wrote: On Tue, 28 Aug 2018, Rich Megginson via rsyslog wrote: As part of the fix for https://github.com/rsyslog/rsyslog/pull/2962 I've added handling for error 429 Busy.  I've seen this most commonly with large Kubernetes clusters where if you have hundreds

Re: [rsyslog] kubernetes connection to masters

2018-08-28 Thread Rich Megginson via rsyslog
On 08/28/2018 06:23 PM, David Lang wrote: As we are looking at managing and securing our k8s install, we are finding that getting a token out of the pod/container runing the management processes is non-trivial, especially to get it onto a separate log server. would it be possible to add

[rsyslog] mmkubernetes: how to handle 429 Busy response?

2018-08-28 Thread Rich Megginson via rsyslog
As part of the fix for https://github.com/rsyslog/rsyslog/pull/2962 I've added handling for error 429 Busy.  I've seen this most commonly with large Kubernetes clusters where if you have hundreds of nodes, all with open connections to the Kubernetes API service, the service will eventually hit

Re: [logging] Re: EFK logging stack: including the Kafka output plugin and the multiline aggregation plugin

2018-08-20 Thread Rich Megginson
Thanks for this!  Will follow up in the PRs. On 08/20/2018 01:47 AM, Alessandro Menti wrote: Hi Rich And Louis, Please submit PRs against origin-aggregated-logging and openshift-ansible.  Note that for origin-aggregated-logging we will require integration testing, which may require the

Re: Logging / Kibana export Logs

2018-08-16 Thread Rich Megginson
You could expose Elasticsearch externally https://docs.okd.io/latest/install_config/aggregate_logging.html |openshift_logging_es_allow_external| Set to |true| to expose Elasticsearch as a reencrypt route. Set to |false| by default. Except that username/password and token auth is

Re: Openshift centralized logging - add custom container logfiles

2018-08-16 Thread Rich Megginson
On 08/16/2018 05:42 AM, Aleksandar Lazic wrote: Am 16.08.2018 um 12:48 schrieb Aleksandar Kostadinov: Might be real nice to allow pod to request sockets created where different log streams can be sent to central logging without extra containers in the pod. You can run socklog/fluentbit/... in

[389-users] Re: disk i/o: very high write rates and poor search performance

2018-08-15 Thread Rich Megginson
On 08/15/2018 10:56 AM, David Boreham wrote: On 8/15/2018 10:36 AM, Rich Megginson wrote: Updating the csn generator and the uuid generator will cause a lot of churn in dse.ldif.  There are other housekeeping tasks which will write dse.ldif But if those things were being done so

[389-users] Re: disk i/o: very high write rates and poor search performance

2018-08-15 Thread Rich Megginson
On 08/15/2018 10:13 AM, David Boreham wrote: in strace.log: [pid 8088] 12:55:39.739539 poll([{fd=435, events=POLLOUT}], 1, 180 [pid 8058] 12:55:39.739573 <... write resumed> ) = 1 <0.87> [pid 8088] 12:55:39.739723 <... poll resumed> ) = 1 ([{fd=435, revents=POLLOUT}]) <0.000168>

Re: [rsyslog] It's not necessary to separate JSON field with space?

2018-08-07 Thread Rich Megginson via rsyslog
If you are unable to submit a PR, then please submit an issue tracker. On 08/07/2018 08:14 AM, eSX wrote: I very much agree with this. There must be a lot of non-standard implementations for log parser. A flag/swith would be a good choice. I will submit PR if I have time. ;) Rich Megginson

Re: [rsyslog] It's not necessary to separate JSON field with space?

2018-08-07 Thread Rich Megginson via rsyslog
On 08/07/2018 03:26 AM, eSX via rsyslog wrote: Hi all When the log message part is JSON, a message processing like: parse json with mmjsonparser, process variables in $!. unset variables, e.g. unset $!foo!bar; Alright, send a processed message to next action. But there were some variables

Re: [rsyslog] omes in omelasticsearch should include more information

2018-08-02 Thread Rich Megginson via rsyslog
Here is an implementation of my proposal: https://github.com/rsyslog/rsyslog/pull/2906 and the doc changes https://github.com/rsyslog/rsyslog-doc/pull/714 On 08/02/2018 10:11 AM, Rich Megginson wrote: On 08/02/2018 09:44 AM, eSX wrote: Hi Rich,thanks for your reply. >  Is it accepta

Re: [rsyslog] omes in omelasticsearch should include more information

2018-08-02 Thread Rich Megginson via rsyslog
to keep the paramenters which generated by initial request is enough for now. A more easy way to configure omelasticsearch is all in one action, but it's hard to code and inflexible? In any case, I think it's necessary to keep the variables of initial request. Rich Megginson via rsyslog

Re: [rsyslog] omes in omelasticsearch should include more information

2018-08-02 Thread Rich Megginson via rsyslog
On 08/02/2018 01:18 AM, eSX via rsyslog wrote: Hello rsyslog omes is the retry information when omelasticsearch is in failure and retry. The contents of omes are response message from Elasticsearch mainly. But the response didn't give a full information for retring. What information is

[ovirt-users] Re: metrics

2018-07-24 Thread Rich Megginson
Mon, Jul 23, 2018 at 6:44 PM, Rich Megginson <mailto:rmegg...@redhat.com>> wrote: We're working on it.  Not sure what the problem is, but it looks like openshift origin 3.9 is just broken right now - due to a combination of ansible and openshift-ansible problems. Shirly

[ovirt-users] Re: metrics

2018-07-23 Thread Rich Megginson
eachable=0 failed=1 INSTALLER STATUS **** Initialization : Complete (0:00:22) Can I live with this error or is something I need to correct? Thanks -

[ovirt-users] Re: metrics

2018-07-19 Thread Rich Megginson
*De: *supo...@logicworks.pt *Para: *"Shirly Radco" *Cc: *"Rich Megginson" , "users" *Enviadas: *Quinta-feira, 19 De Julho de 2018 16:09:48 *Assunto: *Re: [ovirt-users] metrics # yum s

[ovirt-users] Re: metrics

2018-07-19 Thread Rich Megginson
tils-3.9.0-0.53.0.git.1.af49d87.el7.noarch CentOS Linux release 7.5.1804 (Core) Any help? Thanks José ---- *De: *"Rich Megginson" *Para: *"Shirly Radco" , supo...@logicworks.pt *Cc: *"users" *

Re: EFK logging stack: including the Kafka output plugin and the multiline aggregation plugin

2018-07-18 Thread Rich Megginson
Please submit PRs against origin-aggregated-logging and openshift-ansible.  Note that for origin-aggregated-logging we will require integration testing, which may require the installation of kafka by the test, and some form of documentation i.e. a markdown doc for the docs/ subdir. To

Re: [openstack-dev] [kolla-ansible] how do I unify log data format

2018-07-14 Thread Rich Megginson
On 07/14/2018 07:29 AM, Sergey Glazyrin wrote: Hello guys! We are migrating our product to kolla-ansible and as far as probably you know, it uses fluentd to control logs, etc. In non containerized openstack we use rsyslog to send data to logstash. Why not use rsyslog in containerized

Re: [rsyslog] mmnormalize/mmkubernetes matching problem

2018-07-02 Thread Rich Megginson via rsyslog
On 07/02/2018 11:31 AM, David Lang wrote: On Mon, 2 Jul 2018, Rich Megginson wrote: On 06/29/2018 08:16 PM, David Lang wrote: On Fri, 29 Jun 2018, Rich Megginson via rsyslog wrote: On 06/29/2018 06:49 PM, David Lang wrote: On Fri, 29 Jun 2018, Rich Megginson via rsyslog wrote: On 06/29

Re: [rsyslog] mmnormalize/mmkubernetes matching problem

2018-07-02 Thread Rich Megginson via rsyslog
On 06/29/2018 09:02 PM, David Lang wrote: One other thing that I would like to see is an example of "I have the namespace and pod name for this log, now go fetch the data from the API for me". When does that happen?  That is, what is the use case when you are not immediately trying to

Re: [rsyslog] mmnormalize/mmkubernetes matching problem

2018-07-02 Thread Rich Megginson via rsyslog
On 06/29/2018 08:16 PM, David Lang wrote: On Fri, 29 Jun 2018, Rich Megginson via rsyslog wrote: On 06/29/2018 06:49 PM, David Lang wrote: On Fri, 29 Jun 2018, Rich Megginson via rsyslog wrote: On 06/29/2018 03:08 PM, David Lang wrote: the filename I have is: $!:{ "metadata": {

Re: [rsyslog] mmnormalize/mmkubernetes matching problem

2018-06-29 Thread Rich Megginson via rsyslog
On 06/29/2018 06:49 PM, David Lang wrote: On Fri, 29 Jun 2018, Rich Megginson via rsyslog wrote: On 06/29/2018 03:08 PM, David Lang wrote: the filename I have is: $!:{ "metadata": { "filename": "\/var\/log\/containers\/calico-node-jlhg

  1   2   3   4   5   6   7   8   9   10   >