[ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hi all, since some days my hosted-engine environments (one RHEV 4.0.7, one ovirt 4.1.7) continue to send mails about changes between EngineUp and EngineBadHealth. This is pretty annoying and i'm not able to find out the root cause. The only issue i've seen on hosts is this error appearing someti

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

We have had a similar issue that has been resolved with restarting the engine vps.  Not ideal but it solves the problem for a about a month. /JohanOn Fri, 2017-12-01 at 10:50 +0100, Luca 'remix_tj' Lorenzetto wrote: > Hi all, > > since some days my hosted-engine environments (one RHEV 4.0.7, one

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hi, can you please enable DEBUG log and then attach broker.log once it reproduces? See /etc/ovirt-hosted-engine-ha/broker-log.conf for the place where to set it (do not forget to restart ovirt-ha-agent and ovirt-ha-broker afterwards). Name resolution issues might be the cause for this indeed, bec

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hi Martin, i see this in broker-log.conf [logger_root] level=INFO handlers=syslog,logfile propagate=0 [handler_syslog] level=ERROR class=handlers.SysLogHandler formatter=sysform args=('/dev/log', handlers.SysLogHandler.LOG_USER) [handler_logfile] class=logging.handlers.TimedRotatingFileHandler a

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hi, > [logger_root] > level=INFO > [handler_logfile] > level=DEBUG > Seems already set. The file broker.log is already containing DEBUG, > but syslog is not (and this is good). What about logger_root? Yeah, I think you should change that one as well to get full debug logging. The handler level

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hello, i had several switches between EngineUp and EngineBadHealth today with broker.log ad DEBUG level. Where i should start to identify root cause? Log is somewhat chatty at this level. Luca On Fri, Dec 1, 2017 at 1:24 PM, Martin Sivak wrote: > Hi, > >> [logger_root] >> level=INFO > >> [handl

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hi, please attach the log. You can grep out the connected / disconnected lines. Look for engine health monitor lines. Martin On Sat, Dec 2, 2017 at 5:10 PM, Luca 'remix_tj' Lorenzetto wrote: > Hello, > > i had several switches between EngineUp and EngineBadHealth today with > broker.log ad DEB

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

On Mon, Dec 4, 2017 at 9:31 AM, Martin Sivak wrote: > Hi, > > please attach the log. You can grep out the connected / disconnected lines. > > Look for engine health monitor lines. > > Martin Log is quite big (about 1.5GB). I'm filtering out the messages around the last report of EngineBadHealth

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hi Martin, Hi all, *some minutes* has passed and i've the piece of log i'm looking at. ​ broker.log-upbadup ​ I got this morning a notice about enginebadhealth and engineup flip. I'm not able to identify noth

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hello, Today i started troubleshooting more in depth on dns requests and exactly while i was looking at tcpdump an event of EngineUp -> EngineBadHealth happened. Looking at the dns requests i see this: [...] 14:30:35.909201 IP kvmhost01.intranet.company.it.55654 > dns.company.it.53: 34102+ A? en

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Hi, I am afraid we do not have logs that would go that deep into the stack. DNS resolution issues will definitely affect both the notification system (if not using localhost smtp) and the engine status checks (because we use the fqdn). Best regards Martin On Wed, Dec 13, 2017 at 3:15 PM, Luca '

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

On Wed, Dec 13, 2017 at 4:15 PM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > Hello, > > Today i started troubleshooting more in depth on dns requests and exactly > while i was looking at tcpdump an event of EngineUp -> EngineBadHealth > happened. > > Looking at the dns request

Re: [ovirt-users] Debugging why hosted engine flips between EngineUp and EngineBadHealth

Il 13 dic 2017 8:19 PM, "Yaniv Kaul" ha scritto: On Wed, Dec 13, 2017 at 4:15 PM, Luca 'remix_tj' Lorenzetto < lorenzetto.l...@gmail.com> wrote: > Hello, > > Today i started troubleshooting more in depth on dns requests and exactly > while i was looking at tcpdump an event of EngineUp -> Engin