Sorry for the vagueness. By inaccurate email I mean that I am getting emails
that the service is critical because of staleness, but the service is
definitely getting results from the external monitoring server (I have
distributed monitoring set up as instructed here:
http://docs.icinga.org/latest/en/distributed.html. Also I changed the limit for
freshness and Icinga has not registered that I changed that.
Basically it seems that somewhere there is something that saved the state of
Icinga when it started freaking out because it ran out of space, and that thing
is overwriting my current setup. I have changed several services parameters,
and none of them are registering as changed. I have tried deleting
retention.dat and status.dat but no luck. Also when I try to tell services to
stop notify me using the icinga-web gui, it doesn't listen.
Thank you so much for helping, after working on this for three days, I'm quite
confused.
--
Jamila Ruya Khan
[email protected]
On Nov 21, 2011, at 6:22 PM, Michael Friedrich wrote:
> On 21.11.2011 19:31, Jamila Ruya Khan wrote:
>>
>> Thanks for that. I've been using the tarballs from the website, not the
>> package, but I do have different filesystems. /usr is separate, and got full
>> all on its own.
>>
>> I deleted retention.dat while Icinga was stopped, and that slowed down the
>> endless emails, but I am still getting inaccurate emails from the services.
>
> i have absolutely no idea what an inaccurate mail would be. can you elaborate
> that by example, pick a service definition, describe the state changes (by
> log example), verify the contacts to be notified and show the actual
> notification happening (log, mail).
> in case this is not sufficient, increase debuglevel for notifications and see
> how they pass viability checks and so on. check wiki for that.
>
> -michael
>
>> Do I need to stop Icinga and IDO2DB, then delete retention.dat and
>> status.dat, and then remove all the entries in the MySQL database? Reinstall
>> Icinga? I've gotten 400+ notification emails in the last 24 hours and it's
>> gotten a bit ridiculous.
>>
>>
>>
>> --
>>
>> Jamila Ruya Khan
>> (646) 397-8337
>> [email protected]
>>
>>
>>
>> On Nov 21, 2011, at 3:17 AM, Michael Friedrich wrote:
>>
>>> Probably retention.dat is the place you are looking for. Retained data is
>>> kept and re-read on reload/Start. See the docs for more information. And a
>>> hint - use packages and different filesystems like /, /var and /usr.
>>> --
>>> Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet.
>>>
>>>
>>>
>>> Jamila Ruya Khan < [email protected]> schrieb:
>>> Hi all,
>>>
>>> So I've been using Icinga for about 6 months now, love what it's able to
>>> do. Recently my /usr partition got full, and Icinga started having
>>> troubles. I got the folder back down to a reasonable size, but Icinga
>>> hasn't been working right since. Debian 6.0 system, Icinga 1.5.1, MySQL.
>>>
>>> The issue that is confusing me the most, is that I had a service that was
>>> critical before the problems started, and even after deleting the service
>>> from the cfg files, then creating a new service that isn't critical with
>>> the same name, I still get notification emails about the critical service.
>>>
>>> In /usr/local/icinga/var, the status.dat file has the information from the
>>> old service, and even after deleting the service definition from the cfg
>>> files, and deleting all references to the old service from my MySQL
>>> database, and deleting status.dat while Icinga and IDO2DB were stopped,
>>> upon restarting status.dat has the information from th e old service again,
>>> and I keep getting notification emails about the critical service.
>>>
>>> I created a new service with the same name as the old one, and now I get
>>> alternating problem and recovery emails every couple minutes.
>>>
>>> Is there a place to flush old service definitions, or a file other than the
>>> cfg where the service definition might be stored? I
>>> am completely perplexed.
>>>
>>> Thanks,
>>>
>>> --
>>>
>>> Jamila Ruya Khan
>>> (646) 397-8337
>>> [email protected]
>>>
>>>
>>>
>>>
>>> ------------------------------------------------------------------------------
>>> All the data continuously generated in your IT infrastructure
>>> contains a definitive record of customers, application performance,
>>> security threats, fraudulent activity, and more. Splunk takes this
>>> data and makes sense of it. IT sense. And common sense.
>>> http://p.sf.net/sfu/splunk-novd2d_______________________________________________
>>> icinga-users mailing list
>>> [email protected]
>>> https://lists.sourceforge.net/lists/listinfo/icinga-users
>>
>>
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure
>> contains a definitive record of customers, application performance,
>> security threats, fraudulent activity, and more. Splunk takes this
>> data and makes sense of it. IT sense. And common sense.
>> http://p.sf.net/sfu/splunk-novd2d
>>
>>
>> _______________________________________________
>> icinga-users mailing list
>> [email protected]
>> https://lists.sourceforge.net/lists/listinfo/icinga-users
>
>
> --
> DI (FH) Michael Friedrich
>
> Vienna University Computer Center
> Universitaetsstrasse 7 A-1010 Vienna, Austria
>
> email: [email protected]
> phone: +43 1 4277 14359
> mobile: +43 664 60277 14359
> fax: +43 1 4277 14338
> web: http://www.univie.ac.at/zid
> http://www.aco.net
>
> Lead Icinga Core Developer
> http://www.icinga.org
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure
> contains a definitive record of customers, application performance,
> security threats, fraudulent activity, and more. Splunk takes this
> data and makes sense of it. IT sense. And common sense.
> http://p.sf.net/sfu/splunk-novd2d_______________________________________________
> icinga-users mailing list
> [email protected]
> https://lists.sourceforge.net/lists/listinfo/icinga-users
------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure
contains a definitive record of customers, application performance,
security threats, fraudulent activity, and more. Splunk takes this
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d
_______________________________________________
icinga-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/icinga-users
