On 22.11.2011 03:42, Jamila Ruya Khan wrote:
Sorry for the vagueness. By inaccurate email I mean that I am getting emails that the service is critical because of staleness, but the service is definitely getting results from the external monitoring server (I have distributed monitoring set up as instructed here: http://docs.icinga.org/latest/en/distributed.html. Also I changed the limit for freshness and Icinga has not registered that I changed that.

me being a core dev likes logs and debug logs more than text prosa. so please be so kind to elaborate by example.


Basically it seems that somewhere there is something that saved the state of Icinga when it started freaking out because it ran out of space, and that thing is overwriting my current setup. I have changed several services parameters, and none of them are registering as changed. I have tried deleting retention.dat and status.dat but no luck. Also when I try to tell services to stop notify me using the icinga-web gui, it doesn't listen.

Thank you so much for helping, after working on this for three days, I'm quite confused.


--

Jamila Ruya Khan
[email protected] <mailto:[email protected]>



On Nov 21, 2011, at 6:22 PM, Michael Friedrich wrote:

On 21.11.2011 19:31, Jamila Ruya Khan wrote:
Thanks for that. I've been using the tarballs from the website, not the package, but I do have different filesystems. /usr is separate, and got full all on its own.

I deleted retention.dat while Icinga was stopped, and that slowed down the endless emails, but I am still getting inaccurate emails from the services.

i have absolutely no idea what an inaccurate mail would be. can you elaborate that by example, pick a service definition, describe the state changes (by log example), verify the contacts to be notified and show the actual notification happening (log, mail). in case this is not sufficient, increase debuglevel for notifications and see how they pass viability checks and so on. check wiki for that.

-michael

Do I need to stop Icinga and IDO2DB, then delete retention.dat and status.dat, and then remove all the entries in the MySQL database? Reinstall Icinga? I've gotten 400+ notification emails in the last 24 hours and it's gotten a bit ridiculous.



--

Jamila Ruya Khan
(646) 397-8337
[email protected] <mailto:[email protected]>



On Nov 21, 2011, at 3:17 AM, Michael Friedrich wrote:

Probably retention.dat is the place you are looking for. Retained data is kept and re-read on reload/Start. See the docs for more information. And a hint - use packages and different filesystems like /, /var and /usr.
--
Diese Nachricht wurde von meinem Android-Mobiltelefon mit K-9 Mail gesendet.



Jamila Ruya Khan < [email protected] <mailto:[email protected]>> schrieb:

    Hi all,

    So I've been using Icinga for about 6 months now, love what
    it's able to do. Recently my /usr partition got full, and
    Icinga started having troubles. I got the folder back down to a
    reasonable size, but Icinga hasn't been working right since.
    Debian 6.0 system, Icinga 1.5.1, MySQL.

    The issue that is confusing me the most, is that I had a
    service that was critical before the problems started, and even
    after deleting the service from the cfg files, then creating a
    new service that isn't critical with the same name, I still get
    notification emails about the critical service.

    In /usr/local/icinga/var, the status.dat file has the
    information from the old service, and even after deleting the
    service definition from the cfg files, and deleting all
    references to the old service from my MySQL database, and
    deleting status.dat while Icinga and IDO2DB were stopped, upon
    restarting status.dat has the information from th e old service
    again, and I keep getting notification emails about the
    critical service.

    I created a new service with the same name as the old one, and
    now I get alternating problem and recovery emails every couple
    minutes.

    Is there a place to flush old service definitions, or a file
    other than the cfg where the service definition might be
    stored? I am completely perplexed.

    Thanks,

    --

    Jamila Ruya Khan
    (646) 397-8337
    [email protected] <mailto:[email protected]>




------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure
contains a definitive record of customers, application performance,
security threats, fraudulent activity, and more. Splunk takes this
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d_______________________________________________
icinga-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/icinga-users



------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure
contains a definitive record of customers, application performance,
security threats, fraudulent activity, and more. Splunk takes this
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d


_______________________________________________
icinga-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/icinga-users


--
DI (FH) Michael Friedrich

Vienna University Computer Center
Universitaetsstrasse 7 A-1010 Vienna, Austria

email:[email protected]
phone:     +43 1 4277 14359
mobile:    +43 664 60277 14359
fax:       +43 1 4277 14338
web:http://www.univie.ac.at/zid
            http://www.aco.net

Lead Icinga Core Developer
http://www.icinga.org
------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure
contains a definitive record of customers, application performance,
security threats, fraudulent activity, and more. Splunk takes this
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d_______________________________________________
icinga-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/icinga-users



------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure
contains a definitive record of customers, application performance,
security threats, fraudulent activity, and more. Splunk takes this
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d


_______________________________________________
icinga-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/icinga-users


--
DI (FH) Michael Friedrich

Vienna University Computer Center
Universitaetsstrasse 7 A-1010 Vienna, Austria

email:     [email protected]
phone:     +43 1 4277 14359
mobile:    +43 664 60277 14359
fax:       +43 1 4277 14338
web:       http://www.univie.ac.at/zid
           http://www.aco.net

Lead Icinga Core Developer
http://www.icinga.org

------------------------------------------------------------------------------
All the data continuously generated in your IT infrastructure 
contains a definitive record of customers, application performance, 
security threats, fraudulent activity, and more. Splunk takes this 
data and makes sense of it. IT sense. And common sense.
http://p.sf.net/sfu/splunk-novd2d
_______________________________________________
icinga-users mailing list
[email protected]
https://lists.sourceforge.net/lists/listinfo/icinga-users

Reply via email to