Hello all,
I'm a newbie and have been using zenoss for about 1.5 months and have had a few
issues (and a steep learning curve) but looking through the forums have helped
me with most, but as of yesterday afternoon a situation started that is driving
me insane.
Here's the timeline to the situation:
1.) Install and configure zenoss appliance on VMware 1.0.2 installed on Debian
Etch. Add MIBs and devices and it works fine.
2.) Run out of room on appliance virtual disk. Shut down VM. Copy VM directory,
Resize VM disk with vfstools to 5Gb. Boot VM w/ knoppix CD image, remove
journel, ext2resize to new partition size, rebuild journel and boot into zenoss
VM. All fine.
3.) Last week received a page from rpath that 2.1.1 update available. Login to
rPath, make backup, and apply update. Reboot zenoss and works fine until....
4.) yesterday when looses all SNMP capability. Changes that happened early
yesterday afternoon were:
a.) added Cisco *.my MIBs and attempted to add Occam MIBs (would
not because of issue loading base MIB OCCAM-REG-MODULE)
b.) restarted zenhub after finding issue with it not starting and
removing /home/zenoss/var/zenhub.zec as per forum info. It runs
fine for a few hours
c.) All hell starts breaking loose (continual pages about SNMP link to
all 16 monitored devices being down)
5.) Find zentrap is not running and restart it, and it continues to page SNMP
failures. Go home and work on it remotely (vnc trough ssh to host machine and
manipulate VMconsole and browser interface from it)
a.) Find that zentrap is not running. I start it and it keeps running but
the pages (emails) keep coming.
b.) Reboot VM - no change.
c.) Reboot host - no change. (I have to go back in to work
because host stuck @ grub menu).
c.) View the log for zentrap and find the following:
2007-11-29 22:05:26 INFO zen.ZenTrap: started
2007-11-29 22:23:26 ERROR zen.ZenTrap: (2002, "Can't connect to local MySQL
server through socket '/srv/mysql/mysql.sock' (2)")
Traceback (most recent call last):
File "/home/zenoss/Products/ZenEvents/EventServer.py", line 127, in run
self.sendEvent(args)
File "/home/zenoss/Products/ZenEvents/EventServer.py", line 147, in sendEvent
self.zem.sendEvent(evt)
File "/home/zenoss/Products/ZenEvents/MySqlSendEvent.py", line 52, in
sendEvent
return self._sendHeartbeat(event)
File "/home/zenoss/Products/ZenEvents/MySqlSendEvent.py", line 231, in
_sendHeartbeat
raise ZenBackendFailure(str(e))
ZenBackendFailure: (2002, "Can't connect to local MySQL server through socket
'/srv/mysql/mysql.sock' (2)")
2007-11-29 22:23:42 INFO zen.ZenTrap: delete pidfile
/home/zenoss/var/zentrap.py.pid
2007-11-29 22:23:42 INFO zen.ZenTrap: Daemon ZenTrap shutting down
2007-11-29 22:23:42 INFO zen.ZenTrap: 0 events processed in 0.00 seconds
2007-11-29 22:23:46 INFO zen.ZenTrap: 0 events processed in 0.00 seconds
2007-11-30 06:10:31 INFO zen.ZenTrap: started
2007-11-30 06:15:21 INFO zen.ZenTrap: delete pidfile
/home/zenoss/var/zentrap.py.pid
2007-11-30 06:15:21 INFO zen.ZenTrap: Daemon ZenTrap shutting down
2007-11-30 06:15:21 INFO zen.ZenTrap: 0 events processed in 0.00 seconds
2007-11-30 06:15:21 ERROR zen.Events: (2002, "Can't connect to local MySQL
server through socket '/srv/mysql/mysql.sock' (2)")
Traceback (most recent call last):
File "/home/zenoss/Products/ZenEvents/MySqlSendEvent.py", line 98, in
sendEvent
evid = self.doSendEvent(event)
File "/home/zenoss/Products/ZenEvents/MySqlSendEvent.py", line 111, in
doSendEvent
conn = self.connect()
File "/home/zenoss/Products/ZenEvents/DbAccessBase.py", line 34, in connect
database=self.database)
File "/home/zenoss/Products/ZenEvents/DbConnectionPool.py", line 63, in get
obj.ping()
OperationalError: (2002, "Can't connect to local MySQL server through socket
'/srv/mysql/mysql.sock' (2)")
2007-11-30 06:15:21 INFO zen.ZenTrap: 0 events processed in 0.00 seconds
(Above 8 hour gap was when I threw up hands in disgust and went to sleep. I DID
notice that when I looked at my home machine in the morning the ssh/vnc session
was still active, but the vmware-console had died and the zenoss was not
available.
6.) Since this is now looking more like a vmware issue and I've been neglecting
updating to server 1.0.4 since things were running correctly, so I download
and update vmware to 1.0.4 .
a.) Try original updated zenoss VM - no change.
b.) Download and create new 2.1.1 VM - doesn't work, but it's not
getting an IP address issue and not really related so I decide
to.......
c.) Replace zenoss VM with contents of the copied/backup directory
from a week before - no change
d.) Replace zenoss VM with original contents - no change
I'm at a loss to what's happening. I'd have installed the application natively
on the host, but the VM was doing so well.
Any ideas as to what's causing this? I can furnish any information asked for.
Thank you.
the week before - no change
-------------------- m2f --------------------
Read this topic online here:
http://community.zenoss.com/forums/viewtopic.php?p=13911#13911
-------------------- m2f --------------------
_______________________________________________
zenoss-users mailing list
[email protected]
http://lists.zenoss.org/mailman/listinfo/zenoss-users
