Since I've upgraded to 2.3 I've noticed that zenmodeler and zenhub go into some
sort of loop and load down my zenoss server. This in turn causes graphs to
stop, watchdog alerts, etc.
I am including a -v10 output of zenmodeler and zenhub and you can see the
repeating lines at the end of each log, they keep repeating until I kill the
processes (a normal "<command> stop" won't stop the process).
Any ideas? This makes my zenoss server pretty useless as zenhub is basically
unresponsive while this is happening and thus causes lost data, graphs, traps.
*ZENMODELER OUTPUT*
Code:
2008-11-19 14:10:21 DEBUG zen.ZenModeler: Run as a daemon, waiting 600 sec to
start.
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Run as a daemon, slept 600 sec,
starting now.
2008-11-19 14:20:21 DEBUG zen.ZenModeler: run
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Connecting to localhost:8789
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Logging in as admin
2008-11-19 14:20:21 INFO zen.ZenModeler: Connected to ZenHub
2008-11-19 14:20:21 DEBUG zen.ZenModeler: setting up services EventService,
ModelerService
2008-11-19 14:20:21 DEBUG zen.ZenModeler: chaining getInitialServices with d2
2008-11-19 14:20:21 DEBUG zen.ZenModeler: callback after getting service
EventService
2008-11-19 14:20:21 DEBUG zen.ZenModeler: callback after getting service
ModelerService
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Calling connected.
2008-11-19 14:20:21 DEBUG zen.ZenModeler: connected
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Sending event {'severity': 0,
'component': 'zenmodeler', 'agent': 'zenmodeler', 'summary': 'started',
'manager': 'localhost', 'device': 'localhost', 'eventClass': '/App/Start'}
2008-11-19 14:20:21 DEBUG zen.ZenModeler: fetching monitor properties
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Getting threshold classes...
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Loading classes
['Products.ZenModel.MinMaxThreshold']
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Fetching default RRDCreateCommand...
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Getting collector thresholds...
2008-11-19 14:20:21 DEBUG zen.thresholds: Updating threshold ('zeneventlog
cycle time', ('localhost', ''))
2008-11-19 14:20:21 DEBUG zen.thresholds: Updating threshold ('zenmodeler cycle
time', ('localhost', ''))
2008-11-19 14:20:21 DEBUG zen.thresholds: Updating threshold ('zenperfsnmp
cycle time', ('localhost', ''))
2008-11-19 14:20:21 DEBUG zen.thresholds: Updating threshold ('zenping cycle
time', ('localhost', ''))
2008-11-19 14:20:21 DEBUG zen.thresholds: Updating threshold ('zenprocess cycle
time', ('localhost', ''))
2008-11-19 14:20:21 DEBUG zen.thresholds: Updating threshold ('zenwin cycle
time', ('localhost', ''))
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Sending event {'component':
'zenmodeler', 'agent': 'zenmodeler', 'manager': 'localhost', 'timeout': 90,
'device': 'localhost', 'eventClass': '/Heartbeat'}
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Starting collector loop...
2008-11-19 14:20:21 INFO zen.ZenModeler: Collecting for path /Devices
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Starting collector loop...
2008-11-19 14:20:21 INFO zen.ZenModeler: Collecting for path /Devices
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Starting collector loop...
2008-11-19 14:20:21 INFO zen.ZenModeler: Collecting for path /Devices
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Starting collector loop...
2008-11-19 14:20:21 INFO zen.ZenModeler: Collecting for path /Devices
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Starting collector loop...
2008-11-19 14:20:21 INFO zen.ZenModeler: Collecting for path /Devices
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Starting collector loop...
2008-11-19 14:20:21 INFO zen.ZenModeler: Collecting for path /Devices
2008-11-19 14:20:21 DEBUG zen.ZenModeler: Starting collector loop...
*ZENHUB OUTPUT*
Code:
2008-11-19 14:20:20 DEBUG zen.DbConnectionPool: Retrieved a connection; Pool
size: 0
2008-11-19 14:20:20 DEBUG zen.Events: insert into heartbeat set
device='localhost',component='zenhub',timeout=90 on duplicate key update
lastTime=Null, timeout=90: --> 2
2008-11-19 14:20:20 DEBUG zen.DbConnectionPool: Returned a connection; Pool
size: 1
2008-11-19 14:20:21 DEBUG zen.hub: adding listener for localhost:EventService
2008-11-19 14:20:21 DEBUG zen.hub: adding listener for localhost:ModelerService
2008-11-19 14:20:21 DEBUG zen.hub: Servicing sendEvent in EventService
2008-11-19 14:20:21 DEBUG zen.Events: looking up ip localhost
2008-11-19 14:20:21 DEBUG zen.Events: EventClassInst=Start
2008-11-19 14:20:21 DEBUG zen.DbConnectionPool: Retrieved a connection; Pool
size: 0
2008-11-19 14:20:21 DEBUG zen.Events: update status set clearid =
'E7071537e74924729cffffdce' where device='localhost' and component='zenmodeler'
and eventKey='' and (eventClass='/App/Stop' or eventClass='/App/Start'): --> 0
2008-11-19 14:20:21 DEBUG zen.DbConnectionPool: Returned a connection; Pool
size: 1
2008-11-19 14:20:21 DEBUG zen.hub: Time in sendEvent: 0.00
2008-11-19 14:20:21 DEBUG zen.hub: Servicing propertyItems in ModelerService
2008-11-19 14:20:21 DEBUG zen.hub: Time in propertyItems: 0.00
2008-11-19 14:20:21 DEBUG zen.hub: Servicing getThresholdClasses in
ModelerService
2008-11-19 14:20:21 DEBUG zen.hub: Time in getThresholdClasses: 0.00
2008-11-19 14:20:21 DEBUG zen.hub: Servicing getDefaultRRDCreateCommand in
ModelerService
2008-11-19 14:20:21 DEBUG zen.hub: Time in getDefaultRRDCreateCommand: 0.00
2008-11-19 14:20:21 DEBUG zen.hub: Servicing getCollectorThresholds in
ModelerService
2008-11-19 14:20:21 DEBUG zen.hub: Time in getCollectorThresholds: 0.01
2008-11-19 14:20:21 DEBUG zen.hub: Servicing sendEvent in EventService
2008-11-19 14:20:21 DEBUG zen.DbConnectionPool: Retrieved a connection; Pool
size: 0
2008-11-19 14:20:21 DEBUG zen.Events: insert into heartbeat set
device='localhost',component='zenmodeler',timeout=90 on duplicate key update
lastTime=Null, timeout=90: --> 1
2008-11-19 14:20:21 DEBUG zen.DbConnectionPool: Returned a connection; Pool
size: 1
2008-11-19 14:20:21 DEBUG zen.hub: Time in sendEvent: 0.00
2008-11-19 14:20:21 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:22 DEBUG zen.hub: Time in getDeviceListByOrganizer: 1.16
2008-11-19 14:20:22 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:23 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.94
2008-11-19 14:20:23 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:24 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.97
2008-11-19 14:20:24 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:25 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.98
2008-11-19 14:20:25 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:26 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.95
2008-11-19 14:20:26 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:27 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.96
2008-11-19 14:20:27 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:28 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.95
2008-11-19 14:20:28 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:29 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.95
2008-11-19 14:20:29 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:30 DEBUG zen.hub: Time in getDeviceListByOrganizer: 1.06
2008-11-19 14:20:30 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
2008-11-19 14:20:31 DEBUG zen.hub: Time in getDeviceListByOrganizer: 0.99
2008-11-19 14:20:31 DEBUG zen.hub: Servicing getDeviceListByOrganizer in
ModelerService
-------------------- m2f --------------------
Read this topic online here:
http://forums.zenoss.com/viewtopic.php?p=27971#27971
-------------------- m2f --------------------
_______________________________________________
zenoss-users mailing list
[email protected]
http://lists.zenoss.org/mailman/listinfo/zenoss-users
