I finally fixed this. The fix was to restart the server at the OS level. Something was "stuck" in memory, for lack of a better explanation. I've asked BMC if there are any known memory leaks related to the plugin server.
From: William Rentfrow Sent: Friday, February 28, 2014 10:31 AM To: '[email protected]' Subject: RE: Server plugin alias error I should have mentioned that the bad server name reference in the plugin error (CAT1) is the actual name of the load balancer name this server was wrongly installed with. Does the installer ever generate things like jar files on the fly and embed the server name? I assume not...but...I've been wrong before. From: William Rentfrow Sent: Friday, February 28, 2014 10:18 AM To: [email protected] Subject: Server plugin alias error Happy Friday arslisters - I have a weird problem. We are building out some new servers to add to a server group - the load balancer name (changed to CAT1 in the references below was put in instead of the server name during one install. No big deal - we just had to update the appropriate conf and XML files, startup scripts, etc. And everything works - except this - this error shows up in the AtriumPluginSvr.log file. The server name CAT1 is wrong, and the port is wrong. It should be a different name, and port 9556, not 2165: Feb 28 2014 10:02:13.636 ERROR ( ?:? ) - Connects to CAT1:2165 through Java Rpc failed with: ERROR (90): Message not in catalog; Message number = 90; Connection refused CAT1:2165 Feb 28 2014 10:02:13.667 ERROR ( ?:? ) - Message not in catalog; Message number = 8756BMC.FILTERAPI.NOE java.lang.NullPointerException at com.bmc.noe.plugin.ConnectionPoolManager.<init>(Unknown Source) at com.bmc.noe.plugin.ConnectionPoolManager.createConnPoolManager(Unknown Source) at com.bmc.noe.plugin.NOEPluginServer.initialize(Unknown Source) at com.bmc.arsys.pluginsvr.plugins.g.a(Unknown Source) at com.bmc.arsys.pluginsvr.plugins.g.loadPlugin(Unknown Source) at com.bmc.arsys.pluginsvr.plugins.g.instantiateAllPlugins(Unknown Source) at com.bmc.arsys.pluginsvr.plugins.g.<init>(Unknown Source) at com.bmc.arsys.pluginsvr.ARPluginSvrThreadLocalStorageBlock.<init>(Unknown Source) at com.bmc.arsys.pluginsvr.d.b.a(Unknown Source) at com.bmc.arsys.pluginsvr.d.b.beforeExecute(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(Unknown Source) at java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.lang.Thread.run(Unknown Source) Feb 28 2014 10:02:13.667 ERROR ( ?:? ) - Message not in catalog; Message number = 8756BMC.FILTERAPI.NOE Okay, so that's fine - but there's only two places I know of where the server name/port is specified. One is ar.conf - here's the relevant line from ar.conf (and I made sure there was only one line referencing this): Server-Plugin-Alias: BMC.FILTERAPI.NOE BMC.FILTERAPI.NOE server1:9556 (server1 is a placeholder name, had to replace the real name). The BMC.FILTERAPI.NOE is defined in the /<install dir>/AtriumCore/cmdb/plugins/shared/pluginsvr_config.xml - and it exists there, like this. I grepped and it is not located anywhere else. You'll notice I have the over rides values commented out. When I have these uncommented everything works as expected. But that configuration is different than the other servers. I'd prefer they match. <plugin> <name>BMC.FILTERAPI.NOE</name> <type>FilterAPI</type> <code>JAVA</code> <filename>/ritsm/qritsm/a00/apps/AtriumCore/cmdb/plugins/noe/noeplugin7604.jar</filename> <classname>com.bmc.noe.plugin.NOEPluginServer</classname> <pathelement type="path">/ritsm/qritsm/a00/apps/AtriumCore/cmdb/sdk/bin</pathelement> <pathelement type="path">/ritsm/qritsm/a00/apps/AtriumCore/cmdb/plugins/noe</pathelement> <userDefined> <!-- use these values to override the values in the ar.cfg --> <!--<override_ar_server_host>server1</override_ar_server_host> <override_ar_server_port>9556</override_ar_server_port> <override_ar_system_user/> <override_ar_system_password/> --> </userDefined> </plugin> I can't for the life of me figure out where it is getting the wrong server name reference. I've looked in all of the other pluginsvr_config.xml files I can find. I have looked in every *.sh startup script I could find. I checked ar.conf, armonitor.conf, and everything I can think of. And bounced the server lots. It's really bizarre that it's just the one plugin doing this too. If it was all of them I'd be more okay with this problem. William Rentfrow [email protected] Office: 715-204-3061 Cell: 715-398-5056 _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org "Where the Answers Are, and have been for 20 years"

