How much memory does your system have, and how large does the arsystem executable grow to? On the table that you are hitting, how many rows are in that table, and how many open tickets are in this table? Lastly, what query is your escalation using to find the open tickets?
Darrell Reading Systems Engineer Phone 479.204.5739 dere...@wal-mart.com Wal-Mart Stores, Inc. 805 Moberly Lane, MS-0560-68 Bentonville, AR 72716 Save Money. Live Better -----Original Message----- From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Mahan, Janet L[EQ] Sent: Thursday, April 02, 2009 09:23 To: arslist@ARSLIST.ORG Subject: Re: Memory issue on sybase ARS 6.0.1 Ok, let me ask something else related to my issue. Does anyone have a recommendation of the best way to update all open tickets every 5 minutes other than an escalation? The escalation seems to fill the memory up and kill the server and my interval does not work correctly. Thanks Janet Mahan Network Systems Administrator II EMBARQ Voice: 941-766-6199 | Wireless: 407-310-4070 | Fax: 941-766-6199 Email: janet.ma...@embarq.com Voice | Data | Internet | Wireless | Entertainment This e-mail is the property of EMBARQ and may contain confidential and privileged material for the sole use of the intended recipient(s). Any review, use, distribution or disclosure by others is strictly prohibited. If you are not the intended recipient (or authorized to receive for the recipient), please contact the sender and delete all copies of the message. -----Original Message----- From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Grooms, Frederick W Sent: Wednesday, April 01, 2009 2:00 PM To: arslist@ARSLIST.ORG Subject: Re: Memory issue on sybase ARS 6.0.1 Looking below it looks like you are on a Sun V240. What OS Version "uname -a" and what is your "ulimit -a" values. Also check your disk space "df -k" Fred -----Original Message----- From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Mahan, Janet L[EQ] Sent: Wednesday, April 01, 2009 11:27 AM To: arslist@ARSLIST.ORG Subject: Re: Memory issue on sybase ARS 6.0.1 Any ideas? Janet Mahan -----Original Message----- From: Mahan, Janet L[EQ] Sent: Tuesday, March 31, 2009 2:18 PM To: Mahan, Janet L[EQ]; arsl...@listserv.rbugs.com Subject: RE: Memory issue on sybase ARS 6.0.1 Also get these errors: ARERR [160] Decompression has failed ARERR [300] Malloc failed on server Janet Mahan -----Original Message----- From: Janet Mahan [mailto:janet.ma...@embarq.com] Sent: Tuesday, March 31, 2009 1:20 PM To: arsl...@listserv.rbugs.com Cc: Mahan, Janet L[EQ] Subject: Memory issue on sybase ARS 6.0.1 Does anyone have any suggestions how to fix a memory issue where the arserverd process grows so that the processes die with malloc errors. It seems to be related to escalations that I have updating tickets every 4 or 6 minutes. I have opened tickets with BMC but our version is not really supported. Some details: Mar 05 16:24:07 EST r...@waterspout#> tail -f arerror.log Thu Mar 5 16:14:39 2009 390620 : Cannot initialize contact with SQL database (ARERR 551) Thu Mar 5 16:14:39 2009 Thread 26 not handling connection Thu Mar 5 16:15:35 2009 390620 : Failure during SQL operation to the database (ARERR 552) Thu Mar 5 16:15:35 2009 ct_cmd_alloc(): user api layer: external error: Memory allocation failure. (Sybase 16843010) : Thu Mar 5 16:15:35 2009 390620 : AR System server terminated -- fatal error encountered (ARNOTE 21) Thu Mar 5 16:15:35 2009 390620 : Failure while trying to connect to the SQL database. Please ensure the SQL database is running or contact the Database Administrator for help (ARERR 550) Thu Mar 5 16:15:35 2009 ct_cmd_alloc(): user api layer: external error: Memory allocation failure. (Sybase 16843010) : Thu Mar 5 16:15:35 2009 390620 : Cannot initialize contact with SQL database (ARERR 551) Thu Mar 5 16:15:35 2009 Thread 27 not handling connection 390603 : Failure during SQL operation to the database (ARERR 552) ct_cmd_alloc(): user api layer: external error: Memory allocation failure. (Sybase 16843010) : 390603 : AR System server terminated -- fatal error encountered (ARNOTE 21) 0 : AR System server terminated when a signal/exception was received by the server (ARNOTE 20) 10 (ARNOTE 0) Server (pid:8549) died with 0. Action Request System(R) Server Version 6.00.01 patch 1351 Remedy, a BMC Software company. Copyright (c) 1991 - 2004 BMC Software, Inc. All rights reserved. Copyright (c) 1989 - 2004 Verity, Inc. All rights reserved. Reproduction or disassembly of embodied programs and databases prohibited. Verity (r) and TOPIC (r) are registered trademarks of Verity, Inc. ction Request System(R) Fork Daemon Version 6.00.01 patch 1351 Remedy, a BMC Software company. Copyright (c) 2000 - 2004 BMC Software, Inc. All rights reserved. (ARNOTE 0) Server indicates that it's up. sh: /usr/bin/qcagent.pl: not found 390600 : Malloc failed on server (ARERR 300) CopyCache 390600 : AR System server terminated -- fatal error encountered (ARNOTE 21) (ARNOTE 0) Server (pid:8565) died with 65280. Action Request System(R) Server Version 6.00.01 patch 1351 Remedy, a BMC Software company. Copyright (c) 1991 - 2004 BMC Software, Inc. All rights reserved. Copyright (c) 1989 - 2004 Verity, Inc. All rights reserved. Reproduction or disassembly of embodied programs and databases prohibited. Verity (r) and TOPIC (r) are registered trademarks of Verity, Inc. Action Request System(R) Fork Daemon Version 6.00.01 patch 1351 Remedy, a BMC Software company. Copyright (c) 2000 - 2004 BMC Software, Inc. All rights reserved. (ARNOTE 0) Server indicates that it's up. ARERR [90] Cannot establish a network connection to the AR System server : waterspout.nnet (0) : RPC: Miscellaneous tli error - System error (Connection refused) 1> sp_configure "copy cache" 2> go Msg 18124, Level 16, State 1: Server 'waterspoutdb', Procedure 'sp_configure', Line 842: No matching configuration options. Here is a listing of groups: -------------------------------------------------- Backup/Recovery Cache Manager Component Integration Services Configuration Options Diagnostics Disk I/O DTM Administration Error Log Extended Stored Procedure General Information Java Services Languages Lock Manager Memory Use Meta-Data Caches Monitoring Network Communication O/S Resources Parallel Query Physical Memory Physical Resources Processors Rep Agent Thread Administration Security Related SQL Server Administration Unicode User Environment > sp_countmetadata "open objects" 2> go There are 1798 user objects in all database(s), requiring 2505 Kbytes of memory. The 'open objects' configuration parameter is currently set to 500. (return status = 0) 1> sp_countmetadata "open locks" 2> go Configuration option doesn't exist. (return status = 1) 1> sp_configure "number of locks", 5500 2> go Parameter Name Default Memory Used Config Value Run Value Unit Type ------------------------------ ----------- ----------- ------------ ----------- -------------------- ---------- number of locks 5000 964 5500 5500 number dynamic (1 row affected) Configuration option changed. The SQL Server need not be rebooted since the option is dynamic. Changing the value of 'number of locks' to '5500' increases the amount of memory ASE uses by 4 K. (return status = 0) 1> sp_configure "number of open objects", 2100 2> go Parameter Name Default Memory Used Config Value Run Value Unit Type ------------------------------ ----------- ----------- ------------ ----------- -------------------- ---------- number of open objects 500 2931 2100 2100 number dynamic (1 row affected) Configuration option changed. The SQL Server need not be rebooted since the option is dynamic. Changing the value of 'number of open objects' to '2100' increases the amount of memory ASE uses by 2376 K. (return status = 0) 1> sp_configure "number of open objects", 3100 2> go Parameter Name Default Memory Used Config Value Run Value Unit Type ------------------------------ ----------- ----------- ------------ ----------- -------------------- ---------- number of open objects 500 4329 3100 3100 number dynamic (1 row affected) Configuration option changed. The SQL Server need not be rebooted since the option is dynamic. Changing the value of 'number of open objects' to '3100' increases the amount of memory ASE uses by 1462 K. (return status = 0) 390603 : Failure during SQL operation to the database (ARERR 552) ct_cmd_alloc(): user api layer: external error: Memory allocation failure. (Sybase 16843010) : 390603 : AR System server terminated -- fatal error encountered (ARNOTE 21) 0 : AR System server terminated when a signal/exception was received by the server (ARNOTE 20) 10 (ARNOTE 0) Server (pid:8575) died with 0. Action Request System(R) Server Version 6.00.01 patch 1351 Remedy, a BMC Software company. Copyright (c) 1991 - 2004 BMC Software, Inc. Mar 06 0:44:47 EST r...@#> prtconf System Configuration: Sun Microsystems sun4u Memory size: 4096 Megabytes System Peripherals (Software Nodes): SUNW,Sun-Fire-V240 Mar 06 10:53:04 EST r...@#> tail -f arerror.log Fri Mar 6 07:12:28 2009 0 : AR System server terminated when a signal/exception was received by the server (ARNOTE 20) Fri Mar 6 07:12:28 2009 10 Fri Mar 6 09:00:19 2009 390600 : Malloc failed on server (ARERR 300) Fri Mar 6 09:00:19 2009 CopyCache Fri Mar 6 09:00:19 2009 390600 : AR System server terminated -- fatal error encountered (ARNOTE 21) Fri Mar 6 10:23:47 2009 390603 : Failure during SQL operation to the database (ARERR 552) Fri Mar 6 10:23:47 2009 ct_cmd_alloc(): user api layer: external error: Memory allocation failure. (Sybase 16843010) : Fri Mar 6 10:23:47 2009 390603 : AR System server terminated -- fatal error encountered (ARNOTE 21) Fri Mar 6 10:23:47 2009 0 : AR System server terminated when a signal/exception was received by the server (ARNOTE 20) Fri Mar 6 10:23:47 2009 10 ________________________________________________________________________ _______ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: "Where the Answers Are" ________________________________________________________________________ _______ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: "Where the Answers Are" ----------------------------------------- ********************************************************************** This email and any files transmitted with it are confidential and intended solely for the individual or entity to whom they are addressed. If you have received this email in error destroy it immediately. ********************************************************************** Wal-Mart Confidential ********************************************************************** _______________________________________________________________________________ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: "Where the Answers Are"
