RE: [U2] UV - Available memory exceeded [not-secure] Update
Thanks to those who responded on and off list. It turns out the culprit was a Unix script that had been in production since 2001. The last line of this script had been commented out with an asterisk instead of a pound sign... This was a harmless error, until last Thursday when the script found an executable item in its working directory. It dutifully attempted to run it over and over again, forking off processes as it went. It consumed so much in the way of resources that Solaris started downsizing swap, resulting in UV processes getting the Available memory exceeded message, presumably when the OS attempted to page. I saw this in real time today... I inadvertently fired off the process and saw /tamp go from 2% of capacity to 20, then 25, etc The actual size of it wasn't increasing very much, but the maximum size for it dropped like a rock. Unfortunately I gave the system a wedgie before I could kill the process One change of underwear and an edited script later, we are finally good to go... I'll be spending the next few days reviewing my old scripts... just in case. Mark Hennessey --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] UV - Available memory exceeded
Is this some kind of virus? -Original Message- From: mark.hennessey [mailto:[EMAIL PROTECTED] Sent: Monday, July 16, 2007 12:21 PM To: u2-users@listserver.u2ug.org Subject: [U2] UV - Available memory exceeded You have received an important delivery from mark.hennessey Please pick up the package at the following Web address: https://smail.ct.gov/ime?x=4-271240-178878-SS932YZF The package will expire on Wednesday August 15, 2007 at 13:22:42 EDT4 .. Need help picking up your package? * If the Web address above is highlighted, click on it to open a browser window. You will automatically be taken to the package. * If the Web address above is not highlighted, follow these steps: - Open a Web browser window. - Copy and paste the entire Web address into the location or address bar of the browser. - Press enter. ___ Delivered with IME(TM) http://www.tumbleweed.com IME is a trademark of Tumbleweed Communications Corp. --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] UV - Available memory exceeded [not-secure]
I apologize for the in box litter. Unless I opt out by placing not-secure in the subject line of an e-mail, our Tumbleweed secure transport e-mail server may intercept a message based upon arcane policies that re-direct seemingly innocuous messages, yet will allow a message like 'the root password for the web server is donttellanyone!' to sail right through... Mark -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] Behalf Of Jerry Banker Sent: Monday, July 16, 2007 2:19 PM To: u2-users@listserver.u2ug.org Subject: RE: [U2] UV - Available memory exceeded Is this some kind of virus? -Original Message- From: mark.hennessey [mailto:[EMAIL PROTECTED] Sent: Monday, July 16, 2007 12:21 PM To: u2-users@listserver.u2ug.org Subject: [U2] UV - Available memory exceeded You have received an important delivery from mark.hennessey Please pick up the package at the following Web address: https://smail.ct.gov/ime?x=4-271240-178878-SS932YZF - snipped - --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
RE: [U2] UV - Available memory exceeded [not-secure]
Mark, This is perhaps grasping at straws and likely not the cause, but... We've seen this type of behavior available memory exceeded with (1) aborted resizes -- resize bits are left set and can cause attempts to reopen the file in a loop, eventually filling up the stack space, and (2) damaged files with bad linkages / record headers. If there might be common files used by the dying processes it sure wouldn't hurt to run diagnostics on them (or FAST). Just a thought... Jeff Fitzgerald Fitzgerald Long, Inc. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hennessey, Mark F. Sent: Monday, July 16, 2007 12:29 PM To: u2-users@listserver.u2ug.org Subject: [U2] UV - Available memory exceeded [not-secure] My apologies for my previous attempt. --- UV 10.0.8, Solaris 8... On Thursday and Friday night we've had our system grind to a halt with 'Available memory exceeded' messages... At first blush I would think I should have to increase max shared memory (shminfo_shmmax for Solaris), but I've got a fairly large value all ready (536870912, or 512mb). I am seeing errors in /var/adm/messages that coincide with the failures. However they warn of swap space deficiencies... for example: Jul 12 22:43:55 ccses genunix: [ID 470503 kern.warning] WARNING: Sorry, no swap space to grow stack for pid 22440 (uvsh) Jul 12 22:43:55 ccses last message repeated 9 times I found the PH entry for a job that had the above PID. The job up and died with out giving any error messages. The job is not new, and had been running every night without incident. I plan on having our normal nightly processing run tonight, with the exception of the one suspect job. Any thoughts or suggestions? Mark Hennessey State of Connecticut Department of Social Services Information Technology Services Child Support Systems Voice: 860-424-5261 Fax: 860-424-4813 --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
Re: [U2] UV - Available memory exceeded [not-secure]
Or monster large records, typically out of a type 1 or 19 file. Example would be trying to ED PH GAZILLION_LINE_FILE. -- Regards, Clif ~~~ W. Clifton Oliver, CCP CLIFTON OLIVER ASSOCIATES Tel: +1 619 460 5678Web: www.oliver.com ~~~ On Jul 16, 2007, at 12:27 PM, Jeff Fitzgerald wrote: Mark, This is perhaps grasping at straws and likely not the cause, but... We've seen this type of behavior available memory exceeded with (1) aborted resizes -- resize bits are left set and can cause attempts to reopen the file in a loop, eventually filling up the stack space, and (2) damaged files with bad linkages / record headers. If there might be common files used by the dying processes it sure wouldn't hurt to run diagnostics on them (or FAST). Just a thought... Jeff Fitzgerald Fitzgerald Long, Inc. -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hennessey, Mark F. Sent: Monday, July 16, 2007 12:29 PM To: u2-users@listserver.u2ug.org Subject: [U2] UV - Available memory exceeded [not-secure] My apologies for my previous attempt. --- UV 10.0.8, Solaris 8... On Thursday and Friday night we've had our system grind to a halt with 'Available memory exceeded' messages... At first blush I would think I should have to increase max shared memory (shminfo_shmmax for Solaris), but I've got a fairly large value all ready (536870912, or 512mb). I am seeing errors in /var/adm/messages that coincide with the failures. However they warn of swap space deficiencies... for example: Jul 12 22:43:55 ccses genunix: [ID 470503 kern.warning] WARNING: Sorry, no swap space to grow stack for pid 22440 (uvsh) Jul 12 22:43:55 ccses last message repeated 9 times I found the PH entry for a job that had the above PID. The job up and died with out giving any error messages. The job is not new, and had been running every night without incident. I plan on having our normal nightly processing run tonight, with the exception of the one suspect job. Any thoughts or suggestions? Mark Hennessey State of Connecticut Department of Social Services Information Technology Services Child Support Systems Voice: 860-424-5261 Fax: 860-424-4813 --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/ --- u2-users mailing list u2-users@listserver.u2ug.org To unsubscribe please visit http://listserver.u2ug.org/
