Re: ARERR 300 Malloc failed on server
Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when the 'Virtual Size' hits 2 GB, not necessarily when the 'Private Bytes' hits 2 GB...and I have sometimes seen a great disparity between the two values. I additionally try to look at the 'Max Memory Usage' column (that you can add) to see if at any point it actually spiked higher. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 3:04 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org
Re: ARERR 300 Malloc failed on server
I once forgot to give Public access rights (as in anyone can write to it) to a field on a backend form that I had written and the error only manifested itself as a malloc error. Bothersome is a good word for not receiving any sort of error message related to access rights, but when the rights were granted... the malloc error vanished. Took a while to find that one. I suspect the loop of running a table to perform the write was involved in the memory usage. Things just piled up until it was malloc time. Sadly everyone who had tested the app was using an Admin ID for some reason. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Jason Miller Sent: Wednesday, October 24, 2012 4:03 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** HI David, Can you give us some more detail on what it means when access rights to a newly-created field are not properly defined? It is a bit bothersome to think 1) a lack of permissions can cause memory issues 2) that it is easy to not properly define a field which would cause memory issues. Jason On Wed, Oct 24, 2012 at 1:42 PM, David M. Clark david.m.cl...@tn.govmailto:david.m.cl...@tn.gov wrote: We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248tel:574-283-4248 kce...@hubbell.commailto:kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.comhttp://www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.comhttp://www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.orghttp://www.arslist.org attend wwrug12 www.wwrug12.comhttp://www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.orghttp://www.arslist.org attend wwrug12 www.wwrug12.comhttp://www.wwrug12.com ARSList: Where the Answers Are _attend WWRUG12 www.wwrug.comhttp://www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
Thanks, I'll load process explorer on there and watch it. Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when the 'Virtual Size' hits 2 GB, not necessarily when the 'Private Bytes' hits 2 GB...and I have sometimes seen a great disparity between the two values. I additionally try to look at the 'Max Memory Usage' column (that you can add) to see if at any point it actually spiked higher. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 3:04 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers
Re: ARERR 300 Malloc failed on server
Hi, This happens because, there was a request to allocate memory by the server and the OS could not fulfill that request. In response to this, the AR System server shuts itself down and restarts. In general, except for users who are currently interacting with that server with a command, the restart would not even be noticed. Now, why is the server running out of memory? How much memory does the machine have? Could the system just be large enough that after everything is cached and user loads come in and there are large queries that need large spaces. Could it be a lack of swap space - so that there was no space on disc to write out the swap area of memory. Possible solution for this issue could be: Add /3gb parameter in a boot.ini file. The 32-bit versions of the Windows operating system can manage a maximum of 4GB of addressable memory. The 4GB is divided into 2GB for user applications and 2GB for kernel processes. This means that any given application is restricted to 2GB of memory. Adding /3GB switch which causes the operating system to divide the available 4GB of memory into 3GB for user applications and 1GB for kernel processes. Many translations that previously failed due to memory limitations will now run successfully when the /3GB switch is used. HTH -- Regards, Sunil Vyom Labs Pvt. Ltd. BSM Solutions Services || ITIL Consulting Training Email: [hidden email] http://ars-action-request-system.1093659.n2.nabble.com/user/SendEmail.jtp?t ype=nodenode=7583733i=0 || Web Site: www.vyomlabs.com Follow Vyom Labs http://twitter.com/#!/vyomlabs http://twitter.com/#%21/vyomlabs || http://www.linkedin.com/company/vyom-labs On Wed, Oct 24, 2012 at 3:42 PM, Cecil, Ken kce...@hubbell.com wrote: ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 _ This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
The Sysinternals tools are awesome! This is the first time I've worked with Windows servers and just a few days ago went looking for Windows equivalents to familiar unix tools. Process Explorer, Process Monitor, TCPView, and Autoruns are a few of them that I've explored so far. Process Monitor (similar to truss) just helped me yesterday in figuring out that I hadn't updated my PATH the way I should have. The email engine service wasn't starting, and there wasn't any indication why. None of the logs that were supposed to have been created were there. Following the process as it started up using process monitor showed the file that was missing. It was probably overkill to find a pathing issue, but BMC wasn't able to figure it out either. These tools have quickly found a place in my quiver. Thad On Thu, Oct 25, 2012 at 9:54 AM, Cecil, Ken kce...@hubbell.com wrote: Thanks, I'll load process explorer on there and watch it. Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when the 'Virtual Size' hits 2 GB, not necessarily when the 'Private Bytes' hits 2 GB...and I have sometimes seen a great disparity between the two values. I additionally try to look at the 'Max Memory Usage' column (that you can add) to see if at any point it actually spiked higher. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 3:04 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003
Re: ARERR 300 Malloc failed on server
Thad, You may want to check out http://sourceforge.net/projects/unxutils/ as well. Just for command-line stuff. Matt From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Thad Esser Sent: Thursday, October 25, 2012 12:41 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** The Sysinternals tools are awesome! This is the first time I've worked with Windows servers and just a few days ago went looking for Windows equivalents to familiar unix tools. Process Explorer, Process Monitor, TCPView, and Autoruns are a few of them that I've explored so far. Process Monitor (similar to truss) just helped me yesterday in figuring out that I hadn't updated my PATH the way I should have. The email engine service wasn't starting, and there wasn't any indication why. None of the logs that were supposed to have been created were there. Following the process as it started up using process monitor showed the file that was missing. It was probably overkill to find a pathing issue, but BMC wasn't able to figure it out either. These tools have quickly found a place in my quiver. Thad On Thu, Oct 25, 2012 at 9:54 AM, Cecil, Ken kce...@hubbell.com wrote: Thanks, I'll load process explorer on there and watch it. Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when the 'Virtual Size' hits 2 GB, not necessarily when the 'Private Bytes' hits 2 GB...and I have sometimes seen a great disparity between the two values. I additionally try to look at the 'Max Memory Usage' column (that you can add) to see if at any point it actually spiked higher. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 3:04 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run
Re: ARERR 300 Malloc failed on server
Add ..\UnixUtils\usr\local\wbin to your Windows path and things like grep, du, ls, tail now work in Windows :) On Thu, Oct 25, 2012 at 11:10 AM, Matt Reinfeldt arsl...@mattreinfeldt.comwrote: ** Thad, ** ** You may want to check out http://sourceforge.net/projects/unxutils/ as well. Just for command-line stuff. ** ** Matt ** ** *From:* Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] *On Behalf Of *Thad Esser *Sent:* Thursday, October 25, 2012 12:41 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** ** ** The Sysinternals tools are awesome! This is the first time I've worked with Windows servers and just a few days ago went looking for Windows equivalents to familiar unix tools. Process Explorer, Process Monitor, TCPView, and Autoruns are a few of them that I've explored so far. Process Monitor (similar to truss) just helped me yesterday in figuring out that I hadn't updated my PATH the way I should have. The email engine service wasn't starting, and there wasn't any indication why. None of the logs that were supposed to have been created were there. Following the process as it started up using process monitor showed the file that was missing. It was probably overkill to find a pathing issue, but BMC wasn't able to figure it out either. These tools have quickly found a place in my quiver. Thad On Thu, Oct 25, 2012 at 9:54 AM, Cecil, Ken kce...@hubbell.com wrote:*** * Thanks, I'll load process explorer on there and watch it. Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when the 'Virtual Size' hits 2 GB, not necessarily when the 'Private Bytes' hits 2 GB...and I have sometimes seen a great disparity between the two values. I additionally try to look at the 'Max Memory Usage' column (that you can add) to see if at any point it actually spiked higher. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 3:04 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error
Re: ARERR 300 Malloc failed on server
Just wondering. Do you keep trying with the same file each time? If so I wonder if there is something goofy going on in how the AR Server compresses and saves the file in the db? Is it only 4.6 MB Word docs? Would a 4.6 MB text file do the same thing? Jason On Thu, Oct 25, 2012 at 1:31 PM, Cecil, Ken kce...@hubbell.com wrote: ** I am consistently reproducing the error by trying to attach a word doc that is about 4.6 MB to a Work Log entry to an Incident (also tried in a task and it fails there too). The error comes back in about 1 second. Here is the API and SQL log lines from when the error occurs. ** ** CLAT /* Thu Oct 25 2012 15:37:30.6130 */+API call API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */+CE ARCreateEntry -- schema HPD:WorkLog from Remedy User (protocol 14) at IP address 172.16.57.154 SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */BEGIN TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */OK SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */COMMIT TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */OK API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */-CE FAIL CLAT /* Thu Oct 25 2012 15:37:31.3950 */-API call ** ** Here is the Performance Graph…. No increase. ** ** ** ** ** ** Everything else seems to be working fine for everyone. I can even attach smaller files ok. ** ** I triple checked the file space on all the drives on both the AR server and the DB server and there are at least 15GB free on all of them. ** ** I just don’t know where to look next. I still haven’t received a call back from supt just email asking for the logs ** ** Someone suggested using the /3GB boot.ini switch. My question to that would be does that work on a 64bit version of Windows like we have? ** ** ** ** Ken. ** ** *From:* Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] *On Behalf Of *Longwing, LJ CTR MDA/IC *Sent:* Thursday, October 25, 2012 2:34 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** ** ** How does the performance Graph tab look at the time of trying to add the attachment? And you have verified that you aren’t out of filespace? ** ** *From:* Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG arslist@ARSLIST.ORG] *On Behalf Of *Cecil, Ken *Sent:* Thursday, October 25, 2012 12:18 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** ** ** Here are screenshots of what I see for the arserver.exe process before and after trying to attach a file (and getting the error) ** ** ** ** ** ** Try to attaché 1.2 Mb attachment (works) Try to attach 4.7 MB attachment (ARERR 300 Malloc failed) ** ** ** ** ** ** Anybody see anything? ** ** ** ** Ken. ** ** ** ** -Original Message- From: Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** ** Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? ** ** I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when the 'Virtual Size' hits 2 GB, not necessarily when the 'Private Bytes' hits 2 GB...and I have sometimes seen a great disparity between the two values. I additionally try to look at the 'Max Memory Usage' column (that you can add) to see if at any point it actually spiked higher. ** ** -Original Message- From: Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken* *** Sent: Wednesday, October 24, 2012 3:04 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** ** Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. ** ** David, New changes
Re: ARERR 300 Malloc failed on server
Just tried with a 5.9 MB pdf. No go... 10MB text file works! Any ideas? Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Jason Miller Sent: Thursday, October 25, 2012 4:43 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Just wondering. Do you keep trying with the same file each time? If so I wonder if there is something goofy going on in how the AR Server compresses and saves the file in the db? Is it only 4.6 MB Word docs? Would a 4.6 MB text file do the same thing? Jason On Thu, Oct 25, 2012 at 1:31 PM, Cecil, Ken kce...@hubbell.commailto:kce...@hubbell.com wrote: ** I am consistently reproducing the error by trying to attach a word doc that is about 4.6 MB to a Work Log entry to an Incident (also tried in a task and it fails there too). The error comes back in about 1 second. Here is the API and SQL log lines from when the error occurs. CLAT /* Thu Oct 25 2012 15:37:30.6130 */+API call API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */+CE ARCreateEntry -- schema HPD:WorkLog from Remedy User (protocol 14) at IP address 172.16.57.154 SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */BEGIN TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */OK SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */COMMIT TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */OK API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */-CE FAIL CLAT /* Thu Oct 25 2012 15:37:31.3950 */-API call Here is the Performance Graph No increase. Everything else seems to be working fine for everyone. I can even attach smaller files ok. I triple checked the file space on all the drives on both the AR server and the DB server and there are at least 15GB free on all of them. I just don't know where to look next. I still haven't received a call back from supt just email asking for the logs Someone suggested using the /3GB boot.ini switch. My question to that would be does that work on a 64bit version of Windows like we have? Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 2:34 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** How does the performance Graph tab look at the time of trying to add the attachment? And you have verified that you aren't out of filespace? From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Thursday, October 25, 2012 12:18 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Here are screenshots of what I see for the arserver.exe process before and after trying to attach a file (and getting the error) Try to attaché 1.2 Mb attachment (works) Try to attach 4.7 MB attachment (ARERR 300 Malloc failed) Anybody see anything? Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when the 'Virtual Size' hits 2 GB, not necessarily when the 'Private Bytes' hits 2 GB...and I have sometimes seen a great disparity between the two values. I additionally try to look at the 'Max Memory Usage' column (that you can add) to see if at any point it actually spiked higher. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 3:04 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon
Re: ARERR 300 Malloc failed on server
Fascinating. Does it happen if you try right after an AR Server restart; before it's memory usage starts to get to its normal operating level? Just to double check you don't have Db-Max-Attach-Size set in the ar.cfg file? Jason On Thu, Oct 25, 2012 at 1:52 PM, Cecil, Ken kce...@hubbell.com wrote: ** Just tried with a 5.9 MB pdf. No go… ** ** 10MB text file works! ** ** ** ** Any ideas? ** ** Ken. ** ** *From:* Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] *On Behalf Of *Jason Miller *Sent:* Thursday, October 25, 2012 4:43 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** ** ** Just wondering. Do you keep trying with the same file each time? If so I wonder if there is something goofy going on in how the AR Server compresses and saves the file in the db? ** ** Is it only 4.6 MB Word docs? Would a 4.6 MB text file do the same thing?* *** ** ** Jason On Thu, Oct 25, 2012 at 1:31 PM, Cecil, Ken kce...@hubbell.com wrote:*** * ** I am consistently reproducing the error by trying to attach a word doc that is about 4.6 MB to a Work Log entry to an Incident (also tried in a task and it fails there too). The error comes back in about 1 second. Here is the API and SQL log lines from when the error occurs. CLAT /* Thu Oct 25 2012 15:37:30.6130 */+API call API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */+CE ARCreateEntry -- schema HPD:WorkLog from Remedy User (protocol 14) at IP address 172.16.57.154 SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */BEGIN TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */OK SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */COMMIT TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */OK API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */-CE FAIL CLAT /* Thu Oct 25 2012 15:37:31.3950 */-API call Here is the Performance Graph…. No increase. Everything else seems to be working fine for everyone. I can even attach smaller files ok. I triple checked the file space on all the drives on both the AR server and the DB server and there are at least 15GB free on all of them. I just don’t know where to look next. I still haven’t received a call back from supt just email asking for the logs Someone suggested using the /3GB boot.ini switch. My question to that would be does that work on a 64bit version of Windows like we have? Ken. *From:* Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] *On Behalf Of *Longwing, LJ CTR MDA/IC *Sent:* Thursday, October 25, 2012 2:34 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** How does the performance Graph tab look at the time of trying to add the attachment? And you have verified that you aren’t out of filespace? *From:* Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG arslist@ARSLIST.ORG] *On Behalf Of *Cecil, Ken *Sent:* Thursday, October 25, 2012 12:18 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** Here are screenshots of what I see for the arserver.exe process before and after trying to attach a file (and getting the error) Try to attaché 1.2 Mb attachment (works) Try to attach 4.7 MB attachment (ARERR 300 Malloc failed) Anybody see anything? Ken. -Original Message- From: Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, I would agree that 1.2 on a 64Bit OS is a bit hard to explain the malloc error. How did the overall system resources look at the time? I have found at times that the memory size is a bit hard to determine. I use a SysInternals tool 'Process Explorer' to look at things. One thing that I have found is that the memory on my server (32 Bit) tends to crap out when
Re: ARERR 300 Malloc failed on server
I double checked and I do not have a max attach size configured. I just restarted arserver and tried to attach the large word doc again within a few minutes of starting the server and got the memory allocation error. I also check the autogrow setting on the database and it is set to 100MB. Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Jason Miller Sent: Thursday, October 25, 2012 5:22 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Fascinating. Does it happen if you try right after an AR Server restart; before it's memory usage starts to get to its normal operating level? Just to double check you don't have Db-Max-Attach-Size set in the ar.cfg file? Jason On Thu, Oct 25, 2012 at 1:52 PM, Cecil, Ken kce...@hubbell.commailto:kce...@hubbell.com wrote: ** Just tried with a 5.9 MB pdf. No go... 10MB text file works! Any ideas? Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Jason Miller Sent: Thursday, October 25, 2012 4:43 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Just wondering. Do you keep trying with the same file each time? If so I wonder if there is something goofy going on in how the AR Server compresses and saves the file in the db? Is it only 4.6 MB Word docs? Would a 4.6 MB text file do the same thing? Jason On Thu, Oct 25, 2012 at 1:31 PM, Cecil, Ken kce...@hubbell.commailto:kce...@hubbell.com wrote: ** I am consistently reproducing the error by trying to attach a word doc that is about 4.6 MB to a Work Log entry to an Incident (also tried in a task and it fails there too). The error comes back in about 1 second. Here is the API and SQL log lines from when the error occurs. CLAT /* Thu Oct 25 2012 15:37:30.6130 */+API call API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */+CE ARCreateEntry -- schema HPD:WorkLog from Remedy User (protocol 14) at IP address 172.16.57.154 SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */BEGIN TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */OK SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */COMMIT TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */OK API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */-CE FAIL CLAT /* Thu Oct 25 2012 15:37:31.3950 */-API call Here is the Performance Graph No increase. Everything else seems to be working fine for everyone. I can even attach smaller files ok. I triple checked the file space on all the drives on both the AR server and the DB server and there are at least 15GB free on all of them. I just don't know where to look next. I still haven't received a call back from supt just email asking for the logs Someone suggested using the /3GB boot.ini switch. My question to that would be does that work on a 64bit version of Windows like we have? Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 2:34 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** How does the performance Graph tab look at the time of trying to add the attachment? And you have verified that you aren't out of filespace? From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Thursday, October 25, 2012 12:18 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Here are screenshots of what I see for the arserver.exe process before and after trying to attach a file (and getting the error) Try to attaché 1.2 Mb attachment (works) Try to attach 4.7 MB attachment (ARERR 300 Malloc failed) Anybody see anything? Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 8:57 AM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, I would agree that 1.2 on a 64Bit OS
Re: ARERR 300 Malloc failed on server
Hello Ken, Can you confirm what Patch level you are on for AR 7.5? The current Patch for 7.5 is I believe Patch 008, Did you try running patch 008 binary for arserver.exe and run into similar issue. Regards/Vaibhav On Thu, Oct 25, 2012 at 6:45 PM, Cecil, Ken kce...@hubbell.com wrote: ** I double checked and I do not have a max attach size configured. ** ** I just restarted arserver and tried to attach the large word doc again within a few minutes of starting the server and got the memory allocation error. ** ** I also check the autogrow setting on the database and it is set to 100MB.* *** ** ** ** ** Ken. ** ** *From:* Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] *On Behalf Of *Jason Miller *Sent:* Thursday, October 25, 2012 5:22 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** ** ** Fascinating. Does it happen if you try right after an AR Server restart; before it's memory usage starts to get to its normal operating level? ** ** Just to double check you don't have Db-Max-Attach-Size set in the ar.cfg file? ** ** Jason On Thu, Oct 25, 2012 at 1:52 PM, Cecil, Ken kce...@hubbell.com wrote:*** * ** Just tried with a 5.9 MB pdf. No go… 10MB text file works! Any ideas? Ken. *From:* Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] *On Behalf Of *Jason Miller *Sent:* Thursday, October 25, 2012 4:43 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** Just wondering. Do you keep trying with the same file each time? If so I wonder if there is something goofy going on in how the AR Server compresses and saves the file in the db? Is it only 4.6 MB Word docs? Would a 4.6 MB text file do the same thing?* *** Jason On Thu, Oct 25, 2012 at 1:31 PM, Cecil, Ken kce...@hubbell.com wrote:*** * ** I am consistently reproducing the error by trying to attach a word doc that is about 4.6 MB to a Work Log entry to an Incident (also tried in a task and it fails there too). The error comes back in about 1 second. Here is the API and SQL log lines from when the error occurs. CLAT /* Thu Oct 25 2012 15:37:30.6130 */+API call API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */+CE ARCreateEntry -- schema HPD:WorkLog from Remedy User (protocol 14) at IP address 172.16.57.154 SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */BEGIN TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */OK SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */COMMIT TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */OK API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil /* Thu Oct 25 2012 14:37:32.7550 */-CE FAIL CLAT /* Thu Oct 25 2012 15:37:31.3950 */-API call Here is the Performance Graph…. No increase. Everything else seems to be working fine for everyone. I can even attach smaller files ok. I triple checked the file space on all the drives on both the AR server and the DB server and there are at least 15GB free on all of them. I just don’t know where to look next. I still haven’t received a call back from supt just email asking for the logs Someone suggested using the /3GB boot.ini switch. My question to that would be does that work on a 64bit version of Windows like we have? Ken. *From:* Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] *On Behalf Of *Longwing, LJ CTR MDA/IC *Sent:* Thursday, October 25, 2012 2:34 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** How does the performance Graph tab look at the time of trying to add the attachment? And you have verified that you aren’t out of filespace? *From:* Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG arslist@ARSLIST.ORG] *On Behalf Of *Cecil, Ken *Sent:* Thursday, October 25, 2012 12:18 PM *To:* arslist@ARSLIST.ORG *Subject:* Re: ARERR 300 Malloc failed on server ** Here are screenshots of what I see for the arserver.exe process before and after trying to attach a file (and getting the error
Re: ARERR 300 Malloc failed on server
We are on patch 007 and have been on it for a long time before this started happening. It is production so I can't patch the system up to 008 without going through our change planning/release process which will take too long to try right now. Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of vaibhav wadekar Sent: Thursday, October 25, 2012 10:11 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Hello Ken, Can you confirm what Patch level you are on for AR 7.5? The current Patch for 7.5 is I believe Patch 008, Did you try running patch 008 binary for arserver.exe and run into similar issue. Regards/Vaibhav On Thu, Oct 25, 2012 at 6:45 PM, Cecil, Ken kce...@hubbell.commailto:kce...@hubbell.com wrote: ** I double checked and I do not have a max attach size configured. I just restarted arserver and tried to attach the large word doc again within a few minutes of starting the server and got the memory allocation error. I also check the autogrow setting on the database and it is set to 100MB. Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Jason Miller Sent: Thursday, October 25, 2012 5:22 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Fascinating. Does it happen if you try right after an AR Server restart; before it's memory usage starts to get to its normal operating level? Just to double check you don't have Db-Max-Attach-Size set in the ar.cfg file? Jason On Thu, Oct 25, 2012 at 1:52 PM, Cecil, Ken kce...@hubbell.commailto:kce...@hubbell.com wrote: ** Just tried with a 5.9 MB pdf. No go... 10MB text file works! Any ideas? Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Jason Miller Sent: Thursday, October 25, 2012 4:43 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** Just wondering. Do you keep trying with the same file each time? If so I wonder if there is something goofy going on in how the AR Server compresses and saves the file in the db? Is it only 4.6 MB Word docs? Would a 4.6 MB text file do the same thing? Jason On Thu, Oct 25, 2012 at 1:31 PM, Cecil, Ken kce...@hubbell.commailto:kce...@hubbell.com wrote: ** I am consistently reproducing the error by trying to attach a word doc that is about 4.6 MB to a Work Log entry to an Incident (also tried in a task and it fails there too). The error comes back in about 1 second. Here is the API and SQL log lines from when the error occurs. CLAT /* Thu Oct 25 2012 15:37:30.6130 */+API call API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */+CE ARCreateEntry -- schema HPD:WorkLog from Remedy User (protocol 14) at IP address 172.16.57.154 SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */BEGIN TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */OK SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */COMMIT TRANSACTION SQL TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */OK API TID: 004088 RPC ID: 399961 Queue: Fast Client-RPC: 390620USER: kcecil/* Thu Oct 25 2012 14:37:32.7550 */-CE FAIL CLAT /* Thu Oct 25 2012 15:37:31.3950 */-API call Here is the Performance Graph No increase. Everything else seems to be working fine for everyone. I can even attach smaller files ok. I triple checked the file space on all the drives on both the AR server and the DB server and there are at least 15GB free on all of them. I just don't know where to look next. I still haven't received a call back from supt just email asking for the logs Someone suggested using the /3GB boot.ini switch. My question to that would be does that work on a 64bit version of Windows like we have? Ken. From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Thursday, October 25, 2012 2:34 PM To: arslist@ARSLIST.ORGmailto:arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server ** How does the performance Graph tab look at the time of trying to add the attachment? And you have verified that you aren't out of filespace? From: Action
ARERR 300 Malloc failed on server
We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 ** This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.Hubbell.com - Hubbell Incorporated ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
Ken, Malloc errors are 'Memory Allocation' errors, which means that some piece of the system is asking the OS for memory, and is getting an OS level response that the memory is not available. Are you getting these errors on the User Tool or Midtier? Lisa On Wed, Oct 24, 2012 at 3:42 PM, Cecil, Ken kce...@hubbell.com wrote: ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA’s were trying to attach any attachment to an Incident. I ended up restarting the ar server service. ** ** Has anybody run across something similar? (Arerr 300 when working with attachments) ** ** I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. ** ** ** ** Thanks ** ** ** ** Ken Cecil 574-283-4248 kce...@hubbell.com ** ** ** ** AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 -- This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
HI David, Can you give us some more detail on what it means when access rights to a newly-created field are not properly defined? It is a bit bothersome to think 1) a lack of permissions can cause memory issues 2) that it is easy to not properly define a field which would cause memory issues. Jason On Wed, Oct 24, 2012 at 1:42 PM, David M. Clark david.m.cl...@tn.govwrote: We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ** This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.Hubbell.com - Hubbell Incorporated ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where
Re: ARERR 300 Malloc failed on server
If it's happening with attachments, I had this once before when the file system on the server was too full, since attachments go to local disk before going into the db I believe.. Sent from my BlackBerry device on the Rogers Wireless Network -Original Message- From: Cecil, Ken kce...@hubbell.com Sender: Action Request System discussion list(ARSList) arslist@ARSLIST.ORG Date: Wed, 24 Oct 2012 21:04:15 To: arslist@ARSLIST.ORG Reply-To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ** This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications
Re: ARERR 300 Malloc failed on server
AR 7.5 on Windows only has 32-bit binaries available. Even though the OS is 64-bit with 10gb arserver.exe will never take much more memory than you are seeing it use. It could be running out of room within its 32-bit realm. Although I wouldn't think a 4mb attachment should not be enough to push it over the edge. Jason On Wed, Oct 24, 2012 at 2:04 PM, Cecil, Ken kce...@hubbell.com wrote: Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto: arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ** This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's
Re: ARERR 300 Malloc failed on server
Ken, If you were to make a change in Dev studio like add a field or modify a filter, do you see this error pop up from a user perspective as well? When you do make a change, the memory usage of the arserver process should go up significantly. I would be curious to know if you start seeing the malloc errors when this happens. On Wed, Oct 24, 2012 at 3:42 PM, Cecil, Ken kce...@hubbell.com wrote: ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA’s were trying to attach any attachment to an Incident. I ended up restarting the ar server service. ** ** Has anybody run across something similar? (Arerr 300 when working with attachments) ** ** I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. ** ** ** ** Thanks ** ** ** ** Ken Cecil 574-283-4248 kce...@hubbell.com ** ** ** ** AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 -- This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ -- *Tauf Chowdhury * ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: ARERR 300 Malloc failed on server
Not sure how related this is, but we were experiencing memory blowout issues with server reaching within what is our Redhat O/S setup. We've had to change the memory manager remedy and the OS use to control this. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Thursday, 25 October 2012 10:04 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Simon, The servers are Windows Server 2003 Enterprise 64 bit with 10 GB RAM. David, New changes transported to production over since the beginning of September. LJ, That is what I thought. When everything hit the fan yesterday the arserver.exe process was only using ~1.2 GB of RAM. It is a 64 bit OS so I think that seems pretty low to cause an out of memory issue? Lisa, We get the error in both the Mid Tier and WUT. Thanks guys, Ken. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Simon Ellis Sent: Wednesday, October 24, 2012 4:52 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server What O/S are you running on? -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of David M. Clark Sent: Thursday, 25 October 2012 9:43 a.m. To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server We are getting this error intermittently over the past couple of weeks Have you recently customized anything in that area? I've seen this happen when access rights to a newly-created field are not properly defined. -D -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Longwing, LJ CTR MDA/IC Sent: Wednesday, October 24, 2012 3:31 PM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 Malloc failed on server Ken, It sounds like your arserver was bouncing up against a upper memory limit. This can happen sometimes with memory leaks that don't properly release memory once used. A restart of the service brings the system back down to initial minimums of startup. You may want to make sure that you are on the most recent patch of 7.5 to ensure that any known issues are taken care of properly. -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Cecil, Ken Sent: Wednesday, October 24, 2012 1:42 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 Malloc failed on server ** We are getting this error intermittently over the past couple of weeks. The most consistent time it is occurring is when trying to attach a largish attachment (around 4MB). Some have also received it when trying to open an attachment. Yesterday for awhile we were getting the error anytime the SDA's were trying to attach any attachment to an Incident. I ended up restarting the ar server service. Has anybody run across something similar? (Arerr 300 when working with attachments) I have a support request in with BMC and waiting for a reply. The KB articles I found did not seem to apply. Thanks Ken Cecil 574-283-4248 kce...@hubbell.com AR 7.5 ITSM 7.6 Windows 2003 Enterprise 64bit SQL 2008 This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third party's systems on our behalf] for the purposes of security and the assessment of internal compliance with Hubbell policies. This footnote also confirms that this email message has been swept for the presence of computer viruses. www.hubbell.com http://www.hubbell.com/ - Hubbell Incorporated _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ** This email and any files transmitted with it are confidential and intended solely for the addressee. If you have received this email in error please notify the system manager. Subject to local law, communications (including traffic data) with Hubbell may be monitored by our systems [or a third
Re: ARERR 300 - Malloc failed on server.
Thank you, everyone who responded. We have only rebooted which seems to have addressed this issue, at least for now. We will most likely be adding the /3GB parameter in the boot.ini file (as suggested by BMC below) and monitor logs We have seen such issues in the past, Malloc errors are the cause of higher memory growth. Per Microsoft suggestion we recommend adding /3gb parameter in a boot.ini file. The 32-bit versions of the Windows operating system can manage a maximum of 4GB of addressable memory. The 4GB is divided into 2GB for user applications and 2GB for kernel processes. This means that any given application is restricted to 2GB of memory. Adding /3GB switch which causes the operating system to divide the available 4GB of memory into 3GB for user applications and 1GB for kernel processes. Many translations that previously failed due to memory limitations will now run successfully when the /3GB switch is used. Laurie Muhlethaler First Republic Bank Remedy Developer / Administrator 415.364.4436 -Original Message- From: Muhlethaler, Laurie Sent: Thursday, February 12, 2009 8:51 AM To: arsl...@listserv.rbugs.com Cc: Muhlethaler, Laurie Subject: Re: ARERR 300 - Malloc failed on server. On Thu, 12 Feb 2009 00:23:19 -0600, Matt Reinfeldt arsl...@mattreinfeldt.com wrote: Laurie, I just re-read both your post and mine and thought I should be more specific. the fix I suggested is one that has been implemented when experiencing issues with the Overview Console and a few other items in ITSM. If a simple restart of the services gets you back on your feet, then cool. I just wanted to offer a couple of suggestions for investigation for you. Thanks, Matt R. From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Matt Reinfeldt Sent: Thursday, February 12, 2009 12:12 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 - Malloc failed on server. Laurie, One thing I would definitely look at is the ardbcQuery.dll. Get the one from the ITSM 7.0.03 patch009 package and replace it everywhere you find it on your server (keep a backup copy of your current version, in case you want to back it out). Other than that, look at the server patches between patch002 and patch006, which is the latest to see if any of the defects addressed match what you're reporting. Good luck! Matt R. From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Muhlethaler, Laurie Sent: Wednesday, February 11, 2009 5:20 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 - Malloc failed on server. Importance: High ** Listers ~ several users have encountered the ARERR 300 - Malloc failed on server error when trying to launch an incident. Additionally, the table in the IM Console doesn't list any incidents even though I know there are some (evidenced by my being able to scroll through the table and highlight various rows, even though nothing appears). We don't reboot or restart services on a regular basis and from what I can tell from the error messages doc info below, this may contribute to the problem. I'd like to restart the arserver service, but not before I've gotten suggestions from you folks. Any help is greatly appreciated. Malloc failed on server. The system encountered an error during a call to allocate space. The failure occurred on the server during processing of a call from the client. In general, this error occurs when too many processes are running or when some processes have grown to occupy most or all available memory on the server. Recover the memory by shutting down unneeded processes or by restarting processes that have been running for a while. Windows Server 2003 SQL Server 2005 MidTier: IIS 6 (Apache Tomcat) Java: 1.5.0_15 AR Server / Admin / Client - 7.1.00 Patch 002 7.0.03 Patch 006 Service Desk Asset Management Laurie Muhlethaler First Republic Bank Remedy Developer / Administrator 415.364.4436 UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are -- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. This message cannot be guaranteed to be secure or error-free. First Republic Bank and its related entities do not take responsibility for, or accept time-sensitive instructions sent by email including orders, funds transfer instructions or stop payments on checks. All instructions of this nature must be handled by direct communication, not email
ARERR 300 - Malloc failed on server.
Listers ~ several users have encountered the ARERR 300 - Malloc failed on server error when trying to launch an incident. Additionally, the table in the IM Console doesn't list any incidents even though I know there are some (evidenced by my being able to scroll through the table and highlight various rows, even though nothing appears). We don't reboot or restart services on a regular basis and from what I can tell from the error messages doc info below, this may contribute to the problem. I'd like to restart the arserver service, but not before I've gotten suggestions from you folks... Any help is greatly appreciated. Malloc failed on server. The system encountered an error during a call to allocate space. The failure occurred on the server during processing of a call from the client. In general, this error occurs when too many processes are running or when some processes have grown to occupy most or all available memory on the server. Recover the memory by shutting down unneeded processes or by restarting processes that have been running for a while. Windows Server 2003 SQL Server 2005 MidTier: IIS 6 (Apache Tomcat) Java: 1.5.0_15 AR Server / Admin / Client - 7.1.00 Patch 002 7.0.03 Patch 006 Service Desk Asset Management Laurie Muhlethaler First Republic Bank Remedy Developer / Administrator 415.364.4436 -- The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. This message cannot be guaranteed to be secure or error-free. First Republic Bank and its related entities do not take responsibility for, or accept time-sensitive instructions sent by email including orders, funds transfer instructions or stop payments on checks. All instructions of this nature must be handled by direct communication, not email. We reserve the right to monitor and review the content of all email communications sent or received. Emails sent to or from this address may be stored in accordance with regulatory requirements. First Republic Bank is a Division of Merrill Lynch Bank Trust Co., FSB ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: ARERR 300 - Malloc failed on server.
Unfortunately, this error doesn’t have a specific behavior and root cause I recommend to you is to monitor if the server is not running out of memory and create dedicated queues for any process that pushes data to your ARS, also check if the transaction log of the DB is not having problems Reconfigure your log level to “detailed” and turn on the api and sql log, also as preventing try to increase the number of threads (List) of the server. Best Regards Hugo Ruesga perotsystems® US 972.577.7000 MX +52 (33) 3332.3868 P Please consider the environment before printing this email The information contained in and transferred with this electronic message is intended only for the recipient(s) designated above, it is protected by law and it may contain information which is privileged and confidential. If you are not the intended recipient, please do not read, copy, or use it, and do not disclose it to others. Please notify the sender of the delivery error by replying to this message, and then delete it from your system. Thank you. Date: Wed, 11 Feb 2009 15:19:35 -0800 From: lmuhletha...@firstrepublic.com Subject: ARERR 300 - Malloc failed on server. To: arslist@ARSLIST.ORG ** Listers ~ several users have encountered the “ARERR 300 - Malloc failed on server” error when trying to launch an incident. Additionally, the table in the IM Console doesn’t list any incidents even though I know there are some (evidenced by my being able to scroll through the table and highlight various rows, even though nothing appears). We don’t reboot or restart services on a regular basis and from what I can tell from the error messages doc info below, this may contribute to the problem. I’d like to restart the arserver service, but not before I’ve gotten suggestions from you folks… Any help is greatly appreciated. Malloc failed on server. The system encountered an error during a call to allocate space. The failure occurred on the server during processing of a call from the client. In general, this error occurs when too many processes are running or when some processes have grown to occupy most or all available memory on the server. Recover the memory by shutting down unneeded processes or by restarting processes that have been running for a while. Windows Server 2003 SQL Server 2005 MidTier: IIS 6 (Apache Tomcat) Java: 1.5.0_15 AR Server / Admin / Client - 7.1.00 Patch 002 7.0.03 Patch 006 Service Desk Asset Management Laurie Muhlethaler First Republic Bank Remedy Developer / Administrator 415.364.4436 The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. This message cannot be guaranteed to be secure or error-free. First Republic Bank and its related entities do not take responsibility for, or accept time-sensitive instructions sent by email including orders, funds transfer instructions or stop payments on checks. All instructions of this nature must be handled by direct communication, not email. We reserve the right to monitor and review the content of all email communications sent or received. Emails sent to or from this address may be stored in accordance with regulatory requirements. First Republic Bank is a Division of Merrill Lynch Bank Trust Co., FSB__Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ _ Realiza búsquedas en Internet y llévate hasta ¡Un Auto! http://www.ganabuscando.com/Default.aspx ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: ARERR 300 - Malloc failed on server.
Laurie, One thing I would definitely look at is the ardbcQuery.dll. Get the one from the ITSM 7.0.03 patch009 package and replace it everywhere you find it on your server (keep a backup copy of your current version, in case you want to back it out). Other than that, look at the server patches between patch002 and patch006, which is the latest to see if any of the defects addressed match what you're reporting. Good luck! Matt R. From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Muhlethaler, Laurie Sent: Wednesday, February 11, 2009 5:20 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 - Malloc failed on server. Importance: High ** Listers ~ several users have encountered the ARERR 300 - Malloc failed on server error when trying to launch an incident. Additionally, the table in the IM Console doesn't list any incidents even though I know there are some (evidenced by my being able to scroll through the table and highlight various rows, even though nothing appears). We don't reboot or restart services on a regular basis and from what I can tell from the error messages doc info below, this may contribute to the problem. I'd like to restart the arserver service, but not before I've gotten suggestions from you folks. Any help is greatly appreciated. Malloc failed on server. The system encountered an error during a call to allocate space. The failure occurred on the server during processing of a call from the client. In general, this error occurs when too many processes are running or when some processes have grown to occupy most or all available memory on the server. Recover the memory by shutting down unneeded processes or by restarting processes that have been running for a while. Windows Server 2003 SQL Server 2005 MidTier: IIS 6 (Apache Tomcat) Java: 1.5.0_15 AR Server / Admin / Client - 7.1.00 Patch 002 7.0.03 Patch 006 Service Desk Asset Management Laurie Muhlethaler First Republic Bank Remedy Developer / Administrator 415.364.4436 [First Republic Bank logo] http://logos.firstrepublic.com/FRB.jpg _ The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. This message cannot be guaranteed to be secure or error-free. First Republic Bank and its related entities do not take responsibility for, or accept time-sensitive instructions sent by email including orders, funds transfer instructions or stop payments on checks. All instructions of this nature must be handled by direct communication, not email. We reserve the right to monitor and review the content of all email communications sent or received. Emails sent to or from this address may be stored in accordance with regulatory requirements. First Republic Bank is a Division of Merrill Lynch Bank Trust Co., FSB __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
Re: ARERR 300 - Malloc failed on server.
Laurie, I just re-read both your post and mine and thought I should be more specific. the fix I suggested is one that has been implemented when experiencing issues with the Overview Console and a few other items in ITSM. If a simple restart of the services gets you back on your feet, then cool. I just wanted to offer a couple of suggestions for investigation for you. Thanks, Matt R. From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Matt Reinfeldt Sent: Thursday, February 12, 2009 12:12 AM To: arslist@ARSLIST.ORG Subject: Re: ARERR 300 - Malloc failed on server. ** Laurie, One thing I would definitely look at is the ardbcQuery.dll. Get the one from the ITSM 7.0.03 patch009 package and replace it everywhere you find it on your server (keep a backup copy of your current version, in case you want to back it out). Other than that, look at the server patches between patch002 and patch006, which is the latest to see if any of the defects addressed match what you're reporting. Good luck! Matt R. From: Action Request System discussion list(ARSList) [mailto:arsl...@arslist.org] On Behalf Of Muhlethaler, Laurie Sent: Wednesday, February 11, 2009 5:20 PM To: arslist@ARSLIST.ORG Subject: ARERR 300 - Malloc failed on server. Importance: High ** Listers ~ several users have encountered the ARERR 300 - Malloc failed on server error when trying to launch an incident. Additionally, the table in the IM Console doesn't list any incidents even though I know there are some (evidenced by my being able to scroll through the table and highlight various rows, even though nothing appears). We don't reboot or restart services on a regular basis and from what I can tell from the error messages doc info below, this may contribute to the problem. I'd like to restart the arserver service, but not before I've gotten suggestions from you folks. Any help is greatly appreciated. Malloc failed on server. The system encountered an error during a call to allocate space. The failure occurred on the server during processing of a call from the client. In general, this error occurs when too many processes are running or when some processes have grown to occupy most or all available memory on the server. Recover the memory by shutting down unneeded processes or by restarting processes that have been running for a while. Windows Server 2003 SQL Server 2005 MidTier: IIS 6 (Apache Tomcat) Java: 1.5.0_15 AR Server / Admin / Client - 7.1.00 Patch 002 7.0.03 Patch 006 Service Desk Asset Management Laurie Muhlethaler First Republic Bank Remedy Developer / Administrator 415.364.4436 [First Republic Bank logo] http://logos.firstrepublic.com/FRB.jpg _ The information transmitted is intended only for the person or entity to which it is addressed and may contain confidential and/or privileged material. Any review, retransmission, dissemination or other use of, or taking of any action in reliance upon, this information by persons or entities other than the intended recipient is prohibited. If you received this in error, please contact the sender and delete the material from any computer. This message cannot be guaranteed to be secure or error-free. First Republic Bank and its related entities do not take responsibility for, or accept time-sensitive instructions sent by email including orders, funds transfer instructions or stop payments on checks. All instructions of this nature must be handled by direct communication, not email. We reserve the right to monitor and review the content of all email communications sent or received. Emails sent to or from this address may be stored in accordance with regulatory requirements. First Republic Bank is a Division of Merrill Lynch Bank Trust Co., FSB __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ __Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are html___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: RMI Solutions ARSlist: Where the Answers Are
ARERR 300- Malloc failed on server
Hello all, I am getting this thing on my client(and not ARERR 154 which is Malloc error in client library). Does the ARERR 300(Malloc failed on server) get registered in arerror.log file? If its supposed to be registered then i would tell you in advance that i am not seeing it in arerror.log. Is there some bug here? Please let me know where exactly does that get registered. Thanks Chintan. - Moody friends. Drama queens. Your life? Nope! - their life, your story. Play Sims Stories at Yahoo! Games. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org ARSlist:Where the Answers Are
Re: ARERR 300- Malloc failed on server
How much memory is available on the server; things tend to act weird when malloc's start to fail. Malloc's are more than likely required in the logging routine, so a failure c/would block the log write. Axton Grams On 8/3/07, Chintan Shah [EMAIL PROTECTED] wrote: ** Hello all, I am getting this thing on my client(and not ARERR 154 which is Malloc error in client library). Does the ARERR 300(Malloc failed on server) get registered in arerror.log file? If its supposed to be registered then i would tell you in advance that i am not seeing it in arerror.log. Is there some bug here? Please let me know where exactly does that get registered. Thanks Chintan. Moody friends. Drama queens. Your life? Nope! - their life, your story. Play Sims Stories at Yahoo! Games. __20060125___This posting was submitted with HTML in it___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org ARSlist:Where the Answers Are
Re: ARERR 300- Malloc failed on server
i was running qualified searches through 7 client sessions on a certain form...not sure ..but arserverd recycled at 4020M by itself and restarted. i am sorry about my ignorance but can you please elaborate on Malloc's are more than likely required in the logging routine, so a failure c/would block the log write. Does it has to write to log? Appreciate your quick response. Thanks Chintan. Axton [EMAIL PROTECTED] wrote: How much memory is available on the server; things tend to act weird when malloc's start to fail. Malloc's are more than likely required in the logging routine, so a failure c/would block the log write. Axton Grams On 8/3/07, Chintan Shah wrote: ** Hello all, I am getting this thing on my client(and not ARERR 154 which is Malloc error in client library). Does the ARERR 300(Malloc failed on server) get registered in arerror.log file? If its supposed to be registered then i would tell you in advance that i am not seeing it in arerror.log. Is there some bug here? Please let me know where exactly does that get registered. Thanks Chintan. Moody friends. Drama queens. Your life? Nope! - their life, your story. Play Sims Stories at Yahoo! Games. __20060125___This posting was submitted with HTML in it___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org ARSlist:Where the Answers Are - Park yourself in front of a world of choices in alternative vehicles. Visit the Yahoo! Auto Green Center. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org ARSlist:Where the Answers Are
Re: ARERR 300- Malloc failed on server
If you hit 4020M, you hit the limit of memory that a 32-bit process can allocate. This indicates a serious memory leak in the version/patch of arserverd you are running. There is a known issue with 7.0.1, pre-patch 1, if using older clients (6.3 and earlier, i believe) against a unicode arserver. If this is the case, patch the system to at least patch 1 and this issue should be resolved. Axton Grams On 8/3/07, Chintan Shah [EMAIL PROTECTED] wrote: ** i was running qualified searches through 7 client sessions on a certain form...not sure ..but arserverd recycled at 4020M by itself and restarted. i am sorry about my ignorance but can you please elaborate on Malloc's are more than likely required in the logging routine, so a failure c/would block the log write. Does it has to write to log? Appreciate your quick response. Thanks Chintan. Axton [EMAIL PROTECTED] wrote: How much memory is available on the server; things tend to act weird when malloc's start to fail. Malloc's are more than likely required in the logging routine, so a failure c/would block the log write. Axton Grams On 8/3/07, Chintan Shah wrote: ** Hello all, I am getting this thing on my client(and not ARERR 154 which is Malloc error in client library). Does the ARERR 300(Malloc failed on server) get registered in arerror.log file? If its supposed to be registered then i would tell you in advance that i am not seeing it in arerror.log. Is there some bug here? Please let me know where exactly does that get registered. Thanks Chintan. Moody friends. Drama queens. Your life? Nope! - their life, your story. Play Sims Stories at Yahoo! Games. __20060125___This posting was submitted with HTML in it___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org ARSlist:Where the Answers Are Park yourself in front of a world of choices in alternative vehicles. Visit the Yahoo! Auto Green Center. __20060125___This posting was submitted with HTML in it___ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org ARSlist:Where the Answers Are
