Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Ok so we got to the root of the problem causing the system to crash. So I noticed that a handful of incidents were being updated with work info. This work info would push back to the related Service Request. But there is a filter that would loop and keep looping endlessly until the system crashed. HPD:INC:UpdateComm_577_PWLG This only started happening with SRM 2.1 but the filter above was last modified with our original Remedy 7.0.0 install. Sept 2006. We disabled this workflow and the server doesn't crash. Anyone else experiencing this same issue with SRm 2.1? On Feb 14, 4:22 pm, [EMAIL PROTECTED] wrote: It took a bit of time to find out where this went hahaha. Sorry but I'm changing the subject back. On Feb 14, 12:02 pm, Sanford, Claire [EMAIL PROTECTED] wrote: Does anyone have any idea why some times when a Task ticket is updated, the entry is copied to the CHG ticket's Work Log and other times it is NOT copied to the CHG Work Log. It doesn't happen often and there is no pattern that I can see. I have been unable to duplicate it. ARS 6.3 Patch 18 HD 6.0 Oracle 10 w/9 libraries Oracle lives on a remote server Windows 2003 4 gig on app server and 8 gig on DB server Claire Sanford Information Systems Division Memorial Hermann Healthcare System Phone: 713 448 6035 [EMAIL PROTECTED] ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Our support team has found that the 2 error logs we sent showed that both times the ar server crapped out at a filter/filter guide. SRM:AOI:Process_IN_PushAppRequestInfo_05_EventParam_TableLoop (165) I wonder if the other 2 people experiencing issue might be able to check their filter logs to see if it happens at that filter also. On Feb 14, 9:01 am, [EMAIL PROTECTED] wrote: Nothing unusual in the event log of either ars server or ars db server. On Feb 14, 1:20 am, Joe D'Souza [EMAIL PROTECTED] wrote: Also take a look at your Windows Events log and check the errors that get written in chronological order.. This will probably give you an insight as to why the AR Server service restarted as there might be related errors written to the event long prior to the AR Server restart that may have caused it to restart.. Cheers Joe -Original Message- From: Action Request System discussion list(ARSList) [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 5:10 PM To: [EMAIL PROTECTED] Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Thanks for the tips. We are running Windows 2003 Remedy 7.0.1 patch 4 ITSM 7.0.3 patch 6 SRM 2.1 SLM 7.0.3 patch 4 Database is on a remote server with windows 2003 and sql 2000. I will check out the email part and hopefully see something that can be fixed. Harry On Feb 13, 4:51 pm, john rosquist [EMAIL PROTECTED] wrote: Consider disabling escalations for a bit. Also, consider and evaluate the email engine. Are the emails in the queues very large. Are there LOTS of them? Unix or windows? Penetration testing will cause a remedy server to crash, but just once per scan event. John - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 4:14:34 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Did that.. and they are looking into it... Why would the remedy service suddenly restart? I can see it happen. I've seen it 3 times when people message me that it is down. I check the server and the remedy service restarts (not the sever but just the service) arerror.log doesn't seem to indicate anything other than the actual error users get. DB log file shows no errors. On Feb 13, 3:20 pm, john rosquist [EMAIL PROTECTED] wrote: TLI error is a networking error. Given that the ARS server happens to be down at the time, it means that the client/midtier cannot connect to it. Turn SQL and API logging on. Look in the arerror.log in the db directory. Look at your db too. Call home to support to have them start working the issue too. John Rosquist Windward - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 2:38:26 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Hi, We are getting the same issues. When looking at the event logs and witnessing it happen, it looks like something is causing the Remedy service to restart by itself on our system. This causes a 2-4 minutes outage as the remedy service restarts itself. We are in the midst of troubleshooting. Anyone else with any ideas on how approach troubleshooting this? It really has us stumped here. Thanks On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote: We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
{\rtf1\ansi\ansicpg1252\deff0\deftab360{\fonttbl{\f0\froman\fprq2\fcharset0 Times New Roman;}{\f1\fswiss\fcharset0 Arial;}} \viewkind4\uc1\pard\lang1033\f0\fs20 I'm assuming you checked both the Application as well as System logs in the Windows Event viewer\par \par What about the arerror log file at the time the system went down?\par \par Joe\par \par -Original Message-\par From: Action Request System discussion list(ARSList) [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Thursday, February 14, 2008 10:03 AM\par To: [EMAIL PROTECTED] Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?\par \par \par Our support team has found that the 2 error logs we sent showed that both times the ar server crapped out at a filter/filter guide. SRM:AOI:Process_IN_PushAppRequestInfo_05_EventParam_TableLoop (165)\par \par I wonder if the other 2 people experiencing issue might be able to check their filter logs to see if it happens at that filter also.\par \par \par \par On Feb 14, 9:01 am, [EMAIL PROTECTED] wrote:\par Nothing unusual in the event log of either ars server or ars db\par server.\par \par On Feb 14, 1:20 am, Joe D'Souza [EMAIL PROTECTED] wrote:\par \par \par \par \par \par Also take a look at your Windows Events log and check the errors that get\par written in chronological order.. This will probably give you an insight as\par to why the AR Server service restarted as there might be related errors\par written to the event long prior to the AR Server restart that may have\par caused it to restart..\par \par Cheers\par \par Joe\par \par -Original Message-\par From: Action Request System discussion list(ARSList)\par \par [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 5:10 PM\par To: [EMAIL PROTECTED] Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?\par \par Thanks for the tips.\par \par We are running Windows 2003\par Remedy 7.0.1 patch 4\par ITSM 7.0.3 patch 6\par SRM 2.1\par SLM 7.0.3 patch 4\par \par Database is on a remote server with windows 2003 and sql 2000.\par \par I will check out the email part and hopefully see something that can\par be fixed.\par \par Harry\par \par On Feb 13, 4:51 pm, john rosquist [EMAIL PROTECTED] wrote:\par Consider disabling escalations for a bit.Also, consider and evaluate\par the email engine. Are the emails in the queues very large. Are there LOTS of\par them?\par \par Unix or windows?\par \par Penetration testing will cause a remedy server to crash, but just once per\par scan event.\par \par John\par \par - Original Message \par From: [EMAIL PROTECTED] [EMAIL PROTECTED]\par To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 4:14:34 PM\par Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?\par \par Did that.. and they are looking into it...\par \par Why would the remedy service suddenly restart?\par I can see it happen.I've seen it 3 times when people message me that\par it is down.\par I check the server and the remedy service restarts (not the sever but\par just the service)\par \par arerror.log doesn't seem to indicate anything other than the actual\par error users get.\par DB log file shows no errors.\par \par On Feb 13, 3:20 pm, john rosquist [EMAIL PROTECTED] wrote:\par TLI error is a networking error.Given that the ARS server happens to\par be down at the time, it means that the client/midtier cannot connect to it.\par \par Turn SQL and API logging on. Look in the arerror.log in the db\par directory. Look at your db too.\par \par Call home to support to have them start working the issue too.\par \par John Rosquist\par Windward\par \par - Original Message \par From: [EMAIL PROTECTED] [EMAIL PROTECTED]\par To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 2:38:26 PM\par Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?\par \par Hi,\par \par We are getting the same issues.\par When looking at the event logs and witnessing it happen, it looks like\par something is causing the Remedy service to restart by itself on our\par system.\par This causes a 2-4 minutes outage as the remedy service restarts\par itself.\par We are in the midst of troubleshooting.\par \par Anyone else with any ideas on how approach troubleshooting this?\par It really has us stumped here.\par \par Thanks\par \par On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote:\par We (2 admins) just experienced this exact error yesterday.I was\par just\par Emailing my network security folks to see if there are any security\par port scans that might be occuring.We're
ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
It took a bit of time to find out where this went hahaha. Sorry but I'm changing the subject back. On Feb 14, 12:02 pm, Sanford, Claire [EMAIL PROTECTED] wrote: Does anyone have any idea why some times when a Task ticket is updated, the entry is copied to the CHG ticket's Work Log and other times it is NOT copied to the CHG Work Log. It doesn't happen often and there is no pattern that I can see. I have been unable to duplicate it. ARS 6.3 Patch 18 HD 6.0 Oracle 10 w/9 libraries Oracle lives on a remote server Windows 2003 4 gig on app server and 8 gig on DB server Claire Sanford Information Systems Division Memorial Hermann Healthcare System Phone: 713 448 6035 [EMAIL PROTECTED] ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Hi, We are getting the same issues. When looking at the event logs and witnessing it happen, it looks like something is causing the Remedy service to restart by itself on our system. This causes a 2-4 minutes outage as the remedy service restarts itself. We are in the midst of troubleshooting. Anyone else with any ideas on how approach troubleshooting this? It really has us stumped here. Thanks On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote: We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
TLI error is a networking error. Given that the ARS server happens to be down at the time, it means that the client/midtier cannot connect to it. Turn SQL and API logging on. Look in the arerror.log in the db directory. Look at your db too. Call home to support to have them start working the issue too. John Rosquist Windward - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: arslist@ARSLIST.ORG Sent: Wednesday, February 13, 2008 2:38:26 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Hi, We are getting the same issues. When looking at the event logs and witnessing it happen, it looks like something is causing the Remedy service to restart by itself on our system. This causes a 2-4 minutes outage as the remedy service restarts itself. We are in the midst of troubleshooting. Anyone else with any ideas on how approach troubleshooting this? It really has us stumped here. Thanks On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote: We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are Looking for last minute shopping deals? Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Actually, over the weekend, we put SRM 2.1 into production and ITSM module patch 6. After this, our problems started with the AR ERR [90] Cannot establish a network connection to the AR System server: our server (0) : RPC: Miscellaneous tli error - System error (connection refused) It started on Monday when people started using Remedy and since then it is randomly occurring. This message has come up in 6 different intervals with the remedy service restart happening about 3-5 times in each interval of 30-60 minutes (if that makes sense) arerror.log doesn't reveal much. armonitor.log doesn't reveal much either. my event log has these entries to pinpoint when the message comes up. this message means that the remedy service started running so about 2-4 minutes prior, the remedy service stopped. Event Type: Information Event Source: Service Control Manager Event Category: None Event ID: 7036 Date: 2/13/2008 Time: 12:46:18 PM User: N/A Computer: BBSREMEDYAPP Description: The Remedy Action Request System Server service entered the running state. For more information, see Help and Support Center at http://go.microsoft.com/fwlink/events.asp. There is no message anywhere on why the remedy service stopped. On Feb 13, 2:38 pm, [EMAIL PROTECTED] wrote: Hi, We are getting the same issues. When looking at the event logs and witnessing it happen, it looks like something is causing the Remedy service to restart by itself on our system. This causes a 2-4 minutes outage as the remedy service restarts itself. We are in the midst of troubleshooting. Anyone else with any ideas on how approach troubleshooting this? It really has us stumped here. Thanks On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote: We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Did that.. and they are looking into it... Why would the remedy service suddenly restart? I can see it happen. I've seen it 3 times when people message me that it is down. I check the server and the remedy service restarts (not the sever but just the service) arerror.log doesn't seem to indicate anything other than the actual error users get. DB log file shows no errors. On Feb 13, 3:20 pm, john rosquist [EMAIL PROTECTED] wrote: TLI error is a networking error. Given that the ARS server happens to be down at the time, it means that the client/midtier cannot connect to it. Turn SQL and API logging on. Look in the arerror.log in the db directory. Look at your db too. Call home to support to have them start working the issue too. John Rosquist Windward - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 2:38:26 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Hi, We are getting the same issues. When looking at the event logs and witnessing it happen, it looks like something is causing the Remedy service to restart by itself on our system. This causes a 2-4 minutes outage as the remedy service restarts itself. We are in the midst of troubleshooting. Anyone else with any ideas on how approach troubleshooting this? It really has us stumped here. Thanks On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote: We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are ____ Looking for last minute shopping deals? Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org Platinum Sponsor: www.rmsportal.com ARSlist: Where the Answers Are
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Consider disabling escalations for a bit. Also, consider and evaluate the email engine. Are the emails in the queues very large. Are there LOTS of them? Unix or windows? Penetration testing will cause a remedy server to crash, but just once per scan event. John - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: arslist@ARSLIST.ORG Sent: Wednesday, February 13, 2008 4:14:34 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Did that.. and they are looking into it... Why would the remedy service suddenly restart? I can see it happen. I've seen it 3 times when people message me that it is down. I check the server and the remedy service restarts (not the sever but just the service) arerror.log doesn't seem to indicate anything other than the actual error users get. DB log file shows no errors. On Feb 13, 3:20 pm, john rosquist [EMAIL PROTECTED] wrote: TLI error is a networking error. Given that the ARS server happens to be down at the time, it means that the client/midtier cannot connect to it. Turn SQL and API logging on. Look in the arerror.log in the db directory. Look at your db too. Call home to support to have them start working the issue too. John Rosquist Windward - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 2:38:26 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Hi, We are getting the same issues. When looking at the event logs and witnessing it happen, it looks like something is causing the Remedy service to restart by itself on our system. This causes a 2-4 minutes outage as the remedy service restarts itself. We are in the midst of troubleshooting. Anyone else with any ideas on how approach troubleshooting this? It really has us stumped here. Thanks On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote: We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are ____ Looking for last minute shopping deals? Find them fast with Yahoo! Search. http://tools.search.yahoo.com/newsearch/category.php?category=shopping ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist: Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
Thanks for the tips. We are running Windows 2003 Remedy 7.0.1 patch 4 ITSM 7.0.3 patch 6 SRM 2.1 SLM 7.0.3 patch 4 Database is on a remote server with windows 2003 and sql 2000. I will check out the email part and hopefully see something that can be fixed. Harry On Feb 13, 4:51 pm, john rosquist [EMAIL PROTECTED] wrote: Consider disabling escalations for a bit. Also, consider and evaluate the email engine. Are the emails in the queues very large. Are there LOTS of them? Unix or windows? Penetration testing will cause a remedy server to crash, but just once per scan event. John - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 4:14:34 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Did that.. and they are looking into it... Why would the remedy service suddenly restart? I can see it happen. I've seen it 3 times when people message me that it is down. I check the server and the remedy service restarts (not the sever but just the service) arerror.log doesn't seem to indicate anything other than the actual error users get. DB log file shows no errors. On Feb 13, 3:20 pm, john rosquist [EMAIL PROTECTED] wrote: TLI error is a networking error. Given that the ARS server happens to be down at the time, it means that the client/midtier cannot connect to it. Turn SQL and API logging on. Look in the arerror.log in the db directory. Look at your db too. Call home to support to have them start working the issue too. John Rosquist Windward - Original Message From: [EMAIL PROTECTED] [EMAIL PROTECTED] To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 2:38:26 PM Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ? Hi, We are getting the same issues. When looking at the event logs and witnessing it happen, it looks like something is causing the Remedy service to restart by itself on our system. This causes a 2-4 minutes outage as the remedy service restarts itself. We are in the midst of troubleshooting. Anyone else with any ideas on how approach troubleshooting this? It really has us stumped here. Thanks On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote: We (2 admins) just experienced this exact error yesterday. I was just Emailing my network security folks to see if there are any security port scans that might be occuring. We're building our production 7.1 server so the fast and list tread count are default out of the box. I had a rpc connection error during the same time frame while loading SRM. On Feb 13, 8:43 am, Durrant, Michael M. - ITSD [EMAIL PROTECTED] wrote: Howdy listers, Yesterday, when submitting searches, we were being greeted by a strange error: AR ERR [90] Cannot establish a network connection to the AR System server: dhwrem (0) : RPC: Miscellaneous tli error - System error (connection refused) We could create new cases and modify existing cases, but we could not submit searches. I checked the arerror.log and there was nothing out of the ordinary, save for a bunch of SendEMail() 390620 : Parameter list for a function is empty messages, which are typical (yet unexplained) on our system. In a moment of panic, I increased the number of list and fast threads on our server and restarted the server. I haven't seen the error yet today but the morning is still young... Any one seen this before? TIA, Michael The information contained in this email may be privileged, confidential or otherwise protected from disclosure. All persons are advised that they may face penalties under state and federal law for sharing this information with unauthorized individuals. If you received this email in error, please reply to the sender that you have received this information in error. Also, please delete this email after replying to the sender. ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are- Hide quoted text - - Show quoted text - ___ UNSUBSCRIBE or access ARSlist Archives atwww.arslist.org Platinum Sponsor:www.rmsportal.comARSlist:Where the Answers Are ____ Looking for last minute shopping deals? Find them fast with Yahoo! Search. http
Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?
{\rtf1\ansi\ansicpg1252\deff0\deftab360{\fonttbl{\f0\froman\fprq2\fcharset0 Times New Roman;}{\f1\fswiss\fcharset0 Arial;}} \viewkind4\uc1\pard\lang1033\f0\fs20 Also take a look at your Windows Events log and check the errors that get written in chronological order.. This will probably give you an insight as to why the AR Server service restarted as there might be related errors written to the event long prior to the AR Server restart that may have caused it to restart..\par \par Cheers\par \par Joe\par \par -Original Message-\par From: Action Request System discussion list(ARSList)\par [mailto:[EMAIL PROTECTED] Behalf Of [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 5:10 PM\par To: [EMAIL PROTECTED] Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?\par \par \par Thanks for the tips.\par \par We are running Windows 2003\par Remedy 7.0.1 patch 4\par ITSM 7.0.3 patch 6\par SRM 2.1\par SLM 7.0.3 patch 4\par \par Database is on a remote server with windows 2003 and sql 2000.\par \par I will check out the email part and hopefully see something that can\par be fixed.\par \par \par Harry\par \par On Feb 13, 4:51 pm, john rosquist [EMAIL PROTECTED] wrote:\par Consider disabling escalations for a bit. Also, consider and evaluate the email engine. Are the emails in the queues very large. Are there LOTS of them?\par \par Unix or windows?\par \par Penetration testing will cause a remedy server to crash, but just once per scan event.\par \par John\par \par \par \par - Original Message \par From: [EMAIL PROTECTED] [EMAIL PROTECTED]\par To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 4:14:34 PM\par Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?\par \par Did that.. and they are looking into it...\par \par Why would the remedy service suddenly restart?\par I can see it happen. I've seen it 3 times when people message me that\par it is down.\par I check the server and the remedy service restarts (not the sever but\par just the service)\par \par arerror.log doesn't seem to indicate anything other than the actual\par error users get.\par DB log file shows no errors.\par \par On Feb 13, 3:20 pm, john rosquist [EMAIL PROTECTED] wrote:\par TLI error is a networking error. Given that the ARS server happens to be down at the time, it means that the client/midtier cannot connect to it.\par \par Turn SQL and API logging on. Look in the arerror.log in the db directory. Look at your db too.\par \par Call home to support to have them start working the issue too.\par \par John Rosquist\par Windward\par \par - Original Message \par From: [EMAIL PROTECTED] [EMAIL PROTECTED]\par To: [EMAIL PROTECTED] Sent: Wednesday, February 13, 2008 2:38:26 PM\par Subject: Re: ARERR 90 - RPC: Miscellaneous TLI Error - System error ?\par \par Hi,\par \par We are getting the same issues.\par When looking at the event logs and witnessing it happen, it looks like\par something is causing the Remedy service to restart by itself on our\par system.\par This causes a 2-4 minutes outage as the remedy service restarts\par itself.\par We are in the midst of troubleshooting.\par \par Anyone else with any ideas on how approach troubleshooting this?\par It really has us stumped here.\par \par Thanks\par \par On Feb 13, 11:41 am, Peter [EMAIL PROTECTED] wrote:\par We (2 admins) just experienced this exact error yesterday. I was just\par Emailing my network security folks to see if there are any security\par port scans that might be occuring. We're building our production 7.1\par server so the fast and list tread count are default out of the box.\par I had a rpc connection error during the same time frame while loading\par SRM.\par \par On Feb 13, 8:43 am, Durrant, Michael M. - ITSD\par \par [EMAIL PROTECTED] wrote:\par Howdy listers,\par \par Yesterday, when submitting searches, we were being greeted by a\par strange error:\par \par AR ERR [90] Cannot establish a network connection to the AR\par System server: dhwrem (0) : RPC: Miscellaneous tli error - System error\par (connection refused)\par \par We could create new cases and modify existing cases, but we\par could not submit searches. I checked the arerror.log and there was\par nothing out of the ordinary, save for a bunch of SendEMail() 390620 :\par Parameter list for a function is empty messages, which are typical (yet\par unexplained) on our system.\par \par In a moment of panic, I increased the number of list and fast\par threads on our server and restarted the server. I haven't seen the\par error yet today but the morning is still young...\par \par Any one seen this before?\par \par