Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Hi, Thanks to all for their comments. We are not using load balancer, but I have tried with plugin entry using simple name as well as FQDN with the same result. The observation of missing/misplaced parameter seems close. When I looked in the log the line just before the error was showing the client cookie and its content followed by the session ID as extracted from the cookie. Next was the error. Irrespective of all the above, I still cannot understand why when I turn Fiddler on to trace the issue on my client, the error disappears and all is working fine. Jiri From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Tauf Chowdhury Sent: 04 July 2012 18:15 To: arslist@ARSLIST.ORG Subject: Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator ** Jiri, Are you on a load balanced environment? I've seen cases where the plugin entry for ARDBC needs to be configured for the FQDN of the local server name instead of the load balancer name in the ar.conf. On Tue, Jul 3, 2012 at 12:49 PM, Jiri Pospisil jiri.pospi...@lchclearnet.commailto:jiri.pospi...@lchclearnet.com wrote: ** Hi all, I was wondering if anybody has ever seen the following behaviour. About a week ago, our users started getting error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator when opening AR System Customizable Home Page on mid-tier with the overview console. They seem to be able to open other consoles without error and it all worked fine previously. It affects all the users (luckily this is a test environment only). They all use IE7 and I have tested with IE8 with the same result. The home page works fine (i.e. no error) with FireFox and also (and this is the most puzzling to me) when I start running Fiddler on my client with IE7 in order to investigate the issue. When users get the error, the mid-tier server log shows the following error: java.lang.NumberFormatException: For input string: java.lang.NumberFormatException.forInputString(Unknown Source) java.lang.Integer.parseInt(Unknown Source) java.lang.Integer.parseInt(Unknown Source) com.remedy.arsys.stubs.BackchannelServlet.doRequest(Unknown Source) com.remedy.arsys.stubs.GoatServlet.postInternal(Unknown Source) com.remedy.arsys.stubs.GoatHttpServlet.doPost(Unknown Source) javax.servlet.http.HttpServlet.service(HttpServlet.java:637) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454) java.lang.Thread.run(Unknown Source) 02-Jul-2012 21:11:20 - FINE (com.remedy.log.INTERNAL) : Throw Error - 9350 Does anybody have any suggestions as to where to look in order to get to the bottom of this issue. Our environment is OS - Windows 2003, 64 bit Mid-Tier 7.6.03, SP2 Java - 1.6.0_26 Thanks Jiri Pospisil LCH Clearnet A copy of the LCH.Clearnet e-mail disclaimer can be found at: www.lchclearnet.com/disclaimer/emailhttp://www.lchclearnet.com/disclaimer/email LCH.Clearnet Limited, Registered Office: Aldgate House, 33 Aldgate High Street, London EC3N 1EA. Recognised as a Clearing House under the Financial Services Markets Act 2000. Reg in England No.25932. LCH.Clearnet SA, Siège Social, 18 rue du Quatre Septembre, 75002 Paris, Chambre de Compensation conformément au Code Monétaire et Financier. _attend WWRUG12 www.wwrug.comhttp://www.wwrug.com ARSlist: Where the Answers Are_ -- Tauf Chowdhury _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Lou - Are you using F5/BigIP for your load balancing? We were seeing the same error here when certain things are enabled (could be cookie persistence and SSL off load, but I'm not 100% sure what is on or off). At the moment the issue is not appearing, but I know that BigIP changes were made the other day, just not what specifically. Thanks! Melissa From: Lou lrguar...@yahoo.com To: arslist@ARSLIST.ORG, Date: 07/03/2012 06:13 PM Subject:Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator Sent by:Action Request System discussion list(ARSList) arslist@ARSLIST.ORG Bmc gave me a javascript file that I could throw on midtier and it will pop the error with some more debug information. This error is be very generic. We had the same issue and it turned out to be our load balancer that was causing the issue. On Jul 3, 2012, at 4:52 PM, Jiri Pospisil jiri.pospi...@lchclearnet.com wrote: Hi, Thanks for the suggestion. But as I said, when I turn Fiddler on to take the trace, it works fine and the error disappears. Any idea why that might be? Jiri -Original Message- From: Action Request System discussion list(ARSList) [ mailto:arslist@ARSLIST.ORG] On Behalf Of John Baker Sent: 03 July 2012 21:00 To: arslist@ARSLIST.ORG Subject: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator Hello It's a bug in the Mid Tier. The stack trace is trying to convert a string, I assume read from the request, to a number. The string is empty and hence the parse fails, leading to the exception (which should be caught and handled, but isn't). I think you'll need to collect a Fiddler trace to find out what request is causing this to happen, as that's the root cause. John ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are A copy of the LCH.Clearnet e-mail disclaimer can be found at: www.lchclearnet.com/disclaimer/email LCH.Clearnet Limited, Registered Office: Aldgate House, 33 Aldgate High Street, London EC3N 1EA. Recognised as a Clearing House under the Financial Services Markets Act 2000. Reg in England No.25932. LCH.Clearnet SA, Siège Social, 18 rue du Quatre Septembre, 75002 Paris, Chambre de Compensation conformément au Code Monétaire et Financier. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Melissa, Mid Tier does not cluster (an interesting point given the other thread concerning performance), so you must have sticky sessions enabled. With the F5, you need a feature called 'OneConnect' enabled. If I recall, the default F5 sticky sessions means reuse HTTP connections (at the transport layer), which will cause a client connected to Mid Tier A being routed to Mid Tier B. And the 9351 error in general is very poor, as Lou has found out. The error encapsulates a range of different errors, and the actual error is suppressed. I've been meaning to write an article on this for the SSO Plugin newsletter. John -- SSO Plugin for BMC ITSM. http://www.javasystemsolutions.com/jss/ssoplugin ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Hi, In Internet Explorer, by default many of the ActiveX options and scripting are disabled. User must try to active those controls from Internet Explorer just going through Tool-Internet Option- Security tab -select Internet and click Custom Level. However, exception being faced by user is Number format exception. i.e. trying to convert (blank string) to number. So, scripting are not working on the Internet Explorer, which are supposed to set some number value in some field. Further value of same field is being accessed by the server through JSP page or Servlet. HTH -- Regards, ITSM Support Vyom Labs Pvt. Ltd. BSM Solutions Services || ITIL Consulting Training Email: i...@vyomlabs.com || Web Site: www.vyomlabs.com Follow Vyom Labs http://twitter.com/#!/vyomlabs || http://www.linkedin.com/company/vyom-labs From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of Jiri Pospisil Sent: Tuesday, July 03, 2012 10:20 PM To: arslist@ARSLIST.ORG Subject: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator ** Hi all, I was wondering if anybody has ever seen the following behaviour. About a week ago, our users started getting error “ ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator” when opening AR System Customizable Home Page on mid-tier with the overview console. They seem to be able to open other consoles without error and it all worked fine previously. It affects all the users (luckily this is a test environment only). They all use IE7 and I have tested with IE8 with the same result. The home page works fine (i.e. no error) with FireFox and also (and this is the most puzzling to me) when I start running Fiddler on my client with IE7 in order to investigate the issue. When users get the error, the mid-tier server log shows the following error: java.lang.NumberFormatException: For input string: java.lang.NumberFormatException.forInputString(Unknown Source) java.lang.Integer.parseInt(Unknown Source) java.lang.Integer.parseInt(Unknown Source) com.remedy.arsys.stubs.BackchannelServlet.doRequest(Unknown Source) com.remedy.arsys.stubs.GoatServlet.postInternal(Unknown Source) com.remedy.arsys.stubs.GoatHttpServlet.doPost(Unknown Source) javax.servlet.http.HttpServlet.service(HttpServlet.java:637) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454) java.lang.Thread.run(Unknown Source) 02-Jul-2012 21:11:20 - FINE (com.remedy.log.INTERNAL) : Throw Error - 9350 Does anybody have any suggestions as to where to look in order to get to the bottom of this issue. Our environment is OS – Windows 2003, 64 bit Mid-Tier 7.6.03, SP2 Java – 1.6.0_26 Thanks Jiri Pospisil LCH Clearnet A copy of the LCH.Clearnet e-mail disclaimer can be found at: www.lchclearnet.com/disclaimer/email LCH.Clearnet Limited, Registered Office: Aldgate House, 33 Aldgate High Street, London EC3N 1EA. Recognised as a Clearing House under the Financial Services Markets Act 2000. Reg in England No.25932. LCH.Clearnet SA, Siège Social, 18 rue du Quatre Septembre, 75002 Paris, Chambre de Compensation conformément au Code Monétaire et Financier. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Jiri, Are you on a load balanced environment? I've seen cases where the plugin entry for ARDBC needs to be configured for the FQDN of the local server name instead of the load balancer name in the ar.conf. On Tue, Jul 3, 2012 at 12:49 PM, Jiri Pospisil jiri.pospi...@lchclearnet.com wrote: ** Hi all, ** ** I was wondering if anybody has ever seen the following behaviour. ** ** About a week ago, our users started getting error “ ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator” when opening AR System Customizable Home Page on mid-tier with the overview console. They seem to be able to open other consoles without error and it all worked fine previously. ** ** It affects all the users (luckily this is a test environment only). They all use IE7 and I have tested with IE8 with the same result. The home page works fine (i.e. no error) with FireFox and also (and this is the most puzzling to me) when I start running Fiddler on my client with IE7 in order to investigate the issue. ** ** When users get the error, the mid-tier server log shows the following error: ** ** java.lang.NumberFormatException: For input string: java.lang.NumberFormatException.forInputString(Unknown Source) java.lang.Integer.parseInt(Unknown Source) java.lang.Integer.parseInt(Unknown Source) com.remedy.arsys.stubs.BackchannelServlet.doRequest(Unknown Source)*** * com.remedy.arsys.stubs.GoatServlet.postInternal(Unknown Source) com.remedy.arsys.stubs.GoatHttpServlet.doPost(Unknown Source) javax.servlet.http.HttpServlet.service(HttpServlet.java:637) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454) java.lang.Thread.run(Unknown Source) 02-Jul-2012 21:11:20 - FINE (com.remedy.log.INTERNAL) : Throw Error - 9350 ** ** Does anybody have any suggestions as to where to look in order to get to the bottom of this issue. ** ** Our environment is OS – Windows 2003, 64 bit Mid-Tier 7.6.03, SP2 Java – 1.6.0_26 ** ** Thanks ** ** Jiri Pospisil LCH Clearnet ** ** ** ** A copy of the LCH.Clearnet e-mail disclaimer can be found at: * www.lchclearnet.com/disclaimer/email* LCH.Clearnet Limited, Registered Office: Aldgate House, 33 Aldgate High Street, London EC3N 1EA. Recognised as a Clearing House under the Financial Services Markets Act 2000. Reg in England No.25932. LCH.Clearnet SA, Siège Social, 18 rue du Quatre Septembre, 75002 Paris, Chambre de Compensation conformément au Code Monétaire et Financier. _attend WWRUG12 www.wwrug.com ARSlist: Where the Answers Are_ -- *Tauf Chowdhury * ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Hi all, I was wondering if anybody has ever seen the following behaviour. About a week ago, our users started getting error “ ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator” when opening AR System Customizable Home Page on mid-tier with the overview console. They seem to be able to open other consoles without error and it all worked fine previously. It affects all the users (luckily this is a test environment only). They all use IE7 and I have tested with IE8 with the same result. The home page works fine (i.e. no error) with FireFox and also (and this is the most puzzling to me) when I start running Fiddler on my client with IE7 in order to investigate the issue. When users get the error, the mid-tier server log shows the following error: java.lang.NumberFormatException: For input string: java.lang.NumberFormatException.forInputString(Unknown Source) java.lang.Integer.parseInt(Unknown Source) java.lang.Integer.parseInt(Unknown Source) com.remedy.arsys.stubs.BackchannelServlet.doRequest(Unknown Source) com.remedy.arsys.stubs.GoatServlet.postInternal(Unknown Source) com.remedy.arsys.stubs.GoatHttpServlet.doPost(Unknown Source) javax.servlet.http.HttpServlet.service(HttpServlet.java:637) javax.servlet.http.HttpServlet.service(HttpServlet.java:717) org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290) org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206) org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233) org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191) org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:128) org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102) org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109) org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293) org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:849) org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583) org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:454) java.lang.Thread.run(Unknown Source) 02-Jul-2012 21:11:20 - FINE (com.remedy.log.INTERNAL) : Throw Error - 9350 Does anybody have any suggestions as to where to look in order to get to the bottom of this issue. Our environment is OS – Windows 2003, 64 bit Mid-Tier 7.6.03, SP2 Java – 1.6.0_26 Thanks Jiri Pospisil LCH Clearnet A copy of the LCH.Clearnet e-mail disclaimer can be found at: www.lchclearnet.com/disclaimer/email LCH.Clearnet Limited, Registered Office: Aldgate House, 33 Aldgate High Street, London EC3N 1EA. Recognised as a Clearing House under the Financial Services Markets Act 2000. Reg in England No.25932. LCH.Clearnet SA, Siège Social, 18 rue du Quatre Septembre, 75002 Paris, Chambre de Compensation conformément au Code Monétaire et Financier. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Hello It's a bug in the Mid Tier. The stack trace is trying to convert a string, I assume read from the request, to a number. The string is empty and hence the parse fails, leading to the exception (which should be caught and handled, but isn't). I think you'll need to collect a Fiddler trace to find out what request is causing this to happen, as that's the root cause. John ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Hi, Thanks for the suggestion. But as I said, when I turn Fiddler on to take the trace, it works fine and the error disappears. Any idea why that might be? Jiri -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of John Baker Sent: 03 July 2012 21:00 To: arslist@ARSLIST.ORG Subject: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator Hello It's a bug in the Mid Tier. The stack trace is trying to convert a string, I assume read from the request, to a number. The string is empty and hence the parse fails, leading to the exception (which should be caught and handled, but isn't). I think you'll need to collect a Fiddler trace to find out what request is causing this to happen, as that's the root cause. John ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are A copy of the LCH.Clearnet e-mail disclaimer can be found at: www.lchclearnet.com/disclaimer/email LCH.Clearnet Limited, Registered Office: Aldgate House, 33 Aldgate High Street, London EC3N 1EA. Recognised as a Clearing House under the Financial Services Markets Act 2000. Reg in England No.25932. LCH.Clearnet SA, Siège Social, 18 rue du Quatre Septembre, 75002 Paris, Chambre de Compensation conformément au Code Monétaire et Financier. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Sorry, I missed that part. I'm surprised that Fiddler changes the way the Javascript runs - you may want to think about using wireshark to get a packet trace, but that's quite low level stuff. Either way, it's a bug and it's not your fault :) ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
Re: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator
Bmc gave me a javascript file that I could throw on midtier and it will pop the error with some more debug information. This error is be very generic. We had the same issue and it turned out to be our load balancer that was causing the issue. On Jul 3, 2012, at 4:52 PM, Jiri Pospisil jiri.pospi...@lchclearnet.com wrote: Hi, Thanks for the suggestion. But as I said, when I turn Fiddler on to take the trace, it works fine and the error disappears. Any idea why that might be? Jiri -Original Message- From: Action Request System discussion list(ARSList) [mailto:arslist@ARSLIST.ORG] On Behalf Of John Baker Sent: 03 July 2012 21:00 To: arslist@ARSLIST.ORG Subject: Mid-Tier error ARERR [9350] Network protocol/data error when performing data operation. Please contact administrator Hello It's a bug in the Mid Tier. The stack trace is trying to convert a string, I assume read from the request, to a number. The string is empty and hence the parse fails, leading to the exception (which should be caught and handled, but isn't). I think you'll need to collect a Fiddler trace to find out what request is causing this to happen, as that's the root cause. John ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are A copy of the LCH.Clearnet e-mail disclaimer can be found at: www.lchclearnet.com/disclaimer/email LCH.Clearnet Limited, Registered Office: Aldgate House, 33 Aldgate High Street, London EC3N 1EA. Recognised as a Clearing House under the Financial Services Markets Act 2000. Reg in England No.25932. LCH.Clearnet SA, Siège Social, 18 rue du Quatre Septembre, 75002 Paris, Chambre de Compensation conformément au Code Monétaire et Financier. ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are ___ UNSUBSCRIBE or access ARSlist Archives at www.arslist.org attend wwrug12 www.wwrug12.com ARSList: Where the Answers Are
