Isuru, I wonder this issue is due to using TCP transport of ActiveMQ instead of using AMQP.
On Tue, Apr 15, 2014 at 11:32 PM, Isuru Perera <[email protected]> wrote: > Hi Nirmal, > > I'm sorry for the delay. > > The ActiveMQ admin console doesn't show any stats about connections. > > Let me check on this more and get back to you. > > Thanks! > > Best Regards, > > > On Sun, Apr 13, 2014 at 7:16 PM, Nirmal Fernando > <[email protected]>wrote: > >> Can you get the stats on connections too? >> >> >> On Sun, Apr 13, 2014 at 11:49 AM, Isuru Perera <[email protected]> wrote: >> >>> Hi Devs, >>> >>> We need to solve the $subject. >>> >>> These errors keep happening after running Stratos for a long time with >>> ActiveMQ. >>> >>> As I mentioned in JIRA, ActiveMQ could be under heavy load [1]. >>> >>> When these errors happen, I tried a sample app [2] with ActiveMQ and >>> that app worked fine. Note that the sample app connection URL format is >>> vm://localhost >>> >>> When I changed URL to tcp://localhost:61616, I got the same error. >>> >>> i.e. java.io.IOException: Wire format negotiation timeout: peer did not >>> send his wire format. >>> >>> Looks like the TCP transport was affected by the heavy load. >>> >>> I could login to ActiveMQ admin console and get the stats. >>> >>> It's running for 1 day 22 hours. >>> >>> [image: Inline image 1] >>> >>> Stats: >>> >>> [image: Inline image 3] >>> >>> >>> Appreciate your suggestions. >>> >>> Thanks! >>> >>> [1] >>> http://activemq.apache.org/javaxjmsjmsexception-wire-format-negociation-timeout-peer-did-not-send-his-wire-format.html >>> [2] http://activemq.apache.org/hello-world.html >>> >>> >>> ---------- Forwarded message ---------- >>> From: Isuru Perera (JIRA) <[email protected]> >>> Date: Wed, Apr 9, 2014 at 12:50 PM >>> Subject: [jira] [Created] (STRATOS-593) ActiveMQ error: "Wire format >>> negotiation timeout: peer did not send his wire format" >>> To: [email protected] >>> >>> >>> Isuru Perera created STRATOS-593: >>> ------------------------------------ >>> >>> Summary: ActiveMQ error: "Wire format negotiation timeout: >>> peer did not send his wire format" >>> Key: STRATOS-593 >>> URL: https://issues.apache.org/jira/browse/STRATOS-593 >>> Project: Stratos >>> Issue Type: Bug >>> Affects Versions: 4.0.0 RC1 >>> Reporter: Isuru Perera >>> Assignee: Isuru Perera >>> Priority: Blocker >>> Fix For: 4.0.0 RC1 >>> >>> >>> I was running the Stratos setup for a long time. Noticed lot of ActiveMQ >>> error. >>> >>> Error has started appearing after 8 hours. >>> >>> TID: [0] [STRATOS] [2014-04-08 21:02:28,491] ERROR >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} - >>> instance-status topic health checker is failed and will retry to establish >>> a connection after 5s. >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} >>> TID: [0] [STRATOS] [2014-04-08 21:02:37,352] ERROR >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} - >>> topology topic health checker is failed and will retry to establish a >>> connection after 5s. >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} >>> TID: [0] [STRATOS] [2014-04-08 21:02:37,350] ERROR >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} - >>> topology topic health checker is failed and will retry to establish a >>> connection after 5s. >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} >>> TID: [0] [STRATOS] [2014-04-08 21:02:38,768] ERROR >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} - >>> instance-status topic health checker is failed and will retry to establish >>> a connection after 5s. >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} >>> TID: [0] [STRATOS] [2014-04-08 21:02:39,122] ERROR >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} - >>> summarized-health-stats topic health checker is failed and will retry to >>> establish a connection after 5s. >>> {org.apache.stratos.messaging.broker.heartbeat.TopicHealthChecker} >>> TID: [0] [STRATOS] [2014-04-08 21:02:43,528] ERROR >>> {org.apache.stratos.messaging.broker.subscribe.TopicSubscriber} - Error >>> while subscribing to the topic: instance-status >>> {org.apache.stratos.messaging.broker.subscribe.TopicSubscriber} >>> javax.jms.JMSException: Wire format negotiation timeout: peer did not >>> send his wire format. >>> at >>> org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:62) >>> at >>> org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1409) >>> at >>> org.apache.activemq.ActiveMQConnection.ensureConnectionInfoSent(ActiveMQConnection.java:1496) >>> at >>> org.apache.activemq.ActiveMQConnection.start(ActiveMQConnection.java:524) >>> at >>> org.apache.stratos.messaging.broker.connect.TopicConnector.init(TopicConnector.java:69) >>> at >>> org.apache.stratos.messaging.broker.subscribe.TopicSubscriber.doSubscribe(TopicSubscriber.java:60) >>> at >>> org.apache.stratos.messaging.broker.subscribe.TopicSubscriber.run(TopicSubscriber.java:94) >>> at java.lang.Thread.run(Thread.java:744) >>> Caused by: java.io.IOException: Wire format negotiation timeout: peer >>> did not send his wire format. >>> at >>> org.apache.activemq.transport.WireFormatNegotiator.oneway(WireFormatNegotiator.java:98) >>> at >>> org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:68) >>> at >>> org.apache.activemq.transport.ResponseCorrelator.asyncRequest(ResponseCorrelator.java:81) >>> at >>> org.apache.activemq.transport.ResponseCorrelator.request(ResponseCorrelator.java:86) >>> at >>> org.apache.activemq.ActiveMQConnection.syncSendPacket(ActiveMQConnection.java:1380) >>> ... 6 more >>> >>> >>> >>> -- >>> This message was sent by Atlassian JIRA >>> (v6.2#6252) >>> >>> >>> >>> -- >>> Isuru Perera >>> Senior Software Engineer | WSO2, Inc. | http://wso2.com/ >>> Lean . Enterprise . Middleware >>> >>> about.me/chrishantha >>> >> >> >> >> -- >> Best Regards, >> Nirmal >> >> Nirmal Fernando. >> PPMC Member & Committer of Apache Stratos, >> Senior Software Engineer, WSO2 Inc. >> >> Blog: http://nirmalfdo.blogspot.com/ >> > > > > -- > Isuru Perera > Senior Software Engineer | WSO2, Inc. | http://wso2.com/ > Lean . Enterprise . Middleware > > about.me/chrishantha > -- Best Regards, Nirmal Nirmal Fernando. PPMC Member & Committer of Apache Stratos, Senior Software Engineer, WSO2 Inc. Blog: http://nirmalfdo.blogspot.com/
<<inline: Selection_107.png>>
<<inline: Selection_105.png>>
