RE: Pulling consumer design
I see. I missed that lock happens at later time. Thanks! -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Hiram Chirino Sent: Friday, August 11, 2006 12:58 PM To: activemq-dev@geronimo.apache.org Subject: Re: Pulling consumer design Maxim, the pending list is in a way already shared. A message will still in all the pending lists for which it matched the consumer. Only at dispatch time does the message get 'locked' to go a specific consumer. On 8/11/06, Fateev, Maxim <[EMAIL PROTECTED]> wrote: > James, > I'm looking into your change (430445) and don't understand how it solves > problem of slow consumer. It is essentially still a push model as > Queue.dispatch actively pushes messages to subscriptions. Subscriptions store > unconsumed messages in "pending" list. So slow consumer still will get its > share of messages. I think temporary workaround could be sharing "pending" > list between all consumers that have same message selector. > > Maxim. > > -Original Message- > From: James Strachan [mailto:[EMAIL PROTECTED] > Sent: Friday, August 11, 2006 1:00 AM > To: activemq-dev@geronimo.apache.org > Subject: Re: Pulling consumer design > > Sorry about that, I'd forgotten to run the mvn gram:gram command. Its > now in SVN > > On 8/11/06, Vadim Pesochinsky <[EMAIL PROTECTED]> wrote: > > > > There is a little problem with MessagePullMarshaller not generated / > > added to svn. I tried to run generator, but withouth much luck. > > Found this instructions, but I could not find the maven-gram-plugin. Thanks. > > > > cd maven-gram-plugin/ > > mvn install > > cd ../activemq-openwire-generator/ > > mvn install > > cd ../activemq-core > > mvn gram:gram > > > > > > javax.jms.JMSException: Unknown data type: 20 > > at > > org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:58) > > at > > org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1130) > > at > > org.apache.activemq.ActiveMQSession.asyncSendPacket(ActiveMQSession.java:1649) > > at > > org.apache.activemq.ActiveMQMessageConsumer.sendPullCommand(ActiveMQMessageConsumer.java:605) > > at > > org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:463) > > at > > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.runSingleQueue(SingleMessageMultiQueueReceiver.java:185) > > at > > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.doRun(SingleMessageMultiQueueReceiver.java:141) > > at > > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.run(SingleMessageMultiQueueReceiver.java:124) > > at java.lang.Thread.run(Unknown Source) Caused by: > > java.io.IOException: Unknown data type: 20 > > at > > org.apache.activemq.openwire.OpenWireFormat.marshal(OpenWireFormat.java:231) > > at > > org.apache.activemq.transport.tcp.TcpTransport.oneway(TcpTransport.java:108) > > at > > org.apache.activemq.transport.InactivityMonitor.oneway(InactivityMonitor.java:142) > > at > > org.apache.activemq.transport.TransportFilter.oneway(TransportFilter.java:82) > > at > > org.apache.activemq.transport.WireFormatNegotiator.oneway(WireFormatNegotiator.java:86) > > at > > org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:45) > > at > > org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:59) > > at > > org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1128) > > ... 7 more > > -- > > View this message in context: > > http://www.nabble.com/Pulling-consumer-design-tf2086371.html#a575735 > > 4 Sent from the ActiveMQ - Dev forum at Nabble.com. > > > > > > > -- > > James > --- > http://radio.weblogs.com/0112098/ > -- Regards, Hiram Blog: http://hiramchirino.com
Re: Pulling consumer design
Maxim, the pending list is in a way already shared. A message will still in all the pending lists for which it matched the consumer. Only at dispatch time does the message get 'locked' to go a specific consumer. On 8/11/06, Fateev, Maxim <[EMAIL PROTECTED]> wrote: James, I'm looking into your change (430445) and don't understand how it solves problem of slow consumer. It is essentially still a push model as Queue.dispatch actively pushes messages to subscriptions. Subscriptions store unconsumed messages in "pending" list. So slow consumer still will get its share of messages. I think temporary workaround could be sharing "pending" list between all consumers that have same message selector. Maxim. -Original Message- From: James Strachan [mailto:[EMAIL PROTECTED] Sent: Friday, August 11, 2006 1:00 AM To: activemq-dev@geronimo.apache.org Subject: Re: Pulling consumer design Sorry about that, I'd forgotten to run the mvn gram:gram command. Its now in SVN On 8/11/06, Vadim Pesochinsky <[EMAIL PROTECTED]> wrote: > > There is a little problem with MessagePullMarshaller not generated / > added to svn. I tried to run generator, but withouth much luck. Found > this instructions, but I could not find the maven-gram-plugin. Thanks. > > cd maven-gram-plugin/ > mvn install > cd ../activemq-openwire-generator/ > mvn install > cd ../activemq-core > mvn gram:gram > > > javax.jms.JMSException: Unknown data type: 20 > at > org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:58) > at > org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1130) > at > org.apache.activemq.ActiveMQSession.asyncSendPacket(ActiveMQSession.java:1649) > at > org.apache.activemq.ActiveMQMessageConsumer.sendPullCommand(ActiveMQMessageConsumer.java:605) > at > org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:463) > at > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.runSingleQueue(SingleMessageMultiQueueReceiver.java:185) > at > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.doRun(SingleMessageMultiQueueReceiver.java:141) > at > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.run(SingleMessageMultiQueueReceiver.java:124) > at java.lang.Thread.run(Unknown Source) Caused by: > java.io.IOException: Unknown data type: 20 > at > org.apache.activemq.openwire.OpenWireFormat.marshal(OpenWireFormat.java:231) > at > org.apache.activemq.transport.tcp.TcpTransport.oneway(TcpTransport.java:108) > at > org.apache.activemq.transport.InactivityMonitor.oneway(InactivityMonitor.java:142) > at > org.apache.activemq.transport.TransportFilter.oneway(TransportFilter.java:82) > at > org.apache.activemq.transport.WireFormatNegotiator.oneway(WireFormatNegotiator.java:86) > at > org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:45) > at > org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:59) > at > org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1128) > ... 7 more > -- > View this message in context: > http://www.nabble.com/Pulling-consumer-design-tf2086371.html#a5757354 > Sent from the ActiveMQ - Dev forum at Nabble.com. > > -- James --- http://radio.weblogs.com/0112098/ -- Regards, Hiram Blog: http://hiramchirino.com
RE: Pulling consumer design
James, I'm looking into your change (430445) and don't understand how it solves problem of slow consumer. It is essentially still a push model as Queue.dispatch actively pushes messages to subscriptions. Subscriptions store unconsumed messages in "pending" list. So slow consumer still will get its share of messages. I think temporary workaround could be sharing "pending" list between all consumers that have same message selector. Maxim. -Original Message- From: James Strachan [mailto:[EMAIL PROTECTED] Sent: Friday, August 11, 2006 1:00 AM To: activemq-dev@geronimo.apache.org Subject: Re: Pulling consumer design Sorry about that, I'd forgotten to run the mvn gram:gram command. Its now in SVN On 8/11/06, Vadim Pesochinsky <[EMAIL PROTECTED]> wrote: > > There is a little problem with MessagePullMarshaller not generated / > added to svn. I tried to run generator, but withouth much luck. Found > this instructions, but I could not find the maven-gram-plugin. Thanks. > > cd maven-gram-plugin/ > mvn install > cd ../activemq-openwire-generator/ > mvn install > cd ../activemq-core > mvn gram:gram > > > javax.jms.JMSException: Unknown data type: 20 > at > org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:58) > at > org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1130) > at > org.apache.activemq.ActiveMQSession.asyncSendPacket(ActiveMQSession.java:1649) > at > org.apache.activemq.ActiveMQMessageConsumer.sendPullCommand(ActiveMQMessageConsumer.java:605) > at > org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:463) > at > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.runSingleQueue(SingleMessageMultiQueueReceiver.java:185) > at > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.doRun(SingleMessageMultiQueueReceiver.java:141) > at > com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.run(SingleMessageMultiQueueReceiver.java:124) > at java.lang.Thread.run(Unknown Source) Caused by: > java.io.IOException: Unknown data type: 20 > at > org.apache.activemq.openwire.OpenWireFormat.marshal(OpenWireFormat.java:231) > at > org.apache.activemq.transport.tcp.TcpTransport.oneway(TcpTransport.java:108) > at > org.apache.activemq.transport.InactivityMonitor.oneway(InactivityMonitor.java:142) > at > org.apache.activemq.transport.TransportFilter.oneway(TransportFilter.java:82) > at > org.apache.activemq.transport.WireFormatNegotiator.oneway(WireFormatNegotiator.java:86) > at > org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:45) > at > org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:59) > at > org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1128) > ... 7 more > -- > View this message in context: > http://www.nabble.com/Pulling-consumer-design-tf2086371.html#a5757354 > Sent from the ActiveMQ - Dev forum at Nabble.com. > > -- James --- http://radio.weblogs.com/0112098/
Re: Pulling consumer design
Sorry about that, I'd forgotten to run the mvn gram:gram command. Its now in SVN On 8/11/06, Vadim Pesochinsky <[EMAIL PROTECTED]> wrote: There is a little problem with MessagePullMarshaller not generated / added to svn. I tried to run generator, but withouth much luck. Found this instructions, but I could not find the maven-gram-plugin. Thanks. cd maven-gram-plugin/ mvn install cd ../activemq-openwire-generator/ mvn install cd ../activemq-core mvn gram:gram javax.jms.JMSException: Unknown data type: 20 at org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:58) at org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1130) at org.apache.activemq.ActiveMQSession.asyncSendPacket(ActiveMQSession.java:1649) at org.apache.activemq.ActiveMQMessageConsumer.sendPullCommand(ActiveMQMessageConsumer.java:605) at org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:463) at com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.runSingleQueue(SingleMessageMultiQueueReceiver.java:185) at com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.doRun(SingleMessageMultiQueueReceiver.java:141) at com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.run(SingleMessageMultiQueueReceiver.java:124) at java.lang.Thread.run(Unknown Source) Caused by: java.io.IOException: Unknown data type: 20 at org.apache.activemq.openwire.OpenWireFormat.marshal(OpenWireFormat.java:231) at org.apache.activemq.transport.tcp.TcpTransport.oneway(TcpTransport.java:108) at org.apache.activemq.transport.InactivityMonitor.oneway(InactivityMonitor.java:142) at org.apache.activemq.transport.TransportFilter.oneway(TransportFilter.java:82) at org.apache.activemq.transport.WireFormatNegotiator.oneway(WireFormatNegotiator.java:86) at org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:45) at org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:59) at org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1128) ... 7 more -- View this message in context: http://www.nabble.com/Pulling-consumer-design-tf2086371.html#a5757354 Sent from the ActiveMQ - Dev forum at Nabble.com. -- James --- http://radio.weblogs.com/0112098/
Re: Pulling consumer design
There is a little problem with MessagePullMarshaller not generated / added to svn. I tried to run generator, but withouth much luck. Found this instructions, but I could not find the maven-gram-plugin. Thanks. cd maven-gram-plugin/ mvn install cd ../activemq-openwire-generator/ mvn install cd ../activemq-core mvn gram:gram javax.jms.JMSException: Unknown data type: 20 at org.apache.activemq.util.JMSExceptionSupport.create(JMSExceptionSupport.java:58) at org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1130) at org.apache.activemq.ActiveMQSession.asyncSendPacket(ActiveMQSession.java:1649) at org.apache.activemq.ActiveMQMessageConsumer.sendPullCommand(ActiveMQMessageConsumer.java:605) at org.apache.activemq.ActiveMQMessageConsumer.receive(ActiveMQMessageConsumer.java:463) at com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.runSingleQueue(SingleMessageMultiQueueReceiver.java:185) at com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.doRun(SingleMessageMultiQueueReceiver.java:141) at com.barra.cp.common.io.SingleMessageMultiQueueReceiver$OneMessageAtATime.run(SingleMessageMultiQueueReceiver.java:124) at java.lang.Thread.run(Unknown Source) Caused by: java.io.IOException: Unknown data type: 20 at org.apache.activemq.openwire.OpenWireFormat.marshal(OpenWireFormat.java:231) at org.apache.activemq.transport.tcp.TcpTransport.oneway(TcpTransport.java:108) at org.apache.activemq.transport.InactivityMonitor.oneway(InactivityMonitor.java:142) at org.apache.activemq.transport.TransportFilter.oneway(TransportFilter.java:82) at org.apache.activemq.transport.WireFormatNegotiator.oneway(WireFormatNegotiator.java:86) at org.apache.activemq.transport.MutexTransport.oneway(MutexTransport.java:45) at org.apache.activemq.transport.ResponseCorrelator.oneway(ResponseCorrelator.java:59) at org.apache.activemq.ActiveMQConnection.asyncSendPacket(ActiveMQConnection.java:1128) ... 7 more -- View this message in context: http://www.nabble.com/Pulling-consumer-design-tf2086371.html#a5757354 Sent from the ActiveMQ - Dev forum at Nabble.com.
