Qpid Java Broker - Master Failure and Recovery
In your High Availability documentation for the Java Broker, section "1.6.3.2 - Depictions of cluster operation" has a section called "Master Failure and Recovery" which describes the sequence of events for a master failover and the replica taking over the master's role. One of the items states the following: 3. A third-party (an operator, a script or a combination of the two) verifies that the master has truely failed and is no longer running. If it has truely failed, the decision is made to designate the replica as primary, allowing it to assume the role of master despite the other node being down. This primary designation is performed using JMX. I am able to get the BDBHAMessageStore bean and set the "DesignatedPrimary" attribute to true for the replica server in the case the master fails. What else do I need to do for the replica to take over as master. Do I need to set anything else? Do I need to cycle the replica or will it take over the master role simply by setting attributes to tell it that it is assuming the master role? -- View this message in context: http://qpid.2158936.n2.nabble.com/Qpid-Java-Broker-Master-Failure-and-Recovery-tp7596360.html Sent from the Apache Qpid users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Re: JMX interface with Java Broker .20
I was missing the jar. I can now see the bean in jconsole. Thanks for the quick response. -- View this message in context: http://qpid.2158936.n2.nabble.com/JMX-interface-with-Java-Broker-20-tp7596278p7596329.html Sent from the Apache Qpid users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Re: Qpid throwed WSAENOBUFS while receiving data from a broker
Hi Jakub, Thank you for your efforts in reproducing the issue. We have been running some tests after increasing the buffer count from 4 to 8. It seems to help a bit in our high load tests, in term of delaying the exception, but eventually, the exception still occurred after longer runs. We will also try your other recommendation, which is to reduce the receiver capacity and see if it helps (currently at 100). Thanks again. Sincerely, Jin-Ghee Lu (Gene) -- View this message in context: http://qpid.2158936.n2.nabble.com/Qpid-throwed-WSAENOBUFS-while-receiving-data-from-a-broker-tp7592938p7596328.html Sent from the Apache Qpid users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Re: Qpid throwed WSAENOBUFS while receiving data from a broker
Hi Hamid, I'm sorry, I do not really know the idea behind the buffers. Steve mentioned the possibility of increasing the buffer count. From the code where the exception is created it is apparent that there is additional buffer missing, but I do not really know how the SSL data are decrypted and stored into the buffers and why do they actually need additional buffer. I just gave it a try :-). I didn't tried to further increase the number of buffers. I changed it to 5 and it seemed to work, so there was no reason for it. Today I moved more then 10GB of messages of different sizes with different capacity settings and the problem didn't appeared any-more with 5 buffers. Thanks & Regards Jakub On Thu, Aug 1, 2013 at 7:40 PM, Hamid.Shahid wrote: > Hi Jakub, > > It is really good to know that increasing the BufferCount value to 5 helps > to resolve the problem. > Should we double the BufferCount from 4 to 8 instead? Or do you thing there > any be any negative effects of doing this? > > Thanks > > > > > - > Best Regards, > Hamid. > -- > View this message in context: > http://qpid.2158936.n2.nabble.com/Qpid-throwed-WSAENOBUFS-while-receiving-data-from-a-broker-tp7592938p7596320.html > Sent from the Apache Qpid users mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org > For additional commands, e-mail: users-h...@qpid.apache.org > >
Re: Qpid throwed WSAENOBUFS while receiving data from a broker
Hi Jakub, It is really good to know that increasing the BufferCount value to 5 helps to resolve the problem. Should we double the BufferCount from 4 to 8 instead? Or do you thing there any be any negative effects of doing this? Thanks - Best Regards, Hamid. -- View this message in context: http://qpid.2158936.n2.nabble.com/Qpid-throwed-WSAENOBUFS-while-receiving-data-from-a-broker-tp7592938p7596320.html Sent from the Apache Qpid users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Re: JMX interface with Java Broker .20
The below looks reasonable, in which case another option would be that the
mbean provider isnt being discovered. Do you have the qpid-bdbstore-jmx jar
in your lib/plugins folder?
If so, can you outline the steps you used to set up and start the broker? I
downloaded the 0.20 release before replying earlier and tried this out
without incident, simply adding the BDB JE jar and configuring a vhost with
the HA store using the example from the 0.20 docs (sans typo), after which
starting the broker I found the MBean has been created.
Robbie
On 1 August 2013 16:11, jbelch wrote:
> My active node's configuration looks like the following:
>
>
> test
>
>
>
> org.apache.qpid.server.store.berkeleydb.BDBHAMessageStore
>
> ${QPID_WORK}/bdbhastore/eutilrhs1
>
> ReplicationGroup
> eutilrhs1
> eutilrhs1:5001
> eutilrhs1:5001
> SYNC\,SYNC\,SIMPLE_MAJORITY
> false
> true
>
>
>
>
>
>
> I know it working because I have a couple of queues setup as durable. I
> publish durable messages to those queues, cycle the broker, and the message
> persist. I can also see the messages being written to the bdbhastore
> directory. I added -DJEMonitor=true to the qpid-server script and now I
> have a "com.sleepycat.je.jmx" element in the jconsole tree, but I still
> don't have the BDBHAMessageStore element.
>
>
>
> --
> View this message in context:
> http://qpid.2158936.n2.nabble.com/JMX-interface-with-Java-Broker-20-tp7596278p7596312.html
> Sent from the Apache Qpid users mailing list archive at Nabble.com.
>
> -
> To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org
> For additional commands, e-mail: users-h...@qpid.apache.org
>
>
Re: JMX interface with Java Broker .20
My active node's configuration looks like the following:
test
org.apache.qpid.server.store.berkeleydb.BDBHAMessageStore
${QPID_WORK}/bdbhastore/eutilrhs1
ReplicationGroup
eutilrhs1
eutilrhs1:5001
eutilrhs1:5001
SYNC\,SYNC\,SIMPLE_MAJORITY
false
true
I know it working because I have a couple of queues setup as durable. I
publish durable messages to those queues, cycle the broker, and the message
persist. I can also see the messages being written to the bdbhastore
directory. I added -DJEMonitor=true to the qpid-server script and now I
have a "com.sleepycat.je.jmx" element in the jconsole tree, but I still
don't have the BDBHAMessageStore element.
--
View this message in context:
http://qpid.2158936.n2.nabble.com/JMX-interface-with-Java-Broker-20-tp7596278p7596312.html
Sent from the Apache Qpid users mailing list archive at Nabble.com.
-
To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org
For additional commands, e-mail: users-h...@qpid.apache.org
Re: Question on amqp 1.0 payload Type ??
Yes indeed Gordon, thank you for clarifying -- Rob On 1 August 2013 15:01, Gordon Sim wrote: > On 08/01/2013 01:52 PM, Rob Godfrey wrote: > >> Data and AmqpSequence allow the sender to start sending data without >> knowing how many bytes / values the data is going to consist of. This >> allows for streaming scenarios where the size of the data is not known up >> front. >> >> Note also that there is no bound to the size of Data or AmqpSequence, >> whereas an AmqpValue will always be bounded by the largest AMQP data type >> - >> i.e. 4Gb (not that I would ever recommend sending a single message of >> greater than 4Gb). >> > > Just to clarify, each individual section of type Data or AmqpSequence is > bounded and has its size encoded upfront. The ability to stream and/or send > unbounded amounts of data comes through sending multiple such sections in > the same message. Right? (Whereas only a single AmqpValue section is > allowed per message). > > > --**--**- > To unsubscribe, e-mail: > users-unsubscribe@qpid.apache.**org > For additional commands, e-mail: users-h...@qpid.apache.org > >
Re: JMX interface with Java Broker .20
The BDBHAMessageStore MBean will show up for a particular virtualhost if it is using the BDBHAMessageStore, which suggests that you aren't actually doing so. I notice that you linked to the 0.22 docs below, but you mention in the title you are using a 0.20 broker. There was a typo in the example within the 0.20 docs showing how to configure the store in the xml, which might be what you have run into if you originally looked at the older docs, where the virtualhost name element contains "myhost" whereas the configuration tag beneath it is 'myvhost', when it should equal whatever the name is. If your config looks right, send it out and we can take a look. BDB also has its own stats MBean that may be of use, you can turn it on by setting the JEMonitor system property to true. You can pass system properties through the QPID_OPTS environment variable, e.g: export QPID_OPTS="-DJEMonitor=true" Robbie On 1 August 2013 01:48, jbelch wrote: > I was reading the "Qpid JMX API for HA" section today at > > http://qpid.apache.org/releases/qpid-0.22/java-broker/book/Java-Broker-High-Availability-JMXAPI.html > and it looked like it would be fairly simple to get Berkeley DB state > infomration using the JMX Java API. I can get information from other > MBeans > in the JVM, but I can't seem to get anything from BDBHAMessageStore in code > and I can't see the BDBHAMessageStore element under the org.apache.qpid > tree > in the JConsole. Any ideas on what I am doing wrong? Is there something I > have to enable in the configuration files before I startup the qpid server? > > > > -- > View this message in context: > http://qpid.2158936.n2.nabble.com/JMX-interface-with-Java-Broker-20-tp7596278.html > Sent from the Apache Qpid users mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org > For additional commands, e-mail: users-h...@qpid.apache.org > >
Re: Question on amqp 1.0 payload Type ??
On 08/01/2013 01:52 PM, Rob Godfrey wrote: Data and AmqpSequence allow the sender to start sending data without knowing how many bytes / values the data is going to consist of. This allows for streaming scenarios where the size of the data is not known up front. Note also that there is no bound to the size of Data or AmqpSequence, whereas an AmqpValue will always be bounded by the largest AMQP data type - i.e. 4Gb (not that I would ever recommend sending a single message of greater than 4Gb). Just to clarify, each individual section of type Data or AmqpSequence is bounded and has its size encoded upfront. The ability to stream and/or send unbounded amounts of data comes through sending multiple such sections in the same message. Right? (Whereas only a single AmqpValue section is allowed per message). - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Re: Question on amqp 1.0 payload Type ??
Data and AmqpSequence allow the sender to start sending data without knowing how many bytes / values the data is going to consist of. This allows for streaming scenarios where the size of the data is not known up front. Note also that there is no bound to the size of Data or AmqpSequence, whereas an AmqpValue will always be bounded by the largest AMQP data type - i.e. 4Gb (not that I would ever recommend sending a single message of greater than 4Gb). -- Rob On 1 August 2013 13:25, Rakesh Kushwaha wrote: > Hi , > > As Per amqp 1.0, below types are supported for payload part of amqp . > > 3.2.6 Data > > > > > > A data section contains opaque binary data. > > > 3.2.7 AMQP Sequence > provides="section"> > > > A sequence section contains an arbitrary number of structured data > elements. > > > 3.2.8 AMQP Value > > > > An amqp-value section contains a single AMQP value. > > > > for , what is meaning of 'source = *' here , if it means any > type of primitive or compound structure then why we needed first two types > and . > > > Regards, > Rakesh >
Re: Question on Composite Type Notation in AMQP 1.0
It means all types including described types, subject to any further restriction implied by the requires field (i.e. a field can be type="*" but requires="foo", in which case the value can only be of a type which has provides="foo") -- Rob On 1 August 2013 13:11, Rakesh Kushwaha wrote: > Hi , > > AMQP 1.0 defines below elements for defining Composite type filed Notation > . > > name > Type > requires > default > label > mandatory > multiple > > I have question on where AMQP says it can be specific type or '*' . > I want to know what is meaning of * . does this includes all amqp types , > primitive types and composite types which amqp defines or any of primitives > types?? > > Regards, > Rakesh >
Re: How to build qpid C++ client API without python
Those libraries are not linked to python. Steve Huston (sent from my iPhone - please excuse brevity and typos) On Aug 1, 2013, at 7:49 AM, "yonexw" wrote: > Thanks guys for your quick answer. > > I found libqpidclient.so libqpidmessaging.so will link to python. I will try > to unlink it when build it. > > > > -- > View this message in context: > http://qpid.2158936.n2.nabble.com/How-to-build-qpid-C-client-API-without-python-tp7596285p7596291.html > Sent from the Apache Qpid users mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org > For additional commands, e-mail: users-h...@qpid.apache.org > - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Re: How to build qpid C++ client API without python
Thanks guys for your quick answer. I found libqpidclient.so libqpidmessaging.so will link to python. I will try to unlink it when build it. -- View this message in context: http://qpid.2158936.n2.nabble.com/How-to-build-qpid-C-client-API-without-python-tp7596285p7596291.html Sent from the Apache Qpid users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Re: Qpid throwed WSAENOBUFS while receiving data from a broker
One more update from my side ... I finally managed to build the 0.22 release. The problem is fully reproducible there as well. However, I tried to increase the BufferCount value in AsynchIO.h from 4 to 5 and that seems to solve the problem - at least in the terms that the error doesn't reproduce anymore. Thanks & Regards Jakub On Thu, Aug 1, 2013 at 11:37 AM, Hamid.Shahid wrote: > Hi Jakub, > > Thank you for investigation and keeping the thread alive. I hope we will > get > to a conclusion soon about how to fix this. > > > > > - > Best Regards, > Hamid. > -- > View this message in context: > http://qpid.2158936.n2.nabble.com/Qpid-throwed-WSAENOBUFS-while-receiving-data-from-a-broker-tp7592938p7596281.html > Sent from the Apache Qpid users mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org > For additional commands, e-mail: users-h...@qpid.apache.org > >
Re: How to build qpid C++ client API without python
Hi, I think the Python is needed only at the build time for generating some parts of the code. I do not think you need it at runtime. Regards Jakub On Thu, Aug 1, 2013 at 1:24 PM, yonexw wrote: > Hi All, > > I am trying to build qpid C++ client apid, when I configure it I found it > will use python. And I am sure I won't use python in my program. Why python > is need in client C++ API, and how can I disable it when build qpid C++ > client api? > > Thanks a lot! > > > > > > -- > View this message in context: > http://qpid.2158936.n2.nabble.com/How-to-build-qpid-C-client-API-without-python-tp7596285.html > Sent from the Apache Qpid users mailing list archive at Nabble.com. > > - > To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org > For additional commands, e-mail: users-h...@qpid.apache.org > >
Re: How to build qpid C++ client API without python
Python is used for some of the code generation involved in the build, so it is required to build the C++ client API. -Steve On 8/1/13 7:24 AM, "yonexw" wrote: >Hi All, > >I am trying to build qpid C++ client apid, when I configure it I found it >will use python. And I am sure I won't use python in my program. Why >python >is need in client C++ API, and how can I disable it when build qpid C++ >client api? > >Thanks a lot! > > > > > >-- >View this message in context: >http://qpid.2158936.n2.nabble.com/How-to-build-qpid-C-client-API-without-p >ython-tp7596285.html >Sent from the Apache Qpid users mailing list archive at Nabble.com. > >- >To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org >For additional commands, e-mail: users-h...@qpid.apache.org > - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Question on amqp 1.0 payload Type ??
Hi , As Per amqp 1.0, below types are supported for payload part of amqp . 3.2.6 Data A data section contains opaque binary data. 3.2.7 AMQP Sequence A sequence section contains an arbitrary number of structured data elements. 3.2.8 AMQP Value An amqp-value section contains a single AMQP value. for , what is meaning of 'source = *' here , if it means any type of primitive or compound structure then why we needed first two types and . Regards, Rakesh
How to build qpid C++ client API without python
Hi All, I am trying to build qpid C++ client apid, when I configure it I found it will use python. And I am sure I won't use python in my program. Why python is need in client C++ API, and how can I disable it when build qpid C++ client api? Thanks a lot! -- View this message in context: http://qpid.2158936.n2.nabble.com/How-to-build-qpid-C-client-API-without-python-tp7596285.html Sent from the Apache Qpid users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
Question on Composite Type Notation in AMQP 1.0
Hi , AMQP 1.0 defines below elements for defining Composite type filed Notation . name Type requires default label mandatory multiple I have question on where AMQP says it can be specific type or '*' . I want to know what is meaning of * . does this includes all amqp types , primitive types and composite types which amqp defines or any of primitives types?? Regards, Rakesh
Re: Qpid throwed WSAENOBUFS while receiving data from a broker
Hi Jakub, Thank you for investigation and keeping the thread alive. I hope we will get to a conclusion soon about how to fix this. - Best Regards, Hamid. -- View this message in context: http://qpid.2158936.n2.nabble.com/Qpid-throwed-WSAENOBUFS-while-receiving-data-from-a-broker-tp7592938p7596281.html Sent from the Apache Qpid users mailing list archive at Nabble.com. - To unsubscribe, e-mail: users-unsubscr...@qpid.apache.org For additional commands, e-mail: users-h...@qpid.apache.org
