[jira] [Updated] (QPID-6676) QPID 0.32 throughput drop sharply with HA module

2015-08-03 Thread JIRA

 [ 
https://issues.apache.org/jira/browse/QPID-6676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

李翰林 updated QPID-6676:
--
Priority: Critical  (was: Major)

> QPID 0.32 throughput drop sharply with HA module
> 
>
> Key: QPID-6676
> URL: https://issues.apache.org/jira/browse/QPID-6676
> Project: Qpid
>  Issue Type: Bug
>  Components: C++ Broker, C++ Clustering
>Affects Versions: 0.32, qpid-cpp-0.34
> Environment: CentOS6.5 X86_64
>Reporter: 李翰林
>Assignee: Alan Conway
>Priority: Critical
>
> I build QPID 0.32 C++ broker with HA module on CentOS6.5 and run a cluster of 
> 2 nodes with --ha-replicate=all, Then send messages using QPID Messaging API 
> continuously with protocol AMQP0-10 and I meet a strange problem,If I purge 
> all of messages in a queue and continue to send messages,The throughput drop 
> sharply. And the same problem seen on QPID 0.34
> Steps to reproduce:
> 1:
> qpid-config add exchange direct testHA.exchange
> qpid-config add queue testHA.queue --max-queue-size 1048576000
> qpid-config bind testHA.exchange testHA.queue testHA.binding
> 2:
> Run "qpid-queue-stats -f testHA.queue" on a console
> 3:
> Send 10 messages to testHA.exchange with routingkey testHA.binding
> 4:
> Purge queue use the QPID manager tool (qpid-tool)
> 5:
> Repeat step 3
> get the output from step 2:
> Queue Name  SecDepthEnq RateDeq Rate
> ===
> testHA.queue  1064.00 11350 10.670.00   <== 
> step3
> testHA.queue2.00 28965 8807.350.00
> testHA.queue2.00 46650 8842.570.00
> testHA.queue2.00 64300 8825.080.00
> testHA.queue2.00 81950 8824.850.00
> testHA.queue2.00 99600 8825.040.00
> testHA.queue2.00   10   199.970.00
> testHA.queue  40.01 0   0.00  2499.65   
> <== step4
> testHA.queue  16.00 250 15.630.00   
> <== step5
> testHA.queue2.00 900   325.070.00
> testHA.queue2.00   1600   350.050.00
> testHA.queue2.00   2300   350.120.00
> testHA.queue2.00   3000   349.980.00
> testHA.queue   2.003700   349.960.00
> testHA.queue   2.004350   324.960.00



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org



[jira] [Created] (QPID-6676) QPID 0.32 throughput drop sharply with HA module

2015-08-03 Thread JIRA
李翰林 created QPID-6676:
-

 Summary: QPID 0.32 throughput drop sharply with HA module
 Key: QPID-6676
 URL: https://issues.apache.org/jira/browse/QPID-6676
 Project: Qpid
  Issue Type: Bug
  Components: C++ Broker, C++ Clustering
Affects Versions: qpid-cpp-0.34, 0.32
 Environment: CentOS6.5 X86_64
Reporter: 李翰林
Assignee: Alan Conway


I build QPID 0.32 C++ broker with HA module on CentOS6.5 and run a cluster of 2 
nodes with --ha-replicate=all, Then send messages using QPID Messaging API 
continuously with protocol AMQP0-10 and I meet a strange problem,If I purge all 
of messages in a queue and continue to send messages,The throughput drop 
sharply. And the same problem seen on QPID 0.34

Steps to reproduce:
1:
qpid-config add exchange direct testHA.exchange
qpid-config add queue testHA.queue --max-queue-size 1048576000
qpid-config bind testHA.exchange testHA.queue testHA.binding
2:
Run "qpid-queue-stats -f testHA.queue" on a console
3:
Send 10 messages to testHA.exchange with routingkey testHA.binding
4:
Purge queue use the QPID manager tool (qpid-tool)
5:
Repeat step 3

get the output from step 2:
Queue Name  SecDepthEnq RateDeq Rate
===
testHA.queue  1064.00 11350 10.670.00   <== 
step3
testHA.queue2.00 28965 8807.350.00
testHA.queue2.00 46650 8842.570.00
testHA.queue2.00 64300 8825.080.00
testHA.queue2.00 81950 8824.850.00
testHA.queue2.00 99600 8825.040.00
testHA.queue2.00   10   199.970.00
testHA.queue  40.01 0   0.00  2499.65   <== 
step4
testHA.queue  16.00 250 15.630.00   <== 
step5
testHA.queue2.00 900   325.070.00
testHA.queue2.00   1600   350.050.00
testHA.queue2.00   2300   350.120.00
testHA.queue2.00   3000   349.980.00
testHA.queue   2.003700   349.960.00
testHA.queue   2.004350   324.960.00






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org



[jira] [Created] (QPID-6675) Setting sasl_max_ssf causes traceback in qpid.messaging

2015-08-03 Thread Brian Bouterse (JIRA)
Brian Bouterse created QPID-6675:


 Summary: Setting sasl_max_ssf causes traceback in qpid.messaging
 Key: QPID-6675
 URL: https://issues.apache.org/jira/browse/QPID-6675
 Project: Qpid
  Issue Type: Bug
  Components: Python Client
Affects Versions: 0.26
 Environment: cyrus-sasl-scram-2.1.26-14.fc20.x86_64
cyrus-sasl-plain-2.1.26-14.fc20.x86_64
cyrus-sasl-gssapi-2.1.26-14.fc20.x86_64
cyrus-sasl-2.1.26-14.fc20.x86_64
python-saslwrapper-0.16-5.fc20.x86_64
erlang-sasl-R16B-03.10.fc20.x86_64
cyrus-sasl-lib-2.1.26-14.fc20.x86_64
cyrus-sasl-md5-2.1.26-14.fc20.x86_64
cyrus-sasl-devel-2.1.26-14.fc20.x86_64
saslwrapper-0.16-5.fc20.x86_64

qpid-cpp-server-0.26-13.fc20.x86_64
python-qpid-proton-0.7-3.fc20.x86_64
qpid-tools-0.26-13.fc20.noarch
qpid-cpp-client-0.26-13.fc20.x86_64
qpid-cpp-server-store-0.26-13.fc20.x86_64
qpid-proton-c-0.7-3.fc20.x86_64
python-qpid-qmf-0.26-2.fc20.x86_64
python-qpid-0.26-2.fc20.noarch
qpid-qmf-0.26-2.fc20.x86_64
python-qpid-common-0.26-2.fc20.noarch
Reporter: Brian Bouterse


I tried to set sasl_max_ssf on a call to establish() in qpid.messaging, but 
when I do I get the following traceback.

Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/qpid/messaging/driver.py", line 504, 
in dispatch
self.connect()
  File "/usr/lib/python2.7/site-packages/qpid/messaging/driver.py", line 526, 
in connect
self.engine = Engine(self.connection)
  File "/usr/lib/python2.7/site-packages/qpid/messaging/driver.py", line 612, 
in __init__
self._sasl.setAttr("maxssf", self.connection.sasl_max_ssf)
  File "/usr/lib/python2.7/site-packages/qpid/sasl.py", line 36, in setAttr
raise SASLError(self._cli.getError())
SASLError: Error in setAttr (-1) Unknown string attribute name - maxssf



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org



[jira] [Created] (QPID-6674) EXTERNAL sasl mech without username gives "no mechanism available" error message

2015-08-03 Thread Brian Bouterse (JIRA)
Brian Bouterse created QPID-6674:


 Summary: EXTERNAL sasl mech without username gives "no mechanism 
available" error message
 Key: QPID-6674
 URL: https://issues.apache.org/jira/browse/QPID-6674
 Project: Qpid
  Issue Type: Bug
  Components: Python Client
Affects Versions: 0.26
 Environment: cyrus-sasl-scram-2.1.26-14.fc20.x86_64
cyrus-sasl-plain-2.1.26-14.fc20.x86_64
cyrus-sasl-gssapi-2.1.26-14.fc20.x86_64
cyrus-sasl-2.1.26-14.fc20.x86_64
python-saslwrapper-0.16-5.fc20.x86_64
erlang-sasl-R16B-03.10.fc20.x86_64
cyrus-sasl-lib-2.1.26-14.fc20.x86_64
cyrus-sasl-md5-2.1.26-14.fc20.x86_64
cyrus-sasl-devel-2.1.26-14.fc20.x86_64
saslwrapper-0.16-5.fc20.x86_64

qpid-cpp-server-0.26-13.fc20.x86_64
python-qpid-proton-0.7-3.fc20.x86_64
qpid-tools-0.26-13.fc20.noarch
qpid-cpp-client-0.26-13.fc20.x86_64
qpid-cpp-server-store-0.26-13.fc20.x86_64
qpid-proton-c-0.7-3.fc20.x86_64
python-qpid-qmf-0.26-2.fc20.x86_64
python-qpid-0.26-2.fc20.noarch
qpid-qmf-0.26-2.fc20.x86_64
python-qpid-common-0.26-2.fc20.noarch
Reporter: Brian Bouterse


I tried to use qpid.messaging with EXTERNAL. I was not specifying a username 
and I received an error message that makes no sense: "no mechanism available"

I have the following line in sasl2/qpidd.conf:
mech_list: ANONYMOUS DIGEST-MD5 EXTERNAL PLAIN

The contents of qpidd.conf are:
auth=yes
require-encryption=yes
ssl-require-client-authentication=yes
ssl-cert-db=/etc/pki/pulp/qpid/nss
ssl-cert-password-file=/etc/pki/pulp/qpid/nss/password
ssl-cert-name=broker
ssl-port=5671


If I use ANONYMOUS or PLAIN it works for me, but when I use EXTERNAL I get the 
strange message. Here is my reproducer script:

from qpid.messaging.endpoints import Connection

opts = {'ssl_certfile': '/etc/pki/pulp/qpid/client.crt', 'ssl_trustfile': 
'/etc/pki/pulp/qpid/ca.crt', 'ssl_skip_hostname_check': False, 
'sasl_mechanisms': 'EXTERNAL', 'host': 'dhcp129-138.rdu.redhat.com', 'timeout': 
4, 'ssl_keyfile': '/etc/pki/pulp/qpid/client.crt', 'port': 5671, 'transport': 
'ssl'}

print 'no username'
try:
Connection.establish(**opts)
except Exception as err:
print err

print 'wrong username'
opts['username'] = 'wrongusername'
try:
Connection.establish(**opts)
except Exception as err:
print err

print 'right username'
opts['username'] = 'client'
try:
Connection.establish(**opts)
except Exception as err:
print err
else:
print 'no error'



When I run that I get this output:

no username
Error in sasl_client_start (-4) SASL(-4): no mechanism available: 
wrong username
connection-forced: Authentication failed(320)
right username
no error

I expected that if a username is required that I would be told that from the 
error message. If not all cases require a username then I expect not including 
a username would give me a "Authentication failed(320)" also



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org



[jira] [Updated] (QPIDIT-17) Add JMS test suite

2015-08-03 Thread Kim van der Riet (JIRA)

 [ 
https://issues.apache.org/jira/browse/QPIDIT-17?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Kim van der Riet updated QPIDIT-17:
---
Component/s: JmsMessageTest

> Add JMS test suite
> --
>
> Key: QPIDIT-17
> URL: https://issues.apache.org/jira/browse/QPIDIT-17
> Project: Apache QPID IT
>  Issue Type: Task
>  Components: JmsMessageTest
>Reporter: Kim van der Riet
>Assignee: Kim van der Riet
>
> The existing test, the Simple Type Test is centred around the AMQP 1.0 simple 
> types, and is designed to send AMQP types between clients to check 
> interoperability.
> However, in the world of JMS, this approach is not ideal, as there is no 
> direct mapping between JMS message types and AMQP simple types. The idea is 
> to add another test, which is centred around the five basic JMS message types 
> rather than the AMQP types. This will allow these message types to drive the 
> test values rather than the AMQP types, and will provide a more efficient 
> mechanism for testing JMS interoperability between clients. While it may be 
> possible to test between non-JMS clients, it makes sense that one or more JMS 
> clients (such as qpid-jms) always be one of the two test clients.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org



[jira] [Created] (QPIDIT-17) Add JMS test suite

2015-08-03 Thread Kim van der Riet (JIRA)
Kim van der Riet created QPIDIT-17:
--

 Summary: Add JMS test suite
 Key: QPIDIT-17
 URL: https://issues.apache.org/jira/browse/QPIDIT-17
 Project: Apache QPID IT
  Issue Type: Task
Reporter: Kim van der Riet
Assignee: Kim van der Riet


The existing test, the Simple Type Test is centred around the AMQP 1.0 simple 
types, and is designed to send AMQP types between clients to check 
interoperability.

However, in the world of JMS, this approach is not ideal, as there is no direct 
mapping between JMS message types and AMQP simple types. The idea is to add 
another test, which is centred around the five basic JMS message types rather 
than the AMQP types. This will allow these message types to drive the test 
values rather than the AMQP types, and will provide a more efficient mechanism 
for testing JMS interoperability between clients. While it may be possible to 
test between non-JMS clients, it makes sense that one or more JMS clients (such 
as qpid-jms) always be one of the two test clients.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org



[jira] [Commented] (QPID-3521) failover process for the 0-8 client does not clear the pre-dispatch queue

2015-08-03 Thread Keith Wall (JIRA)

[ 
https://issues.apache.org/jira/browse/QPID-3521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14652040#comment-14652040
 ] 

Keith Wall commented on QPID-3521:
--

A couple of comments:


# Code changes seem to make a functional change to the 0-10 Connection#stop 
path, but this is not called out in the JIRA.  I suggest a new JIRA describing 
the issue/user impact is appropriate.
# I like the fact that we are now testing failover + connectio#stop, but it is 
the test assumes internals of the Java Broker (the  statistic 
unacknowledgedMessages) and this is distasteful, as is spreading knowledge of 
the management interfaces across the test suite.  Why is it not sufficient 
countdown after the message listener's Connection#stop and kill the Broker to 
cause failover?
# AMQSession#stopExistingDispatcher is a check then act with the risk of a NPE 
if _dispatcher is nulled between. Copy the reference and then use the copy.
# AMQSession#drainDispatchQueueWithDispatcher use a try/finally to help ensure 
that the dispatcher cleanup flag is always returned to its unset state.


> failover process for the 0-8 client does not clear the pre-dispatch queue
> -
>
> Key: QPID-3521
> URL: https://issues.apache.org/jira/browse/QPID-3521
> Project: Qpid
>  Issue Type: Bug
>  Components: Java Client
>Reporter: Robbie Gemmell
>Assignee: Keith Wall
>  Labels: failover
> Attachments: clear-dispatch-queue-on-failover.diff
>
>
> failover process for the 0-8 client does not clear the pre-dispatch queue, 
> only the consumer receive queue.
> This is currently masked by an issue with the rollbackMark. The changes made 
> in QPID-3546 to fix the 0-10 client path need to be applied to the 0-8/9/9-1 
> client path when this issue is resolved.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org



Re: Dispatch devs: any interest in moving to git?

2015-08-03 Thread Michael Goulish

+1

It does clear like the development universe has decided that git
is the preferred technology.  Then it's worth it just so that developers
on this project will not have to keep two different source code control
systems in their heads.

Also, I do _not_ think that git is just a fashion.  It's a fundamentally
different way for sccs to work, and I bet that most projects will still
be using it 10 years from now.  I sure cannot say that about svn.



- Original Message -

Show of hands: would any of the dispatch developers object to moving the 
dispatch project from subversion to git?

I've been using the git-svn conduit with dispatch, and, well, it just feels 
like a hack.

Sure, I'm personally biased towards git, and maybe there really isn't a solid 
technical reason behind moving to it (though I'd bet some github users would 
argue that).

Opinions?

-K

-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org


-
To unsubscribe, e-mail: dev-unsubscr...@qpid.apache.org
For additional commands, e-mail: dev-h...@qpid.apache.org