Re: Arguments for Kafka over RabbitMQ ?

2013-06-13 Thread Alexis Richardson
Hi all, First, thanks to Tim (from Rabbit) and Jonathan for moving this thread along. Jonathan, I hope you found my links to the data model docs, and Tim's replies, helpful. Has everyone got what they wanted from this thread? alexis On Tue, Jun 11, 2013 at 5:49 PM, Jonathan Hodges

Re: Arguments for Kafka over RabbitMQ ?

2013-06-08 Thread Alexis Richardson
source! As always YMMV. On Fri, Jun 7, 2013 at 4:40 PM, Alexis Richardson alexis.richard...@gmail.com wrote: Jonathan, On Fri, Jun 7, 2013 at 7:03 PM, Jonathan Hodges hodg...@gmail.com wrote: Hi Alexis, I appreciate your reply and clarifications to my misconception about Rabbit

Re: Arguments for Kafka over RabbitMQ ?

2013-06-08 Thread Alexis Richardson
of magnitude more than 10x difference. It all comes down to random vs sequential writes/reads to disk as I mentioned above. On Sat, Jun 8, 2013 at 2:07 AM, Alexis Richardson alexis.richard...@gmail.com wrote: Jonathan On Sat, Jun 8, 2013 at 2:09 AM, Jonathan Hodges hodg...@gmail.com

Re: Arguments for Kafka over RabbitMQ ?

2013-06-08 Thread Alexis Richardson
A few more details for those following this: On Sat, Jun 8, 2013 at 9:09 PM, Alexis Richardson alexis.richard...@gmail.com wrote: Jonathan I am aware of the difference between sequential writes and other kinds of writes ;p) AFAIK the Kafka docs describe a sort of platonic alternative system

Re: Arguments for Kafka over RabbitMQ ?

2013-06-08 Thread Alexis Richardson
One more useful link... http://hg.rabbitmq.com/rabbitmq-server/file/bc2fda987fe8/src/rabbit_queue_index.erl#l32 On Jun 8, 2013 9:20 PM, Alexis Richardson alexis.richard...@gmail.com wrote: A few more details for those following this: On Sat, Jun 8, 2013 at 9:09 PM, Alexis Richardson

Re: Arguments for Kafka over RabbitMQ ?

2013-06-07 Thread Alexis Richardson
Hi Alexis from Rabbit here. I hope I am not intruding! It would be super helpful if people with questions, observations or moans posted them to the rabbitmq list too :-) A few comments: * Along with ZeroMQ, I consider Kafka to be one of the interesting and useful messaging projects out there.

Re: Arguments for Kafka over RabbitMQ ?

2013-06-07 Thread Alexis Richardson
a netsplit, see eg http://www.rabbitmq.com/blog/2013/05/01/rabbitmq-3-1-0-in-images/ at the bottom. A good pattern is: HA clusters for EC2 availability zones; Federation across zones. Jun On Fri, Jun 7, 2013 at 5:54 AM, Alexis Richardson ale...@rabbitmq.comwrote: Hi Alexis from Rabbit here

Re: Arguments for Kafka over RabbitMQ ?

2013-06-07 Thread Alexis Richardson
-performance-measurements-part-2/ Obviously none of this uses batching, which is an easy trick for increasing throughput. YMMV. Is this helping? alexis Thanks for educating me on these matters. -Jonathan On Fri, Jun 7, 2013 at 6:54 AM, Alexis Richardson ale...@rabbitmq.comwrote: Hi Alexis

Re: Arguments for Kafka over RabbitMQ ?

2013-06-07 Thread Alexis Richardson
some Rabbit benchmarks under this scenario, because I believe it is the main area where Kafka appears to be the superior solution. Thanks for educating me on these matters. -Jonathan On Fri, Jun 7, 2013 at 6:54 AM, Alexis Richardson ale...@rabbitmq.comwrote: Hi Alexis from Rabbit here