Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Mahadev Konar
Sorry not John, Mike :)... mahadev PS: not getting enough sleep! :) On Tue, Dec 6, 2011 at 12:44 PM, Mahadev Konar wrote: > This is exactly what Hedwig does. > John as Neha mentioned, >  You might want to look at Kafka/Hedwig/ActiveMQ. > > mahadev > > On Tue, Dec 6, 2011 at 11:41 AM, Ted Dunnin

Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Mahadev Konar
This is exactly what Hedwig does. John as Neha mentioned, You might want to look at Kafka/Hedwig/ActiveMQ. mahadev On Tue, Dec 6, 2011 at 11:41 AM, Ted Dunning wrote: > ZK definitely provides the raw material for something like SQS. > > Generally, however, a queue *in* ZK isn't quite as good an

Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Ted Dunning
ZK definitely provides the raw material for something like SQS. Generally, however, a queue *in* ZK isn't quite as good an idea as a queue that is *coordinated* by ZK, mostly for performance reasons. Thus Pat's suggestion to look at Bookkeeper is not a bad one at all. A direct clone of SQS that

Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Neha Narkhede
Mike, Just curious, why wouldn't you want to use a messaging queue like Kafka ( http://incubator.apache.org/kafka/) or ActiveMQ ? Thanks, Neha On Tue, Dec 6, 2011 at 11:21 AM, Jordan Zimmerman wrote: > Curator has both a Queue and a Priority Queue as described on the > ZooKeeper recipes page: >

Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Jordan Zimmerman
Curator has both a Queue and a Priority Queue as described on the ZooKeeper recipes page: https://github.com/Netflix/curator/wiki/Recipes -JZ On 12/6/11 11:16 AM, "Mike Schilli" wrote: >Seems like it should be possible to implement a queue service like >Amazon's SQS [1] with ZooKeeper, with q

Re: SQS Implementation with ZooKeeper

2011-12-06 Thread Patrick Hunt
I proposed implementing an SQS intf a long while back. However at this point you'd be better off using BK or Hedwig to implement it. Patrick On Tue, Dec 6, 2011 at 11:16 AM, Mike Schilli wrote: > Seems like it should be possible to implement a queue service like > Amazon's SQS [1] with ZooKeeper

SQS Implementation with ZooKeeper

2011-12-06 Thread Mike Schilli
Seems like it should be possible to implement a queue service like Amazon's SQS [1] with ZooKeeper, with queue items becoming 'invisible' once a client picks them, but pop back into the queue after a timeout unless the client doesn't explicitly delete them. Anyone done that? -- -- Mike Mike Sch