Re: Partitions and highlevel consumers

2013-07-02 Thread Josh Foure
Hi, am a also new to Kafka but let me explain my understanding which someone with more knowledge can confirm.  There are actually 2 scenarios: 1.  If all 5 of your consumers are in different consumer groups then this will behave like a JMS topic where all 5 of your consumers will each get a

Re: Using Kafka for data messages

2013-06-14 Thread Josh Foure
: Mahendra M mahendr...@gmail.com To: users@kafka.apache.org; Josh Foure user...@yahoo.com Sent: Friday, June 14, 2013 8:03 AM Subject: Re: Using Kafka for data messages Hi Josh, Thanks for clarifying the use case. The idea is good, but I see the following three issues 1. Creating

Using Kafka for data messages

2013-06-13 Thread Josh Foure
  Hi all, my team is proposing a novel way of using Kafka and I am hoping someone can help do a sanity check on this:   1.  When a user logs into our website, we will create a “logged in” event message in Kafka containing the user id.  2.  30+ systems (consumers each in their own consumer groups)

Re: Using Kafka for data messages

2013-06-13 Thread Josh Foure
To: users@kafka.apache.org; Josh Foure user...@yahoo.com Sent: Thursday, June 13, 2013 12:56 PM Subject: Re: Using Kafka for data messages Hi Josh, The idea looks very interesting. I just had one doubt. 1. A user logs in. His login id is sent on a topic 2. Other systems (consumers on this topic

Re: Using Kafka for data messages

2013-06-13 Thread Josh Foure
like a way to distribute the workload in terms of storing the messages and not for the message selection scenario I am describing if I understood correctly. From: Timothy Chen tnac...@gmail.com To: users@kafka.apache.org; Josh Foure user...@yahoo.com Sent