Re: Sending Same Message to Two Topics on Same Broker Cluster

2014-10-21 Thread Neha Narkhede
I'm not sure I understood your concern about invoking send() twice, once with each topic. Are you worried about the network overhead? Whether Kafka does this transparently or not, sending messages to different topics will carry some overhead. I think the design of the API is much more intuitive

Re: Sending Same Message to Two Topics on Same Broker Cluster

2014-10-21 Thread Bhavesh Mistry
Hi Neha, All, I am saying is that if same byte[] or data has to go to two topics then, I have to call send twice and with same data has to transfer over the wire twice (assuming the partition is on same broker for two topics, then it not efficient.). If Kafka Protocol allows to set multiple

Re: Sending Same Message to Two Topics on Same Broker Cluster

2014-10-21 Thread Jay Kreps
Hey Bhavesh, This would only work if both topics happened to be on the same machine, which generally they wouldn't. -Jay On Tue, Oct 21, 2014 at 9:14 AM, Bhavesh Mistry mistry.p.bhav...@gmail.com wrote: Hi Neha, All, I am saying is that if same byte[] or data has to go to two topics then,

Re: Sending Same Message to Two Topics on Same Broker Cluster

2014-10-20 Thread Bhavesh Mistry
Hi Neha, Yes, I understand that but when transmitting single message (I can not set List of all topics) Only Single one. So I will to add same message in buffer with different topic. If Kakfa protocol, allows to add multiple topic then message does not have to be re-transmited over the wire to