Re: confirm subscribe to dev@kafka.apache.org

On Mon, 24 Nov 2014, at 10:23, dev-h...@kafka.apache.org wrote: > Hi! This is the ezmlm program. I'm managing the > dev@kafka.apache.org mailing list. > > I'm working for my owner, who can be reached > at dev-ow...@kafka.apache.org. > > To confirm that you would like > >d...@dyachkov.org >

Re: Review Request 25995: Patch for KAFKA-1650

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/25995/ --- (Updated Nov. 24, 2014, 4:15 p.m.) Review request for kafka. Bugs: KAFKA-1650

[jira] [Updated] (KAFKA-1650) Mirror Maker could lose data on unclean shutdown.

[ https://issues.apache.org/jira/browse/KAFKA-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1650: Attachment: KAFKA-1650_2014-11-24_08:15:17.patch > Mirror Maker could lose data on unclean shutdown.

[jira] [Commented] (KAFKA-1650) Mirror Maker could lose data on unclean shutdown.

[ https://issues.apache.org/jira/browse/KAFKA-1650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223099#comment-14223099 ] Jiangjie Qin commented on KAFKA-1650: - Updated reviewboard https://reviews.apache.org/

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223161#comment-14223161 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/24/14 5:26 PM: ---

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223161#comment-14223161 ] Bhavesh Mistry commented on KAFKA-1642: --- [~ewencp], The way to reproduce this is to

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223161#comment-14223161 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/24/14 5:27 PM: ---

Re: [DISCUSSION] Message Metadata

My bad, the link should be this: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Enriched+Message+Metadata On Fri, Nov 21, 2014 at 5:29 PM, Timothy Chen wrote: > Hi Guozhang, > > I don't think that is publically accessible, can you update it to the > Kafka wiki? > > Tim > > On Fri, Nov

Re: Review Request 27391: Fix KAFKA-1634

> On Nov. 21, 2014, 2:41 p.m., Joel Koshy wrote: > > core/src/main/scala/kafka/common/OffsetMetadataAndError.scala, line 17 > > > > > > I thought we would be going with separate format for on-disk storage? > > > >

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223161#comment-14223161 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/24/14 6:57 PM: ---

Re: Review Request 28268: Bump up default scala version from 2.10.1 to 2.10.4

> On Nov. 22, 2014, 2:24 a.m., Joel Koshy wrote: > > Looks good, although the patch does not apply - can you rebase; check that > > it builds properly and then we can close this out. This is a little wired.. both you and Gwen said it does not apply but when I apply the patch (patch -p1 --dry-r

[jira] [Updated] (KAFKA-1624) building on JDK 8 fails

[ https://issues.apache.org/jira/browse/KAFKA-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1624: - Attachment: KAFKA-1624_2014-11-24_11:01:56.patch > building on JDK 8 fails > -

Re: Review Request 28268: Fix KAFKA-1624

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28268/ --- (Updated Nov. 24, 2014, 7:02 p.m.) Review request for kafka. Summary (updated

[jira] [Commented] (KAFKA-1624) building on JDK 8 fails

[ https://issues.apache.org/jira/browse/KAFKA-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223304#comment-14223304 ] Guozhang Wang commented on KAFKA-1624: -- Updated reviewboard https://reviews.apache.or

Re: Review Request 28268: Fix KAFKA-1624

> On Nov. 22, 2014, 2:24 a.m., Joel Koshy wrote: > > Looks good, although the patch does not apply - can you rebase; check that > > it builds properly and then we can close this out. > > Guozhang Wang wrote: > This is a little wired.. both you and Gwen said it does not apply but > when I a

[jira] [Updated] (KAFKA-1624) building on JDK 8 fails

[ https://issues.apache.org/jira/browse/KAFKA-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1624: - Resolution: Fixed Status: Resolved (was: Patch Available) > building on JDK 8 fails > ---

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223532#comment-14223532 ] Bhavesh Mistry commented on KAFKA-1642: --- Also Regarding KafkaProder.close() method h

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223532#comment-14223532 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/24/14 9:21 PM: ---

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223532#comment-14223532 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/24/14 9:22 PM: ---

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223571#comment-14223571 ] Bhavesh Mistry commented on KAFKA-1642: --- Here is exact steps how to reproducer it bu

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223626#comment-14223626 ] Bhavesh Mistry commented on KAFKA-1642: --- Also, there is issue in my last patch. I d

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223626#comment-14223626 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/24/14 10:16 PM: --

[jira] [Created] (KAFKA-1796) Sanity check partition command line tools

Guozhang Wang created KAFKA-1796: Summary: Sanity check partition command line tools Key: KAFKA-1796 URL: https://issues.apache.org/jira/browse/KAFKA-1796 Project: Kafka Issue Type: Bug

[jira] [Updated] (KAFKA-1580) Reject producer requests to internal topics

[ https://issues.apache.org/jira/browse/KAFKA-1580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1580: - Resolution: Fixed Status: Resolved (was: Patch Available) > Reject producer requests to i

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223755#comment-14223755 ] Ewen Cheslack-Postava commented on KAFKA-1642: -- Ok, so as I suspected, you ne

[jira] [Updated] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bhavesh Mistry updated KAFKA-1642: -- Affects Version/s: 0.8.1.1 > [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when networ

[jira] [Updated] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jay Kreps updated KAFKA-1642: - Priority: Blocker (was: Major) > [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network >

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223779#comment-14223779 ] Bhavesh Mistry commented on KAFKA-1642: --- [~ewencp], Thanks for looking into this re

Does Kafka Producer service ?

Hello Amazing Kafka Creators & User, I have learnt and use kafka in our Production system, so you can count my understanding as intermediate. With the statement that "Kafka has solved the Scalability and Availability needs for a large scale message publish/subscribe system", I understand that hav

Re: Review Request 28121: Patch for KAFKA-1780

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28121/#review62909 --- core/src/main/scala/kafka/consumer/ConsumerIterator.scala

[jira] [Commented] (KAFKA-1780) Add peek()/poll() for ConsumerIterator

[ https://issues.apache.org/jira/browse/KAFKA-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223830#comment-14223830 ] Neha Narkhede commented on KAFKA-1780: -- [~ewencp] Sorry for the late review. Posted c

[jira] [Updated] (KAFKA-1780) Add peek()/poll() for ConsumerIterator

[ https://issues.apache.org/jira/browse/KAFKA-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1780: - Attachment: KAFKA-1780_2014-11-24_17:24:54.patch > Add peek()/poll() for ConsumerI

Re: Review Request 28121: Patch for KAFKA-1780

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28121/ --- (Updated Nov. 25, 2014, 1:24 a.m.) Review request for kafka. Bugs: KAFKA-1780

[jira] [Commented] (KAFKA-1780) Add peek()/poll() for ConsumerIterator

[ https://issues.apache.org/jira/browse/KAFKA-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223905#comment-14223905 ] Ewen Cheslack-Postava commented on KAFKA-1780: -- Updated reviewboard https://r

Re: Review Request 28121: Patch for KAFKA-1780

> On Nov. 25, 2014, 12:26 a.m., Neha Narkhede wrote: > > core/src/main/scala/kafka/consumer/ConsumerIterator.scala, line 30 > > > > > > Since we're changing the behavior of ConsumerIterator, let's document > > it here.

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223779#comment-14223779 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/25/14 1:31 AM: ---

Re: Review Request 28121: Patch for KAFKA-1780

> On Nov. 25, 2014, 12:26 a.m., Neha Narkhede wrote: > > core/src/main/scala/kafka/consumer/ConsumerIterator.scala, line 30 > > > > > > Since we're changing the behavior of ConsumerIterator, let's document > > it here.

[jira] [Created] (KAFKA-1797) add the serializer/deserializer api to the new java client

Jun Rao created KAFKA-1797: -- Summary: add the serializer/deserializer api to the new java client Key: KAFKA-1797 URL: https://issues.apache.org/jira/browse/KAFKA-1797 Project: Kafka Issue Type: Impr

[jira] [Updated] (KAFKA-1797) add the serializer/deserializer api to the new java client

[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1797: --- Status: Patch Available (was: Open) > add the serializer/deserializer api to the new java client > --

[jira] [Updated] (KAFKA-1797) add the serializer/deserializer api to the new java client

[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1797: --- Attachment: kafka-1797.patch > add the serializer/deserializer api to the new java client > --

[jira] [Commented] (KAFKA-1797) add the serializer/deserializer api to the new java client

[ https://issues.apache.org/jira/browse/KAFKA-1797?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223927#comment-14223927 ] Jun Rao commented on KAFKA-1797: Created reviewboard https://reviews.apache.org/r/28423/di

Review Request 28423: Patch for kafka-1797

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28423/ --- Review request for kafka. Bugs: kafka-1797 https://issues.apache.org/jira/b

[DISCUSSION] adding the serializer api back to the new java producer

Hi, Everyone, I'd like to start a discussion on whether it makes sense to add the serializer api back to the new java producer. Currently, the new java producer takes a byte array for both the key and the value. While this api is simple, it pushes the serialization logic into the application. This

Re: Review Request 27990: Patch for KAFKA-1751

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27990/#review62922 --- In addition to ensuring that the reassignment command doesn't reassi

Re: [DISCUSSION] adding the serializer api back to the new java producer

This is admittedly late in the release cycle to make a change. To add to Jun's description the motivation was that we felt it would be better to change that interface now rather than after the release if it needed to change. The motivation for wanting to make a change was the ability to really be

Re: Review Request 28121: Patch for KAFKA-1780

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/28121/#review62926 --- Ship it! - Neha Narkhede On Nov. 25, 2014, 1:24 a.m., Ewen Chesla

[jira] [Commented] (KAFKA-1780) Add peek()/poll() for ConsumerIterator

[ https://issues.apache.org/jira/browse/KAFKA-1780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223949#comment-14223949 ] Neha Narkhede commented on KAFKA-1780: -- This patch touches the consumer iterator. LGT

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224039#comment-14224039 ] Bhavesh Mistry commented on KAFKA-1642: --- Here are some more cases to reproduce this

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224041#comment-14224041 ] Bhavesh Mistry commented on KAFKA-1642: --- [~ewencp], I hope above steps will give yo

Re: [DISCUSSION] adding the serializer api back to the new java producer

As one of the people who spent too much time building Avro repositories, +1 on bringing serializer API back. I think it will make the new producer easier to work with. Gwen On Mon, Nov 24, 2014 at 6:13 PM, Jay Kreps wrote: > This is admittedly late in the release cycle to make a change. To add

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224041#comment-14224041 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/25/14 4:37 AM: ---

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224041#comment-14224041 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/25/14 4:39 AM: ---

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224041#comment-14224041 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/25/14 4:40 AM: ---

[jira] [Commented] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224046#comment-14224046 ] Bhavesh Mistry commented on KAFKA-1642: --- Also, Are you going to port back the back t

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224046#comment-14224046 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/25/14 4:43 AM: ---

Re: [DISCUSSION] adding the serializer api back to the new java producer

Looked at the patch. +1 from me. On 11/24/14 8:29 PM, "Gwen Shapira" wrote: >As one of the people who spent too much time building Avro repositories, >+1 >on bringing serializer API back. > >I think it will make the new producer easier to work with. > >Gwen > >On Mon, Nov 24, 2014 at 6:13 PM, Ja

[jira] [Comment Edited] (KAFKA-1642) [Java New Producer Kafka Trunk] CPU Usage Spike to 100% when network connection is lost

[ https://issues.apache.org/jira/browse/KAFKA-1642?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224041#comment-14224041 ] Bhavesh Mistry edited comment on KAFKA-1642 at 11/25/14 5:37 AM: ---