KAFKA-2042

2015-03-24 Thread Guozhang Wang
Hello, We found a serious bug while testing flush() calls in the new producer, which is summarized in KAFKA-2042. In general, when the producer starts up it will try to refresh metadata with empty topic list, and hence get all the topic metadata. When sending the message with some topic later

Re: KAFKA-2042

2015-03-24 Thread Jun Rao
Hi, Guozhang, The flush() was added to the new producer in trunk, not in 0.8.2, right? Thanks, Jun On Tue, Mar 24, 2015 at 2:42 PM, Guozhang Wang wrote: > Hello, > > We found a serious bug while testing flush() calls in the new producer, > which is summarized in KAFKA-2042. &g

Re: KAFKA-2042

2015-03-24 Thread Jiangjie Qin
n Rao" wrote: >Hi, Guozhang, > >The flush() was added to the new producer in trunk, not in 0.8.2, right? > >Thanks, > >Jun > >On Tue, Mar 24, 2015 at 2:42 PM, Guozhang Wang wrote: > >> Hello, >> >> We found a serious bug while testing flush()

Re: KAFKA-2042

2015-03-24 Thread Guozhang Wang
un > > On Tue, Mar 24, 2015 at 2:42 PM, Guozhang Wang wrote: > > > Hello, > > > > We found a serious bug while testing flush() calls in the new producer, > > which is summarized in KAFKA-2042. > > > > In general, when the producer starts up it will try to

Review Request 32434: Patch for KAFKA-2042

2015-03-24 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/32434/ --- Review request for kafka. Bugs: KAFKA-2042 https://issues.apache.org/jira

Re: Review Request 32434: Patch for KAFKA-2042

2015-03-24 Thread Guozhang Wang
To reply, visit: > https://reviews.apache.org/r/32434/ > --- > > (Updated March 24, 2015, 8:17 a.m.) > > > Review request for kafka. > > > Bugs: KAFKA-2042 > https://issues.apache.org/jira/b

Re: Review Request 32434: Patch for KAFKA-2042

2015-03-24 Thread Jiangjie Qin
-2042 https://issues.apache.org/jira/browse/KAFKA-2042 Repository: kafka Description (updated) --- Move the change to KafkaProducer after talking to Guozhang offline. Diffs (updated) - clients/src/main/java/org/apache/kafka/clients/producer/KafkaProducer.java

Re: Review Request 32434: Patch for KAFKA-2042

2015-03-24 Thread Jiangjie Qin
-2042 https://issues.apache.org/jira/browse/KAFKA-2042 Repository: kafka Description (updated) --- Move the change to KafkaProducer after talking to Guozhang offline. A less expensive fix Diffs (updated) - clients/src/main/java/org/apache/kafka/clients/Metadata.java

Re: Review Request 32434: Patch for KAFKA-2042

2015-03-24 Thread Guozhang Wang
wrote: > > --- > This is an automatically generated e-mail. To reply, visit: > https://reviews.apache.org/r/32434/ > --- > > (Updated March 24, 2015, 8:57 p.m.) > > > Review request for kafka.

Re: Review Request 32434: Patch for KAFKA-2042

2015-03-24 Thread Jiangjie Qin
To reply, visit: > https://reviews.apache.org/r/32434/ > --- > > (Updated March 24, 2015, 8:57 p.m.) > > > Review request for kafka. > > > Bugs: KAFKA-2042 > https://issues.apache.org/jira/browse/KAFKA-2042 > &

Re: Review Request 32434: Patch for KAFKA-2042

2015-03-24 Thread Guozhang Wang
ch 24, 2015, 8:57 p.m.) > > > Review request for kafka. > > > Bugs: KAFKA-2042 > https://issues.apache.org/jira/browse/KAFKA-2042 > > > Repository: kafka > > > Description > --- > > Move the change to KafkaProducer after talking to Guozhang offli

[jira] [Created] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
Jiangjie Qin created KAFKA-2042: --- Summary: New producer metadata update always get all topics. Key: KAFKA-2042 URL: https://issues.apache.org/jira/browse/KAFKA-2042 Project: Kafka Issue Type

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14377476#comment-14377476 ] Jiangjie Qin commented on KAFKA-2042: - Created reviewboard https://reviews.apache

[jira] [Updated] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2042: Attachment: KAFKA-2042.patch > New producer metadata update always get all top

[jira] [Updated] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2042: Assignee: Jiangjie Qin Status: Patch Available (was: Open) > New producer metadata upd

[jira] [Updated] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2042: Priority: Blocker (was: Major) > New producer metadata update always get all top

[jira] [Updated] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2042: Attachment: KAFKA-2042_2015-03-24_13:37:49.patch > New producer metadata update always get

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378551#comment-14378551 ] Jiangjie Qin commented on KAFKA-2042: - Updated reviewboard https://reviews.apache

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378586#comment-14378586 ] Jiangjie Qin commented on KAFKA-2042: - Updated reviewboard https://reviews.apache

[jira] [Updated] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-2042: Attachment: KAFKA-2042_2015-03-24_13:57:23.patch > New producer metadata update always get

[jira] [Updated] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2042: - Fix Version/s: 0.8.3 > New producer metadata update always get all top

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378828#comment-14378828 ] Guozhang Wang commented on KAFKA-2042: -- Thanks for the patch, committed to t

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378954#comment-14378954 ] Jun Rao commented on KAFKA-2042: Could you explain a bit more when the new producer

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14378986#comment-14378986 ] Jiangjie Qin commented on KAFKA-2042: - Yes, it depends on whether the topic lis

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379015#comment-14379015 ] Jun Rao commented on KAFKA-2042: If I start a console-producer w/o typing in any mes

[jira] [Commented] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14379120#comment-14379120 ] Jiangjie Qin commented on KAFKA-2042: - Ah, yes, that's right. I found this i

[jira] [Updated] (KAFKA-2042) New producer metadata update always get all topics.

2015-03-24 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-2042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-2042: - Resolution: Fixed Status: Resolved (was: Patch Available) > New producer metadata upd