[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14002843#comment-14002843 ] James Oliver commented on KAFKA-1432: - Updated reviewboard https://reviews.apache.org/r/21663/diff/ against branch trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432.patch, KAFKA-1432.patch, > KAFKA-1432.patch, KAFKA-1432_2014-05-05_10:31:42.patch, > KAFKA-1432_2014-05-05_14:33:01.patch, KAFKA-1432_2014-05-05_15:24:08.patch, > KAFKA-1432_2014-05-06_16:05:28.patch, KAFKA-1432_2014-05-19_23:13:01.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13992488#comment-13992488 ] Jun Rao commented on KAFKA-1432: Thanks for the followup patch. +1 and committed to trunk. > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432.patch, KAFKA-1432.patch, > KAFKA-1432.patch, KAFKA-1432_2014-05-05_10:31:42.patch, > KAFKA-1432_2014-05-05_14:33:01.patch, KAFKA-1432_2014-05-05_15:24:08.patch, > KAFKA-1432_2014-05-06_16:05:28.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991304#comment-13991304 ] Guozhang Wang commented on KAFKA-1432: -- Updated reviewboard https://reviews.apache.org/r/21134/ against branch origin/trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432.patch, KAFKA-1432.patch, > KAFKA-1432_2014-05-05_10:31:42.patch, KAFKA-1432_2014-05-05_14:33:01.patch, > KAFKA-1432_2014-05-05_15:24:08.patch, KAFKA-1432_2014-05-06_16:05:28.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991293#comment-13991293 ] Guozhang Wang commented on KAFKA-1432: -- Created reviewboard https://reviews.apache.org/r/21134/ against branch origin/trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432.patch, KAFKA-1432.patch, > KAFKA-1432_2014-05-05_10:31:42.patch, KAFKA-1432_2014-05-05_14:33:01.patch, > KAFKA-1432_2014-05-05_15:24:08.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13991286#comment-13991286 ] Guozhang Wang commented on KAFKA-1432: -- Created reviewboard against branch origin/trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432.patch, > KAFKA-1432_2014-05-05_10:31:42.patch, KAFKA-1432_2014-05-05_14:33:01.patch, > KAFKA-1432_2014-05-05_15:24:08.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13990052#comment-13990052 ] Guozhang Wang commented on KAFKA-1432: -- Updated reviewboard https://reviews.apache.org/r/20997/ against branch origin/trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432_2014-05-05_10:31:42.patch, > KAFKA-1432_2014-05-05_14:33:01.patch, KAFKA-1432_2014-05-05_15:24:08.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13989997#comment-13989997 ] Guozhang Wang commented on KAFKA-1432: -- Updated reviewboard https://reviews.apache.org/r/20997/ against branch origin/trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432_2014-05-05_10:31:42.patch, > KAFKA-1432_2014-05-05_14:33:01.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13989743#comment-13989743 ] Guozhang Wang commented on KAFKA-1432: -- Updated reviewboard https://reviews.apache.org/r/20997/ against branch origin/trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch, KAFKA-1432_2014-05-05_10:31:42.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
[jira] [Commented] (KAFKA-1432) Make num.producerThreads configurable on new MirrrorMaker
[ https://issues.apache.org/jira/browse/KAFKA-1432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13987184#comment-13987184 ] Guozhang Wang commented on KAFKA-1432: -- Created reviewboard https://reviews.apache.org/r/20997/ against branch origin/trunk > Make num.producerThreads configurable on new MirrrorMaker > - > > Key: KAFKA-1432 > URL: https://issues.apache.org/jira/browse/KAFKA-1432 > Project: Kafka > Issue Type: Bug >Reporter: Guozhang Wang >Assignee: Guozhang Wang > Fix For: 0.8.2 > > Attachments: KAFKA-1432.patch > > > Originally we make the num.producerThreads coupled with num.consumerThreads > since we thought with the new producer, a single or couple of instances are > sufficient for throughput. However, with compression turned on, which is now > executed in the caller thread we still need configurable number of producer > threads. -- This message was sent by Atlassian JIRA (v6.2#6252)
