Re: Review Request 17460: Patch for KAFKA-330

> On Feb. 5, 2014, 2:50 a.m., Joel Koshy wrote: > > core/src/main/scala/kafka/controller/ControllerChannelManager.scala, line > > 220 > > > > > > Why not only limit to the topic-partitions relevant to this > > leader

[jira] [Updated] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1171: --- Attachment: kafka-1171_v12.patch Did a google search on scalatest and found the answer right in this jira. A

[jira] [Commented] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891820#comment-13891820 ] Jun Rao commented on KAFKA-1171: The unit tests issue for scala 2.10.x is caused by scalat

[jira] [Commented] (KAFKA-1242) Get added to the asf-cla group

[ https://issues.apache.org/jira/browse/KAFKA-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891693#comment-13891693 ] Jun Rao commented on KAFKA-1242: Tomas, You may already have been added to that list once

Re: Review Request 17460: Patch for KAFKA-330

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17460/#review33668 --- I haven't finished reviewing but will continue when I get time. I ha

[jira] [Commented] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891612#comment-13891612 ] Neha Narkhede commented on KAFKA-1171: -- Thanks for the patch, Jun. 1. ./gradlew cop

[jira] [Commented] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891472#comment-13891472 ] David Arthur commented on KAFKA-1171: - Jun, that's fine. I added the subproject name b

[jira] [Comment Edited] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891472#comment-13891472 ] David Arthur edited comment on KAFKA-1171 at 2/5/14 12:05 AM: --

[jira] [Updated] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1171: --- Attachment: kafka-1171_v11.patch Attach patch v11. 1. Included all but one fixes from David Arthur on top of

Re: Review Request 17537: Patch for KAFKA-1028

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17537/#review33658 --- core/src/main/scala/kafka/controller/PartitionLeaderSelector.scala

[jira] [Commented] (KAFKA-1237) Add mirror maker using 08 consumer and 09 producer

[ https://issues.apache.org/jira/browse/KAFKA-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891210#comment-13891210 ] Neha Narkhede commented on KAFKA-1237: -- Updated reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1237) Add mirror maker using 08 consumer and 09 producer

[ https://issues.apache.org/jira/browse/KAFKA-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1237: - Attachment: KAFKA-1237_2014-02-04_13:12:08.patch > Add mirror maker using 08 consumer and 09 prod

[jira] [Issue Comment Deleted] (KAFKA-1137) Problem of FetchRequest API

[ https://issues.apache.org/jira/browse/KAFKA-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1137: - Comment: was deleted (was: Updated reviewboard https://reviews.apache.org/r/17649/ against branc

[jira] [Closed] (KAFKA-1137) Problem of FetchRequest API

[ https://issues.apache.org/jira/browse/KAFKA-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede closed KAFKA-1137. > Problem of FetchRequest API > --- > > Key: KAFKA-1137 >

Re: Review Request 17649: Patch for KAFKA-1237

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17649/ --- (Updated Feb. 4, 2014, 9:12 p.m.) Review request for kafka. Summary (updated)

[jira] [Updated] (KAFKA-1137) Problem of FetchRequest API

[ https://issues.apache.org/jira/browse/KAFKA-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1137: - Attachment: KAFKA-1137_2014-02-04_13:04:23.patch > Problem of FetchRequest API >

[jira] [Commented] (KAFKA-1137) Problem of FetchRequest API

[ https://issues.apache.org/jira/browse/KAFKA-1137?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891201#comment-13891201 ] Neha Narkhede commented on KAFKA-1137: -- Updated reviewboard https://reviews.apache.or

Re: Review Request 17649: Patch for KAFKA-1137

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17649/ --- (Updated Feb. 4, 2014, 9:04 p.m.) Review request for kafka. Summary (updated)

Re: Review Request 17688: API refactoring for new producer

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17688/#review33622 --- clients/src/main/java/kafka/clients/producer/KafkaProducer.java

[jira] [Updated] (KAFKA-1242) Get added to the asf-cla group

[ https://issues.apache.org/jira/browse/KAFKA-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1242: - Assignee: Joe Stein > Get added to the asf-cla group > -- > >

[jira] [Commented] (KAFKA-1242) Get added to the asf-cla group

[ https://issues.apache.org/jira/browse/KAFKA-1242?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13891052#comment-13891052 ] Neha Narkhede commented on KAFKA-1242: -- [~joestein] Do you know what is the procedure

[jira] [Created] (KAFKA-1242) Get added to the asf-cla group

Tomas Uribe created KAFKA-1242: -- Summary: Get added to the asf-cla group Key: KAFKA-1242 URL: https://issues.apache.org/jira/browse/KAFKA-1242 Project: Kafka Issue Type: Task Component

[jira] [Created] (KAFKA-1241) Cryptic serde error messages in new producer

Neha Narkhede created KAFKA-1241: Summary: Cryptic serde error messages in new producer Key: KAFKA-1241 URL: https://issues.apache.org/jira/browse/KAFKA-1241 Project: Kafka Issue Type: Bug

Re: New producer todo

I can help on compression. Thanks, Jun On Tue, Feb 4, 2014 at 8:54 AM, Jay Kreps wrote: > Here is the list of todo items we have for the new producer (in no > particular order): > 1. Rename to org.apache.* package > 2. Discuss config approach > 3. Finalize config approach > 4. Add slf4j loggi

Re: code layout

Since we don't really have an admin api (just standalone tools), perhaps we can start with option A. We can potentially add an admin (or tools) jar in the future when we expose programming apis for admin. Thanks, Jun On Sun, Feb 2, 2014 at 9:59 PM, Jay Kreps wrote: > Yes, this is a good point

[jira] [Updated] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1171: --- Attachment: kafka-1171_v10.patch Attach patch v10. 1. added uploadCoreArchives_all task 2. added releaseTar

[jira] [Updated] (KAFKA-1239) New producer checklist

[ https://issues.apache.org/jira/browse/KAFKA-1239?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1239: - Assignee: (was: Jun Rao) > New producer checklist > -- > >

Re: Startup

Have you checked this page? https://cwiki.apache.org/confluence/display/KAFKA/Kafka+papers+and+presentations On Tue, Feb 4, 2014 at 2:53 AM, Aman Srivastava < aman.srivast...@wizecommerce.com> wrote: > Hi , > I am using Kafka for first time for development utilizing hadoop > environment . Any

Re: New producer todo

I'd prefer to do the discussion on the mailing list as that has been getting vastly better participation then the JIRAs do. On Tue, Feb 4, 2014 at 9:24 AM, Neha Narkhede wrote: > Filed https://issues.apache.org/jira/browse/KAFKA-1239 to track this todo, > so we can continue discussion for these

Re: Startup

Are you trying to get Kafka data into Hadooop? If so, you can take a look at https://github.com/linkedin/camus Thanks, Jun On Tue, Feb 4, 2014 at 2:53 AM, Aman Srivastava < aman.srivast...@wizecommerce.com> wrote: > Hi , > I am using Kafka for first time for development utilizing hadoop > env

Config for new clients (and server)

We touched on this a bit in previous discussions, but I wanted to draw out the approach to config specifically as an item of discussion. The new producer and consumer use a similar key-value config approach as the existing scala clients but have different implementation code to help define these c

[jira] [Updated] (KAFKA-1236) Change producer performance tool to optionally use the new producer

[ https://issues.apache.org/jira/browse/KAFKA-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1236: - Description: The producer performance tool needs the ability to optionally use the new producer.

Re: New producer todo

Filed https://issues.apache.org/jira/browse/KAFKA-1239 to track this todo, so we can continue discussion for these items on the respective JIRA. Also moved JIRAs for some of these as sub tasks of KAFKA-1239. Thanks, Neha On Tue, Feb 4, 2014 at 8:54 AM, Jay Kreps wrote: > Here is the list of to

[jira] [Created] (KAFKA-1240) Add ability to existing system tests to use the new producer client

Neha Narkhede created KAFKA-1240: Summary: Add ability to existing system tests to use the new producer client Key: KAFKA-1240 URL: https://issues.apache.org/jira/browse/KAFKA-1240 Project: Kafka

[jira] [Updated] (KAFKA-1236) Add ability to existing system tests to use the new producer client

[ https://issues.apache.org/jira/browse/KAFKA-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1236: - Issue Type: Sub-task (was: Improvement) Parent: KAFKA-1239 > Add ability to existing sys

[jira] [Updated] (KAFKA-1237) Add mirror maker using 08 consumer and 09 producer

[ https://issues.apache.org/jira/browse/KAFKA-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1237: - Issue Type: Sub-task (was: Improvement) Parent: KAFKA-1239 > Add mirror maker using 08 c

[jira] [Updated] (KAFKA-1236) Change producer performance tool to optionally use the new producer

[ https://issues.apache.org/jira/browse/KAFKA-1236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1236: - Summary: Change producer performance tool to optionally use the new producer (was: Add ability t

[jira] [Created] (KAFKA-1239) New producer checklist

Neha Narkhede created KAFKA-1239: Summary: New producer checklist Key: KAFKA-1239 URL: https://issues.apache.org/jira/browse/KAFKA-1239 Project: Kafka Issue Type: New Feature Compon

[jira] [Updated] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Arthur updated KAFKA-1171: Attachment: 0001-Adding-basic-Gradle-build.patch * Adding upload_* tasks for the different Scala ve

[jira] [Updated] (KAFKA-1237) Add mirror maker using 08 consumer and 09 producer

[ https://issues.apache.org/jira/browse/KAFKA-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1237: - Attachment: KAFKA-1237_2014-02-04_09:10:13.patch > Add mirror maker using 08 consumer and 09 prod

[jira] [Commented] (KAFKA-1237) Add mirror maker using 08 consumer and 09 producer

[ https://issues.apache.org/jira/browse/KAFKA-1237?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890856#comment-13890856 ] Neha Narkhede commented on KAFKA-1237: -- Updated reviewboard https://reviews.apache.or

Re: Review Request 17649: Patch for KAFKA-1237

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17649/#review33606 --- core/src/main/scala/kafka/tools/newproducer/MirrorMaker.java

Re: Review Request 17649: Patch for KAFKA-1237

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17649/ --- (Updated Feb. 4, 2014, 5:10 p.m.) Review request for kafka. Bugs: KAFKA-1237

Re: Review Request 17688: API refactoring for new producer

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/17688/#review33602 --- clients/src/main/java/kafka/common/Cluster.java

New producer todo

Here is the list of todo items we have for the new producer (in no particular order): 1. Rename to org.apache.* package 2. Discuss config approach 3. Finalize config approach 4. Add slf4j logging for debugging purposes 5. Discuss metrics approach 6. Add metrics 7. Convert perf test to optionally us

[jira] [Commented] (KAFKA-1171) Gradle build for Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1171?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890828#comment-13890828 ] Jay Kreps commented on KAFKA-1171: -- My impression is that people who use Scala have mostl

[jira] [Commented] (KAFKA-1227) Code dump of new producer

[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890833#comment-13890833 ] Jay Kreps commented on KAFKA-1227: -- The later one. I think I haven't mastered our uber-pa

Startup

Hi , I am using Kafka for first time for development utilizing hadoop environment . Any references ,ppts would be appreciated Thanks Aman CONFIDENTIALITY NOTICE == This email message and any attachments are for the exclusive use of the intended recipient(s) and may contain

kafka pull request: fixed typo

GitHub user mosch opened a pull request: https://github.com/apache/kafka/pull/17 fixed typo You can merge this pull request into a Git repository by running: $ git pull https://github.com/mosch/kafka patch-1 Alternatively you can review and apply these changes as the patch at

[jira] [Commented] (KAFKA-1227) Code dump of new producer

[ https://issues.apache.org/jira/browse/KAFKA-1227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13890594#comment-13890594 ] Edward Ribeiro commented on KAFKA-1227: --- Two review board entries were created for t