Re: Kafka Command Line & Shell

I started writing this up on the wiki https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Command+Line+and+Related+Improvements Instead of starting a new thread I figure just continue this one I started. I also added another (important) component for centralized management of configuration as

[jira] [Updated] (KAFKA-1694) kafka command line and centralized operations

[ https://issues.apache.org/jira/browse/KAFKA-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1694: - Summary: kafka command line and centralized operations (was: kafka command line shell) > kafka command l

[jira] [Updated] (KAFKA-1694) kafka command line shell

[ https://issues.apache.org/jira/browse/KAFKA-1694?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1694: - Description: https://cwiki.apache.org/confluence/display/KAFKA/Kafka+Command+Line+and+Related+Improvemen

[jira] [Commented] (KAFKA-1667) topic-level configuration not validated

[ https://issues.apache.org/jira/browse/KAFKA-1667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207668#comment-14207668 ] Gwen Shapira commented on KAFKA-1667: - btw. [~edio], you probably want to assign the J

[jira] [Commented] (KAFKA-1684) Implement TLS/SSL authentication

[ https://issues.apache.org/jira/browse/KAFKA-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207653#comment-14207653 ] Gwen Shapira commented on KAFKA-1684: - If we'll look at the wiki (https://cwiki.apach

[jira] [Commented] (KAFKA-1752) add --replace-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207635#comment-14207635 ] Gwen Shapira commented on KAFKA-1752: - So it looks like we actually want --add-broker

Re: No longer supporting Java 6, if? when?

Perhaps relevant: Hadoop is moving toward dropping Java6 in next release. https://issues.apache.org/jira/browse/HADOOP-10530 On Thu, Nov 6, 2014 at 11:03 AM, Jay Kreps wrote: > Yeah it is a little bit silly that people are still using Java 6. > > I guess this is a tradeoff--being more conserva

[jira] [Commented] (KAFKA-1684) Implement TLS/SSL authentication

[ https://issues.apache.org/jira/browse/KAFKA-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207625#comment-14207625 ] Gwen Shapira commented on KAFKA-1684: - I don't think HBase is the right model here (si

Build failed in Jenkins: Kafka-trunk #327

See Changes: [jjkoshy] KAFKA-1742; ControllerContext removeTopic does not correctly update state; reviewed by Joel Koshy, Guozhang Wang and Neha Narkhede -- [...truncated 1259 lines...] kafka.admin.

[jira] [Resolved] (KAFKA-1742) ControllerContext removeTopic does not correctly update state

[ https://issues.apache.org/jira/browse/KAFKA-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-1742. --- Resolution: Fixed > ControllerContext removeTopic does not correctly update state > --

[jira] [Commented] (KAFKA-1763) validate_index_log in system tests runs remotely but uses local paths

[ https://issues.apache.org/jira/browse/KAFKA-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207592#comment-14207592 ] Mayuresh Gharat commented on KAFKA-1763: Yeah we will probably test out today. >

[jira] [Commented] (KAFKA-1742) ControllerContext removeTopic does not correctly update state

[ https://issues.apache.org/jira/browse/KAFKA-1742?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207591#comment-14207591 ] Joel Koshy commented on KAFKA-1742: --- +1 and committed to trunk and 0.8.2 Based on the r

Re: Kafka consumer transactional support

The transactional work is currently just a prototype. The release wiki is a bit outdated and I just updated it. Do you have a particular transactional use case in mind? Thanks, Jun On Mon, Nov 10, 2014 at 3:23 PM, Falabella, Anthony < anthony.falabe...@citi.com> wrote: > I've tried to search a

[jira] [Commented] (KAFKA-1684) Implement TLS/SSL authentication

[ https://issues.apache.org/jira/browse/KAFKA-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207578#comment-14207578 ] Jun Rao commented on KAFKA-1684: I am not sure if we need to use the same port. HBase supp

Re: [DISCUSSION] Message Metadata

Thinking about this a bit more. For adding the auditing support, I am not sure if we need to change the message format by adding the application tags. An alternative way to do that is to add it in the producer client. For example, for each message payload (doesn't matter what the serialization mech

[jira] [Commented] (KAFKA-1752) add --replace-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207546#comment-14207546 ] Joe Stein commented on KAFKA-1752: -- [~nehanarkhede] I think you make a great point. If KA

[jira] [Commented] (KAFKA-1684) Implement TLS/SSL authentication

[ https://issues.apache.org/jira/browse/KAFKA-1684?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207411#comment-14207411 ] Gwen Shapira commented on KAFKA-1684: - For 7: I don't think we'll use the same port fo

[jira] [Updated] (KAFKA-1764) ZookeeperConsumerConnector could put multiple shutdownCommand to the same data chunk queue.

[ https://issues.apache.org/jira/browse/KAFKA-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1764: Attachment: KAFKA-1764.patch > ZookeeperConsumerConnector could put multiple shutdownCommand to the

[jira] [Updated] (KAFKA-1764) ZookeeperConsumerConnector could put multiple shutdownCommand to the same data chunk queue.

[ https://issues.apache.org/jira/browse/KAFKA-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1764: Status: Patch Available (was: Open) > ZookeeperConsumerConnector could put multiple shutdownCommand

[jira] [Commented] (KAFKA-1764) ZookeeperConsumerConnector could put multiple shutdownCommand to the same data chunk queue.

[ https://issues.apache.org/jira/browse/KAFKA-1764?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207278#comment-14207278 ] Jiangjie Qin commented on KAFKA-1764: - Created reviewboard https://reviews.apache.org/

Review Request 27890: Patch for KAFKA-1764

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27890/ --- Review request for kafka. Bugs: KAFKA-1764 https://issues.apache.org/jira/b

Re: Review Request 27735: Patch for KAFKA-1173

> On Nov. 11, 2014, 5:06 a.m., Joe Stein wrote: > > Vagrantfile, line 40 > > > > > > It might be worth adding somethign about this in the README as it might > > be start to come up on the mailing list a bit The securi

[jira] [Commented] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14207148#comment-14207148 ] Ewen Cheslack-Postava commented on KAFKA-1173: -- Updated reviewboard https://r

Re: Review Request 27735: Patch for KAFKA-1173

> On Nov. 11, 2014, 4:40 a.m., Joe Stein wrote: > > Vagrantfile, line 30 > > > > > > we should use the enviornment variable AWS_ACCESS_KEY and > > AWS_SECRET_KEY which vagrant aws provider will read instead > > https:

[jira] [Updated] (KAFKA-1173) Using Vagrant to get up and running with Apache Kafka

[ https://issues.apache.org/jira/browse/KAFKA-1173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1173: - Attachment: KAFKA-1173_2014-11-11_13:50:55.patch > Using Vagrant to get up and run

Re: Review Request 27735: Patch for KAFKA-1173

--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27735/ --- (Updated Nov. 11, 2014, 9:51 p.m.) Review request for kafka. Bugs: KAFKA-1173

[jira] [Updated] (KAFKA-1763) validate_index_log in system tests runs remotely but uses local paths

[ https://issues.apache.org/jira/browse/KAFKA-1763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1763: - Reviewer: Joel Koshy [~jjkoshy], [~mgharat] This is to fix the system tests that broke at LI. Pro

[jira] [Commented] (KAFKA-1752) add --replace-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206968#comment-14206968 ] Neha Narkhede commented on KAFKA-1752: -- Thanks for the update. I agree with the 2 sce

[jira] [Commented] (KAFKA-1752) add --replace-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206915#comment-14206915 ] Joe Stein commented on KAFKA-1752: -- [~nehanarkhede] Yes, there are two (similar) cases th

[jira] [Resolved] (KAFKA-224) Shouw throw exception when serializer.class if not configured for Producer

[ https://issues.apache.org/jira/browse/KAFKA-224?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-224. Resolution: Not a Problem Closing. Doesn't look like there's an issue here since we have a default.

[jira] [Resolved] (KAFKA-1040) ConsumerConfig and ProducerConfig do "work" in the Constructor

[ https://issues.apache.org/jira/browse/KAFKA-1040?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-1040. - Resolution: Won't Fix Closing as won't fix since I don't think anyone has a problem with the curre

[jira] [Resolved] (KAFKA-1624) building on JDK 8 fails

[ https://issues.apache.org/jira/browse/KAFKA-1624?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gwen Shapira resolved KAFKA-1624. - Resolution: Not a Problem Closing with "not a problem", since this is just a matter of building wi

[jira] [Comment Edited] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206845#comment-14206845 ] Dmitry Pekar edited comment on KAFKA-1753 at 11/11/14 7:09 PM: -

[jira] [Commented] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206845#comment-14206845 ] Dmitry Pekar commented on KAFKA-1753: - Ok. In that case I will add "--decomission-brok

[jira] [Commented] (KAFKA-1752) add --replace-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206842#comment-14206842 ] Neha Narkhede commented on KAFKA-1752: -- [~Dmitry Pekar], [~joestein] Re-thinking this

[jira] [Commented] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206834#comment-14206834 ] Neha Narkhede commented on KAFKA-1753: -- I think from a user's perspective --decommiss

[jira] [Commented] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206712#comment-14206712 ] Gwen Shapira commented on KAFKA-1753: - Yes, I think this will be usable for most cases

[jira] [Commented] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206705#comment-14206705 ] Joe Stein commented on KAFKA-1753: -- << A broker list with 29 brokers is pretty annoying

[jira] [Commented] (KAFKA-1765) slf4j binding conflict in slf4j-log4j12 and kafka-assembly

[ https://issues.apache.org/jira/browse/KAFKA-1765?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206702#comment-14206702 ] Jun Rao commented on KAFKA-1765: Yes, SimpleLogger was dragged in incorrectly in 0.8.0. Yo

[jira] [Commented] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206698#comment-14206698 ] Gwen Shapira commented on KAFKA-1753: - --replace-broker 1 --broker-list 2,3,4 can work

Re: Question about ZookeeperConsumerConnector

Thanks Jun! Jiangjie, could you file a JIRA? Thanks. Guozhang On Tue, Nov 11, 2014 at 9:27 AM, Jun Rao wrote: > Hi, Jiangjie, > > Thanks for the investigation. Yes, this seems like a real issue. > > 1. It doesn't seem that we need to put the shutdownCommand back into the > queue. Once an itera

Re: Question about ZookeeperConsumerConnector

Hi, Jiangjie, Thanks for the investigation. Yes, this seems like a real issue. 1. It doesn't seem that we need to put the shutdownCommand back into the queue. Once an iterator receives a shutdownCommand, it will be in a Done state and will remain in that state forever. 2. Yes, we just need to ge

[jira] [Commented] (KAFKA-1494) Failed to send messages after 3 tries.

[ https://issues.apache.org/jira/browse/KAFKA-1494?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206624#comment-14206624 ] Martin Tapp commented on KAFKA-1494: Had the same problem, only worked on auto-created

[jira] [Commented] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206525#comment-14206525 ] Joe Stein commented on KAFKA-1753: -- I like the approach being taken in KAFKA-1752 --repl

[jira] [Commented] (KAFKA-1752) add --replace-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206524#comment-14206524 ] Joe Stein commented on KAFKA-1752: -- I like the approach --replace-broker 1 --broker-list

[jira] [Comment Edited] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206333#comment-14206333 ] Vladimir Tretyakov edited comment on KAFKA-1481 at 11/11/14 11:42 AM: --

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206333#comment-14206333 ] Vladimir Tretyakov commented on KAFKA-1481: --- Hi again, 65. Honestly I'd prefer

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206303#comment-14206303 ] Vladimir Tretyakov commented on KAFKA-1481: --- Hi [~junrao], {quote} Vladimir Tre

[jira] [Comment Edited] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206223#comment-14206223 ] Dmitry Pekar edited comment on KAFKA-1753 at 11/11/14 9:58 AM: -

Re: Review Request 27634: Patch for KAFKA-1667

> On Nov. 7, 2014, 5 a.m., Gwen Shapira wrote: > > core/src/test/scala/unit/kafka/integration/UncleanLeaderElectionTest.scala, > > line 144 > > > > > > String.valueOf(false) should evaluate to "false", right? Why do w

[jira] [Commented] (KAFKA-1753) add --decommission-broker option

[ https://issues.apache.org/jira/browse/KAFKA-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14206223#comment-14206223 ] Dmitry Pekar commented on KAFKA-1753: - [~nehanarkhede] Suppose we have a cluster [0..4

[jira] [Created] (KAFKA-1766) Ecosystem docs subsection has wrong anchor

Kirill Zaborsky created KAFKA-1766: -- Summary: Ecosystem docs subsection has wrong anchor Key: KAFKA-1766 URL: https://issues.apache.org/jira/browse/KAFKA-1766 Project: Kafka Issue Type: Bug