[jira] [Comment Edited] (KAFKA-1710) [New Java Producer Potential Deadlock] Producer Deadlock when all messages is being sent to single partition

2014-10-27 Thread Bhavesh Mistry (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186350#comment-14186350 ] Bhavesh Mistry edited comment on KAFKA-1710 at 10/28/14 4:58 AM: ---

[jira] [Comment Edited] (KAFKA-1710) [New Java Producer Potential Deadlock] Producer Deadlock when all messages is being sent to single partition

2014-10-27 Thread Bhavesh Mistry (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186350#comment-14186350 ] Bhavesh Mistry edited comment on KAFKA-1710 at 10/28/14 4:40 AM: ---

[jira] [Commented] (KAFKA-1710) [New Java Producer Potential Deadlock] Producer Deadlock when all messages is being sent to single partition

2014-10-27 Thread Bhavesh Mistry (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1710?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186350#comment-14186350 ] Bhavesh Mistry commented on KAFKA-1710: --- [~jkreps], I understand the current code b

[jira] [Commented] (KAFKA-1732) DumpLogSegments tool fails when path has a '.'

2014-10-27 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186334#comment-14186334 ] Neha Narkhede commented on KAFKA-1732: -- Thanks [~charmalloc]. Missed updating the ver

[jira] [Updated] (KAFKA-1732) DumpLogSegments tool fails when path has a '.'

2014-10-27 Thread Joe Stein (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Stein updated KAFKA-1732: - Fix Version/s: 0.8.2 > DumpLogSegments tool fails when path has a '.' > --

RE: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released

2014-10-27 Thread Libo Yu
Congrats! When do you think the final 0.82 will be released? > To: annou...@apache.org; us...@kafka.apache.org; dev@kafka.apache.org > Subject: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released > Date: Tue, 28 Oct 2014 00:50:35 + > From: joest...@apache.org > > The Apache Kafka community is ple

[jira] [Updated] (KAFKA-1706) Adding a byte bounded blocking queue to util.

2014-10-27 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1706: Attachment: KAFKA-1706_2014-10-27_18:34:37.patch > Adding a byte bounded blocking queue to util. > -

[jira] [Commented] (KAFKA-1706) Adding a byte bounded blocking queue to util.

2014-10-27 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1706?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186196#comment-14186196 ] Jiangjie Qin commented on KAFKA-1706: - Updated reviewboard https://reviews.apache.org/

Re: Review Request 26755: Patch for KAFKA-1706

2014-10-27 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26755/ --- (Updated Oct. 28, 2014, 1:34 a.m.) Review request for kafka. Bugs: KAFKA-1706

Re: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released

2014-10-27 Thread Jun Rao
Joe, Thanks for driving the release. Jun On Mon, Oct 27, 2014 at 5:50 PM, Joe Stein wrote: > The Apache Kafka community is pleased to announce the beta release for > Apache Kafka 0.8.2. > > The 0.8.2-beta release introduces many new features, improvements and > fixes including: > - A new Java

Re: Review Request 26373: Patch for KAFKA-1647

2014-10-27 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26373/#review58748 --- Ship it! Looks good to me. Can you make these final edits and uploa

[jira] [Commented] (KAFKA-1731) add config/jmx changes in 0.8.2 doc

2014-10-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186179#comment-14186179 ] Gwen Shapira commented on KAFKA-1731: - Thanks :) No comments, it looks good. > add

Re: Review Request 27256: Fix KAFKA-1735

2014-10-27 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27256/#review58744 --- clients/src/main/java/org/apache/kafka/common/record/MemoryRecords.

Re: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released

2014-10-27 Thread Jay Kreps
Yeah it must be a caching thing because others in the same office do see it (but not all). And ctrl-shift-r doesn't seem to help. Nevermind :-) -Jay On Mon, Oct 27, 2014 at 6:00 PM, Gwen Shapira wrote: > Strange. I'm seeing it. > > Browser cache? > > On Mon, Oct 27, 2014 at 5:59 PM, Jay Kreps

Re: Review Request 26755: Patch for KAFKA-1706

2014-10-27 Thread Joel Koshy
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26755/#review58725 --- Another thing I forgot to mention in the earlier review: we definite

Re: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released

2014-10-27 Thread Gwen Shapira
Strange. I'm seeing it. Browser cache? On Mon, Oct 27, 2014 at 5:59 PM, Jay Kreps wrote: > I actually don't see the beta release on that download page: > http://kafka.apache.org/downloads.html > > -Jay > > On Mon, Oct 27, 2014 at 5:50 PM, Joe Stein wrote: > >> The Apache Kafka community is plea

Re: [ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released

2014-10-27 Thread Jay Kreps
I actually don't see the beta release on that download page: http://kafka.apache.org/downloads.html -Jay On Mon, Oct 27, 2014 at 5:50 PM, Joe Stein wrote: > The Apache Kafka community is pleased to announce the beta release for > Apache Kafka 0.8.2. > > The 0.8.2-beta release introduces many ne

[ANNOUNCEMENT] Apache Kafka 0.8.2-beta Released

2014-10-27 Thread Joe Stein
The Apache Kafka community is pleased to announce the beta release for Apache Kafka 0.8.2. The 0.8.2-beta release introduces many new features, improvements and fixes including: - A new Java producer for ease of implementation and enhanced performance. - Delete topic support. - Per topic conf

[jira] [Commented] (KAFKA-1501) transient unit tests failures due to port already in use

2014-10-27 Thread Jay Kreps (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1501?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186130#comment-14186130 ] Jay Kreps commented on KAFKA-1501: -- Nice, so statistically it is 93% likely to be fixed,

[jira] [Commented] (KAFKA-1481) Stop using dashes AND underscores as separators in MBean names

2014-10-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1481?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186124#comment-14186124 ] Jun Rao commented on KAFKA-1481: Vladimir, Thanks for the patch. Really appreciate your h

Jenkins build is back to normal : Kafka-trunk #319

2014-10-27 Thread Apache Jenkins Server
See

Re: Review Request 26373: Patch for KAFKA-1647

2014-10-27 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26373/ --- (Updated Oct. 28, 2014, 12:20 a.m.) Review request for kafka. Bugs: KAFKA-164

[jira] [Updated] (KAFKA-1647) Replication offset checkpoints (high water marks) can be lost on hard kills and restarts

2014-10-27 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jiangjie Qin updated KAFKA-1647: Attachment: KAFKA-1647_2014-10-27_17:19:07.patch > Replication offset checkpoints (high water marks)

[jira] [Commented] (KAFKA-1647) Replication offset checkpoints (high water marks) can be lost on hard kills and restarts

2014-10-27 Thread Jiangjie Qin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1647?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186104#comment-14186104 ] Jiangjie Qin commented on KAFKA-1647: - Updated reviewboard https://reviews.apache.org/

Re: Review Request 26373: Patch for KAFKA-1647

2014-10-27 Thread Jiangjie Qin
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/26373/ --- (Updated Oct. 28, 2014, 12:19 a.m.) Review request for kafka. Bugs: KAFKA-164

[jira] [Commented] (KAFKA-1735) MemoryRecords.Iterator needs to handle partial reads from compressed stream

2014-10-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14186072#comment-14186072 ] Guozhang Wang commented on KAFKA-1735: -- Created reviewboard https://reviews.apache.or

[jira] [Updated] (KAFKA-1735) MemoryRecords.Iterator needs to handle partial reads from compressed stream

2014-10-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1735: - Status: Patch Available (was: Open) > MemoryRecords.Iterator needs to handle partial reads from c

[jira] [Updated] (KAFKA-1735) MemoryRecords.Iterator needs to handle partial reads from compressed stream

2014-10-27 Thread Guozhang Wang (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1735?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-1735: - Attachment: KAFKA-1735.patch > MemoryRecords.Iterator needs to handle partial reads from compresse

Review Request 27256: Fix KAFKA-1735

2014-10-27 Thread Guozhang Wang
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27256/ --- Review request for kafka. Bugs: KAFKA-1735 https://issues.apache.org/jira/b

[jira] [Created] (KAFKA-1735) MemoryRecords.Iterator needs to handle partial reads from compressed stream

2014-10-27 Thread Guozhang Wang (JIRA)
Guozhang Wang created KAFKA-1735: Summary: MemoryRecords.Iterator needs to handle partial reads from compressed stream Key: KAFKA-1735 URL: https://issues.apache.org/jira/browse/KAFKA-1735 Project: Ka

[DISCUSSION] Nested compression in Kafka?

2014-10-27 Thread Guozhang Wang
Hello folks, I came across this "testComplexCompressDecompress" in kafka.message.MessageCompressionTest while I'm working some consumer decompression optimization. This test checks if nested compression is supported. I remember vaguely that some time ago we decide not to support nested compressio

Re: Review Request 26755: Patch for KAFKA-1706

2014-10-27 Thread Joel Koshy
> On Oct. 25, 2014, 7:52 a.m., Joel Koshy wrote: > > core/src/main/scala/kafka/utils/ByteBoundedBlockingQueue.scala, line 109 > > > > > > getAndDecrement(sizeFunction.get(e)) > > Jiangjie Qin wrote: > It seems get

[jira] [Updated] (KAFKA-1732) DumpLogSegments tool fails when path has a '.'

2014-10-27 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1732: - Resolution: Fixed Status: Resolved (was: Patch Available) Thanks for the patch. Pushed to

Re: Review Request 27238: Patch for KAFKA-1732

2014-10-27 Thread Neha Narkhede
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27238/#review58723 --- Ship it! Ship It! - Neha Narkhede On Oct. 27, 2014, 6:41 p.m., E

[jira] [Updated] (KAFKA-1733) Producer.send will block indeterminately when broker is unavailable.

2014-10-27 Thread Neha Narkhede (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Neha Narkhede updated KAFKA-1733: - Reviewer: Jun Rao Assignee: (was: Jun Rao) > Producer.send will block indeterminately when

[jira] [Updated] (KAFKA-1731) add config/jmx changes in 0.8.2 doc

2014-10-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1731: --- Attachment: config-jmx_082.patch Attached please find the patch. > add config/jmx changes in 0.8.2 doc >

[jira] [Commented] (KAFKA-1731) add config/jmx changes in 0.8.2 doc

2014-10-27 Thread Gwen Shapira (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185818#comment-14185818 ] Gwen Shapira commented on KAFKA-1731: - Any chance you can upload a patch so we can see

[jira] [Updated] (KAFKA-1731) add config/jmx changes in 0.8.2 doc

2014-10-27 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao updated KAFKA-1731: --- Fix Version/s: 0.8.2 Assignee: Jun Rao I made a pass on the site doc to add the new broker side confi

Re: Kafka Security?

2014-10-27 Thread Gwen Shapira
This is very much work in progress. You can follow the Jira here to see how it goes: https://issues.apache.org/jira/browse/KAFKA-1682 On Mon, Oct 27, 2014 at 11:49 AM, Stephenson, John L wrote: > List Users, > Does anyone know when/if Kafka security features are being planned? I > haven't

[jira] [Created] (KAFKA-1734) System test metric plotting nonexistent file warnings

2014-10-27 Thread Andrew Olson (JIRA)
Andrew Olson created KAFKA-1734: --- Summary: System test metric plotting nonexistent file warnings Key: KAFKA-1734 URL: https://issues.apache.org/jira/browse/KAFKA-1734 Project: Kafka Issue Type:

Kafka Security?

2014-10-27 Thread Stephenson, John L
List Users, Does anyone know when/if Kafka security features are being planned? I haven't seen much on the net outside of the following proposal: https://cwiki.apache.org/confluence/display/KAFKA/Security. Thanks! john

[jira] [Updated] (KAFKA-1732) DumpLogSegments tool fails when path has a '.'

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1732: - Assignee: Ewen Cheslack-Postava Status: Patch Available (was: Open) > DumpL

[jira] [Updated] (KAFKA-1732) DumpLogSegments tool fails when path has a '.'

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-1732: - Attachment: KAFKA-1732.patch > DumpLogSegments tool fails when path has a '.' > --

Review Request 27238: Patch for KAFKA-1732

2014-10-27 Thread Ewen Cheslack-Postava
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27238/ --- Review request for kafka. Bugs: KAFKA-1732 https://issues.apache.org/jira/b

[jira] [Commented] (KAFKA-1732) DumpLogSegments tool fails when path has a '.'

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1732?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185586#comment-14185586 ] Ewen Cheslack-Postava commented on KAFKA-1732: -- Created reviewboard https://r

[jira] [Commented] (KAFKA-1733) Producer.send will block indeterminately when broker is unavailable.

2014-10-27 Thread Marc Chung (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185539#comment-14185539 ] Marc Chung commented on KAFKA-1733: --- I have a patch (work in progress) here: https://gi

[jira] [Created] (KAFKA-1733) Producer.send will block indeterminately when broker is unavailable.

2014-10-27 Thread Marc Chung (JIRA)
Marc Chung created KAFKA-1733: - Summary: Producer.send will block indeterminately when broker is unavailable. Key: KAFKA-1733 URL: https://issues.apache.org/jira/browse/KAFKA-1733 Project: Kafka

[jira] [Created] (KAFKA-1732) DumpLogSegments tool fails when path has a '.'

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
Ewen Cheslack-Postava created KAFKA-1732: Summary: DumpLogSegments tool fails when path has a '.' Key: KAFKA-1732 URL: https://issues.apache.org/jira/browse/KAFKA-1732 Project: Kafka

[jira] [Commented] (KAFKA-559) Garbage collect old consumer metadata entries

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185380#comment-14185380 ] Ewen Cheslack-Postava commented on KAFKA-559: - This is an updated version of th

[jira] [Commented] (KAFKA-559) Garbage collect old consumer metadata entries

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185377#comment-14185377 ] Ewen Cheslack-Postava commented on KAFKA-559: - Created reviewboard https://revi

Review Request 27232: Patch for KAFKA-559

2014-10-27 Thread Ewen Cheslack-Postava
--- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/27232/ --- Review request for kafka. Bugs: KAFKA-559 https://issues.apache.org/jira/br

[jira] [Updated] (KAFKA-559) Garbage collect old consumer metadata entries

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-559: Attachment: KAFKA-559.patch > Garbage collect old consumer metadata entries > ---

[jira] [Updated] (KAFKA-559) Garbage collect old consumer metadata entries

2014-10-27 Thread Ewen Cheslack-Postava (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ewen Cheslack-Postava updated KAFKA-559: Assignee: Ewen Cheslack-Postava (was: Tejas Patil) Status: Patch Available (wa

Re: Review Request 26885: Patch for KAFKA-1642

2014-10-27 Thread Ewen Cheslack-Postava
> On Oct. 27, 2014, 12:13 a.m., Guozhang Wang wrote: > > clients/src/main/java/org/apache/kafka/clients/NetworkClient.java, line 122 > > > > > > The comments "When connecting or connected, this handles slow/stalled >

[jira] [Commented] (KAFKA-260) Add audit trail to kafka

2014-10-27 Thread Stas Levin (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-260?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14185220#comment-14185220 ] Stas Levin commented on KAFKA-260: -- Hi guys, We've adopted the data model above in Alethe