Re: 0.9.0.1 - KafkaProducer keeps requesting for metadata of topic which is no longer present, leads to never ending UNKNOWN_TOPIC_OR_PARTITION logs

2016-05-15 Thread Rajini Sivaram
There is an open JIRA for this issue ( https://issues.apache.org/jira/browse/KAFKA-3065). The PR is quite old and needs rebasing. I will take a look at it today. On Sun, May 15, 2016 at 6:14 AM, Jaikiran Pai wrote: > Hello Kafka team, > > > We are using 0.9.0.1 (latest stable) of Kafka server an

Regarding kafka-rest plugin

2016-05-15 Thread basavaraj
Hi team Kafka, Please let me know is their any Kafka rest service plug-in available. If their please share the Details. I went through some github code but that are not working. Thanks & Regards, Basavaraj

Re: [VOTE] 0.10.0.0 RC4

2016-05-15 Thread Gwen Shapira
Thanks, man! Good to see Heroku being good friends to the Kafka community by testing new releases, reporting issues and following up with the cause and documentation pr. With this out of the way, we closed all known blockers for 0.10.0.0. I'll roll out a new RC tomorrow morning. Gwen On Sun, Ma

[GitHub] kafka pull request: Add a newline to a Javadoc sample in KafkaCons...

2016-05-15 Thread izeye
GitHub user izeye opened a pull request: https://github.com/apache/kafka/pull/1390 Add a newline to a Javadoc sample in KafkaConsumer This PR simply adds a newline to a Javadoc sample in `KafkaConsumer` to flush the outputs. You can merge this pull request into a Git repository by

[jira] [Commented] (KAFKA-1981) Make log compaction point configurable

2016-05-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-1981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15284004#comment-15284004 ] Jun Rao commented on KAFKA-1981: [~ewasserman], thanks for the KIP. This seems like a usef

Re: [VOTE] 0.10.0.0 RC4

2016-05-15 Thread Tom Crayford
https://github.com/apache/kafka/pull/1389 On Sun, May 15, 2016 at 9:22 PM, Ismael Juma wrote: > Hi Tom, > > Great to hear that the failure testing scenario went well. :) > > Your suggested improvement sounds good to me and a PR would be great. For > this kind of change, you can skip the JIRA, ju

[GitHub] kafka pull request: MINOR: document increased network bandwidth of...

2016-05-15 Thread tcrayford
GitHub user tcrayford opened a pull request: https://github.com/apache/kafka/pull/1389 MINOR: document increased network bandwidth of 0.10 under replication If you're pushing close to the network capacity, 0.10's additional 8 bytes per message can lead to overload of your network. W

Re: [VOTE] 0.10.0.0 RC4

2016-05-15 Thread Ismael Juma
Hi Tom, Great to hear that the failure testing scenario went well. :) Your suggested improvement sounds good to me and a PR would be great. For this kind of change, you can skip the JIRA, just prefix the PR title with `MINOR:`. Thanks, Ismael On Sun, May 15, 2016 at 9:17 PM, Tom Crayford wrote

Re: [VOTE] 0.10.0.0 RC4

2016-05-15 Thread Tom Crayford
How about this? Note: Due to the additional timestamp introduced in each message (8 bytes of data), producers sending small messages may see a message throughput degradation because of the increased overhead. Likewise, replication now transmits an additional 8 bytes per message. If you

Re: [VOTE] 0.10.0.0 RC4

2016-05-15 Thread Ismael Juma
Hi Tom, Thanks for the update and for all the testing you have done! No worries about the chase here, I'd much rather have false positives by people who are validating the releases than false negatives because people don't validate the releases. :) The upgrade note we currently have follows: htt

Re: [VOTE] 0.10.0.0 RC4

2016-05-15 Thread Tom Crayford
I've been digging into this some more. It seems like this may have been an issue with benchmarks maxing out the network card - under 0.10.0.0-RC the slightly additional bandwidth per message seems to have pushed the broker's NIC into overload territory where it starts dropping packets (verified wit

Jenkins build is back to normal : kafka-trunk-jdk8 #628

2016-05-15 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-3565) Producer's throughput lower with compressed data after KIP-31/32

2016-05-15 Thread Jun Rao (JIRA)
[ https://issues.apache.org/jira/browse/KAFKA-3565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao resolved KAFKA-3565. Resolution: Fixed Fix Version/s: 0.10.0.0 Issue resolved by pull request 1372 [https://github.com/apa

[GitHub] kafka pull request: KAFKA-3565: Add documentation to warn user abo...

2016-05-15 Thread asfgit
Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1372 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[GitHub] kafka pull request: MINOR: Inline `Record.write` into `Compressor....

2016-05-15 Thread ijuma
GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1388 MINOR: Inline `Record.write` into `Compressor.putRecord` This simplifies the call path making the code easier to understand. Previously, `Record.write(ByteBuffer...)` called `Compressor.putRecord` whi