[GitHub] kafka pull request #2019: KAFKA-4298: Ensure compressed message sets are con...

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/2019 KAFKA-4298: Ensure compressed message sets are converted when cleaning the log You can merge this pull request into a Git repository by running: $ git pull

[jira] [Commented] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570935#comment-15570935 ] ASF GitHub Bot commented on KAFKA-4298: --- GitHub user hachikuji opened a pull request:

[jira] [Updated] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

[ https://issues.apache.org/jira/browse/KAFKA-4298?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4298: --- Description: When cleaning the log, we attempt to write the cleaned messages using the

[jira] [Created] (KAFKA-4298) LogCleaner does not convert compressed message sets properly

Jason Gustafson created KAFKA-4298: -- Summary: LogCleaner does not convert compressed message sets properly Key: KAFKA-4298 URL: https://issues.apache.org/jira/browse/KAFKA-4298 Project: Kafka

[jira] [Issue Comment Deleted] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Comment: was deleted (was: KAFKA-4297.solution2.patch: I modified 'kafka\.Kafka' to 'kafkaServer-gc'

[jira] [Updated] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Attachment: (was: KAFKA-4297.solution1.patch) > Cannot Stop Kafka with Shell Script >

[jira] [Issue Comment Deleted] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Comment: was deleted (was: KAFKA-4297.solution1.patch: I added '-Dkafka.server' option in running

[jira] [Updated] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Attachment: (was: KAFKA-4297.solution2.patch) > Cannot Stop Kafka with Shell Script >

[GitHub] kafka pull request #1978: HOTFIX: Cannot Stop Kafka with Shell Script (Solut...

Github user Mabin-J closed the pull request at: https://github.com/apache/kafka/pull/1978 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[GitHub] kafka pull request #1976: HOTFIX: Cannot Stop Kafka with Shell Script (Solut...

Github user Mabin-J closed the pull request at: https://github.com/apache/kafka/pull/1976 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Commented] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570785#comment-15570785 ] ASF GitHub Bot commented on KAFKA-4297: --- GitHub user Mabin-J opened a pull request:

[GitHub] kafka pull request #2018: KAFKA-4297: fix possiblity that didn't stop with s...

GitHub user Mabin-J opened a pull request: https://github.com/apache/kafka/pull/2018 KAFKA-4297: fix possiblity that didn't stop with shell (solution 2) If Kafka's homepath is long, kafka cannot stop with 'kafka-server-stop.sh'. That command showed this message: ```

[jira] [Commented] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570782#comment-15570782 ] ASF GitHub Bot commented on KAFKA-4297: --- GitHub user Mabin-J opened a pull request:

[GitHub] kafka pull request #2017: KAFKA-4297: fix possiblity that didn't stop with s...

GitHub user Mabin-J opened a pull request: https://github.com/apache/kafka/pull/2017 KAFKA-4297: fix possiblity that didn't stop with shell (solution 1) If Kafka's homepath is long, kafka cannot stop with 'kafka-server-stop.sh'. That command showed this message: ```

[jira] [Updated] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Attachment: KAFKA-4297.solution2.patch KAFKA-4297.solution2.patch: I modified 'kafka\.Kafka' to

[jira] [Comment Edited] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570754#comment-15570754 ] Mabin Jeong edited comment on KAFKA-4297 at 10/13/16 4:03 AM: --

[jira] [Updated] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Attachment: KAFKA-4297.solution1.patch I added '-Dkafka.server' option in running command and

[jira] [Updated] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Status: Open (was: Patch Available) > Cannot Stop Kafka with Shell Script >

[jira] [Issue Comment Deleted] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Comment: was deleted (was: I added '-Dkafka.server' option in running command and modified stop

[jira] [Updated] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Status: Patch Available (was: Open) I added '-Dkafka.server' option in running command and modified

[jira] [Updated] (KAFKA-4297) Cannot Stop Kafka with Shell Script

[ https://issues.apache.org/jira/browse/KAFKA-4297?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mabin Jeong updated KAFKA-4297: --- Description: If Kafka's homepath is long, kafka cannot stop with 'kafka-server-stop.sh'. That

[jira] [Created] (KAFKA-4297) Cannot Stop Kafka with Shell Script

Mabin Jeong created KAFKA-4297: -- Summary: Cannot Stop Kafka with Shell Script Key: KAFKA-4297 URL: https://issues.apache.org/jira/browse/KAFKA-4297 Project: Kafka Issue Type: Bug Affects

Build failed in Jenkins: kafka-trunk-jdk8 #976

See Changes: [jjkoshy] KAFKA-4025; make sure file.encoding system property is set to UTF-8 when -- [...truncated 14097 lines...] org.apache.kafka.streams.StreamsConfigTest >

[jira] [Commented] (KAFKA-4296) LogCleaner CleanerStats swap logic seems incorrect

[ https://issues.apache.org/jira/browse/KAFKA-4296?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570372#comment-15570372 ] ASF GitHub Bot commented on KAFKA-4296: --- GitHub user hachikuji opened a pull request:

[GitHub] kafka pull request #2016: KAFKA-4296: Fix LogCleaner statistics rolling

GitHub user hachikuji opened a pull request: https://github.com/apache/kafka/pull/2016 KAFKA-4296: Fix LogCleaner statistics rolling You can merge this pull request into a Git repository by running: $ git pull https://github.com/hachikuji/kafka KAFKA-4296 Alternatively you

Re: Reg: Kafka Security features

1. Kafka security features (Kerberos , ACL's) are beta quality code or can they be used in production? Because Kafka documentation shows they are of beta code quality. We need to update the document. But Authorizer feature released as part of 0.9.0. We have lot of deployments using this

Reg: Kafka Security features

Hi All, Could you please provide below information. 1. Kafka security features (Kerberos , ACL's) are beta quality code or can they be used in production? Because Kafka documentation shows they are of beta code quality. >From Apache Kafka Documentation "In release 0.9.0.0, the Kafka community

[jira] [Resolved] (KAFKA-4025) build fails on windows due to rat target output encoding

[ https://issues.apache.org/jira/browse/KAFKA-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy resolved KAFKA-4025. --- Resolution: Fixed Assignee: radai rosenblatt Reviewer: Joel Koshy Fix

[jira] [Commented] (KAFKA-4025) build fails on windows due to rat target output encoding

[ https://issues.apache.org/jira/browse/KAFKA-4025?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570214#comment-15570214 ] ASF GitHub Bot commented on KAFKA-4025: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #1710: KAFKA-4025 - make sure file.encoding system proper...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1710 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Build failed in Jenkins: kafka-trunk-jdk8 #975

See Changes: [wangguoz] HOTFIX: Increase number of retries in smoke test -- [...truncated 7401 lines...] kafka.log.BrokerCompressionTest > testBrokerSideCompression[10] STARTED

[jira] [Updated] (KAFKA-4293) ByteBufferMessageSet.deepIterator burns CPU catching EOFExceptions

[ https://issues.apache.org/jira/browse/KAFKA-4293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Koshy updated KAFKA-4293: -- Assignee: radai rosenblatt It turns out we should be able to handle all of our current codecs by

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570135#comment-15570135 ] Jason Gustafson commented on KAFKA-2066: I am available to pick this up since I'm beginning work

Build failed in Jenkins: kafka-0.10.1-jdk7 #69

See Changes: [wangguoz] HOTFIX: Increase number of retries in smoke test -- [...truncated 7325 lines...] kafka.api.SslProducerSendTest > testSendOffset STARTED kafka.api.SslProducerSendTest >

[jira] [Created] (KAFKA-4296) LogCleaner CleanerStats swap logic seems incorrect

Jason Gustafson created KAFKA-4296: -- Summary: LogCleaner CleanerStats swap logic seems incorrect Key: KAFKA-4296 URL: https://issues.apache.org/jira/browse/KAFKA-4296 Project: Kafka Issue

[jira] [Commented] (KAFKA-2066) Replace FetchRequest / FetchResponse with their org.apache.kafka.common.requests equivalents

[ https://issues.apache.org/jira/browse/KAFKA-2066?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570087#comment-15570087 ] Ismael Juma commented on KAFKA-2066: [~dajac], it would be good to make progress on this. Do you think

[jira] [Commented] (KAFKA-4185) Abstract out password verifier in SaslServer as an injectable dependency

[ https://issues.apache.org/jira/browse/KAFKA-4185?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15570070#comment-15570070 ] Piyush Vijay commented on KAFKA-4185: - comments [~ecomar], [~ijuma]? > Abstract out password verifier

[GitHub] kafka pull request #2015: Small refactoring to improve readability and reduc...

GitHub user picadoh opened a pull request: https://github.com/apache/kafka/pull/2015 Small refactoring to improve readability and reduce method complexity Small method extraction to reduce complexity and improve readability of the assign method. Private methods were

Jenkins build is back to normal : kafka-trunk-jdk7 #1626

See

[jira] [Commented] (KAFKA-3559) Task creation time taking too long in rebalance callback

[ https://issues.apache.org/jira/browse/KAFKA-3559?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569915#comment-15569915 ] Guozhang Wang commented on KAFKA-3559: -- [~enothereska] If you feel this suggestion deserve another

[jira] [Commented] (KAFKA-2292) failed fetch request logging doesn't indicate source of request

[ https://issues.apache.org/jira/browse/KAFKA-2292?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15569819#comment-15569819 ] sunilkalva commented on KAFKA-2292: --- [~malaskat] Any updates ? > failed fetch request logging doesn't

[jira] [Updated] (KAFKA-4271) The console consumer fails on Windows with new consumer is used

[ https://issues.apache.org/jira/browse/KAFKA-4271?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Vahid Hashemian updated KAFKA-4271: --- Description: When I try to consume message using the new consumer (Quickstart Step 5) I get

[GitHub] kafka pull request #2014: HOTFIX: Increase number of retries in smoke test

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2014 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [kafka-clients] [VOTE] 0.10.1.0 RC2

+1; all kafka-python integration tests pass. -Dana On Wed, Oct 12, 2016 at 10:41 AM, Jason Gustafson wrote: > Hello Kafka users, developers and client-developers, > > One more RC for 0.10.1.0. I think we're getting close! > > Release plan: >

Re: Store flushing on commit.interval.ms from KIP-63 introduces aggregation latency

Ah thanks so much for the insights -- we should be in a position to profile the new library against real data in the next week or so so I'll let you know how it goes. On Oct 11, 2016 6:26 PM, "Guozhang Wang" wrote: > Hello Greg, > > I can share some context of KIP-63 here: >

Re: [DISCUSS] KIP-80: Kafka REST Server

What is the criteria for keeping things in and out of Kafka, what code goes in or out and what is part of the architecture or not? The discussion of what goes into a project and what stays out is an always evolving question. Different projects treat this in different ways. Let me paint 2

[VOTE] 0.10.1.0 RC2

Hello Kafka users, developers and client-developers, One more RC for 0.10.1.0. I think we're getting close! Release plan: https://cwiki.apache.org/confluence/display/KAFKA/Rele ase+Plan+0.10.1. Release notes for the 0.10.1.0 release:

delete topic causing spikes in fetch/metadata requests

We are using kafka 0.8.2.2 (client and server), when ever we delete a topic we see lot of errors in broker logs like below, and there is also a spike in fetch/metadata requests. Can i correlate these errors with topic delete or its a known issue. Since there is spike in metadata requests and fetch

Re: [VOTE] 0.10.1.0 RC1

FYI: I'm cutting another RC this morning due to https://issues.apache.org/jira/browse/KAFKA-4290. Hopefully this is the last! -Jason On Mon, Oct 10, 2016 at 8:20 PM, Jason Gustafson wrote: > The documentation is mostly fixed now: http://kafka.apache.org/0 >

Re: [DISCUSS] KIP-80: Kafka REST Server

I think the questions around governance make sense, I think we should really clarify that to make the process more clear so it can be fully inclusive. The idea that we should not collaborate on what is there now, though, because in the future we might disagree about direction does not really make

Build failed in Jenkins: kafka-trunk-jdk7 #1625

See Changes: [ismael] KAFKA-4289; moved short-lived loggers to companion objects -- [...truncated 14079 lines...] org.apache.kafka.streams.kstream.internals.KStreamImplTest >

Jenkins build is back to normal : kafka-trunk-jdk8 #974

See

[jira] [Commented] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568706#comment-15568706 ] Mazhar Shaikh commented on KAFKA-4128: -- Hi Gwen Shapira, My concern for this bug is as below : 1.

[jira] [Updated] (KAFKA-4289) CPU wasted on reflection calls initializing short-lived loggers

[ https://issues.apache.org/jira/browse/KAFKA-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4289: --- Assignee: radai rosenblatt > CPU wasted on reflection calls initializing short-lived loggers >

[jira] [Updated] (KAFKA-4289) CPU wasted on reflection calls initializing short-lived loggers

[ https://issues.apache.org/jira/browse/KAFKA-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-4289: --- Fix Version/s: 0.10.2.0 > CPU wasted on reflection calls initializing short-lived loggers >

[jira] [Resolved] (KAFKA-4289) CPU wasted on reflection calls initializing short-lived loggers

[ https://issues.apache.org/jira/browse/KAFKA-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4289. Resolution: Fixed > CPU wasted on reflection calls initializing short-lived loggers >

[jira] [Commented] (KAFKA-4289) CPU wasted on reflection calls initializing short-lived loggers

[ https://issues.apache.org/jira/browse/KAFKA-4289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568547#comment-15568547 ] ASF GitHub Bot commented on KAFKA-4289: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2006: KAFKA-4289 - moved short-lived loggers to companio...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2006 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

[jira] [Updated] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

[ https://issues.apache.org/jira/browse/KAFKA-4295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sswater Shi updated KAFKA-4295: --- Description: I'm not sure it is a bug or you guys designed it. Since 0.9.x.x, the

[jira] [Created] (KAFKA-4295) kafka-console-consumer.sh does not delete the temporary group in zookeeper

Sswater Shi created KAFKA-4295: -- Summary: kafka-console-consumer.sh does not delete the temporary group in zookeeper Key: KAFKA-4295 URL: https://issues.apache.org/jira/browse/KAFKA-4295 Project: Kafka

[jira] [Created] (KAFKA-4294) Allow password file in server.properties to separate 'secrets' from standard configs

Ryan P created KAFKA-4294: - Summary: Allow password file in server.properties to separate 'secrets' from standard configs Key: KAFKA-4294 URL: https://issues.apache.org/jira/browse/KAFKA-4294 Project: Kafka

[jira] [Commented] (KAFKA-4258) Page not found http://kafka.apache.org/streams.html

[ https://issues.apache.org/jira/browse/KAFKA-4258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15568084#comment-15568084 ] Mickael Maison commented on KAFKA-4258: --- With the new website, the URL is now:

[GitHub] kafka pull request #2014: HOTFIX: Increase number of retries in smoke test

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/2014 HOTFIX: Increase number of retries in smoke test You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka hotfix-smoke-test

Re: [DISCUSS] KIP-82 - Add Record Headers

@Jay and Dana We have internally had a few discussions of how we may address this if we had a common apache kafka message wrapper for headers that can be used client side only to, and address the compaction issue. I have detailed this solution separately and linked from the main KIP-82 wiki.

Build failed in Jenkins: kafka-trunk-jdk8 #973

See Changes: [jason] MINOR: Fixed broken links in the documentation -- [...truncated 14151 lines...] org.apache.kafka.streams.processor.internals.assignment.TaskAssignorTest > testStickiness

Jenkins build is back to normal : kafka-0.10.1-jdk7 #68

See

Jenkins build is back to normal : kafka-trunk-jdk7 #1624

See