[GitHub] kafka pull request #1699: MINOR: rename StateStoreProvider.getStores() -> St...

GitHub user dguy opened a pull request: https://github.com/apache/kafka/pull/1699 MINOR: rename StateStoreProvider.getStores() -> StateStoreProvider.stores() Rename StateStoreProvider.getStores(...) to StateStoreProvider.stores(...) as this is consistent with the naming of other 'ge

[jira] [Commented] (KAFKA-3817) KTableRepartitionMap should handle null inputs

[ https://issues.apache.org/jira/browse/KAFKA-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405568#comment-15405568 ] Jan Filipiak commented on KAFKA-3817: - [~guozhang] So the ability to handle null val

[jira] [Created] (KAFKA-4015) Add new cleanup.policy, compact_and_delete

Damian Guy created KAFKA-4015: - Summary: Add new cleanup.policy, compact_and_delete Key: KAFKA-4015 URL: https://issues.apache.org/jira/browse/KAFKA-4015 Project: Kafka Issue Type: New Feature

[GitHub] kafka pull request #1384: KAFKA-3667:Improve Section 7.2 Encryption and Auth...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1384 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3667) Improve Section 7.2 Encryption and Authentication using SSL to include proper hostname verification configuration

[ https://issues.apache.org/jira/browse/KAFKA-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405638#comment-15405638 ] ASF GitHub Bot commented on KAFKA-3667: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-3667) Improve Section 7.2 Encryption and Authentication using SSL to include proper hostname verification configuration

[ https://issues.apache.org/jira/browse/KAFKA-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-3667. Resolution: Fixed Reviewer: Ismael Juma Fix Version/s: 0.10.0.1 > Improve Section 7.

[jira] [Updated] (KAFKA-3667) Improve Section 7.2 Encryption and Authentication using SSL to include proper hostname verification configuration

[ https://issues.apache.org/jira/browse/KAFKA-3667?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3667: --- Assignee: Ryan P > Improve Section 7.2 Encryption and Authentication using SSL to include proper > ho

[GitHub] kafka pull request #1618: KAFKA-3945: Change the type of 'acks' config in co...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1618 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405654#comment-15405654 ] ASF GitHub Bot commented on KAFKA-3945: --- Github user asfgit closed the pull request

[jira] [Updated] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3945: --- Resolution: Fixed Reviewer: Ismael Juma Status: Resolved (was: Patch Available) > kafka

[jira] [Updated] (KAFKA-3945) kafka-console-producer.sh does not accept request-required-acks=all

[ https://issues.apache.org/jira/browse/KAFKA-3945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma updated KAFKA-3945: --- Fix Version/s: 0.10.1.0 > kafka-console-producer.sh does not accept request-required-acks=all > --

[jira] [Commented] (KAFKA-3665) Default ssl.endpoint.identification.algorithm should be https

[ https://issues.apache.org/jira/browse/KAFKA-3665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405659#comment-15405659 ] Ryan P commented on KAFKA-3665: --- RFC-6066 describes an extension to the TLS protocol to hand

[jira] [Commented] (KAFKA-1194) The kafka broker cannot delete the old log files after the configured time

[ https://issues.apache.org/jira/browse/KAFKA-1194?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405810#comment-15405810 ] Harald Kirsch commented on KAFKA-1194: -- Just stumbled over yet another problem instan

Build failed in Jenkins: kafka-0.10.0-jdk7 #180

See Changes: [ismael] KAFKA-3667; Improve Section 7.2 Encryption and Authentication using SSL -- [...truncated 5715 lines...] org.apache.kafka.streams.kstream.TimeWindowsTest > windowSizeMustNot

[jira] [Created] (KAFKA-4016) Kafka Streams join benchmark

Eno Thereska created KAFKA-4016: --- Summary: Kafka Streams join benchmark Key: KAFKA-4016 URL: https://issues.apache.org/jira/browse/KAFKA-4016 Project: Kafka Issue Type: Improvement Co

[GitHub] kafka pull request #1700: KAFKA-4016: Added join benchmarks

GitHub user enothereska opened a pull request: https://github.com/apache/kafka/pull/1700 KAFKA-4016: Added join benchmarks You can merge this pull request into a Git repository by running: $ git pull https://github.com/enothereska/kafka join-benchmarks Alternatively you can r

[jira] [Commented] (KAFKA-4016) Kafka Streams join benchmark

[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405894#comment-15405894 ] ASF GitHub Bot commented on KAFKA-4016: --- GitHub user enothereska opened a pull reque

[jira] [Work started] (KAFKA-4016) Kafka Streams join benchmark

[ https://issues.apache.org/jira/browse/KAFKA-4016?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on KAFKA-4016 started by Eno Thereska. --- > Kafka Streams join benchmark > > > K

[GitHub] kafka pull request #1701: MINOR: increase usability of shell-scripts

GitHub user igalic opened a pull request: https://github.com/apache/kafka/pull/1701 MINOR: increase usability of shell-scripts we do this by ensuring that the --zookeeper parameter consistently defaults to localhost:2181 — as it already does in some places. You can merge this

[jira] [Commented] (KAFKA-3817) KTableRepartitionMap should handle null inputs

[ https://issues.apache.org/jira/browse/KAFKA-3817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405982#comment-15405982 ] Guozhang Wang commented on KAFKA-3817: -- Good point, mind filing a minor PR? > KTable

[jira] [Commented] (KAFKA-3916) Connection from controller to broker disconnects

[ https://issues.apache.org/jira/browse/KAFKA-3916?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406027#comment-15406027 ] Michal Turek commented on KAFKA-3916: - We saw this issue yesterday, I don't know if th

Re: [kafka-clients] [VOTE] 0.10.0.1 RC1

Hi, There are two versions of slf4j-log4j jar in the build. (1.6.1, 1.7.21). slf4j-log4j12-1.6.1.jar is coming from streams:examples module. Thanks, Manikumar On Tue, Aug 2, 2016 at 8:31 PM, Ismael Juma wrote: > Hello Kafka users, developers and client-developers, > > This is the second candid

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406063#comment-15406063 ] Flavio Junqueira commented on KAFKA-1211: - Thanks for the clarification, [~junrao]

[jira] [Commented] (KAFKA-3042) updateIsr should stop after failed several times due to zkVersion issue

[ https://issues.apache.org/jira/browse/KAFKA-3042?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406121#comment-15406121 ] Guozhang Wang commented on KAFKA-3042: -- I agree that we should consider improving the

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses as ...

Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/1698 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature

[GitHub] kafka pull request #1698: KAFKA-3999: Record raw size of fetch responses as ...

GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/1698 KAFKA-3999: Record raw size of fetch responses as part of consumer metrics Currently, only the decompressed size of fetch responses is recorded. This PR adds a sensor to keep track of the r

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406235#comment-15406235 ] ASF GitHub Bot commented on KAFKA-3999: --- GitHub user vahidhashemian reopened a pull

[jira] [Commented] (KAFKA-3999) Consumer bytes-fetched metric uses decompressed message size

[ https://issues.apache.org/jira/browse/KAFKA-3999?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406234#comment-15406234 ] ASF GitHub Bot commented on KAFKA-3999: --- Github user vahidhashemian closed the pull

Reg: SSL setup

Hi, Can you please provide information on Self signed certificate setup in Kafka. As in Kafka documentation only CA signed setup is provided. http://kafka.apache.org/documentation.html#security_ssl As because, we need to provide parameters trustore, keystore during configuration. Or to work wit

[jira] [Created] (KAFKA-4017) Return more helpful responses when misconfigured connectors are submitted

Dustin Cote created KAFKA-4017: -- Summary: Return more helpful responses when misconfigured connectors are submitted Key: KAFKA-4017 URL: https://issues.apache.org/jira/browse/KAFKA-4017 Project: Kafka

Re: Kafka Streams for Remote Server

Hi Misha, If it works locally, then I would still suspect that it is due to a transient timing issue: note that the create-topic script is non-blocking, i.e. even when it returns it does not necessarily guarantee that the leader metadata information has been completed propagating to brokers. Gu

[jira] [Resolved] (KAFKA-1143) Consumer should cache topic partition info

[ https://issues.apache.org/jira/browse/KAFKA-1143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-1143. -- Resolution: Duplicate Fix Version/s: (was: 0.10.1.0) This ticket was proposed for ZK-

[GitHub] kafka pull request #1692: MINOR: Fixed documentation for KStream left join K...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1692 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406623#comment-15406623 ] Guozhang Wang commented on KAFKA-2063: -- Re 1) Currently we use pause / resume per par

[GitHub] kafka pull request #1702: Kafka 3940: Log should check the return value of d...

GitHub user imandhan opened a pull request: https://github.com/apache/kafka/pull/1702 Kafka 3940: Log should check the return value of dir.mkdirs() Changed occurrences of dir.mkdirs() to Files.createDirectory and similarly for File.delete to Files.delete You can merge this pull req

Preserve offset in Mirror Maker

We're using mirror maker to mirror data from one data center to another data center ( 1 to 1 ). We noticed that by default the mirror maker by default start from latest offset. How to change mirror maker producer config to start from last check pointed offset in case of crash without losing dat

[jira] [Assigned] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jun Rao reassigned KAFKA-3875: -- Assignee: Jun Rao > Transient test failure: > kafka.api.SslProducerSendTest.testSendNonCompressedMessa

Re: Preserve offset in Mirror Maker

MirrorMaker actually doesn't have a default - it uses what you configured in the consumer.properties file you use. Either: auto.offset.reset = latest (biggest in old versions) or auto.offset.reset = earliest (smallest in old versions) So you can choose whether when MirrorMaker first comes up, if

[jira] [Commented] (KAFKA-2063) Bound fetch response size

[ https://issues.apache.org/jira/browse/KAFKA-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406730#comment-15406730 ] Guozhang Wang commented on KAFKA-2063: -- Another note from Streams is that in situatio

[GitHub] kafka pull request #1699: MINOR: rename StateStoreProvider.getStores() -> St...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1699 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

Build failed in Jenkins: kafka-trunk-jdk8 #797

See Changes: [wangguoz] MINOR: Fixed documentation for KStream left join KStream-KTable -- [...truncated 1648 lines...] kafka.api.PlaintextConsumerTest > testPauseStateNotPreservedByRebalance ST

[jira] [Commented] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406737#comment-15406737 ] Jun Rao commented on KAFKA-3875: I took a look at this and found a few things. 1. The Ill

[GitHub] kafka pull request #1703: KAFKA-3875: Transient test failure: kafka.api.SslP...

GitHub user junrao opened a pull request: https://github.com/apache/kafka/pull/1703 KAFKA-3875: Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime 1. The IllegalStateException is actually thrown from testCloseWithZeroTimeoutFromSenderTh

[jira] [Commented] (KAFKA-3875) Transient test failure: kafka.api.SslProducerSendTest.testSendNonCompressedMessageWithCreateTime

[ https://issues.apache.org/jira/browse/KAFKA-3875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406740#comment-15406740 ] ASF GitHub Bot commented on KAFKA-3875: --- GitHub user junrao opened a pull request:

Jenkins build is back to normal : kafka-trunk-jdk7 #1459

See

Jenkins build is back to normal : kafka-0.10.0-jdk7 #181

See

[jira] [Created] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

Ismael Juma created KAFKA-4018: -- Summary: Streams causing older slf4j-log4j library to be packaged along with newer version Key: KAFKA-4018 URL: https://issues.apache.org/jira/browse/KAFKA-4018 Project:

[GitHub] kafka pull request #1704: KAFKA-4018: Streams causing older slf4j-log4j libr...

GitHub user ijuma opened a pull request: https://github.com/apache/kafka/pull/1704 KAFKA-4018: Streams causing older slf4j-log4j library to be packaged along with newer version This is a regression caused by 0bb1d3ae. After that commit, Streams no longer has a direct depend

[jira] [Commented] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406855#comment-15406855 ] ASF GitHub Bot commented on KAFKA-4018: --- GitHub user ijuma opened a pull request:

Re: [kafka-clients] [VOTE] 0.10.0.1 RC1

Thanks Manikumar. I filed KAFKA-4018 with the details of when we regressed as well as a fix. Ismael On Wed, Aug 3, 2016 at 4:18 PM, Manikumar Reddy wrote: > Hi, > > There are two versions of slf4j-log4j jar in the build. (1.6.1, 1.7.21). > slf4j-log4j12-1.6.1.jar is coming from streams:examples

[jira] [Commented] (KAFKA-3752) Provide a way for KStreams to recover from unclean shutdown

[ https://issues.apache.org/jira/browse/KAFKA-3752?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406893#comment-15406893 ] Guozhang Wang commented on KAFKA-3752: -- [~theduderog] Do you still have the logs on t

[jira] [Commented] (KAFKA-1211) Hold the produce request with ack > 1 in purgatory until replicas' HW has larger than the produce offset

[ https://issues.apache.org/jira/browse/KAFKA-1211?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406915#comment-15406915 ] Jun Rao commented on KAFKA-1211: [~fpj], very good questions. 1. Yes, the idea is for the

[GitHub] kafka pull request #1704: KAFKA-4018: Streams causing older slf4j-log4j libr...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/1704 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is enab

[jira] [Commented] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406936#comment-15406936 ] ASF GitHub Bot commented on KAFKA-4018: --- Github user asfgit closed the pull request

[jira] [Resolved] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-4018. Resolution: Fixed Issue resolved by pull request 1704 [https://github.com/apache/kafka/pull/1704] >

[jira] [Assigned] (KAFKA-4018) Streams causing older slf4j-log4j library to be packaged along with newer version

[ https://issues.apache.org/jira/browse/KAFKA-4018?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma reassigned KAFKA-4018: -- Assignee: Ismael Juma > Streams causing older slf4j-log4j library to be packaged along with new

[jira] [Commented] (KAFKA-3894) Log Cleaner thread crashes and never restarts

[ https://issues.apache.org/jira/browse/KAFKA-3894?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15406970#comment-15406970 ] Jun Rao commented on KAFKA-3894: [~tcrayford-heroku], I chatted with [~jkreps] on this a b

[jira] [Commented] (KAFKA-3989) Add JMH module for Benchmarks

[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407054#comment-15407054 ] Bill Bejeck commented on KAFKA-3989: I opted to try the gradle shadow plugin first (h

[jira] [Comment Edited] (KAFKA-3989) Add JMH module for Benchmarks

[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407054#comment-15407054 ] Bill Bejeck edited comment on KAFKA-3989 at 8/4/16 3:03 AM: I

[jira] [Comment Edited] (KAFKA-3989) Add JMH module for Benchmarks

[ https://issues.apache.org/jira/browse/KAFKA-3989?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407054#comment-15407054 ] Bill Bejeck edited comment on KAFKA-3989 at 8/4/16 3:03 AM: I

Build failed in Jenkins: kafka-trunk-jdk8 #798

See Changes: [wangguoz] MINOR: rename StateStoreProvider.getStores() -> -- [...truncated 8287 lines...] org.apache.kafka.common.metrics.MetricsTest > testPercentiles STARTED org.apache.kafka.com

Jenkins build is back to normal : kafka-trunk-jdk8 #799

See

[jira] [Commented] (KAFKA-4017) Return more helpful responses when misconfigured connectors are submitted

[ https://issues.apache.org/jira/browse/KAFKA-4017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407224#comment-15407224 ] Ewen Cheslack-Postava commented on KAFKA-4017: -- [~cotedm] Have the config tha

[jira] [Comment Edited] (KAFKA-2471) Replicas Order and Leader out of sync

[ https://issues.apache.org/jira/browse/KAFKA-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407254#comment-15407254 ] yf edited comment on KAFKA-2471 at 8/4/16 6:14 AM: --- I meet the same prob

[jira] [Commented] (KAFKA-2471) Replicas Order and Leader out of sync

[ https://issues.apache.org/jira/browse/KAFKA-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407254#comment-15407254 ] yf commented on KAFKA-2471: --- I meet the same problem. But my data in zk is: {"version":1,"partit

[jira] [Comment Edited] (KAFKA-2471) Replicas Order and Leader out of sync

[ https://issues.apache.org/jira/browse/KAFKA-2471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15407254#comment-15407254 ] yf edited comment on KAFKA-2471 at 8/4/16 6:15 AM: --- I meet the same prob