[jira] [Commented] (KAFKA-4352) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

[ https://issues.apache.org/jira/browse/KAFKA-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614279#comment-15614279 ] Vahid Hashemian commented on KAFKA-4352: Thanks [~mjsax]. FYI, [the fix for

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

*compatability From: Michael Pearce Sent: Friday, October 28, 2016 5:17:07 AM To: dev@kafka.apache.org Subject: Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag Hi Jay, I think use case that is the issue that Konstantin

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

Hi Jay, I think use case that is the issue that Konstantin mentioned in the kip-82 thread , and also we have at IG is clear use case. Many companies are using message wrappers, these are useful because as per kip-82 see their use cases (I don't think I need to re iterate the large list here)

Build failed in Jenkins: kafka-trunk-jdk8 #1008

See Changes: [jason] KAFKA-4349; Handle 'PreparingRebalance' and 'AwaitingSync' states in -- [...truncated 6328 lines...] kafka.api.FetchRequestTest > testShuffle PASSED

[jira] [Assigned] (KAFKA-4351) Topic regex behavioral change with MirrorMaker new consumer

[ https://issues.apache.org/jira/browse/KAFKA-4351?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] huxi reassigned KAFKA-4351: --- Assignee: huxi > Topic regex behavioral change with MirrorMaker new consumer >

[jira] [Commented] (KAFKA-4351) Topic regex behavioral change with MirrorMaker new consumer

[ https://issues.apache.org/jira/browse/KAFKA-4351?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15614094#comment-15614094 ] huxi commented on KAFKA-4351: - MirrorMakerOldConsumer employs TopicFilter which replaces all commas with '|'

Re: [VOTE] KIP-85: Dynamic JAAS configuration for Kafka clients

Thanks for the KIP! +1 On Wed, Oct 26, 2016 at 3:23 PM, Gwen Shapira wrote: > Woohoo! +1 (binding) > > On Wed, Oct 26, 2016 at 5:26 PM, Rajini Sivaram < > rajinisiva...@googlemail.com> wrote: > > > I would like to initiate the voting process for KIP-85: Dynamic JAAS > >

[jira] [Commented] (KAFKA-4348) On Mac OS, KafkaConsumer.poll returns 0 when there are still messages on Kafka server

[ https://issues.apache.org/jira/browse/KAFKA-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613993#comment-15613993 ] huxi commented on KAFKA-4348: - what's the value for acks? And did you start reading right after producing the

[jira] [Updated] (KAFKA-4349) Consumer group describe exception when group state is PreparingRebalance

[ https://issues.apache.org/jira/browse/KAFKA-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson updated KAFKA-4349: --- Resolution: Fixed Fix Version/s: 0.10.2.0 Status: Resolved (was: Patch

[jira] [Commented] (KAFKA-4349) Consumer group describe exception when group state is PreparingRebalance

[ https://issues.apache.org/jira/browse/KAFKA-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613982#comment-15613982 ] ASF GitHub Bot commented on KAFKA-4349: --- Github user asfgit closed the pull request at:

[GitHub] kafka pull request #2070: KAFKA-4349: Handle 'PreparingRebalance' and 'Await...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2070 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [VOTE] Add REST Server to Apache Kafka

-1 I think a good set of HTTP APIs can simplify client implementations and allow for easier integration with Kafka as well as simpler ops/admin tools. Elasticsearch is a great example. However, I think it's too early to put this into the core. The existing Kafka REST proxies (that I know of)

[jira] [Commented] (KAFKA-4350) Can't mirror from Kafka 0.9 to Kafka 0.10.1

[ https://issues.apache.org/jira/browse/KAFKA-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613815#comment-15613815 ] Jason Gustafson commented on KAFKA-4350: [~ecesena] Unfortunately, this is a limitation of the

[jira] [Commented] (KAFKA-3554) Generate actual data with specific compression ratio and add multi-thread support in the ProducerPerformance tool.

[ https://issues.apache.org/jira/browse/KAFKA-3554?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15613675#comment-15613675 ] David commented on KAFKA-3554: -- Hey guys, Is there any ConsumerPerformance code in Java instead of Scala? I

Re: [DISCUSS] KIP-81: Max in-flight fetches

This is a good observation on limiting total memory usage. If I understand the proposal I think it is that the consumer client would stop sending fetch requests once a certain number of in-flight fetch requests is met. I think a better approach would be to always issue one fetch request to each

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

I kind of agree with James that it is a bit questionable how valuable any data in a delete marker can be since it will be deleted somewhat nondeterministically. Let's definitely ensure the change is worth the resulting pain and additional complexity in the data model. I think the two things we

[jira] [Created] (KAFKA-4353) Add semantic types to Kafka Connect

Randall Hauch created KAFKA-4353: Summary: Add semantic types to Kafka Connect Key: KAFKA-4353 URL: https://issues.apache.org/jira/browse/KAFKA-4353 Project: Kafka Issue Type: Improvement

Re: [DISCUSS] KIP-86: Configurable SASL callback handlers

Hi, Rajini, Thanks for the explanation. So AccessController.getContext() returns the context specific to the calling thread. Then, this should work. Jun On Thu, Oct 27, 2016 at 2:32 AM, Rajini Sivaram < rajinisiva...@googlemail.com> wrote: > Hi Jun, > > We will be using the

Jenkins build is back to normal : kafka-trunk-jdk7 #1658

See

[jira] [Commented] (KAFKA-4352) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

[ https://issues.apache.org/jira/browse/KAFKA-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612806#comment-15612806 ] Matthias J. Sax commented on KAFKA-4352: Thanks for the pointer [~vahid]. We will observe this,

[jira] [Commented] (KAFKA-4352) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

[ https://issues.apache.org/jira/browse/KAFKA-4352?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612784#comment-15612784 ] Vahid Hashemian commented on KAFKA-4352: This JIRA could be a duplicate of

[jira] [Created] (KAFKA-4352) Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset

Guozhang Wang created KAFKA-4352: Summary: Failure in org.apache.kafka.streams.integration.ResetIntegrationTest.testReprocessingFromScratchAfterReset Key: KAFKA-4352 URL:

[jira] [Updated] (KAFKA-4350) Can't mirror from Kafka 0.9 to Kafka 0.10.1

[ https://issues.apache.org/jira/browse/KAFKA-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Emanuele Cesena updated KAFKA-4350: --- Description: I'm running 2 clusters: K9 with Kafka 0.9 and K10 with Kafka 0.10.1. In K10,

[jira] [Commented] (KAFKA-4350) Can't mirror from Kafka 0.9 to Kafka 0.10.1

[ https://issues.apache.org/jira/browse/KAFKA-4350?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612592#comment-15612592 ] Emanuele Cesena commented on KAFKA-4350: I did a bit more investigation. I can reproduce similar

[jira] [Resolved] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang resolved KAFKA-4316. -- Resolution: Won't Fix > Kafka Streams 0.10.0.1 does not run on Windows x64 >

[jira] [Updated] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guozhang Wang updated KAFKA-4316: - Fix Version/s: 0.10.1.0 > Kafka Streams 0.10.0.1 does not run on Windows x64 >

[jira] [Commented] (KAFKA-4316) Kafka Streams 0.10.0.1 does not run on Windows x64

[ https://issues.apache.org/jira/browse/KAFKA-4316?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15612460#comment-15612460 ] Guozhang Wang commented on KAFKA-4316: -- I'm closing this ticket as "won't fix" for 0.10.0.1 for now.

[GitHub] kafka pull request #2066: MINOR: Increase zk connection timeout in tests for...

Github user asfgit closed the pull request at: https://github.com/apache/kafka/pull/2066 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the feature is

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

Thanks, James, I think this is a really good addition to the KIP details, please feel free to amend the wiki/add the use cases, also if any others you think of. I definitely think its worthwhile documenting. If you can’t let me know ill add them next week (just leaving for a long weekend off)

[jira] [Created] (KAFKA-4351) Topic regex behavioral change with MirrorMaker new consumer

Dustin Cote created KAFKA-4351: -- Summary: Topic regex behavioral change with MirrorMaker new consumer Key: KAFKA-4351 URL: https://issues.apache.org/jira/browse/KAFKA-4351 Project: Kafka Issue

Re: [DISCUSS] KIP-84: Support SASL/SCRAM mechanisms

Jun, 4) Agree, it does make the implementation simpler. Updated KIP. 5) Thank you, that looks neater. Updated KIP. On Wed, Oct 26, 2016 at 6:59 PM, Jun Rao wrote: > Hi, Rajini, > > Thanks for the reply. > > 4. Implementation wise, it seems to me that it's simpler to read

Re: [DISCUSS] KIP-86: Configurable SASL callback handlers

Hi Jun, We will be using the AccessControlContext corresponding to the current calling context (i.e. on the current thread). So concurrent Subject.doAs() in other threads will not have any impact. On the current thread, we are using the Subject corresponding to the latest Subject.doAs(). This is

Re: [DISCUSS] KIP-82 - Add Record Headers

> On Oct 25, 2016, at 10:23 PM, Michael Pearce wrote: > > Hi All, > > In case you hadn't noticed re the compaction issue for non-null values i have > created a separate KIP-87, if you could all contribute to its discussion > would be much appreciated. > >

[jira] [Commented] (KAFKA-4348) On Mac OS, KafkaConsumer.poll returns 0 when there are still messages on Kafka server

[ https://issues.apache.org/jira/browse/KAFKA-4348?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610972#comment-15610972 ] Yiquan Zhou commented on KAFKA-4348: Thank you for looking into this issue. I just ran the test again

[jira] [Resolved] (KAFKA-4329) The order of the parameters for creating the ZkUtils object is reversed

[ https://issues.apache.org/jira/browse/KAFKA-4329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Wang resolved KAFKA-4329. -- Resolution: Resolved Reviewer: Ismael Juma (was: Guozhang Wang) Using named parameters to avoid

Re: [DISCUSS] KIP-87 - Add Compaction Tombstone Flag

This KIP would definitely address a gap in the current functionality, where you currently can't have a tombstone with any associated content. That said, I'd like to talk about use cases, to make sure that this is in fact useful. The KIP should be updated with whatever use cases we come up with.

[jira] [Commented] (KAFKA-4128) Kafka broker losses messages when zookeeper session times out

[ https://issues.apache.org/jira/browse/KAFKA-4128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610937#comment-15610937 ] Mazhar Shaikh commented on KAFKA-4128: -- [2016-10-26 18:36:55,992] INFO KafkaConfig values:

[jira] [Commented] (KAFKA-4349) Consumer group describe exception when group state is PreparingRebalance

[ https://issues.apache.org/jira/browse/KAFKA-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610884#comment-15610884 ] ASF GitHub Bot commented on KAFKA-4349: --- GitHub user vahidhashemian reopened a pull request:

[jira] [Commented] (KAFKA-4349) Consumer group describe exception when group state is PreparingRebalance

[ https://issues.apache.org/jira/browse/KAFKA-4349?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=15610883#comment-15610883 ] ASF GitHub Bot commented on KAFKA-4349: --- Github user vahidhashemian closed the pull request at:

[GitHub] kafka pull request #2070: KAFKA-4349: Handle 'PreparingRebalance' and 'Await...

Github user vahidhashemian closed the pull request at: https://github.com/apache/kafka/pull/2070 --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and wishes so, or if the

[GitHub] kafka pull request #2070: KAFKA-4349: Handle 'PreparingRebalance' and 'Await...

GitHub user vahidhashemian reopened a pull request: https://github.com/apache/kafka/pull/2070 KAFKA-4349: Handle 'PreparingRebalance' and 'AwaitingSync' states in consumer group describe The edge case where consumer group state is `PreparingRebalance` or `AwaitingSync` will be