Build failed in Jenkins: kafka-trunk-jdk8 #3768

See Changes: [github] MINOR: WorkerUtils#topicDescriptions must unwrap exceptions properly [cmccabe] MINOR: add useConfiguredPartitioner and skipFlush options for --

[jira] [Created] (KAFKA-8628) Auto-generated Kafka RPC code should be able to use zero-copy ByteBuffers

Colin P. McCabe created KAFKA-8628: -- Summary: Auto-generated Kafka RPC code should be able to use zero-copy ByteBuffers Key: KAFKA-8628 URL: https://issues.apache.org/jira/browse/KAFKA-8628 Project:

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

On Wed, Jul 3, 2019, at 11:22, Stanislav Kozlovski wrote: > Hey Colin, > > Thanks for the detailed reply! > > > Not really. Cruise Control, for example, tries to update the znode even > > when it's not empty. This doesn't work, of course. This is an existing > > problem with the old API--

Build failed in Jenkins: kafka-trunk-jdk11 #674

See Changes: [jason] MINOR: Typo correction in server.properties (#7011) [jason] MINOR: Improve group metadata unknown key version exception message [jason] MINOR: Fix static membership documentation link in

Re: [VOTE] KIP-476: Add Java AdminClient interface

Thanks for the details Colin and Andy. My indent was not to block the KIP, but it seems to be a fair question to ask. I talked to Ismael offline about it and understand his reasoning better now. If we don't deprecate `abstract AdminClient` class, it seems reasonable to not deprecate the

Build failed in Jenkins: kafka-trunk-jdk8 #3767

See Changes: [jason] MINOR: Typo correction in server.properties (#7011) [jason] MINOR: Improve group metadata unknown key version exception message [jason] MINOR: Fix static membership documentation link in

Re: [DISCUSS] KIP-484: Expose metrics for group and transaction metadata loading duration

It looks great! If there are no more concerns, lets start a vote. On Tue, Jul 2, 2019 at 2:59 PM Anastasia Vela wrote: > > After further discussion with Anna, we decided the following: > - add the average metric, but noted in the KIP that the average value may > look low at times when there are

[jira] [Created] (KAFKA-8627) Investigate batching on state restore

Sophie Blee-Goldman created KAFKA-8627: -- Summary: Investigate batching on state restore Key: KAFKA-8627 URL: https://issues.apache.org/jira/browse/KAFKA-8627 Project: Kafka Issue Type:

Build failed in Jenkins: kafka-trunk-jdk11 #673

See Changes: [rajinisivaram] MINOR: system tests - avoid 'sasl.enabled.mechanisms' in listener -- [...truncated 6.40 MB...]

Re: [DISCUSS] KIP-455 Create an Admin API for Replica Reassignments

Hey Colin, Thanks for the detailed reply! > Not really. Cruise Control, for example, tries to update the znode even when > it's not empty. This doesn't work, of course. This is an existing problem > with the old API-- which the new API fixes, of course. I am not sure that's the case - I

Re: [DISCUSS] KIP-213: Second follow-up on Foreign Key Joins

It was KIP-77: https://cwiki.apache.org/confluence/display/KAFKA/KIP-77%3A+Improve+Kafka+Streams+Join+Semantics It did all kind of improvements, including removing unnecessary tombstones. About S-1: I agree that it would be complex and impact performance. I did not think about all details yet,

Build failed in Jenkins: kafka-trunk-jdk8 #3766

See Changes: [rajinisivaram] MINOR: system tests - avoid 'sasl.enabled.mechanisms' in listener -- [...truncated 6.48 MB...]

Re: [VOTE] KIP-475: New Metric to Measure Number of Tasks on a Connector

Thanks for the input, everyone! I'm marking this KIP as accepted with 3 binding votes (Gwen, Guozhang, Randall) 3 nonbinding votes (Andrew, Konstantine, Ryanne) The PR is updated at https://github.com/apache/kafka/pull/6843/files On Sun, Jun 23, 2019 at 10:52 AM Andrew Schofield wrote: > +1

[jira] [Created] (KAFKA-8626) Group will fall into constant incremental rebalancing with a long non-responsive static member

Boyang Chen created KAFKA-8626: -- Summary: Group will fall into constant incremental rebalancing with a long non-responsive static member Key: KAFKA-8626 URL: https://issues.apache.org/jira/browse/KAFKA-8626

Re: [DISCUSS] KIP-213: Second follow-up on Foreign Key Joins

Hi Matthias Do you happen to recall what the impact was of having unnecessary tombstones? I am wondering if the negative impact is still relevant today, and if so, if you can recall the PRs or KIPs related to it. That being said, I think that S-1 is too complex in terms of synchronization. It

[jira] [Created] (KAFKA-8625) intra broker data balance stuck

Ryne Yang created KAFKA-8625: Summary: intra broker data balance stuck Key: KAFKA-8625 URL: https://issues.apache.org/jira/browse/KAFKA-8625 Project: Kafka Issue Type: Bug Affects Versions:

Build failed in Jenkins: kafka-trunk-jdk11 #672

See Changes: [github] MINOR: Embedded connect cluster should mask exit procedures by default -- [...truncated 6.45 MB...] org.apache.kafka.trogdor.common.WorkerUtilsTest

Re: [DISCUSS] KIP-444: Augment Metrics for Kafka Streams

Hi Guozhang, I just noticed that the Per-State-Store tags are somehow mixed up in the KIP (e.g "client-id=[threadId]"). Best, Bruno On Mon, Jul 1, 2019 at 6:28 PM Boyang Chen wrote: > > Hey Guozhang, > > do we plan to add per partition latency in this KIP? > > On Mon, Jul 1, 2019 at 7:08 AM

Re: [DISCUSS]KIP-216: IQ should throw different exceptions for different errors

Hi, Matthias, This is second part. > For the internal exceptions: > > `StateStoreClosedException` -- why can it be wrapped as > `StreamThreadNotStartedException` ? It seems that the later would only > be thrown by `KafkaStreams#store()` and thus would be throw directly. Both

Re: [VOTE] KIP-476: Add Java AdminClient interface

Matthias, I was referring to platforms such as spark or flink that support multiple versions of the Kafka clients. Ismael mentioned this higher up on the thread. I'd prefer this KIP didn't get held up over somewhat unrelated change, i.e. should the factory method be on the interface or utility

Re: Synchronized consumption + processing based on timestamps?

Thanks Matthias, For #1 this is something we have done already, but it can obviously take a while to catch up for large topics (or may not catch up at all if the volume is large). For #2, this is what I am wondering about, if anyone knows of any implementations that provide an option like this

Re: PR review

https://github.com/apache/kafka/pull/6771 Bouncing both users and dev to get some activity going. We are waiting for a while to get this KIP pr merged. Could someone please review? Thanks, On Sun, 30 Jun 2019 at 08:59, M. Manna wrote: > https://github.com/apache/kafka/pull/6771 > > Hello, >

Re: [DISCUSS] KIP-221: Repartition Topic Hints in Streams

Hello Matthias, Thanks for the feedback and ideas. I like the idea of introducing dedicated `Topic` class for topic configuration for internal operators like `groupedBy`. Would be great to hear others opinion about this as well. Kind regards, Levani > On Jul 3, 2019, at 7:00 AM, Matthias J.

Build failed in Jenkins: kafka-trunk-jdk8 #3765

See Changes: [jason] MINOR: Preserve the assignment order from the LeaderAndIsr request [github] MINOR: Adjust Streams parameter hint on TimeoutException (#6280) [github] MINOR: Embedded connect cluster should

Build failed in Jenkins: kafka-trunk-jdk11 #671

See Changes: [jason] MINOR: Preserve the assignment order from the LeaderAndIsr request [github] MINOR: Adjust Streams parameter hint on TimeoutException (#6280) --