Build failed in Jenkins: kafka-2.4-jdk8 #35

See Changes: [jason] MINOR: Add toString to PartitionReassignment (#7579) -- [...truncated 2.69 MB...] org.apache.kafka.streams.TopologyTestDriverTest > shouldUseSourceSpec

Build failed in Jenkins: kafka-trunk-jdk8 #3992

See Changes: [cmccabe] MINOR: Check against empty replicas in AlterPartitionReassignments [cmccabe] MINOR: Rename brokers to replicas in the reassignment API (#7570) [github] MINOR: Add toString to PartitionRea

Re: [VOTE] KIP-537: Increase default zookeeper session timeout

+1 (non binding) Thanks for the KIP On Wed, Oct 23, 2019 at 12:02 AM Harsha Chintalapani wrote: > > +1 (binding). > Thanks, > Harsha > > On Tue, Oct 22, 2019 at 3:20 PM Colin McCabe wrote: > > > +1 (binding). > > > > Thanks, Jason. > > > > best, > > Colin > > > > > > On Mon, Oct 21, 2019, at 17:

[jira] [Resolved] (KAFKA-9078) System Test Failure: ConnectRestApiTest

[ https://issues.apache.org/jira/browse/KAFKA-9078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Manikumar resolved KAFKA-9078. -- Resolution: Fixed > System Test Failure: ConnectRestApiTest > --- >

Re: [DISCUSS] KIP-530: Considerrenaming'UsePreviousTimeOnInvalidTimeStamp' classto'UsePartitionTimeOnInvalidTimeStamp'

Hi Matthias, Thank You for the review of KIP and I have made the changes in it as per your suggestion. Will be moving this KIP to vote now. With Regards, Rabi Kumar K C On Wed, Oct 23, 2019 at 7:56 AM Matthias J. Sax wrote: > Thanks for the KIP, Rabi. > > Overall LGTM, but I think we can simpl

[jira] [Created] (KAFKA-9086) Remove destroy-rate and create-rate Streams Metrics

Bruno Cadonna created KAFKA-9086: Summary: Remove destroy-rate and create-rate Streams Metrics Key: KAFKA-9086 URL: https://issues.apache.org/jira/browse/KAFKA-9086 Project: Kafka Issue Type:

Re: [DISCUSS] KIP-535: Allow state stores to serve stale reads during rebalance

Thanks, everyone for taking a look. Some very cool ideas have flown in.  >> There was a follow-on idea I POCed to continuously share lag information in >> the heartbeat protocol+1 that would be great, I will update the KIP assuming >> this work will finish soon >> I think that adding a new met

[jira] [Created] (KAFKA-9087) ReplicaAlterLogDirs fails with java.lang.IllegalStateException: Offset mismatch for the future replica

Gregory Koshelev created KAFKA-9087: --- Summary: ReplicaAlterLogDirs fails with java.lang.IllegalStateException: Offset mismatch for the future replica Key: KAFKA-9087 URL: https://issues.apache.org/jira/browse/KA

[jira] [Created] (KAFKA-9088) Consolidate InternalMockProcessorContext and MockInternalProcessorContext

Bruno Cadonna created KAFKA-9088: Summary: Consolidate InternalMockProcessorContext and MockInternalProcessorContext Key: KAFKA-9088 URL: https://issues.apache.org/jira/browse/KAFKA-9088 Project: Kafk

Build failed in Jenkins: kafka-2.4-jdk8 #36

See Changes: [manikumar] KAFKA-9078: Fix Connect system test after adding MM2 connector classes -- [...truncated 3.16 MB...] org.apache.kafka.streams.test.OutputVerifierTest

Re: [Discuss] - KIP-532 - Add KStream#toTable to the Streams DSL

Apologies for the delay. I have made the changes in the KIP, i'll be starting the voting process shortly. Best regards, Aishwarya Kumar On Mon, Oct 7, 2019 at 6:06 PM Matthias J. Sax wrote: > Aishwarya, > > Why is bullet point (2) formatted as "strike through"? If you intend to > replace it wi

Re: [DISCUSS] KIP-535: Allow state stores to serve stale reads during rebalance

Responding to the points raised by Matthias 1. IIUC John intends to add (or we can do this in this KIP) lag information to AssignmentInfo, which gets sent to every participant. 2. At-least I was under the assumption that it can be called per query, since the API docs don't seem to suggest otherwi

request permission to create KIP

Hello, I am working on this jira https://issues.apache.org/jira/browse/KAFKA-9076 which requires a KIP. Since I am new to Confluence, I would like to request permission to create KIP. My confluence User ID: yangguo1220 My registered email: ning2008w...@gmail.com Thanks, Ning

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Thanks Satish, Harsha, It's probably worth it making it clearer in the KIP what exact libraries will be added to libs, if any. The KIP specifies the remote storage interface but it isn't clear if particular implementations will be added to Kafka's repository or whether they will reside in other re

[jira] [Resolved] (KAFKA-9056) Selector outbound byte metric does not count partial sends

[ https://issues.apache.org/jira/browse/KAFKA-9056?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jason Gustafson resolved KAFKA-9056. Fix Version/s: 2.5.0 Resolution: Fixed > Selector outbound byte metric does not coun

[jira] [Resolved] (KAFKA-5214) Re-add KafkaAdminClient#apiVersions

[ https://issues.apache.org/jira/browse/KAFKA-5214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-5214. --- Resolution: Invalid Closing as per discussion from KIP-522: https://lists.apache.org/thread.

[jira] [Resolved] (KAFKA-5723) Refactor BrokerApiVersionsCommand to use AdminClient

[ https://issues.apache.org/jira/browse/KAFKA-5723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison resolved KAFKA-5723. --- Resolution: Invalid Closing as per discussion from KIP-522: [https://lists.apache.org/thread

Re: [DISCUSS] KIP-522: Update BrokerApiVersionsCommand to use AdminClient

Thanks Colin for the feedback. I'm discarding this KIP and I've closed both https://issues.apache.org/jira/browse/KAFKA-5214 and https://issues.apache.org/jira/browse/KAFKA-5723 with links to this discussion. On Mon, Sep 23, 2019 at 7:18 PM Colin McCabe wrote: > > Hi Mickael, > > The brokerApiVe

Re: request permission to create KIP

Done. On 10/22/19 11:44 PM, Ning Zhang wrote: > Hello, > > I am working on this jira https://issues.apache.org/jira/browse/KAFKA-9076 > which requires a KIP. Since I am new to Confluence, I would like to request > permission to create KIP. > > My confluence User ID: yangguo1220 > My registered e

[VOTE] KIP-530: Consider renaming 'UsePreviousTimeOnInvalidTimeStamp' class to 'UsePartitionTimeOnInvalidTimeStamp'

Hello All, As per the discussion I want to call for a vote to go forward with the changes mentioned in KIP-530. Links: https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=130028807 https://issues.apache.org/jira/browse/KAFKA-8953 With Best Regards, Rabi Kumar K C

Build failed in Jenkins: kafka-trunk-jdk11 #906

See Changes: [manikumar] KAFKA-9078: Fix Connect system test after adding MM2 connector classes -- [...truncated 5.47 MB...] org.apache.kafka.streams.test.OutputVerifier

[jira] [Created] (KAFKA-9089) Reassignment should be resilient to unexpected errors

Jason Gustafson created KAFKA-9089: -- Summary: Reassignment should be resilient to unexpected errors Key: KAFKA-9089 URL: https://issues.apache.org/jira/browse/KAFKA-9089 Project: Kafka Issue

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

Hi Sophie, Thank you for your comments. As for the different methods signatures I have not really considered any other options but while I do agree it is confusing, I don't see any obvious solutions. The problem is that the cogroup essentially pairs a group stream with an aggregator and when it i

Build failed in Jenkins: kafka-trunk-jdk8 #3993

See Changes: [manikumar] KAFKA-9078: Fix Connect system test after adding MM2 connector classes -- [...truncated 5.49 MB...] org.apache.kafka.streams.test.OutputVerifie

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

Hi Walker, Thanks for picking up the KIP! I hope you don't mind if I pile on a question also. The motivation section depicts the current "non-optimal" case as a multi-way KTable equi-join, but the proposed API looks like a multi-way KStream windowed join+aggregate. My question is specifically wh

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

Thanks for the explanation, makes sense to me! As for the API, one other thought I had is might we ever want or need to introduce any other configs or parameters in the future? Obviously that's difficult to say now (or maybe the answer seems obviously "no") but we seem to often end up needing to ad

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi, Harsha, Regarding feature branch, if the goal is faster collaboration, it seems that doing the development on your own fork is better since non-committers can push changes there. Regarding the dependencies, this is an important thing to clarify. My understanding for this KIP is that in Apache

Re: [VOTE] KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type

I'll add my +1 (binding) as well best, Colin On Tue, Oct 22, 2019, at 15:47, M. Manna wrote: > +1 (non-bonding) it’s a helpful info. > > Thanks for the KIP. > > Regards, > > On Tue, 22 Oct 2019 at 23:45, Jason Gustafson wrote: > > > +1 Thanks Colin. > > > > On Tue, Oct 22, 2019 at 12:42 AM T

Re: [VOTE] KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type

Hi Colin, Thanks for the KIP. Would it make sense to have a tag with the TLS version as well? Ismael On Mon, Oct 21, 2019 at 3:43 PM Colin McCabe wrote: > Hi all, > > I'd like to start the vote on KIP-538: Add a metric tracking the number of > open connections with a given SSL cipher type. > >

Build failed in Jenkins: kafka-trunk-jdk8 #3994

See Changes: [github] KAFKA-9056; Inbound/outbound byte metrics should reflect incomplete -- [...truncated 2.70 MB...] org.apache.kafka.streams.test.TestRecordTest > tes

Re: [VOTE] 2.3.1 RC2

+ dev@kafka.apache.org On Tue, Oct 22, 2019, at 15:48, Colin McCabe wrote: > +1. I ran the broker, producer, consumer, etc. > > best, > Colin > > On Tue, Oct 22, 2019, at 13:32, Guozhang Wang wrote: > > +1. I've ran the quick start and unit tests. > > > > > > Guozhang > > > > On Tue, Oct 22,

Re: [VOTE] KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type

Hi Ismael, That's a good idea! I added it to the KIP. best, Colin On Wed, Oct 23, 2019, at 12:59, Ismael Juma wrote: > Hi Colin, > > Thanks for the KIP. Would it make sense to have a tag with the TLS version > as well? > > Ismael > > On Mon, Oct 21, 2019 at 3:43 PM Colin McCabe wrote: > >

Re: [VOTE] 2.3.1 RC2

+1 (binding) - downloaded and compiled source code - verified signatures for source code and Scala 2.11 binary - run core/connect/streams quickstart using Scala 2.11 binaries -Matthias On 10/23/19 2:43 PM, Colin McCabe wrote: > + dev@kafka.apache.org > > On Tue, Oct 22, 2019, at 15:48, Colin

[jira] [Created] (KAFKA-9090) LeaveGroup admin request should enforce minimum version

Boyang Chen created KAFKA-9090: -- Summary: LeaveGroup admin request should enforce minimum version Key: KAFKA-9090 URL: https://issues.apache.org/jira/browse/KAFKA-9090 Project: Kafka Issue Type:

[jira] [Created] (KAFKA-9091) KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type

Colin McCabe created KAFKA-9091: --- Summary: KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type Key: KAFKA-9091 URL: https://issues.apache.org/jira/browse/KAFKA-9091

[jira] [Resolved] (KAFKA-9052) KIP-538: Add a metric tracking the number of open connections with a given SSL cipher type

[ https://issues.apache.org/jira/browse/KAFKA-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-9052. - Resolution: Duplicate > KIP-538: Add a metric tracking the number of open connections with a give

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

Interesting idea, Sophie. So far, we tried to reuse existing config objects and only add new ones when needed to avoid creating "redundant" classes. This is of course a reactive approach (with the drawback to deprecate stuff if we change it, as you described). I can personally not see any need to

Build failed in Jenkins: kafka-trunk-jdk11 #907

See Changes: [github] KAFKA-9056; Inbound/outbound byte metrics should reflect incomplete -- [...truncated 5.47 MB...] org.apache.kafka.streams.test.OutputVerifierTest >

[DISCUSS] KIP-545: support automated consumer offset sync across clusters in MM 2.0

Hello All, MirrorMaker 2.0 (MM 2.0) is a new Kafka community initiative that is designed to address the limitations of current MirrorMaker. The offset translation is one of MM2.0's features to serve the foundation of m

Build failed in Jenkins: kafka-trunk-jdk8 #3995

See Changes: [cmccabe] KAFKA-8584: The RPC code generator should support ByteBuffer. (#7342) [wangguoz] KAFKA-8700: Flaky Test QueryableStateIntegrationTest#queryOnRebalance ---

Re: KAFKA-8584: Support of ByteBuffer for bytes field implemented[Convert Kafka RPCs to use automatically generated code]

Hello. This improvement merged. Thanks Colin for the review. В Пт, 18/10/2019 в 15:02 -0700, Colin McCabe пишет: > Hi Nikolay, > > Sorry that I haven't had more bandwidth to review this recently. I will take > a look today. > > In the future, can you please rebase your changes on top of trunk

[jira] [Resolved] (KAFKA-6108) Synchronizing on commits and StandbyTasks can be improved

[ https://issues.apache.org/jira/browse/KAFKA-6108?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-6108. Resolution: Fixed > Synchronizing on commits and StandbyTasks can be improved > ---

[jira] [Resolved] (KAFKA-8914) Setting GROUP_INSTANCE_ID_CONFIG leads to a protobuf error

[ https://issues.apache.org/jira/browse/KAFKA-8914?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matthias J. Sax resolved KAFKA-8914. Resolution: Duplicate Thanks for the follow up [~igmar]. Closing this as duplicate. Btw: 2.

Re: [DISCUSS] KIP-150 - Kafka-Streams Cogroup

> I can personally not see any need to add other configuration Famous last words? Just kidding, 95% confidence is more than enough to me (and better to optimize for current design than for hypothetical future changes). One last question I have then is about the operator/store/repartition naming

[jira] [Created] (KAFKA-9092) Kafka Streams Upgrade Magic v0 does not support record headers

wxmimperio created KAFKA-9092: - Summary: Kafka Streams Upgrade Magic v0 does not support record headers Key: KAFKA-9092 URL: https://issues.apache.org/jira/browse/KAFKA-9092 Project: Kafka Issue

Re: [VOTE] KIP-530: Consider renaming 'UsePreviousTimeOnInvalidTimeStamp' class to 'UsePartitionTimeOnInvalidTimeStamp'

+1 (binding) Thanks for the KIP! -Matthias On 10/23/19 9:37 AM, RABI K.C. wrote: > Hello All, > > As per the discussion I want to call for a vote to go forward with the > changes mentioned in KIP-530. > > Links: > https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=130028807 > htt