[jira] [Resolved] (KAFKA-12780) java.lang.IllegalStateException: Tried to lookup lag for unknown task 2_0

2021-05-13 Thread Ireneusz Matysiewicz (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12780?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ireneusz Matysiewicz resolved KAFKA-12780. -- Resolution: Fixed > java.lang.IllegalStateException: Tried to lookup lag for u

[GitHub] [kafka-site] mjsax commented on a change in pull request #354: Updated downloads.html to include 2.7.1

2021-05-13 Thread GitBox
mjsax commented on a change in pull request #354: URL: https://github.com/apache/kafka-site/pull/354#discussion_r632288752 ## File path: downloads.html ## @@ -60,23 +60,66 @@ 2.8.0https://downloads.apache.org/kafka/2.8.0/RELEASE_NOTES.html";>Release Notes. + +2

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #124

2021-05-13 Thread Apache Jenkins Server
See

[jira] [Created] (KAFKA-12783) Remove the deprecated ZK-based partition reassignment API

2021-05-13 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-12783: Summary: Remove the deprecated ZK-based partition reassignment API Key: KAFKA-12783 URL: https://issues.apache.org/jira/browse/KAFKA-12783 Project: Kafka Iss

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

2021-05-13 Thread Sophie Blee-Goldman
One last update: we will not actually remove the existing o.a.k.streams.processor.TaskId class, but only deprecate it, along with any methods that returned it (ie the getters on ProcessorContext and StateStoreContext) Internally, everything will still be converted to use the new internal TaskId cl

[jira] [Resolved] (KAFKA-1676) Ability to cancel replica reassignment in progress

2021-05-13 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-1676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-1676. - Fix Version/s: 2.5.0 Assignee: Colin McCabe Resolution: Fixed > Ability to cancel

[jira] [Resolved] (KAFKA-9520) Deprecate ZooKeeper access for kafka-reassign-partitions.sh

2021-05-13 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9520?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-9520. - Fix Version/s: 2.5.0 Assignee: Colin McCabe Resolution: Fixed We deprecated ZK ac

[jira] [Resolved] (KAFKA-4712) kafka-reassign-partitions causes ISR to shrink

2021-05-13 Thread Colin McCabe (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-4712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Colin McCabe resolved KAFKA-4712. - Resolution: Cannot Reproduce This seems to be related to overall load on the cluster as a result

[jira] [Created] (KAFKA-12782) Javadocs search sends you to a non-existent URL

2021-05-13 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12782: -- Summary: Javadocs search sends you to a non-existent URL Key: KAFKA-12782 URL: https://issues.apache.org/jira/browse/KAFKA-12782 Project: Kafka

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

2021-05-13 Thread Sophie Blee-Goldman
Thanks all. I updated the KIP slightly since there is some ambiguity around whether the existing TaskId class is currently part of the public API or not. To settle the matter, I have introduced a new public TaskId interface that exposes the metadata, and moved the existing TaskId class to the inter

Jenkins build is still unstable: Kafka » Kafka Branch Builder » trunk #123

2021-05-13 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-618: Atomic commit of source connector records and offsets

2021-05-13 Thread Chris Egerton
Hi Tom, I'm fine with an implicit mapping of connector-provided null to user-exposed UNKNOWN, if the design continues down that overall path. Allowing users to assert that a connector should support exactly-once sounds reasonable; it's similar to the pre-flight checks we already do for connector

[jira] [Created] (KAFKA-12781) Improve the endOffsets accuracy in TaskMetadata

2021-05-13 Thread Walker Carlson (Jira)
Walker Carlson created KAFKA-12781: -- Summary: Improve the endOffsets accuracy in TaskMetadata Key: KAFKA-12781 URL: https://issues.apache.org/jira/browse/KAFKA-12781 Project: Kafka Issue Ty

Re: [DISCUSS] Apache Kafka 3.0.0 release

2021-05-13 Thread Konstantine Karantasis
Hi all, Lots of good progress recently towards the 3.0.0 release and given that we are now a little less than a month away from the first milestone, I wanted to post a status update and a reminder of the upcoming dates for this major release. According to the current release plan for Apache Kafka

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

2021-05-13 Thread Ryanne Dolan
re serialization, my concern is that serialization often accounts for a lot of the cycles spent before returning the future. It's not blocking per se, but it's the same effect from the caller's perspective. Moreover, serde impls often block themselves, e.g. when fetching schemas from a registry. I

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #122

2021-05-13 Thread Apache Jenkins Server
See

[jira] [Resolved] (KAFKA-8326) Add Serde> support

2021-05-13 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman resolved KAFKA-8326. --- Fix Version/s: 3.0.0 Resolution: Fixed > Add Serde> support >

[jira] [Reopened] (KAFKA-9295) KTableKTableForeignKeyInnerJoinMultiIntegrationTest#shouldInnerJoinMultiPartitionQueryable

2021-05-13 Thread A. Sophie Blee-Goldman (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] A. Sophie Blee-Goldman reopened KAFKA-9295: --- Unfortunately it seems to still be failing :/  [https://ci-builds.apache.org/job

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

2021-05-13 Thread Guozhang Wang
+1 On a hindsight, maybe TaskId should not really be in `org.apache.kafka.streams.processor` but rather just in `o.a.k.streams`, but maybe not worth pulling it up now :) Guozhang On Thu, May 13, 2021 at 1:58 PM Walker Carlson wrote: > +1 from me! (non-binding) > > Walker > > On Thu, May 13, 20

Re: [VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

2021-05-13 Thread Walker Carlson
+1 from me! (non-binding) Walker On Thu, May 13, 2021 at 1:53 PM Sophie Blee-Goldman wrote: > Hey all, > > I'm just going to take this KIP straight to a vote since it should be a > trivial and uncontroversial change. Of course please raise any concerns > should they come up, and I can take thin

[VOTE] KIP-740: Use TaskId instead of String for the taskId field in TaskMetadata

2021-05-13 Thread Sophie Blee-Goldman
Hey all, I'm just going to take this KIP straight to a vote since it should be a trivial and uncontroversial change. Of course please raise any concerns should they come up, and I can take things to a DISCUSS thread. The KIP is a simple change to move from String to TaskId for the taskID field of

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #121

2021-05-13 Thread Apache Jenkins Server
See Changes: -- [...truncated 408827 lines...] [2021-05-13T20:50:02.320Z] > Task :server-common:compileJava UP-TO-DATE [2021-05-13T20:50:02.320Z] > Task :connect:api:compile

[jira] [Created] (KAFKA-12780) java.lang.IllegalStateException: Tried to lookup lag for unknown task 2_0

2021-05-13 Thread Ireneusz Matysiewicz (Jira)
Ireneusz Matysiewicz created KAFKA-12780: Summary: java.lang.IllegalStateException: Tried to lookup lag for unknown task 2_0 Key: KAFKA-12780 URL: https://issues.apache.org/jira/browse/KAFKA-12780

[jira] [Created] (KAFKA-12779) Use TaskId instead of String for the taskId field in TaskMetadata

2021-05-13 Thread A. Sophie Blee-Goldman (Jira)
A. Sophie Blee-Goldman created KAFKA-12779: -- Summary: Use TaskId instead of String for the taskId field in TaskMetadata Key: KAFKA-12779 URL: https://issues.apache.org/jira/browse/KAFKA-12779

Re: [DISCUSS] KIP-690 Add additional configuration to control MirrorMaker 2 internal topics naming convention

2021-05-13 Thread Gwen Shapira
Hey, sorry for arriving late, but I have a question about the rejected alternative involving configuration. I may be missing something, but we are looking at 3 new configs (one for each topic). And this rejected alternative is basically identical to what Connect already does (you can choose names

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

2021-05-13 Thread Nakamura
Hey Ryanne, I agree we should add an additional constructor (or else an additional overload in KafkaProducer#send, but the new constructor would be easier to understand) if we're targeting the "user provides the thread" approach. >From looking at the code, I think we can keep record serialization

[jira] [Created] (KAFKA-12778) QuorumController should honor request timeouts

2021-05-13 Thread Colin McCabe (Jira)
Colin McCabe created KAFKA-12778: Summary: QuorumController should honor request timeouts Key: KAFKA-12778 URL: https://issues.apache.org/jira/browse/KAFKA-12778 Project: Kafka Issue Type: Bu

Re: [DISCUSS] KIP-739: Block Less on KafkaProducer#send

2021-05-13 Thread Ryanne Dolan
Hey Moses, I like the direction here. My thinking is that a single additional work queue, s.t. send() can enqueue and return, seems like the lightest touch. However, I don't think we can trivially process that queue in an internal thread pool without subtly changing behavior for some users. For exa

[jira] [Created] (KAFKA-12777) AutoTopicCreationManager does not handle response errors

2021-05-13 Thread David Arthur (Jira)
David Arthur created KAFKA-12777: Summary: AutoTopicCreationManager does not handle response errors Key: KAFKA-12777 URL: https://issues.apache.org/jira/browse/KAFKA-12777 Project: Kafka Issu

[DISCUSS] KIP-739: Block Less on KafkaProducer#send

2021-05-13 Thread Nakamura
Hey Folks, I just posted a new proposal in the wiki. I think we have an opportunity to improve the KafkaProducer#send user experience. It would certainly make our lives easier. Please take a look! There are two subprob

Re: 2.7.1 Status

2021-05-13 Thread Mickael Maison
Hi Gary, I'm almost done with the release process. We just need to get a couple of PRs merged and I'll send the announcement. Thanks On Wed, May 12, 2021 at 10:11 PM Gary Russell wrote: > > Thanks; I was thrown by the age of the jars, but I see, indeed, that voting > began all the way back the

[GitHub] [kafka-site] mimaison commented on pull request #354: Updated downloads.html to include 2.7.1

2021-05-13 Thread GitBox
mimaison commented on pull request #354: URL: https://github.com/apache/kafka-site/pull/354#issuecomment-840484630 @mjsax @vvcephei can you take a look? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL a

Re: too many open files

2021-05-13 Thread Gu Haihua
Hi Liam I can’t reply to you directly. So I have to reply it here. We are running many kinds of customized connectors. Most of them are jdbc source and sink tasks. The error throws on the standalone KC. Here is the output of ulimit [devops@gio_server4-21 ~]$ ulimit -a core file size (bl