Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1646

2023-03-03 Thread Apache Jenkins Server
See 


Changes:


--
[...truncated 534219 lines...]
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testCreateTopLevelPaths() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testCreateTopLevelPaths() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > 
testGetAllTopicsInClusterDoesNotTriggerWatch() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > 
testGetAllTopicsInClusterDoesNotTriggerWatch() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testIsrChangeNotificationGetters() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testIsrChangeNotificationGetters() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testLogDirEventNotificationsDeletion() 
STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testLogDirEventNotificationsDeletion() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testGetLogConfigs() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testGetLogConfigs() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testBrokerSequenceIdMethods() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testBrokerSequenceIdMethods() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testAclMethods() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testAclMethods() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testCreateSequentialPersistentPath() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testCreateSequentialPersistentPath() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testConditionalUpdatePath() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testConditionalUpdatePath() PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() 
STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testGetAllTopicsInClusterTriggersWatch() 
PASSED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.735Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testDeleteTopicZNode() STARTED
[2023-03-04T04:00:29.735Z] 
[2023-03-04T04:00:29.903Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testDeleteTopicZNode() PASSED
[2023-03-04T04:00:29.903Z] 
[2023-03-04T04:00:29.903Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testDeletePath() STARTED
[2023-03-04T04:00:29.903Z] 
[2023-03-04T04:00:29.903Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testDeletePath() PASSED
[2023-03-04T04:00:29.903Z] 
[2023-03-04T04:00:29.903Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testGetBrokerMethods() STARTED
[2023-03-04T04:00:29.903Z] 
[2023-03-04T04:00:29.903Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testGetBrokerMethods() PASSED
[2023-03-04T04:00:29.903Z] 
[2023-03-04T04:00:29.903Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > KafkaZkClientTest > testJuteMaxBufffer() 

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1645

2023-03-03 Thread Apache Jenkins Server
See 




Re: [VOTE] KIP-904: Kafka Streams - Guarantee subtractor is called before adder if key has not changed

2023-03-03 Thread Fq Public
I will close the vote now. 
The results are 3 binding votes (Guozhang, Walker, Matthias) and 1 non-binding 
vote (Lucas).
Therefore the vote on KIP-904 passes. 
Next steps are to revise the draft PR 
(https://github.com/apache/kafka/pull/10747) and go from there.

Thank you everyone!
Farooq

On 2023/03/03 10:13:37 Lucas Brutschy wrote:
> +1 (non-binding)
> 
> Thanks!
> 
> On Wed, Mar 1, 2023 at 9:03 PM Matthias J. Sax  wrote:
> >
> > +1 (binding)
> >
> > Thanks for the KIP!
> >
> > On 3/1/23 10:58 AM, Walker Carlson wrote:
> > > +1 Binding
> > >
> > > On Mon, Feb 27, 2023 at 12:48 PM Guozhang Wang 
> > > wrote:
> > >
> > >> +1.
> > >>
> > >> On Sun, Feb 26, 2023 at 4:27 PM Fq Public  wrote:
> > >>>
> > >>> Hi everyone,
> > >>>
> > >>> I'd like to start the vote on KIP-904: Kafka Streams - Guarantee
> > >> subtractor
> > >>> is called before adder if key has not changed.
> > >>> The KIP is available here: https://cwiki.apache.org/confluence/x/P5VbDg
> > >>> The easiest way to view the entire discussion thread is via this search
> > >>> link: https://lists.apache.org/list?dev@kafka.apache.org:lte=1M:KIP-904
> > >>> Please take a look and vote.
> > >>>
> > >>> Thank you,
> > >>> Farooq
> > >>
> > >
> 

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1644

2023-03-03 Thread Apache Jenkins Server
See 


Changes:


--
[...truncated 449057 lines...]
[2023-03-03T21:10:59.278Z] > Task :clients:compileTestJava UP-TO-DATE
[2023-03-03T21:10:59.278Z] > Task :clients:testClasses UP-TO-DATE
[2023-03-03T21:10:59.278Z] > Task :storage:api:compileTestJava UP-TO-DATE
[2023-03-03T21:10:59.278Z] > Task :storage:api:testClasses UP-TO-DATE
[2023-03-03T21:10:59.278Z] > Task :raft:compileTestJava UP-TO-DATE
[2023-03-03T21:10:59.278Z] > Task :connect:json:compileTestJava UP-TO-DATE
[2023-03-03T21:10:59.278Z] > Task :raft:testClasses UP-TO-DATE
[2023-03-03T21:10:59.278Z] > Task :connect:json:testClasses UP-TO-DATE
[2023-03-03T21:11:00.296Z] > Task :connect:json:testJar
[2023-03-03T21:11:00.296Z] > Task :connect:json:testSrcJar
[2023-03-03T21:11:00.296Z] > Task 
:streams:generateMetadataFileForMavenJavaPublication
[2023-03-03T21:11:00.296Z] > Task :server-common:compileTestJava UP-TO-DATE
[2023-03-03T21:11:00.296Z] > Task :server-common:testClasses UP-TO-DATE
[2023-03-03T21:11:00.296Z] > Task :group-coordinator:compileTestJava UP-TO-DATE
[2023-03-03T21:11:00.296Z] > Task :group-coordinator:testClasses UP-TO-DATE
[2023-03-03T21:11:00.296Z] > Task 
:clients:generateMetadataFileForMavenJavaPublication
[2023-03-03T21:11:00.296Z] > Task :metadata:compileTestJava UP-TO-DATE
[2023-03-03T21:11:00.296Z] > Task :metadata:testClasses UP-TO-DATE
[2023-03-03T21:11:03.447Z] 
[2023-03-03T21:11:03.447Z] > Task :connect:api:javadoc
[2023-03-03T21:11:03.448Z] 
/home/jenkins/jenkins-agent/workspace/Kafka_kafka_trunk_2/connect/api/src/main/java/org/apache/kafka/connect/source/SourceRecord.java:44:
 warning - Tag @link: reference not found: org.apache.kafka.connect.data
[2023-03-03T21:11:04.645Z] 1 warning
[2023-03-03T21:11:05.788Z] 
[2023-03-03T21:11:05.788Z] > Task :connect:api:copyDependantLibs UP-TO-DATE
[2023-03-03T21:11:05.788Z] > Task :connect:api:jar UP-TO-DATE
[2023-03-03T21:11:05.788Z] > Task 
:connect:api:generateMetadataFileForMavenJavaPublication
[2023-03-03T21:11:05.788Z] > Task :connect:json:copyDependantLibs UP-TO-DATE
[2023-03-03T21:11:05.788Z] > Task :connect:json:jar UP-TO-DATE
[2023-03-03T21:11:05.788Z] > Task 
:connect:json:generateMetadataFileForMavenJavaPublication
[2023-03-03T21:11:05.788Z] > Task :connect:api:javadocJar
[2023-03-03T21:11:05.788Z] > Task 
:connect:json:publishMavenJavaPublicationToMavenLocal
[2023-03-03T21:11:05.788Z] > Task :connect:json:publishToMavenLocal
[2023-03-03T21:11:05.788Z] > Task :connect:api:compileTestJava UP-TO-DATE
[2023-03-03T21:11:05.788Z] > Task :connect:api:testClasses UP-TO-DATE
[2023-03-03T21:11:05.788Z] > Task :connect:api:testJar
[2023-03-03T21:11:05.788Z] > Task :connect:api:testSrcJar
[2023-03-03T21:11:05.788Z] > Task 
:connect:api:publishMavenJavaPublicationToMavenLocal
[2023-03-03T21:11:05.788Z] > Task :connect:api:publishToMavenLocal
[2023-03-03T21:11:09.248Z] > Task :streams:javadoc
[2023-03-03T21:11:09.248Z] > Task :streams:javadocJar
[2023-03-03T21:11:11.498Z] 
[2023-03-03T21:11:11.498Z] > Task :clients:javadoc
[2023-03-03T21:11:11.498Z] 
/home/jenkins/jenkins-agent/workspace/Kafka_kafka_trunk_2/clients/src/main/java/org/apache/kafka/common/security/oauthbearer/secured/package-info.java:21:
 warning - Tag @link: reference not found: 
org.apache.kafka.common.security.oauthbearer
[2023-03-03T21:11:12.429Z] 1 warning
[2023-03-03T21:11:13.448Z] 
[2023-03-03T21:11:13.448Z] > Task :clients:javadocJar
[2023-03-03T21:11:14.468Z] > Task :clients:srcJar
[2023-03-03T21:11:14.468Z] > Task :clients:testJar
[2023-03-03T21:11:15.489Z] > Task :clients:testSrcJar
[2023-03-03T21:11:15.489Z] > Task 
:clients:publishMavenJavaPublicationToMavenLocal
[2023-03-03T21:11:15.489Z] > Task :clients:publishToMavenLocal
[2023-03-03T21:11:29.702Z] > Task :core:compileScala
[2023-03-03T21:13:08.865Z] > Task :core:classes
[2023-03-03T21:13:08.865Z] > Task :core:compileTestJava NO-SOURCE
[2023-03-03T21:13:37.939Z] > Task :core:compileTestScala
[2023-03-03T21:15:01.280Z] > Task :core:testClasses
[2023-03-03T21:15:01.280Z] > Task :streams:compileTestJava UP-TO-DATE
[2023-03-03T21:15:01.280Z] > Task :streams:testClasses UP-TO-DATE
[2023-03-03T21:15:02.301Z] > Task :streams:testJar
[2023-03-03T21:15:02.301Z] > Task :streams:testSrcJar
[2023-03-03T21:15:02.301Z] > Task 
:streams:publishMavenJavaPublicationToMavenLocal
[2023-03-03T21:15:02.301Z] > Task :streams:publishToMavenLocal
[2023-03-03T21:15:02.301Z] 
[2023-03-03T21:15:02.301Z] Deprecated Gradle features were used in this build, 
making it incompatible with Gradle 9.0.
[2023-03-03T21:15:02.301Z] 
[2023-03-03T21:15:02.301Z] You can use '--warning-mode all' to show the 
individual deprecation warnings and determine if they come from your own 
scripts or plugins.
[2023-03-03T21:15:02.301Z] 
[2023-03-03T21:15:02.301Z] See 
https://docs.gradle.org/8.0.1/userguide/command_line_interface.html#sec:command_line_warnings

[GitHub] [kafka-site] mjsax commented on pull request #410: KAFKA-13882 Docker to preview docs locally

2023-03-03 Thread via GitHub


mjsax commented on PR #410:
URL: https://github.com/apache/kafka-site/pull/410#issuecomment-1454128799

   I just checkout the PR locally and it worked for me -- did you update your 
local copy after the latest changes?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org



Re: [DISCUSS] KIP-882: Make Kafka Connect REST API request timeouts configurable

2023-03-03 Thread Greg Harris
Yash,

1.
Currently the request parameters in the REST API are individual and pertain
to just one endpoint.
They also change the content of the query result, or change the action
taken on the cluster.
I think that a request timeout is a property of the HTTP request more than
it is a property of the cluster query or cluster action.
The two solutions have very similar tradeoffs, but I'm interested in
whether one is more idiomatic and more obvious to users.

2.
I understand that only these three endpoints are in need of increased
timeouts at this time due to long connector validations.
>From another perspective, this change is making the API more irregular and
someone in the future might choose to make it more regular by standardizing
the configurable timeout functionality.
I wouldn't (in this KIP) dismiss someone's desire to configure other
timeouts in the future (in another KIP), and design them into a corner.
It is acceptable to limit the scope of this change to just the three
endpoints due to practical reasons, but I don't think that should prevent
us from trying to ensure that this design fits in the "end goal" state of
the Connect service.

3. 4.
I am not suggesting an incompatible change, as the current synchronous
behavior is still a useful API for certain situations. I think that it is
possible to add asynchronous validations in a backwards compatible way,
using new endpoints or other new request parameters.
The interface could be designed such that users with connectors that exceed
the synchronous timeouts can utilize the asynchronous API. Tooling can use
the asynchronous API when it is available, and fall back to the synchronous
API when it is not.
I think that it also may be more in-line with the design of the rest of the
REST API, where nearly every other request is asynchronous. That's why
you're only targeting these three endpoints, they're the only ones with a
synchronicity constraint.
Again, I'm not necessarily saying that you must implement such an
asynchronous validation scheme in this KIP, but we should consider if that
is a more extensible solution. If we decided to implement configurable
synchronous timeouts now, how would that complement an asynchronous API in
the future?

On Thu, Mar 2, 2023 at 10:00 PM Yash Mayya  wrote:

> Hi Greg,
>
> Thanks for taking a look!
>
> 1. I believe Chris suggested the use of a query parameter above as we
> already have precedents for using query parameters to configure per request
> behavior in Kafka Connect (the restart connectors API and the get
> connectors API for instance). Also, the limited choice of endpoints
> targeted is intentional (see my reply to the next point).
>
> 2. I intentionally targeted just the three listed endpoints where
> synchronous connector config validations come into the picture. This is
> because of the legitimate cases where config validation for specific
> connector plugins might exceed the default request timeout in edge case
> scenarios (outlined in the KIP's motivation section). Other Connect REST
> endpoints shouldn't be taking longer than the default 90 second request
> timeout; if they do so, it would either be indicative of a bug in the
> Connect framework or a cluster health issue - neither of which should be
> covered up by manually setting a longer request timeout.
>
> 3. 4. I think changing the config validation behavior would be a backward
> incompatible change and I wanted to avoid that in this particular KIP.
> There are multiple programmatic UIs out there which rely on the current
> synchronous config validation behavior and breaking the existing contract
> would definitely require a larger discussion.
>
> Thanks,
> Yash
>
> On Fri, Mar 3, 2023 at 12:04 AM Greg Harris 
> wrote:
>
> > Hey Yash,
> >
> > Thanks for the KIP, and sorry for the late review.
> >
> > 1. Have you considered a HTTP header to provide the client-configurable
> > timeout? A header might more naturally extend to all of the other
> endpoints
> > in the future, rather than duplicating the query parameter across
> > endpoints.
> >
> > 2. I understand that this change is targeted at just long duration
> > Connector::validation calls, is that due to voluntary scope constraints?
> > Implementing configurable timeouts for all endpoints in a uniform way
> could
> > be desirable, even if the default timeout will work for nearly all of the
> > other calls.
> >
> > 3. Did you consider adding asynchronous validation as a user-facing
> > feature? I think that relying on the synchronous validation results in a
> > single HTTP request is a bit of an anti-pattern, and one that we've
> > inherited from the original REST design. It seems useful when using the
> > REST API by hand, but seems to be a liability when used in environments
> > with an external management layer.
> >
> > 4. Perhaps rather than allowing synchronous calls to Connector:validate
> to
> > increase in duration, we should provide a way for connectors to surface
> > validation problems 

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.4 #93

2023-03-03 Thread Apache Jenkins Server
See 




Re: [VOTE] KIP-875: First-class offsets support in Kafka Connect

2023-03-03 Thread Chris Egerton
Hi all,

Thanks for the votes! I'll cast a final +1 myself and close the vote out.

This KIP passes with the following +1 votes (and no +0 or -1 votes):

• Greg Harris
• Yash Mayya
• Knowles Atchison Jr
• Mickael Maison (binding)
• Tom Bentley (binding)
• Josep Prat (binding)
• Chris Egerton (binding, author)

I'll write up Jira tickets and begin implementing things next week.

Cheers,

Chris

On Fri, Mar 3, 2023 at 10:07 AM Josep Prat 
wrote:

> Hi Chris,
>
> Thanks for the KIP. I have a non-blocking comment on the DISCUSS thread.
>
> +1 (binding).
>
> Best,
>
> On Wed, Mar 1, 2023 at 12:16 PM Tom Bentley  wrote:
>
> > Hi Chris,
> >
> > Thanks for the KIP.
> >
> > +1 (binding).
> >
> > Cheers,
> >
> > Tom
> >
> > On Wed, 15 Feb 2023 at 16:11, Chris Egerton 
> > wrote:
> >
> > > Hi all,
> > >
> > > Thanks to everyone who's voted so far! Just wanted to bump this thread
> > and
> > > see if we could get a few more votes; currently we're at +3 non-binding
> > > and +1 binding. Hoping we can get this approved, reviewed, and merged
> in
> > > time for 3.5.0.
> > >
> > > Cheers,
> > >
> > > Chris
> > >
> > > On Tue, Jan 31, 2023 at 2:52 AM Mickael Maison <
> mickael.mai...@gmail.com
> > >
> > > wrote:
> > >
> > > > Thanks Chris for the KIP, this is a much needed feature!
> > > >
> > > > +1 (binding)
> > > >
> > > >
> > > > On Tue, Jan 24, 2023 at 3:45 PM Knowles Atchison Jr
> > > >  wrote:
> > > > >
> > > > > +1 (non binding)
> > > > >
> > > > > On Tue, Jan 24, 2023 at 5:24 AM Yash Mayya 
> > > wrote:
> > > > >
> > > > > > Hi Chris,
> > > > > >
> > > > > > I'm +1 (non-binding). Thanks again for proposing this extremely
> > > > > > valuable addition to Kafka Connect!
> > > > > >
> > > > > > Thanks,
> > > > > > Yash
> > > > > >
> > > > > > On Thu, Jan 19, 2023 at 12:11 AM Chris Egerton
> > >  > > > >
> > > > > > wrote:
> > > > > >
> > > > > > > Hi all,
> > > > > > >
> > > > > > > I'd like to call for a vote on KIP-875, which adds support for
> > > > viewing
> > > > > > and
> > > > > > > manipulating the offsets of connectors to the Kafka Connect
> REST
> > > API.
> > > > > > >
> > > > > > > The KIP:
> > > > > > >
> > > > > > >
> > > > > >
> > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect
> > > > > > >
> > > > > > > The discussion thread:
> > > > > > >
> https://lists.apache.org/thread/m5bklnh5w4mwr9nbzrmfk0pftpxfjd02
> > > > > > >
> > > > > > > Cheers,
> > > > > > >
> > > > > > > Chris
> > > > > > >
> > > > > >
> > > >
> > >
> >
>
>
> --
> [image: Aiven] 
>
> *Josep Prat*
> Open Source Engineering Director, *Aiven*
> josep.p...@aiven.io   |   +491715557497
> aiven.io    |    >
>      <
> https://twitter.com/aiven_io>
> *Aiven Deutschland GmbH*
> Alexanderufer 3-7, 10117 Berlin
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> Amtsgericht Charlottenburg, HRB 209739 B
>


Re: [VOTE] KIP-875: First-class offsets support in Kafka Connect

2023-03-03 Thread Josep Prat
Hi Chris,

Thanks for the KIP. I have a non-blocking comment on the DISCUSS thread.

+1 (binding).

Best,

On Wed, Mar 1, 2023 at 12:16 PM Tom Bentley  wrote:

> Hi Chris,
>
> Thanks for the KIP.
>
> +1 (binding).
>
> Cheers,
>
> Tom
>
> On Wed, 15 Feb 2023 at 16:11, Chris Egerton 
> wrote:
>
> > Hi all,
> >
> > Thanks to everyone who's voted so far! Just wanted to bump this thread
> and
> > see if we could get a few more votes; currently we're at +3 non-binding
> > and +1 binding. Hoping we can get this approved, reviewed, and merged in
> > time for 3.5.0.
> >
> > Cheers,
> >
> > Chris
> >
> > On Tue, Jan 31, 2023 at 2:52 AM Mickael Maison  >
> > wrote:
> >
> > > Thanks Chris for the KIP, this is a much needed feature!
> > >
> > > +1 (binding)
> > >
> > >
> > > On Tue, Jan 24, 2023 at 3:45 PM Knowles Atchison Jr
> > >  wrote:
> > > >
> > > > +1 (non binding)
> > > >
> > > > On Tue, Jan 24, 2023 at 5:24 AM Yash Mayya 
> > wrote:
> > > >
> > > > > Hi Chris,
> > > > >
> > > > > I'm +1 (non-binding). Thanks again for proposing this extremely
> > > > > valuable addition to Kafka Connect!
> > > > >
> > > > > Thanks,
> > > > > Yash
> > > > >
> > > > > On Thu, Jan 19, 2023 at 12:11 AM Chris Egerton
> >  > > >
> > > > > wrote:
> > > > >
> > > > > > Hi all,
> > > > > >
> > > > > > I'd like to call for a vote on KIP-875, which adds support for
> > > viewing
> > > > > and
> > > > > > manipulating the offsets of connectors to the Kafka Connect REST
> > API.
> > > > > >
> > > > > > The KIP:
> > > > > >
> > > > > >
> > > > >
> > >
> >
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect
> > > > > >
> > > > > > The discussion thread:
> > > > > > https://lists.apache.org/thread/m5bklnh5w4mwr9nbzrmfk0pftpxfjd02
> > > > > >
> > > > > > Cheers,
> > > > > >
> > > > > > Chris
> > > > > >
> > > > >
> > >
> >
>


-- 
[image: Aiven] 

*Josep Prat*
Open Source Engineering Director, *Aiven*
josep.p...@aiven.io   |   +491715557497
aiven.io    |   
     
*Aiven Deutschland GmbH*
Alexanderufer 3-7, 10117 Berlin
Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
Amtsgericht Charlottenburg, HRB 209739 B


[jira] [Created] (KAFKA-14776) Update SCRAM system tests to run with KRaft

2023-03-03 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-14776:
-

 Summary: Update SCRAM system tests to run with KRaft
 Key: KAFKA-14776
 URL: https://issues.apache.org/jira/browse/KAFKA-14776
 Project: Kafka
  Issue Type: Improvement
  Components: kraft
Reporter: Proven Provenzano
Assignee: Proven Provenzano


I will update the SCRAM system tests to run under both ZK and KRaft quorum mode.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


[jira] [Created] (KAFKA-14775) Support SCRAM for broker to controller authentication

2023-03-03 Thread Proven Provenzano (Jira)
Proven Provenzano created KAFKA-14775:
-

 Summary: Support SCRAM for broker to controller authentication
 Key: KAFKA-14775
 URL: https://issues.apache.org/jira/browse/KAFKA-14775
 Project: Kafka
  Issue Type: Improvement
  Components: kraft
Reporter: Proven Provenzano
Assignee: Proven Provenzano


We need to apply SCRAM changes to controller nodes.

We need to handle DescribeUserScramCredentialsRequest in the controller nodes.

As part of this update I will split out the code from 
{{BrokerMetadataPublisher.scala}} for applying the SCRAM  into a separate 
{{{}MetadataPublisher{}}}, as we did with {{DynamicConfigPublisher}}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #1643

2023-03-03 Thread Apache Jenkins Server
See 


Changes:


--
[...truncated 449539 lines...]
[2023-03-03T14:04:52.372Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > ZkMigrationClientTest > testIdempotentCreateTopics() STARTED
[2023-03-03T14:04:52.372Z] 
[2023-03-03T14:04:52.372Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > ZkMigrationClientTest > testIdempotentCreateTopics() PASSED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > ZkMigrationClientTest > testWriteExistingClientQuotas() STARTED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > ZkMigrationClientTest > testWriteExistingClientQuotas() PASSED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > AllocateProducerIdsRequestTest > 
testAllocateProducersIdSentToController() > 
unit.kafka.server.AllocateProducerIdsRequestTest.testAllocateProducersIdSentToController()[1]
 STARTED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > AllocateProducerIdsRequestTest > 
testAllocateProducersIdSentToController() > 
unit.kafka.server.AllocateProducerIdsRequestTest.testAllocateProducersIdSentToController()[1]
 PASSED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > AllocateProducerIdsRequestTest > 
testAllocateProducersIdSentToNonController() > 
unit.kafka.server.AllocateProducerIdsRequestTest.testAllocateProducersIdSentToNonController()[1]
 STARTED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 174 > AllocateProducerIdsRequestTest > 
testAllocateProducersIdSentToNonController() > 
unit.kafka.server.AllocateProducerIdsRequestTest.testAllocateProducersIdSentToNonController()[1]
 PASSED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] > Task :streams:integrationTest
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 176 > PauseResumeIntegrationTest > 
shouldAllowForNamedTopologiesToStartPaused(boolean) > 
org.apache.kafka.streams.integration.PauseResumeIntegrationTest.shouldAllowForNamedTopologiesToStartPaused(boolean)[1]
 PASSED
[2023-03-03T14:04:52.373Z] 
[2023-03-03T14:04:52.373Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 176 > PauseResumeIntegrationTest > 
shouldAllowForNamedTopologiesToStartPaused(boolean) > 
org.apache.kafka.streams.integration.PauseResumeIntegrationTest.shouldAllowForNamedTopologiesToStartPaused(boolean)[2]
 STARTED
[2023-03-03T14:04:59.720Z] 
[2023-03-03T14:04:59.720Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 176 > StoreQueryIntegrationTest > 
shouldQueryStoresAfterAddingAndRemovingStreamThread() PASSED
[2023-03-03T14:04:59.720Z] 
[2023-03-03T14:04:59.720Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 176 > StoreQueryIntegrationTest > 
shouldQuerySpecificStalePartitionStoresMultiStreamThreadsNamedTopology() STARTED
[2023-03-03T14:05:00.230Z] 
[2023-03-03T14:05:00.230Z] Gradle Test Run :streams:integrationTest > Gradle 
Test Executor 176 > PauseResumeIntegrationTest > 
shouldAllowForNamedTopologiesToStartPaused(boolean) > 
org.apache.kafka.streams.integration.PauseResumeIntegrationTest.shouldAllowForNamedTopologiesToStartPaused(boolean)[2]
 PASSED
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] > Task :core:integrationTest
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 173 > KafkaZkClientTest > testControllerManagementMethods() PASSED
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 173 > KafkaZkClientTest > testTopicAssignmentMethods() STARTED
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 173 > KafkaZkClientTest > testTopicAssignmentMethods() PASSED
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 173 > KafkaZkClientTest > testConnectionViaNettyClient() STARTED
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 173 > KafkaZkClientTest > testConnectionViaNettyClient() PASSED
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 173 > KafkaZkClientTest > testPropagateIsrChanges() STARTED
[2023-03-03T14:05:01.759Z] 
[2023-03-03T14:05:01.759Z] Gradle Test Run :core:integrationTest > Gradle Test 
Executor 173 > KafkaZkClientTest > 

Re: [DISCUSS] KIP-641 An new java interface to replace 'kafka.common.MessageReader'

2023-03-03 Thread Chia-Ping Tsai
Dear all,

there are some changes for KIP-614 

https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=158866569

1) the interface RecordReader extends Configurable.
2) the input stream is removed from RecordReader#configure method
3) RecordReader#readRecords accept InputStream as argument, and the returned 
type is changed from single ProducerRecord to Iterator

Please take a look and then start to vote if you have free time. thanks.

vote: https://lists.apache.org/thread/kjdtyfg5xytn60q0qvxhfopzmfp9tsxr


[jira] [Resolved] (KAFKA-14745) MirrorSourceConnector keeps creating ReplicationPolicy instances

2023-03-03 Thread Mickael Maison (Jira)


 [ 
https://issues.apache.org/jira/browse/KAFKA-14745?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Mickael Maison resolved KAFKA-14745.

Fix Version/s: 3.5.0
   Resolution: Fixed

> MirrorSourceConnector keeps creating ReplicationPolicy instances
> 
>
> Key: KAFKA-14745
> URL: https://issues.apache.org/jira/browse/KAFKA-14745
> Project: Kafka
>  Issue Type: Improvement
>  Components: mirrormaker
>Reporter: Mickael Maison
>Assignee: Mickael Maison
>Priority: Major
> Fix For: 3.5.0
>
>
> In MirrorSourceConnector.findTargetTopicPartitions() we call 
> MirrorSourceConfig.checkpointsTopic() for each remote topic or all topics 
> when using IdentityReplicationPolicy.
> The issue is that checkpointsTopic() calls 
> MirrorSourceConfig.replicationPolicy() which always creates a new instance of 
> the ReplicationPolicy.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)


Re: [VOTE] KIP-904: Kafka Streams - Guarantee subtractor is called before adder if key has not changed

2023-03-03 Thread Lucas Brutschy
+1 (non-binding)

Thanks!

On Wed, Mar 1, 2023 at 9:03 PM Matthias J. Sax  wrote:
>
> +1 (binding)
>
> Thanks for the KIP!
>
> On 3/1/23 10:58 AM, Walker Carlson wrote:
> > +1 Binding
> >
> > On Mon, Feb 27, 2023 at 12:48 PM Guozhang Wang 
> > wrote:
> >
> >> +1.
> >>
> >> On Sun, Feb 26, 2023 at 4:27 PM Fq Public  wrote:
> >>>
> >>> Hi everyone,
> >>>
> >>> I'd like to start the vote on KIP-904: Kafka Streams - Guarantee
> >> subtractor
> >>> is called before adder if key has not changed.
> >>> The KIP is available here: https://cwiki.apache.org/confluence/x/P5VbDg
> >>> The easiest way to view the entire discussion thread is via this search
> >>> link: https://lists.apache.org/list?dev@kafka.apache.org:lte=1M:KIP-904
> >>> Please take a look and vote.
> >>>
> >>> Thank you,
> >>> Farooq
> >>
> >