Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #451

2021-09-06 Thread Apache Jenkins Server
See 


Changes:


--
[...truncated 490568 lines...]
[2021-09-07T05:32:43.003Z] 
[2021-09-07T05:32:43.003Z] FetchRequestBetweenDifferentIbpTest > 
testControllerOldToNewIBP() STARTED
[2021-09-07T05:32:48.781Z] > Task :core:compileTestScala
[2021-09-07T05:32:57.695Z] 
[2021-09-07T05:32:57.695Z] FetchRequestBetweenDifferentIbpTest > 
testControllerOldToNewIBP() PASSED
[2021-09-07T05:32:57.695Z] 
[2021-09-07T05:32:57.695Z] FetchRequestBetweenDifferentIbpTest > 
testControllerNewIBP() STARTED
[2021-09-07T05:33:06.177Z] 
[2021-09-07T05:33:06.177Z] FetchRequestBetweenDifferentIbpTest > 
testControllerNewIBP() PASSED
[2021-09-07T05:33:06.177Z] 
[2021-09-07T05:33:06.177Z] FetchRequestBetweenDifferentIbpTest > 
testControllerOldIBP() STARTED
[2021-09-07T05:33:17.179Z] 
[2021-09-07T05:33:17.179Z] FetchRequestBetweenDifferentIbpTest > 
testControllerOldIBP() PASSED
[2021-09-07T05:33:17.179Z] 
[2021-09-07T05:33:17.179Z] FetchRequestBetweenDifferentIbpTest > 
testControllerNewToOldIBP() STARTED
[2021-09-07T05:33:31.657Z] > Task :core:testClasses
[2021-09-07T05:33:34.017Z] 
[2021-09-07T05:33:34.017Z] FetchRequestBetweenDifferentIbpTest > 
testControllerNewToOldIBP() PASSED
[2021-09-07T05:33:35.304Z] 
[2021-09-07T05:33:35.304Z] 1345 tests completed, 1 failed, 7 skipped
[2021-09-07T05:33:35.304Z] There were failing tests. See the report at: 
file:///home/jenkins/workspace/Kafka_kafka_trunk/core/build/reports/tests/integrationTest/index.html
[2021-09-07T05:33:35.304Z] 
[2021-09-07T05:33:35.304Z] Deprecated Gradle features were used in this build, 
making it incompatible with Gradle 8.0.
[2021-09-07T05:33:35.304Z] 
[2021-09-07T05:33:35.304Z] You can use '--warning-mode all' to show the 
individual deprecation warnings and determine if they come from your own 
scripts or plugins.
[2021-09-07T05:33:35.304Z] 
[2021-09-07T05:33:35.304Z] See 
https://docs.gradle.org/7.2/userguide/command_line_interface.html#sec:command_line_warnings
[2021-09-07T05:33:35.304Z] 
[2021-09-07T05:33:35.304Z] BUILD SUCCESSFUL in 1h 53m 25s
[2021-09-07T05:33:35.304Z] 202 actionable tasks: 109 executed, 93 up-to-date
[2021-09-07T05:33:36.391Z] 
[2021-09-07T05:33:36.391Z] See the profiling report at: 
file:///home/jenkins/workspace/Kafka_kafka_trunk/build/reports/profile/profile-2021-09-07-03-40-16.html
[2021-09-07T05:33:36.391Z] A fine-grained performance profile is available: use 
the --scan option.
[Pipeline] junit
[2021-09-07T05:33:37.257Z] Recording test results
[2021-09-07T05:33:45.602Z] > Task :streams:compileTestJava
[2021-09-07T05:33:45.602Z] > Task :streams:testClasses
[2021-09-07T05:33:45.602Z] > Task :streams:testJar
[2021-09-07T05:33:45.602Z] > Task :streams:testSrcJar
[2021-09-07T05:33:45.602Z] > Task 
:streams:publishMavenJavaPublicationToMavenLocal
[2021-09-07T05:33:45.602Z] > Task :streams:publishToMavenLocal
[2021-09-07T05:33:45.602Z] 
[2021-09-07T05:33:45.602Z] Deprecated Gradle features were used in this build, 
making it incompatible with Gradle 8.0.
[2021-09-07T05:33:45.602Z] 
[2021-09-07T05:33:45.602Z] You can use '--warning-mode all' to show the 
individual deprecation warnings and determine if they come from your own 
scripts or plugins.
[2021-09-07T05:33:45.602Z] 
[2021-09-07T05:33:45.602Z] See 
https://docs.gradle.org/7.2/userguide/command_line_interface.html#sec:command_line_warnings
[2021-09-07T05:33:45.602Z] 
[2021-09-07T05:33:45.602Z] Execution optimizations have been disabled for 3 
invalid unit(s) of work during this build to ensure correctness.
[2021-09-07T05:33:45.602Z] Please consult deprecation warnings for more details.
[2021-09-07T05:33:45.602Z] 
[2021-09-07T05:33:45.602Z] BUILD SUCCESSFUL in 3m 15s
[2021-09-07T05:33:45.602Z] 77 actionable tasks: 38 executed, 39 up-to-date
[Pipeline] sh
[2021-09-07T05:33:48.747Z] + grep ^version= gradle.properties
[2021-09-07T05:33:48.747Z] + cut -d= -f 2
[2021-09-07T05:33:50.560Z] [Checks API] No suitable checks publisher found.
[Pipeline] dir
[2021-09-07T05:33:50.566Z] Running in 
/home/jenkins/workspace/Kafka_kafka_trunk/streams/quickstart
[Pipeline] {
[Pipeline] echo
[2021-09-07T05:33:50.567Z] Skipping Kafka Streams archetype test for Java 17
[Pipeline] }
[Pipeline] sh
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // timestamps
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[2021-09-07T05:33:52.403Z] + mvn clean install -Dgpg.skip
[2021-09-07T05:33:53.348Z] [INFO] Scanning for projects...
[2021-09-07T05:33:53.348Z] [INFO] 

[2021-09-07T05:33:53.348Z] [INFO] Reactor Build Order:
[2021-09-07T05:33:53.349Z] [INFO] 
[2021-09-07T05:33:53.349Z] [INFO] Kafka Streams :: Quickstart   
 [pom]
[2021-09-07T05:33:53.349Z] [INFO] 

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #450

2021-09-06 Thread Apache Jenkins Server
See 


Changes:


--
[...truncated 417229 lines...]
[2021-09-06T21:39:10.993Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfStableConsumerGroupWithTopicPartition() PASSED
[2021-09-06T21:39:10.993Z] 
[2021-09-06T21:39:10.993Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsNonExistingGroup() STARTED
[2021-09-06T21:39:12.737Z] 
[2021-09-06T21:39:12.737Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsNonExistingGroup() PASSED
[2021-09-06T21:39:12.737Z] 
[2021-09-06T21:39:12.737Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfStableConsumerGroupWithUnknownTopicOnly() STARTED
[2021-09-06T21:39:16.299Z] 
[2021-09-06T21:39:16.299Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfStableConsumerGroupWithUnknownTopicOnly() PASSED
[2021-09-06T21:39:16.299Z] 
[2021-09-06T21:39:16.299Z] TopicCommandIntegrationTest > 
testAlterPartitionCount() STARTED
[2021-09-06T21:39:20.896Z] 
[2021-09-06T21:39:20.896Z] TopicCommandIntegrationTest > 
testAlterPartitionCount() PASSED
[2021-09-06T21:39:20.896Z] 
[2021-09-06T21:39:20.896Z] TopicCommandIntegrationTest > 
testCreatePartitionsDoesNotRetryThrottlingQuotaExceededException() STARTED
[2021-09-06T21:39:24.460Z] 
[2021-09-06T21:39:24.460Z] TopicCommandIntegrationTest > 
testCreatePartitionsDoesNotRetryThrottlingQuotaExceededException() PASSED
[2021-09-06T21:39:24.460Z] 
[2021-09-06T21:39:24.460Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExistWithIfExists() STARTED
[2021-09-06T21:39:27.077Z] 
[2021-09-06T21:39:27.077Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExistWithIfExists() PASSED
[2021-09-06T21:39:27.077Z] 
[2021-09-06T21:39:27.077Z] TopicCommandIntegrationTest > 
testCreateWithDefaultReplication() STARTED
[2021-09-06T21:39:35.469Z] 
[2021-09-06T21:39:35.469Z] TopicCommandIntegrationTest > 
testCreateWithDefaultReplication() PASSED
[2021-09-06T21:39:35.469Z] 
[2021-09-06T21:39:35.469Z] TopicCommandIntegrationTest > 
testDescribeAtMinIsrPartitions() STARTED
[2021-09-06T21:39:43.863Z] 
[2021-09-06T21:39:43.863Z] TopicCommandIntegrationTest > 
testDescribeAtMinIsrPartitions() PASSED
[2021-09-06T21:39:43.863Z] 
[2021-09-06T21:39:43.863Z] TopicCommandIntegrationTest > 
testCreateWithNegativeReplicationFactor() STARTED
[2021-09-06T21:39:48.457Z] 
[2021-09-06T21:39:48.457Z] TopicCommandIntegrationTest > 
testCreateWithNegativeReplicationFactor() PASSED
[2021-09-06T21:39:48.457Z] 
[2021-09-06T21:39:48.457Z] TopicCommandIntegrationTest > 
testCreateWithInvalidReplicationFactor() STARTED
[2021-09-06T21:39:51.075Z] 
[2021-09-06T21:39:51.075Z] TopicCommandIntegrationTest > 
testCreateWithInvalidReplicationFactor() PASSED
[2021-09-06T21:39:51.075Z] 
[2021-09-06T21:39:51.075Z] TopicCommandIntegrationTest > 
testDeleteTopicDoesNotRetryThrottlingQuotaExceededException() STARTED
[2021-09-06T21:39:54.638Z] 
[2021-09-06T21:39:54.638Z] TopicCommandIntegrationTest > 
testDeleteTopicDoesNotRetryThrottlingQuotaExceededException() PASSED
[2021-09-06T21:39:54.638Z] 
[2021-09-06T21:39:54.638Z] TopicCommandIntegrationTest > 
testListTopicsWithExcludeInternal() STARTED
[2021-09-06T21:40:00.367Z] 
[2021-09-06T21:40:00.367Z] TopicCommandIntegrationTest > 
testListTopicsWithExcludeInternal() PASSED
[2021-09-06T21:40:00.367Z] 
[2021-09-06T21:40:00.367Z] TopicCommandIntegrationTest > 
testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress() STARTED
[2021-09-06T21:40:03.929Z] 
[2021-09-06T21:40:03.929Z] TopicCommandIntegrationTest > 
testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress() PASSED
[2021-09-06T21:40:03.929Z] 
[2021-09-06T21:40:03.929Z] TopicCommandIntegrationTest > 
testCreateWithNegativePartitionCount() STARTED
[2021-09-06T21:40:08.523Z] 
[2021-09-06T21:40:08.523Z] TopicCommandIntegrationTest > 
testCreateWithNegativePartitionCount() PASSED
[2021-09-06T21:40:08.523Z] 
[2021-09-06T21:40:08.523Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExist() STARTED
[2021-09-06T21:40:12.084Z] 
[2021-09-06T21:40:12.084Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExist() PASSED
[2021-09-06T21:40:12.084Z] 
[2021-09-06T21:40:12.084Z] TopicCommandIntegrationTest > 
testCreateAlterTopicWithRackAware() STARTED
[2021-09-06T21:40:17.809Z] 
[2021-09-06T21:40:17.809Z] TopicCommandIntegrationTest > 
testCreateAlterTopicWithRackAware() PASSED
[2021-09-06T21:40:17.809Z] 
[2021-09-06T21:40:17.809Z] TopicCommandIntegrationTest > 
testListTopicsWithIncludeList() STARTED
[2021-09-06T21:40:21.373Z] 
[2021-09-06T21:40:21.373Z] TopicCommandIntegrationTest > 
testListTopicsWithIncludeList() PASSED
[2021-09-06T21:40:21.373Z] 
[2021-09-06T21:40:21.373Z] TopicCommandIntegrationTest > testTopicDeletion() 
STARTED
[2021-09-06T21:40:25.969Z] 
[2021-09-06T21:40:25.969Z] TopicCommandIntegrationTest > testTopicDeletion() 

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #449

2021-09-06 Thread Apache Jenkins Server
See 


Changes:


--
[...truncated 350869 lines...]
[Pipeline] {
[Pipeline] sh
[2021-09-06T19:42:42.531Z] 
[2021-09-06T19:42:42.532Z] SaslOAuthBearerSslEndToEndAuthorizationTest > 
testProduceConsumeWithPrefixedAcls() PASSED
[2021-09-06T19:42:42.532Z] 
[2021-09-06T19:42:42.532Z] SaslOAuthBearerSslEndToEndAuthorizationTest > 
testProduceConsumeViaAssign() STARTED
[2021-09-06T19:42:44.044Z] + echo Y
[2021-09-06T19:42:44.044Z] + mvn archetype:generate -DarchetypeCatalog=local 
-DarchetypeGroupId=org.apache.kafka 
-DarchetypeArtifactId=streams-quickstart-java -DarchetypeVersion=3.1.0-SNAPSHOT 
-DgroupId=streams.examples -DartifactId=streams.examples -Dversion=0.1 
-Dpackage=myapps
[2021-09-06T19:42:44.977Z] [INFO] Scanning for projects...
[2021-09-06T19:42:44.977Z] [INFO] 
[2021-09-06T19:42:44.977Z] [INFO] --< 
org.apache.maven:standalone-pom >---
[2021-09-06T19:42:44.977Z] [INFO] Building Maven Stub Project (No POM) 1
[2021-09-06T19:42:44.977Z] [INFO] [ pom 
]-
[2021-09-06T19:42:44.977Z] [INFO] 
[2021-09-06T19:42:44.977Z] [INFO] >>> maven-archetype-plugin:3.2.0:generate 
(default-cli) > generate-sources @ standalone-pom >>>
[2021-09-06T19:42:44.977Z] [INFO] 
[2021-09-06T19:42:44.977Z] [INFO] <<< maven-archetype-plugin:3.2.0:generate 
(default-cli) < generate-sources @ standalone-pom <<<
[2021-09-06T19:42:44.977Z] [INFO] 
[2021-09-06T19:42:44.977Z] [INFO] 
[2021-09-06T19:42:44.977Z] [INFO] --- maven-archetype-plugin:3.2.0:generate 
(default-cli) @ standalone-pom ---
[2021-09-06T19:42:45.910Z] [INFO] Generating project in Interactive mode
[2021-09-06T19:42:45.910Z] [WARNING] Archetype not found in any catalog. 
Falling back to central repository.
[2021-09-06T19:42:45.910Z] [WARNING] Add a repository with id 'archetype' in 
your settings.xml if archetype's repository is elsewhere.
[2021-09-06T19:42:45.910Z] [INFO] Using property: groupId = streams.examples
[2021-09-06T19:42:45.910Z] [INFO] Using property: artifactId = streams.examples
[2021-09-06T19:42:45.910Z] [INFO] Using property: version = 0.1
[2021-09-06T19:42:45.910Z] [INFO] Using property: package = myapps
[2021-09-06T19:42:45.910Z] Confirm properties configuration:
[2021-09-06T19:42:45.910Z] groupId: streams.examples
[2021-09-06T19:42:45.910Z] artifactId: streams.examples
[2021-09-06T19:42:45.910Z] version: 0.1
[2021-09-06T19:42:45.910Z] package: myapps
[2021-09-06T19:42:45.910Z]  Y: : [INFO] 

[2021-09-06T19:42:45.910Z] [INFO] Using following parameters for creating 
project from Archetype: streams-quickstart-java:3.1.0-SNAPSHOT
[2021-09-06T19:42:45.910Z] [INFO] 

[2021-09-06T19:42:45.910Z] [INFO] Parameter: groupId, Value: streams.examples
[2021-09-06T19:42:45.910Z] [INFO] Parameter: artifactId, Value: streams.examples
[2021-09-06T19:42:45.910Z] [INFO] Parameter: version, Value: 0.1
[2021-09-06T19:42:45.910Z] [INFO] Parameter: package, Value: myapps
[2021-09-06T19:42:45.910Z] [INFO] Parameter: packageInPathFormat, Value: myapps
[2021-09-06T19:42:45.910Z] [INFO] Parameter: package, Value: myapps
[2021-09-06T19:42:45.910Z] [INFO] Parameter: version, Value: 0.1
[2021-09-06T19:42:45.910Z] [INFO] Parameter: groupId, Value: streams.examples
[2021-09-06T19:42:45.910Z] [INFO] Parameter: artifactId, Value: streams.examples
[2021-09-06T19:42:45.910Z] [INFO] Project created from Archetype in dir: 
/home/jenkins/workspace/Kafka_kafka_trunk/streams/quickstart/test-streams-archetype/streams.examples
[2021-09-06T19:42:45.910Z] [INFO] 

[2021-09-06T19:42:45.910Z] [INFO] BUILD SUCCESS
[2021-09-06T19:42:45.910Z] [INFO] 

[2021-09-06T19:42:45.910Z] [INFO] Total time:  1.196 s
[2021-09-06T19:42:45.910Z] [INFO] Finished at: 2021-09-06T19:42:45Z
[2021-09-06T19:42:45.910Z] [INFO] 

[Pipeline] dir
[2021-09-06T19:42:46.423Z] Running in 
/home/jenkins/workspace/Kafka_kafka_trunk/streams/quickstart/test-streams-archetype/streams.examples
[Pipeline] {
[Pipeline] sh
[2021-09-06T19:42:48.558Z] + mvn compile
[2021-09-06T19:42:49.486Z] 
[2021-09-06T19:42:49.486Z] SaslOAuthBearerSslEndToEndAuthorizationTest > 
testProduceConsumeViaAssign() PASSED
[2021-09-06T19:42:49.486Z] 
[2021-09-06T19:42:49.486Z] SaslOAuthBearerSslEndToEndAuthorizationTest > 
testNoConsumeWithDescribeAclViaAssign() STARTED
[2021-09-06T19:42:49.657Z] [INFO] Scanning for projects...
[2021-09-06T19:42:49.657Z] [INFO] 
[2021-09-06T19:42:49.657Z] [INFO] -< 
streams.examples:streams.examples >--

Re: [VOTE] KIP-773 Differentiate consistently metric latency measured in millis and nanos

2021-09-06 Thread Josep Prat
Hi there,
Thanks for participating in the discussion and voting.
I'm closing this vote with *three* binding +1 and zero -1 votes.

Binding +1
- Guozhang
- Bruno
- Tom
Non-Binding +1
- Josep
- Luke
- Sagar

I'll submit the PR right away.

Thanks again,

On Mon, Sep 6, 2021 at 3:14 PM Tom Bentley  wrote:

> +1 (binding).
>
> Thanks Josep!
>
> On Mon, Sep 6, 2021 at 1:51 PM Bruno Cadonna  wrote:
>
> > Thanks, Josep!
> >
> > +1 (binding)
> >
> > Best,
> > Bruno
> >
> > On 04.09.21 05:55, Sagar wrote:
> > > Looks good to me.
> > >
> > > +1(non-binding)
> > >
> > > Sagar.
> > >
> > > On Sat, 4 Sep 2021 at 8:15 AM, Luke Chen  wrote:
> > >
> > >> Thanks for the KIP.
> > >>
> > >> +1 (non-binding)
> > >>
> > >> Thanks.
> > >> Luke
> > >>
> > >> On Sat, Sep 4, 2021 at 10:32 AM Guozhang Wang 
> > wrote:
> > >>
> > >>> Thanks Josep,
> > >>>
> > >>> Took a look at the KIP, LGTM.
> > >>>
> > >>> On Fri, Sep 3, 2021 at 11:25 AM Josep Prat
>  > >
> > >>> wrote:
> > >>>
> >  Hi there,
> > 
> >  Since it's a rather small KIP, I'd like to start a vote for the
> > KIP-773
> >  Differentiate consistently metric latency measured  in millis and
> > >> nanos.
> >  The KIP page The KIP can be found at:
> >  https://cwiki.apache.org/confluence/x/ZwNACw
> > 
> >  Thanks in advance,
> > 
> >  --
> > 
> >  Josep Prat
> > 
> >  *Aiven Deutschland GmbH*
> > 
> >  Immanuelkirchstraße 26, 10405 Berlin
> > 
> >  Amtsgericht Charlottenburg, HRB 209739 B
> > 
> >  Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> > 
> >  *m:* +491715557497
> > 
> >  *w:* aiven.io
> > 
> >  *e:* josep.p...@aiven.io
> > 
> > >>>
> > >>>
> > >>> --
> > >>> -- Guozhang
> > >>>
> > >>
> > >
> >
> >
>


-- 

Josep Prat

*Aiven Deutschland GmbH*

Immanuelkirchstraße 26, 10405 Berlin

Amtsgericht Charlottenburg, HRB 209739 B

Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen

*m:* +491715557497

*w:* aiven.io

*e:* josep.p...@aiven.io


Jenkins build became unstable: Kafka » Kafka Branch Builder » 3.0 #124

2021-09-06 Thread Apache Jenkins Server
See 




Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #448

2021-09-06 Thread Apache Jenkins Server
See 




Re: [Suspected Spam] Re: [VOTE] 3.0.0 RC1

2021-09-06 Thread Tom Bentley
Hi Konstantine,

I just noticed that the new public DescribeConsumerGroupsResult constructor
refers to the non-public API KafkaFutureImpl. If the constructor has to be
public I think it should use the public KafkaFuture. TBH I don't know if
we'd consider a change to the signature after 3.0 to be a compatibility
break given that KafkaFutureImpl is non-public, so people shouldn't be
using it. I opened https://issues.apache.org/jira/browse/KAFKA-13276 and
tagged it as a 3.0 blocker, but if you disagree feel free to remove. PR to
remove use a KafkaFutureImpl from all *Result class constructors available:
https://github.com/apache/kafka/pull/11301

Kind regards,

Tom



On Fri, Sep 3, 2021 at 5:10 PM Gary Russell  wrote:

> This [1] is a blocker for me.
>
> Also, the documentation link [2] returns a 404.
>
> [1]: https://issues.apache.org/jira/browse/KAFKA-13262
> [2]: https://kafka.apache.org/30/documentation.html
> 
> From: Ron Dagostino 
> Sent: Thursday, September 2, 2021 9:16 PM
> To: dev@kafka.apache.org 
> Cc: Users ; kafka-clients <
> kafka-clie...@googlegroups.com>
> Subject: [Suspected Spam] Re: [VOTE] 3.0.0 RC1
>
> Hi Konstantine.  I have opened a probable blocker ticket
>
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FKAFKA-13270data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=DmGTJeScZXxP5WoszUhdqsJodj%2FCiHuFPXhSwkedR%2BI%3Dreserved=0.
> I will work on a PR
> shortly.  The description on that ticket is as follows:
>
> The implementation of
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fissues.apache.org%2Fjira%2Fbrowse%2FZOOKEEPER-3593data=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=5LV9W5CWAQD%2BnnBIcRXXsLUjhN6%2BqQ8ZjSNEZOlprOg%3Dreserved=0
> in
> ZooKeeper version 3.6.0 decreased the default value for the ZooKeeper
> client's `jute.maxbuffer` configuration from 4MB to 1MB. This can cause a
> problem if Kafka tries to retrieve a large amount of data across many
> znodes – in such a case the ZooKeeper client will repeatedly emit a message
> of the form "java.io.IOException: Packet len <> is out of range" and
> the Kafka broker will never connect to ZooKeeper and fail to make progress
> on the startup sequence. We can avoid the potential for this issue to occur
> by explicitly setting the value to 4MB whenever we create a new ZooKeeper
> client as long as no explicit value has been set via the `jute.maxbuffer`
> system property.
>
> Ron
>
> On Thu, Sep 2, 2021 at 5:52 PM Israel Ekpo  wrote:
>
> > Magnus,
> >
> > Please could you share the machine and network specs?
> >
> > How much CPU, RAM is available on each node?
> >
> > What JDK, JRE version are you using?
> >
> > What are your broker and client configuration values? Please could you
> > share this info if possible?
> >
> > Thanks.
> >
> >
> >
> > On Wed, Sep 1, 2021 at 10:25 AM Magnus Edenhill 
> > wrote:
> >
> > > Hi Konstantine,
> > >
> > > Some findings from running 3.0.0-RC1 with the librdkafka test suite:
> > >
> > > * Compaction seems to take slightly longer to kick in when segment
> sizes
> > >   exceed their threshold. (Used to take less than 20 seconds, now takes
> > > 20..30 seconds.)
> > >
> > > * CreateTopic seems to take slightly longer to propagate through the
> > > cluster,
> > >   e.g., before a new topic is available in metadata from other brokers.
> > >
> > > * CreateTopics seems to take longer when the Admin request timeout is
> > set,
> > >   looks like a plateau at 10 seconds:
> > >
> https://nam04.safelinks.protection.outlook.com/?url=https%3A%2F%2Fimgur.com%2Fa%2Fn6y76sjdata=04%7C01%7Cgrussell%40vmware.com%7C54b3dbe5cc6049a3ad8708d96e788b42%7Cb39138ca3cee4b4aa4d6cd83d9dd62f0%7C0%7C1%7C637662286287405487%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000sdata=1wARQVJ%2BycVR1GLla70EbZ9o4hPNpmey4wpGcWfzHvI%3Dreserved=0
> > >
> > > (This is a 3 broker cluster with identical configs between 2.8 and
> > 3.0.0.)
> > >
> > > Nothing critical, but could be an indication of regression so I thought
> > I'd
> > > mention it.
> > >
> > > Regards,
> > > Magnus
> > >
> > >
> > > Den tis 31 aug. 2021 kl 17:51 skrev Konstantine Karantasis <
> > > kkaranta...@apache.org>:
> > >
> > > > Small correction to my previous email.
> > > > The actual link for public preview of the 3.0.0 blog post draft is:
> > > >
> > > >
> > >
> >
> 

[jira] [Resolved] (KAFKA-13270) Kafka may fail to connect to ZooKeeper, retry forever, and never start

2021-09-06 Thread Ismael Juma (Jira)


 [ 
https://issues.apache.org/jira/browse/KAFKA-13270?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Ismael Juma resolved KAFKA-13270.
-
  Assignee: Ismael Juma  (was: Ron Dagostino)
Resolution: Fixed

> Kafka may fail to connect to ZooKeeper, retry forever, and never start
> --
>
> Key: KAFKA-13270
> URL: https://issues.apache.org/jira/browse/KAFKA-13270
> Project: Kafka
>  Issue Type: Bug
>Affects Versions: 3.0.0
>Reporter: Ron Dagostino
>Assignee: Ismael Juma
>Priority: Blocker
> Fix For: 3.0.0
>
>
> The implementation of https://issues.apache.org/jira/browse/ZOOKEEPER-3593 in 
> ZooKeeper version 3.6.0 decreased the default value for the ZooKeeper 
> client's `jute.maxbuffer` configuration from 4MB to 1MB.  This can cause a 
> problem if Kafka tries to retrieve a large amount of data across many znodes 
> -- in such a case the ZooKeeper client will repeatedly emit a message of the 
> form "java.io.IOException: Packet len <> is out of range" and the Kafka 
> broker will never connect to ZooKeeper and fail to make progress on the 
> startup sequence.  We can avoid the potential for this issue to occur by 
> explicitly setting the value to 4MB whenever we create a new ZooKeeper client 
> as long as no explicit value has been set via the `jute.maxbuffer` system 
> property.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


[jira] [Created] (KAFKA-13276) Public DescribeConsumerGroupsResult constructor refers to KafkaFutureImpl

2021-09-06 Thread Tom Bentley (Jira)
Tom Bentley created KAFKA-13276:
---

 Summary: Public DescribeConsumerGroupsResult constructor refers to 
KafkaFutureImpl
 Key: KAFKA-13276
 URL: https://issues.apache.org/jira/browse/KAFKA-13276
 Project: Kafka
  Issue Type: Bug
Affects Versions: 3.0.0
Reporter: Tom Bentley


The new public DescribeConsumerGroupsResult constructor refers to the 
non-public API KafkaFutureImpl



--
This message was sent by Atlassian Jira
(v8.3.4#803005)


Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #447

2021-09-06 Thread Apache Jenkins Server
See 


Changes:


--
[...truncated 490557 lines...]
[2021-09-06T14:02:56.758Z] 
[2021-09-06T14:02:56.758Z] PlaintextConsumerTest > 
testConsumeMessagesWithCreateTime() PASSED
[2021-09-06T14:02:56.758Z] 
[2021-09-06T14:02:56.758Z] PlaintextConsumerTest > testAsyncCommit() STARTED
[2021-09-06T14:03:01.417Z] 
[2021-09-06T14:03:01.417Z] PlaintextConsumerTest > testAsyncCommit() PASSED
[2021-09-06T14:03:01.417Z] 
[2021-09-06T14:03:01.417Z] PlaintextConsumerTest > 
testLowMaxFetchSizeForRequestAndPartition() STARTED
[2021-09-06T14:03:32.682Z] 
[2021-09-06T14:03:32.682Z] PlaintextConsumerTest > 
testLowMaxFetchSizeForRequestAndPartition() PASSED
[2021-09-06T14:03:32.682Z] 
[2021-09-06T14:03:32.682Z] PlaintextConsumerTest > 
testMultiConsumerSessionTimeoutOnStopPolling() STARTED
[2021-09-06T14:03:51.941Z] 
[2021-09-06T14:03:51.941Z] PlaintextConsumerTest > 
testMultiConsumerSessionTimeoutOnStopPolling() PASSED
[2021-09-06T14:03:51.941Z] 
[2021-09-06T14:03:51.941Z] PlaintextConsumerTest > 
testMaxPollIntervalMsDelayInRevocation() STARTED
[2021-09-06T14:03:56.598Z] 
[2021-09-06T14:03:56.598Z] PlaintextConsumerTest > 
testMaxPollIntervalMsDelayInRevocation() PASSED
[2021-09-06T14:03:56.598Z] 
[2021-09-06T14:03:56.598Z] PlaintextConsumerTest > 
testPerPartitionLagMetricsCleanUpWithAssign() STARTED
[2021-09-06T14:04:01.425Z] 
[2021-09-06T14:04:01.425Z] PlaintextConsumerTest > 
testPerPartitionLagMetricsCleanUpWithAssign() PASSED
[2021-09-06T14:04:01.425Z] 
[2021-09-06T14:04:01.425Z] PlaintextConsumerTest > 
testPartitionsForInvalidTopic() STARTED
[2021-09-06T14:04:04.084Z] 
[2021-09-06T14:04:04.084Z] PlaintextConsumerTest > 
testPartitionsForInvalidTopic() PASSED
[2021-09-06T14:04:04.084Z] 
[2021-09-06T14:04:04.084Z] PlaintextConsumerTest > 
testPauseStateNotPreservedByRebalance() STARTED
[2021-09-06T14:04:10.101Z] 
[2021-09-06T14:04:10.101Z] PlaintextConsumerTest > 
testPauseStateNotPreservedByRebalance() PASSED
[2021-09-06T14:04:10.101Z] 
[2021-09-06T14:04:10.101Z] PlaintextConsumerTest > 
testFetchHonoursFetchSizeIfLargeRecordNotFirst() STARTED
[2021-09-06T14:04:14.757Z] 
[2021-09-06T14:04:14.757Z] PlaintextConsumerTest > 
testFetchHonoursFetchSizeIfLargeRecordNotFirst() PASSED
[2021-09-06T14:04:14.757Z] 
[2021-09-06T14:04:14.757Z] PlaintextConsumerTest > testSeek() STARTED
[2021-09-06T14:04:22.285Z] 
[2021-09-06T14:04:22.285Z] PlaintextConsumerTest > testSeek() PASSED
[2021-09-06T14:04:22.285Z] 
[2021-09-06T14:04:22.285Z] PlaintextConsumerTest > 
testConsumingWithNullGroupId() STARTED
[2021-09-06T14:04:32.375Z] 
[2021-09-06T14:04:32.375Z] PlaintextConsumerTest > 
testConsumingWithNullGroupId() PASSED
[2021-09-06T14:04:32.375Z] 
[2021-09-06T14:04:32.375Z] PlaintextConsumerTest > testPositionAndCommit() 
STARTED
[2021-09-06T14:04:35.990Z] 
[2021-09-06T14:04:35.990Z] PlaintextConsumerTest > testPositionAndCommit() 
PASSED
[2021-09-06T14:04:35.990Z] 
[2021-09-06T14:04:35.990Z] PlaintextConsumerTest > 
testFetchRecordLargerThanMaxPartitionFetchBytes() STARTED
[2021-09-06T14:04:41.965Z] 
[2021-09-06T14:04:41.965Z] PlaintextConsumerTest > 
testFetchRecordLargerThanMaxPartitionFetchBytes() PASSED
[2021-09-06T14:04:41.965Z] 
[2021-09-06T14:04:41.965Z] PlaintextConsumerTest > testUnsubscribeTopic() 
STARTED
[2021-09-06T14:04:46.622Z] 
[2021-09-06T14:04:46.622Z] PlaintextConsumerTest > testUnsubscribeTopic() PASSED
[2021-09-06T14:04:46.622Z] 
[2021-09-06T14:04:46.622Z] PlaintextConsumerTest > 
testMultiConsumerSessionTimeoutOnClose() STARTED
[2021-09-06T14:04:56.882Z] 
[2021-09-06T14:04:56.882Z] PlaintextConsumerTest > 
testMultiConsumerSessionTimeoutOnClose() PASSED
[2021-09-06T14:04:56.882Z] 
[2021-09-06T14:04:56.882Z] PlaintextConsumerTest > 
testMultiConsumerStickyAssignor() STARTED
[2021-09-06T14:05:14.523Z] 
[2021-09-06T14:05:14.523Z] PlaintextConsumerTest > 
testMultiConsumerStickyAssignor() PASSED
[2021-09-06T14:05:14.523Z] 
[2021-09-06T14:05:14.523Z] PlaintextConsumerTest > 
testFetchRecordLargerThanFetchMaxBytes() STARTED
[2021-09-06T14:05:17.181Z] 
[2021-09-06T14:05:17.181Z] PlaintextConsumerTest > 
testFetchRecordLargerThanFetchMaxBytes() PASSED
[2021-09-06T14:05:17.181Z] 
[2021-09-06T14:05:17.181Z] PlaintextConsumerTest > testAutoCommitOnClose() 
STARTED
[2021-09-06T14:05:22.986Z] 
[2021-09-06T14:05:22.986Z] PlaintextConsumerTest > testAutoCommitOnClose() 
PASSED
[2021-09-06T14:05:22.986Z] 
[2021-09-06T14:05:22.986Z] PlaintextConsumerTest > testListTopics() STARTED
[2021-09-06T14:05:27.875Z] 
[2021-09-06T14:05:27.875Z] PlaintextConsumerTest > testListTopics() PASSED
[2021-09-06T14:05:27.875Z] 
[2021-09-06T14:05:27.875Z] PlaintextConsumerTest > 
testExpandingTopicSubscriptions() STARTED
[2021-09-06T14:05:33.518Z] 
[2021-09-06T14:05:33.518Z] PlaintextConsumerTest > 
testExpandingTopicSubscriptions() PASSED
[2021-09-06T14:05:33.518Z] 
[2021-09-06T14:05:33.518Z] PlaintextConsumerTest > 

Re: [VOTE] KIP-773 Differentiate consistently metric latency measured in millis and nanos

2021-09-06 Thread Tom Bentley
+1 (binding).

Thanks Josep!

On Mon, Sep 6, 2021 at 1:51 PM Bruno Cadonna  wrote:

> Thanks, Josep!
>
> +1 (binding)
>
> Best,
> Bruno
>
> On 04.09.21 05:55, Sagar wrote:
> > Looks good to me.
> >
> > +1(non-binding)
> >
> > Sagar.
> >
> > On Sat, 4 Sep 2021 at 8:15 AM, Luke Chen  wrote:
> >
> >> Thanks for the KIP.
> >>
> >> +1 (non-binding)
> >>
> >> Thanks.
> >> Luke
> >>
> >> On Sat, Sep 4, 2021 at 10:32 AM Guozhang Wang 
> wrote:
> >>
> >>> Thanks Josep,
> >>>
> >>> Took a look at the KIP, LGTM.
> >>>
> >>> On Fri, Sep 3, 2021 at 11:25 AM Josep Prat  >
> >>> wrote:
> >>>
>  Hi there,
> 
>  Since it's a rather small KIP, I'd like to start a vote for the
> KIP-773
>  Differentiate consistently metric latency measured  in millis and
> >> nanos.
>  The KIP page The KIP can be found at:
>  https://cwiki.apache.org/confluence/x/ZwNACw
> 
>  Thanks in advance,
> 
>  --
> 
>  Josep Prat
> 
>  *Aiven Deutschland GmbH*
> 
>  Immanuelkirchstraße 26, 10405 Berlin
> 
>  Amtsgericht Charlottenburg, HRB 209739 B
> 
>  Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> 
>  *m:* +491715557497
> 
>  *w:* aiven.io
> 
>  *e:* josep.p...@aiven.io
> 
> >>>
> >>>
> >>> --
> >>> -- Guozhang
> >>>
> >>
> >
>
>


Re: [VOTE] KIP-773 Differentiate consistently metric latency measured in millis and nanos

2021-09-06 Thread Bruno Cadonna

Thanks, Josep!

+1 (binding)

Best,
Bruno

On 04.09.21 05:55, Sagar wrote:

Looks good to me.

+1(non-binding)

Sagar.

On Sat, 4 Sep 2021 at 8:15 AM, Luke Chen  wrote:


Thanks for the KIP.

+1 (non-binding)

Thanks.
Luke

On Sat, Sep 4, 2021 at 10:32 AM Guozhang Wang  wrote:


Thanks Josep,

Took a look at the KIP, LGTM.

On Fri, Sep 3, 2021 at 11:25 AM Josep Prat 
wrote:


Hi there,

Since it's a rather small KIP, I'd like to start a vote for the KIP-773
Differentiate consistently metric latency measured  in millis and

nanos.

The KIP page The KIP can be found at:
https://cwiki.apache.org/confluence/x/ZwNACw

Thanks in advance,

--

Josep Prat

*Aiven Deutschland GmbH*

Immanuelkirchstraße 26, 10405 Berlin

Amtsgericht Charlottenburg, HRB 209739 B

Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen

*m:* +491715557497

*w:* aiven.io

*e:* josep.p...@aiven.io




--
-- Guozhang







Re: Request Permissions to Contribute

2021-09-06 Thread Bruno Cadonna

Hi,

You are all set now!

Happy contributing!
Bruno


On 06.09.21 08:13, felixzh wrote:

Hi,

I'd like to request permissions to contribute to Kafka to propose a KIP.

Wiki ID: felixzh
Jira ID: felixzh

Thanks you



Re: [DISCUSS] KIP-773 Differentiate consistently metric latency measured in millis and nanos

2021-09-06 Thread Josep Prat
Hi Tom,

You are right, the deprecation of the existing metrics was not mentioned in
"Proposed Changes", it was only present under the "Compatibility,
Deprecation, and Migration Plan" one:

Both existing wrongly named metrics and new ones will be added in the
ops.html page under the "Common monitoring metrics for
producer/consumer/connect/streams" section.* The wrongly named ones will
contain a warning letting users know that this metric is deprecated and
will be removed in following releases*.


I just modified the KIP adding a mention to the deprecation of the existing
metrics under the "Proposed Changes" section. Let me know if this covers
your concern.

Thanks for the feedback,

On Mon, Sep 6, 2021 at 11:59 AM Tom Bentley  wrote:

> Hi Josep,
>
> Thanks for the KIP.
>
> The KIP doesn't seem to explicitly say that the old metrics will be
> deprecated. If we're adding new metrics to fix this naming issue I think we
> should officially and explicitly deprecate the old names at the same time,
> otherwise we'll just end up needing another KIP to deprecate the old names.
> We don't have to commit to when exactly we would remove the old metrics.
>
> Thanks again,
>
> Tom
>
> On Fri, Sep 3, 2021 at 2:49 PM Josep Prat 
> wrote:
>
> > Hi there,
> >
> > I would like to start the discussion thread for KIP-773 Differentiate
> > consistently metric latency measured in millis and nanos. The KIP can be
> > found at: https://cwiki.apache.org/confluence/x/ZwNACw
> >
> > Thanks in advance,
> >
> > --
> >
> > Josep Prat
> >
> > *Aiven Deutschland GmbH*
> >
> > Immanuelkirchstraße 26, 10405 Berlin
> >
> > Amtsgericht Charlottenburg, HRB 209739 B
> >
> > Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
> >
> > *m:* +491715557497
> >
> > *w:* aiven.io
> >
> > *e:* josep.p...@aiven.io
> >
>


-- 

Josep Prat

*Aiven Deutschland GmbH*

Immanuelkirchstraße 26, 10405 Berlin

Amtsgericht Charlottenburg, HRB 209739 B

Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen

*m:* +491715557497

*w:* aiven.io

*e:* josep.p...@aiven.io


[GitHub] [kafka-site] cadonna merged pull request #362: Add Instaclustr to the "Powered By" list

2021-09-06 Thread GitBox


cadonna merged pull request #362:
URL: https://github.com/apache/kafka-site/pull/362


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org




Re: [DISCUSS] KIP-773 Differentiate consistently metric latency measured in millis and nanos

2021-09-06 Thread Tom Bentley
Hi Josep,

Thanks for the KIP.

The KIP doesn't seem to explicitly say that the old metrics will be
deprecated. If we're adding new metrics to fix this naming issue I think we
should officially and explicitly deprecate the old names at the same time,
otherwise we'll just end up needing another KIP to deprecate the old names.
We don't have to commit to when exactly we would remove the old metrics.

Thanks again,

Tom

On Fri, Sep 3, 2021 at 2:49 PM Josep Prat 
wrote:

> Hi there,
>
> I would like to start the discussion thread for KIP-773 Differentiate
> consistently metric latency measured in millis and nanos. The KIP can be
> found at: https://cwiki.apache.org/confluence/x/ZwNACw
>
> Thanks in advance,
>
> --
>
> Josep Prat
>
> *Aiven Deutschland GmbH*
>
> Immanuelkirchstraße 26, 10405 Berlin
>
> Amtsgericht Charlottenburg, HRB 209739 B
>
> Geschäftsführer: Oskari Saarenmaa & Hannu Valtonen
>
> *m:* +491715557497
>
> *w:* aiven.io
>
> *e:* josep.p...@aiven.io
>


Request Permissions to Contribute

2021-09-06 Thread felixzh
Hi,

I'd like to request permissions to contribute to Kafka to propose a KIP.

Wiki ID: felixzh
Jira ID: felixzh

Thanks you