Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #412

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 486305 lines...]
[2021-08-18T06:43:42.921Z]  Y: : [INFO] 

[2021-08-18T06:43:42.921Z] [INFO] Using following parameters for creating 
project from Archetype: streams-quickstart-java:3.1.0-SNAPSHOT
[2021-08-18T06:43:42.921Z] [INFO] 

[2021-08-18T06:43:42.921Z] [INFO] Parameter: groupId, Value: streams.examples
[2021-08-18T06:43:42.921Z] [INFO] Parameter: artifactId, Value: streams.examples
[2021-08-18T06:43:42.921Z] [INFO] Parameter: version, Value: 0.1
[2021-08-18T06:43:42.921Z] [INFO] Parameter: package, Value: myapps
[2021-08-18T06:43:42.921Z] [INFO] Parameter: packageInPathFormat, Value: myapps
[2021-08-18T06:43:42.921Z] [INFO] Parameter: package, Value: myapps
[2021-08-18T06:43:42.921Z] [INFO] Parameter: version, Value: 0.1
[2021-08-18T06:43:42.921Z] [INFO] Parameter: groupId, Value: streams.examples
[2021-08-18T06:43:42.921Z] [INFO] Parameter: artifactId, Value: streams.examples
[2021-08-18T06:43:42.921Z] [INFO] Project created from Archetype in dir: 
/home/jenkins/jenkins-agent/workspace/Kafka_kafka_trunk/streams/quickstart/test-streams-archetype/streams.examples
[2021-08-18T06:43:42.921Z] [INFO] 

[2021-08-18T06:43:42.921Z] [INFO] BUILD SUCCESS
[2021-08-18T06:43:42.921Z] [INFO] 

[2021-08-18T06:43:42.921Z] [INFO] Total time:  1.944 s
[2021-08-18T06:43:42.921Z] [INFO] Finished at: 2021-08-18T06:43:42Z
[2021-08-18T06:43:42.921Z] [INFO] 

[Pipeline] dir
[2021-08-18T06:43:43.440Z] Running in 
/home/jenkins/jenkins-agent/workspace/Kafka_kafka_trunk/streams/quickstart/test-streams-archetype/streams.examples
[Pipeline] {
[Pipeline] sh
[2021-08-18T06:43:45.598Z] + mvn compile
[2021-08-18T06:43:46.698Z] 
[2021-08-18T06:43:46.698Z] ControllerIntegrationTest > 
testLeaderAndIsrWhenEntireIsrOfflineAndUncleanLeaderElectionEnabled() PASSED
[2021-08-18T06:43:46.698Z] 
[2021-08-18T06:43:46.698Z] ControllerIntegrationTest > 
testControllerMoveOnPartitionReassignment() STARTED
[2021-08-18T06:43:47.359Z] [INFO] Scanning for projects...
[2021-08-18T06:43:47.359Z] [INFO] 
[2021-08-18T06:43:47.359Z] [INFO] -< 
streams.examples:streams.examples >--
[2021-08-18T06:43:47.359Z] [INFO] Building Kafka Streams Quickstart :: Java 0.1
[2021-08-18T06:43:47.359Z] [INFO] [ jar 
]-
[2021-08-18T06:43:48.300Z] [INFO] 
[2021-08-18T06:43:48.300Z] [INFO] --- maven-resources-plugin:2.6:resources 
(default-resources) @ streams.examples ---
[2021-08-18T06:43:48.300Z] [INFO] Using 'UTF-8' encoding to copy filtered 
resources.
[2021-08-18T06:43:48.300Z] [INFO] Copying 1 resource
[2021-08-18T06:43:48.300Z] [INFO] 
[2021-08-18T06:43:48.300Z] [INFO] --- maven-compiler-plugin:3.1:compile 
(default-compile) @ streams.examples ---
[2021-08-18T06:43:49.241Z] [INFO] Changes detected - recompiling the module!
[2021-08-18T06:43:49.241Z] [INFO] Compiling 3 source files to 
/home/jenkins/jenkins-agent/workspace/Kafka_kafka_trunk/streams/quickstart/test-streams-archetype/streams.examples/target/classes
[2021-08-18T06:43:49.341Z] 
[2021-08-18T06:43:49.341Z] ControllerIntegrationTest > 
testControllerMoveOnPartitionReassignment() PASSED
[2021-08-18T06:43:49.341Z] 
[2021-08-18T06:43:49.341Z] ControllerIntegrationTest > 
testControllerFeatureZNodeSetupWhenFeatureVersioningIsEnabledWithEnabledExistingFeatureZNode()
 STARTED
[2021-08-18T06:43:50.705Z] [INFO] 

[2021-08-18T06:43:50.705Z] [INFO] BUILD SUCCESS
[2021-08-18T06:43:50.705Z] [INFO] 

[2021-08-18T06:43:50.705Z] [INFO] Total time:  2.766 s
[2021-08-18T06:43:50.705Z] [INFO] Finished at: 2021-08-18T06:43:49Z
[2021-08-18T06:43:50.705Z] [INFO] 

[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // dir
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // withEnv
[Pipeline] }
[Pipeline] // node
[Pipeline] }
[Pipeline] // timestamps
[Pipeline] }
[Pipeline] // timeout
[Pipeline] }
[Pipeline] // stage
[Pipeline] }
[2021-08-18T06:43:51.983Z] 
[2021-08-18T06:43:51.983Z] ControllerIntegrationTest > 
testControllerFeatureZNodeSetupWhenFeatureVersioningIsEnabledWithEnabledExistingFeatureZNode()
 PASSED
[2021-08-18T06:43:51.983Z] 
[2021-08-18T06:43:51.983Z] ControllerIntegrationTest > 
testControllerMoveOnTopicCreation() 

[jira] [Created] (KAFKA-13210) fetch/findSessions queries with open endpoints for SessionStore/WindowStore

[Luke Chen (Jira)]

Luke Chen created KAFKA-13210:
-

 Summary: fetch/findSessions queries with open endpoints for 
SessionStore/WindowStore
 Key: KAFKA-13210
 URL: https://issues.apache.org/jira/browse/KAFKA-13210
 Project: Kafka
  Issue Type: Bug
  Components: streams
Reporter: Luke Chen
Assignee: Luke Chen


This is the implementation of KIP-766: 
[https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=186876596]

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Build failed in Jenkins: Kafka » Kafka Branch Builder » 3.0 #98

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 480779 lines...]
[2021-08-18T01:52:18.603Z] > Task :raft:testClasses UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :connect:json:testJar
[2021-08-18T01:52:18.603Z] > Task :connect:json:testSrcJar
[2021-08-18T01:52:18.603Z] > Task :metadata:compileTestJava UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :metadata:testClasses UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task 
:clients:generateMetadataFileForMavenJavaPublication
[2021-08-18T01:52:18.603Z] 
[2021-08-18T01:52:18.603Z] > Task :streams:processMessages
[2021-08-18T01:52:18.603Z] Execution optimizations have been disabled for task 
':streams:processMessages' to ensure correctness due to the following reasons:
[2021-08-18T01:52:18.603Z]   - Gradle detected a problem with the following 
location: 
'/home/jenkins/jenkins-agent/workspace/Kafka_kafka_3.0/streams/src/generated/java/org/apache/kafka/streams/internals/generated'.
 Reason: Task ':streams:srcJar' uses this output of task 
':streams:processMessages' without declaring an explicit or implicit 
dependency. This can lead to incorrect results being produced, depending on 
what order the tasks are executed. Please refer to 
https://docs.gradle.org/7.1.1/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.
[2021-08-18T01:52:18.603Z] MessageGenerator: processed 1 Kafka message JSON 
files(s).
[2021-08-18T01:52:18.603Z] 
[2021-08-18T01:52:18.603Z] > Task 
:clients:generatePomFileForMavenJavaPublication
[2021-08-18T01:52:18.603Z] > Task :core:compileScala UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :core:classes UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :core:compileTestJava NO-SOURCE
[2021-08-18T01:52:18.603Z] > Task :streams:compileJava UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :streams:classes UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :streams:copyDependantLibs UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :streams:jar UP-TO-DATE
[2021-08-18T01:52:18.603Z] > Task :streams:test-utils:compileJava UP-TO-DATE
[2021-08-18T01:52:19.551Z] > Task 
:streams:generateMetadataFileForMavenJavaPublication
[2021-08-18T01:52:19.551Z] > Task :core:compileTestScala UP-TO-DATE
[2021-08-18T01:52:19.551Z] > Task :core:testClasses UP-TO-DATE
[2021-08-18T01:52:23.523Z] > Task :connect:api:javadoc
[2021-08-18T01:52:23.523Z] > Task :connect:api:copyDependantLibs UP-TO-DATE
[2021-08-18T01:52:23.523Z] > Task :connect:api:jar UP-TO-DATE
[2021-08-18T01:52:23.523Z] > Task 
:connect:api:generateMetadataFileForMavenJavaPublication
[2021-08-18T01:52:23.523Z] > Task :connect:json:copyDependantLibs UP-TO-DATE
[2021-08-18T01:52:23.523Z] > Task :connect:json:jar UP-TO-DATE
[2021-08-18T01:52:23.523Z] > Task 
:connect:json:generateMetadataFileForMavenJavaPublication
[2021-08-18T01:52:23.523Z] > Task :connect:api:javadocJar
[2021-08-18T01:52:23.523Z] > Task 
:connect:json:publishMavenJavaPublicationToMavenLocal
[2021-08-18T01:52:23.523Z] > Task :connect:json:publishToMavenLocal
[2021-08-18T01:52:23.523Z] > Task :connect:api:compileTestJava UP-TO-DATE
[2021-08-18T01:52:23.523Z] > Task :connect:api:testClasses UP-TO-DATE
[2021-08-18T01:52:23.523Z] > Task :connect:api:testJar
[2021-08-18T01:52:23.523Z] > Task :connect:api:testSrcJar
[2021-08-18T01:52:23.523Z] > Task 
:connect:api:publishMavenJavaPublicationToMavenLocal
[2021-08-18T01:52:23.523Z] > Task :connect:api:publishToMavenLocal
[2021-08-18T01:52:27.316Z] > Task :streams:javadoc
[2021-08-18T01:52:27.316Z] > Task :streams:javadocJar
[2021-08-18T01:52:27.316Z] > Task :streams:compileTestJava UP-TO-DATE
[2021-08-18T01:52:27.316Z] > Task :streams:testClasses UP-TO-DATE
[2021-08-18T01:52:28.264Z] > Task :streams:testJar
[2021-08-18T01:52:28.264Z] > Task :streams:testSrcJar
[2021-08-18T01:52:28.264Z] > Task 
:streams:publishMavenJavaPublicationToMavenLocal
[2021-08-18T01:52:28.264Z] > Task :streams:publishToMavenLocal
[2021-08-18T01:52:30.036Z] > Task :clients:javadoc
[2021-08-18T01:52:31.153Z] > Task :clients:javadocJar
[2021-08-18T01:52:32.098Z] 
[2021-08-18T01:52:32.098Z] > Task :clients:srcJar
[2021-08-18T01:52:32.098Z] Execution optimizations have been disabled for task 
':clients:srcJar' to ensure correctness due to the following reasons:
[2021-08-18T01:52:32.098Z]   - Gradle detected a problem with the following 
location: 
'/home/jenkins/jenkins-agent/workspace/Kafka_kafka_3.0/clients/src/generated/java'.
 Reason: Task ':clients:srcJar' uses this output of task 
':clients:processMessages' without declaring an explicit or implicit 
dependency. This can lead to incorrect results being produced, depending on 
what order the tasks are executed. Please refer to 
https://docs.gradle.org/7.1.1/userguide/validation_problems.html#implicit_dependency
 for more details about this problem.
[2021-08-18T01:52:33.046Z] 
[2021-08-18T01:52:33.046Z] > Task :clients:testJar
[2021-08-18T01:52:33.992Z] > Task :clie

Jenkins build is back to normal : Kafka » kafka-2.7-jdk8 #173

[Apache Jenkins Server]

See 

Re: [DISCUSS] KIP-736: Report the true end to end fetch latency

[Kai Huang]

Hi all,

I'd like to bump up this discussion thread on KIP-736. 

I think this would be a useful metric from a monitoring perspective especially 
when troubleshooting or diagnosing issues. I've tested the fetch latency metric 
in Twitter's production environment, and provided some examples to illustrate 
how this metric can be used:
https://cwiki.apache.org/confluence/display/KAFKA/KIP-736%3A+Report+the+true+end+to+end+fetch+latency

Please give it a look and let me know what you think.

Kai


On 2021/04/27 18:13:18, Ming Liu  wrote: 
> Hi All, I'd like to open up the discussion on a KIP-736. This is to
> report the "real" fetch latency by removing the effects of waiting due
> to replica.fetch.wait.max.ms or fetch.min.bytes.
> 
>   Please give it a look over and let me know what you think.
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-736%3A+Report+the+true+end+to+end+fetch+latency
> 
> Thanks
> 

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 3.0 #97

[Apache Jenkins Server]

See 

Re: Making topic validation public

[Guozhang Wang]

Hi Boyang,

I feel okay to add a doc section in Kafka about which topic names are
valid; and maybe add such validation into Utils as well.

Guozhang

On Sun, Aug 15, 2021 at 12:57 PM Boyang Chen 
wrote:

> Hey there,
>
> Kafka has an internal topic validation logic
> <
> https://github.com/apache/kafka/blob/64b8e17827251174490678dd296ce2c1a79ff5ef/clients/src/main/java/org/apache/kafka/common/internals/Topic.java#L43
> >
> which
> is very useful and effective. Do you think it's possible to make it part of
> the public agreement, so that 3rd party integration with Kafka could
> validate the topic upfront instead of waiting until the application has
> been set up end-to-end?
>
> Boyang
>


-- 
-- Guozhang

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #66

[Apache Jenkins Server]

See 

Re: [VOTE] KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore

[Guozhang Wang]

Thanks Luke! +1 as well.

On Tue, Aug 17, 2021 at 11:42 AM John Roesler  wrote:

> Thanks, Luke!
>
> I'm sorry I missed your discussion thread. The KIP looks
> good to me!
>
> I'm +1 (binding)
>
> Thanks,
> -John
>
> On Tue, 2021-08-17 at 16:40 +0800, Luke Chen wrote:
> > Hi all,
> > I'd like to start to vote for
> > *KIP-766: fetch/findSessions queries with open endpoints for
> > WindowStore/SessionStore*.
> >
> > This is a follow-up KIP for KIP-763: Range queries with open endpoints
> > <
> https://cwiki.apache.org/confluence/display/KAFKA/KIP-763%3A+Range+queries+with+open+endpoints
> >.
> > In KIP-763, we focused on *ReadOnlyKeyValueStore*, in this KIP, we'll
> focus
> > on *ReadOnlySessionStore* and *ReadOnlyWindowStore, *to have open
> endpoints
> > queries for SessionStore/WindowStore.
> >
> > The KIP can be found here:
> >
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=186876596
> >
> > Thank you.
> > Luke
>
>
>

-- 
-- Guozhang

Build failed in Jenkins: Kafka » Kafka Branch Builder » trunk #410

[Apache Jenkins Server]

See 


Changes:


--
[...truncated 487076 lines...]
[2021-08-17T20:41:35.851Z] 
[2021-08-17T20:41:35.851Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfEmptyConsumerGroupWithTopicPartition() PASSED
[2021-08-17T20:41:35.851Z] 
[2021-08-17T20:41:35.851Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfEmptyConsumerGroupWithTopicOnly() STARTED
[2021-08-17T20:41:39.450Z] 
[2021-08-17T20:41:39.450Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfEmptyConsumerGroupWithTopicOnly() PASSED
[2021-08-17T20:41:39.450Z] 
[2021-08-17T20:41:39.450Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfStableConsumerGroupWithTopicPartition() STARTED
[2021-08-17T20:41:41.214Z] 
[2021-08-17T20:41:41.214Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfStableConsumerGroupWithTopicPartition() PASSED
[2021-08-17T20:41:41.214Z] 
[2021-08-17T20:41:41.214Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsNonExistingGroup() STARTED
[2021-08-17T20:41:44.503Z] 
[2021-08-17T20:41:44.503Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsNonExistingGroup() PASSED
[2021-08-17T20:41:44.503Z] 
[2021-08-17T20:41:44.503Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfStableConsumerGroupWithUnknownTopicOnly() STARTED
[2021-08-17T20:41:46.268Z] 
[2021-08-17T20:41:46.268Z] DeleteOffsetsConsumerGroupCommandIntegrationTest > 
testDeleteOffsetsOfStableConsumerGroupWithUnknownTopicOnly() PASSED
[2021-08-17T20:41:46.268Z] 
[2021-08-17T20:41:46.268Z] TopicCommandIntegrationTest > 
testAlterPartitionCount() STARTED
[2021-08-17T20:41:50.910Z] 
[2021-08-17T20:41:50.910Z] TopicCommandIntegrationTest > 
testAlterPartitionCount() PASSED
[2021-08-17T20:41:50.910Z] 
[2021-08-17T20:41:50.910Z] TopicCommandIntegrationTest > 
testCreatePartitionsDoesNotRetryThrottlingQuotaExceededException() STARTED
[2021-08-17T20:41:54.511Z] 
[2021-08-17T20:41:54.511Z] TopicCommandIntegrationTest > 
testCreatePartitionsDoesNotRetryThrottlingQuotaExceededException() PASSED
[2021-08-17T20:41:54.511Z] 
[2021-08-17T20:41:54.511Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExistWithIfExists() STARTED
[2021-08-17T20:41:58.659Z] 
[2021-08-17T20:41:58.659Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExistWithIfExists() PASSED
[2021-08-17T20:41:58.659Z] 
[2021-08-17T20:41:58.659Z] TopicCommandIntegrationTest > 
testCreateWithDefaultReplication() STARTED
[2021-08-17T20:42:01.929Z] 
[2021-08-17T20:42:01.929Z] TopicCommandIntegrationTest > 
testCreateWithDefaultReplication() PASSED
[2021-08-17T20:42:01.929Z] 
[2021-08-17T20:42:01.929Z] TopicCommandIntegrationTest > 
testDescribeAtMinIsrPartitions() STARTED
[2021-08-17T20:42:15.557Z] 
[2021-08-17T20:42:15.557Z] TopicCommandIntegrationTest > 
testDescribeAtMinIsrPartitions() PASSED
[2021-08-17T20:42:15.557Z] 
[2021-08-17T20:42:15.557Z] TopicCommandIntegrationTest > 
testCreateWithNegativeReplicationFactor() STARTED
[2021-08-17T20:42:19.872Z] 
[2021-08-17T20:42:19.872Z] TopicCommandIntegrationTest > 
testCreateWithNegativeReplicationFactor() PASSED
[2021-08-17T20:42:19.872Z] 
[2021-08-17T20:42:19.872Z] TopicCommandIntegrationTest > 
testCreateWithInvalidReplicationFactor() STARTED
[2021-08-17T20:42:22.982Z] 
[2021-08-17T20:42:22.982Z] TopicCommandIntegrationTest > 
testCreateWithInvalidReplicationFactor() PASSED
[2021-08-17T20:42:22.982Z] 
[2021-08-17T20:42:22.982Z] TopicCommandIntegrationTest > 
testDeleteTopicDoesNotRetryThrottlingQuotaExceededException() STARTED
[2021-08-17T20:42:27.400Z] 
[2021-08-17T20:42:27.400Z] TopicCommandIntegrationTest > 
testDeleteTopicDoesNotRetryThrottlingQuotaExceededException() PASSED
[2021-08-17T20:42:27.400Z] 
[2021-08-17T20:42:27.400Z] TopicCommandIntegrationTest > 
testListTopicsWithExcludeInternal() STARTED
[2021-08-17T20:42:31.708Z] 
[2021-08-17T20:42:31.708Z] TopicCommandIntegrationTest > 
testListTopicsWithExcludeInternal() PASSED
[2021-08-17T20:42:31.708Z] 
[2021-08-17T20:42:31.708Z] TopicCommandIntegrationTest > 
testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress() STARTED
[2021-08-17T20:42:35.206Z] 
[2021-08-17T20:42:35.206Z] TopicCommandIntegrationTest > 
testDescribeUnderReplicatedPartitionsWhenReassignmentIsInProgress() PASSED
[2021-08-17T20:42:35.206Z] 
[2021-08-17T20:42:35.206Z] TopicCommandIntegrationTest > 
testCreateWithNegativePartitionCount() STARTED
[2021-08-17T20:42:39.486Z] 
[2021-08-17T20:42:39.486Z] TopicCommandIntegrationTest > 
testCreateWithNegativePartitionCount() PASSED
[2021-08-17T20:42:39.486Z] 
[2021-08-17T20:42:39.486Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExist() STARTED
[2021-08-17T20:42:43.900Z] 
[2021-08-17T20:42:43.900Z] TopicCommandIntegrationTest > 
testAlterWhenTopicDoesntExist() PASSED
[2021-08-17T20:42:43.900Z]

Jenkins build became unstable: Kafka » Kafka Branch Builder » 3.0 #96

[Apache Jenkins Server]

See 

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

[Konstantine Karantasis]

Hi Rajini.

Approved, given its low risk and the lack of convenient workarounds.

Konstantine


On Tue, Aug 17, 2021 at 11:00 AM Rajini Sivaram 
wrote:

> Hi Konstantine,
>
> We found an issue with replication with IBP 2.7:
> https://issues.apache.org/jira/browse/KAFKA-13207. The fix is small and
> low
> risk and has been merged to trunk. Can we include this in 3.0 branch since
> it can result in IllegalStateException during replication?
>
> Thank you,
>
> Rajini
>
>
> On Thu, Aug 5, 2021 at 6:21 PM Konstantine Karantasis <
> kkaranta...@apache.org> wrote:
>
> > Jose, thanks for the heads up on the 3 new blocker candidates.
> >
> > I read the tickets and they have clear descriptions and implementation
> > details.
> > However, at this stage to be able to make a call and approve new blockers
> > I'd appreciate it if we could get some insight regarding the risk and the
> > necessity of a fix. A rough ETA would also be helpful.
> >
> > Having said that, based on the descriptions and the existence of a few
> > other blockers, I'm tentatively approving KAFKA-13161, KAFKA-13165, and
> > KAFKA-13168 and we might have to make a new assessment if these are the
> > only blockers in the next few days or if we notice a regression during
> > testing.
> >
> > Konstantine
> >
> >
> >
> > On Thu, Aug 5, 2021 at 10:04 AM Konstantine Karantasis <
> > kkaranta...@apache.org> wrote:
> >
> > >
> > > Thanks for reporting this new issue Ryan,
> > >
> > > It's important and this issue seems to have clearly regressed dynamic
> > > default configs in the 3.0 branch.
> > > So, it's approved.
> > >
> > > Konstantine
> > >
> > >
> > > On Wed, Aug 4, 2021 at 4:34 PM José Armando García Sancio
> > >  wrote:
> > >
> > >> Hey all,
> > >>
> > >> For the KIP-500 work for 3.0 we would like to propose the following
> > >> Jiras as blockers:
> > >>
> > >> 1. https://issues.apache.org/jira/browse/KAFKA-13168
> > >> 2. https://issues.apache.org/jira/browse/KAFKA-13165
> > >> 3. https://issues.apache.org/jira/browse/KAFKA-13161
> > >>
> > >> The description for each Jira should have more details.
> > >>
> > >> Thanks,
> > >> -Jose
> > >>
> > >> On Tue, Aug 3, 2021 at 12:14 PM Ryan Dielhenn
> > >>  wrote:
> > >> >
> > >> > Hi Konstantine,
> > >> >
> > >> > I would like to report another bug in KRaft.
> > >> >
> > >> > The ConfigHandler that processes dynamic broker config deltas in
> KRaft
> > >> > expects that the default resource name for dynamic broker configs is
> > the
> > >> > old default entity name used in ZK: "". Since dynamic
> default
> > >> > broker configs are persisted as empty string in the quorum instead
> of
> > >> > "", the brokers are not updating the their default
> > >> configuration
> > >> > when they see empty string as a resource name in the config delta
> and
> > >> are
> > >> > throwing a NumberFormatException when they try to parse the resource
> > >> name
> > >> > to process it as a per-broker configuration.
> > >> >
> > >> > I filed a JIRA: https://issues.apache.org/jira/browse/KAFKA-13160
> > >> >
> > >> > I also have a PR to fix this:
> > >> https://github.com/apache/kafka/pull/11168
> > >> >
> > >> > I think that this should be a blocker for 3.0 because dynamic
> default
> > >> > broker configs will not be usable in KRaft otherwise.
> > >> >
> > >> > Best,
> > >> > Ryan Dielhenn
> > >> >
> > >> > On Sat, Jul 31, 2021 at 10:42 AM Konstantine Karantasis <
> > >> > kkaranta...@apache.org> wrote:
> > >> >
> > >> > > Thanks Ryan,
> > >> > >
> > >> > > Approved. Seems also like a low risk fix.
> > >> > > With that opportunity, let's make sure there are no other configs
> > that
> > >> > > would need a similar validation.
> > >> > >
> > >> > > Konstantine
> > >> > >
> > >> > > On Fri, Jul 30, 2021 at 8:33 AM Ryan Dielhenn
> > >> > >  wrote:
> > >> > >
> > >> > > > Hey Konstantine,
> > >> > > >
> > >> > > > Thanks for the question. If these configs are not validated the
> > >> user's
> > >> > > > experience will be affected and upgrades from 3.0 will be
> harder.
> > >> > > >
> > >> > > > Best,
> > >> > > > Ryan Dielhenn
> > >> > > >
> > >> > > > On Thu, Jul 29, 2021 at 3:59 PM Konstantine Karantasis <
> > >> > > > kkaranta...@apache.org> wrote:
> > >> > > >
> > >> > > > > Thanks for reporting this issue Ryan.
> > >> > > > >
> > >> > > > > I believe what you mention corresponds to the ticket you
> created
> > >> here:
> > >> > > > >
> > https://issues.apache.org/jira/projects/KAFKA/issues/KAFKA-13151
> > >> > > > >
> > >> > > > > What happens if the configurations are present but the broker
> > >> doesn't
> > >> > > > fail
> > >> > > > > at startup when configured to run in KRaft mode?
> > >> > > > > Asking to see if we have any workarounds in our availability.
> > >> > > > >
> > >> > > > > Thanks,
> > >> > > > > Konstantine
> > >> > > > >
> > >> > > > > On Thu, Jul 29, 2021 at 2:51 PM Ryan Dielhenn
> > >> > > > >  wrote:
> > >> > > > >
> > >> > > > > > Hi,
> > >> > > > > >
> > >> > > > > > Disregard log.clean.policy being 

[jira] [Resolved] (KAFKA-13198) TopicsDelta doesn't update deleted topic when processing PartitionChangeRecord

[Jun Rao (Jira)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-13198?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Jun Rao resolved KAFKA-13198.
-
Resolution: Fixed

merged the PR to 3.0 and trunk.

> TopicsDelta doesn't update deleted topic when processing PartitionChangeRecord
> --
>
> Key: KAFKA-13198
> URL: https://issues.apache.org/jira/browse/KAFKA-13198
> Project: Kafka
>  Issue Type: Bug
>  Components: kraft, replication
>Reporter: Jose Armando Garcia Sancio
>Assignee: Jose Armando Garcia Sancio
>Priority: Blocker
>  Labels: kip-500
> Fix For: 3.0.0
>
>
> In KRaft when a replica gets reassigned away from a topic partition we are 
> not notifying the {{ReplicaManager}} to stop the replica.
> On solution is to track those topic partition ids when processing 
> {{PartitionChangeRecord}} and to returned them as {{deleted}} when the 
> replica manager calls {{calculateDeltaChanges}}.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Jenkins build is still unstable: Kafka » Kafka Branch Builder » 2.8 #65

[Apache Jenkins Server]

See 

[jira] [Resolved] (KAFKA-13207) Replica fetcher should not update partition state on diverging epoch if partition removed from fetcher

[Rajini Sivaram (Jira)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-13207?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rajini Sivaram resolved KAFKA-13207.

Resolution: Fixed

> Replica fetcher should not update partition state on diverging epoch if 
> partition removed from fetcher
> --
>
> Key: KAFKA-13207
> URL: https://issues.apache.org/jira/browse/KAFKA-13207
> Project: Kafka
>  Issue Type: New Feature
>  Components: core
>Affects Versions: 2.8.0
>Reporter: Rajini Sivaram
>Assignee: Rajini Sivaram
>Priority: Critical
> Fix For: 3.0.0, 2.8.1
>
>
> {{AbstractFetcherThread#truncateOnFetchResponse}}{color:#24292e} is used with 
> IBP 2.7 and above to truncate partitions based on diverging epoch returned in 
> fetch responses. Truncation should only be performed for partitions that are 
> still owned by the fetcher and this check should be done while holding 
> {color}{{partitionMapLock}}{color:#24292e} to ensure that any partitions 
> removed from the fetcher thread are not truncated{color}



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[jira] [Resolved] (KAFKA-13209) Upgrade jetty-server to fix CVE-2021-34429

[Justine Olshan (Jira)]

 [ 
https://issues.apache.org/jira/browse/KAFKA-13209?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Justine Olshan resolved KAFKA-13209.

Resolution: Fixed

> Upgrade jetty-server to fix CVE-2021-34429
> --
>
> Key: KAFKA-13209
> URL: https://issues.apache.org/jira/browse/KAFKA-13209
> Project: Kafka
>  Issue Type: Improvement
>Reporter: Justine Olshan
>Assignee: Justine Olshan
>Priority: Major
> Fix For: 3.0.0, 2.7.2, 2.8.1
>
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)

Re: [VOTE] KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore

[John Roesler]

Thanks, Luke!

I'm sorry I missed your discussion thread. The KIP looks
good to me!

I'm +1 (binding)

Thanks,
-John

On Tue, 2021-08-17 at 16:40 +0800, Luke Chen wrote:
> Hi all,
> I'd like to start to vote for
> *KIP-766: fetch/findSessions queries with open endpoints for
> WindowStore/SessionStore*.
> 
> This is a follow-up KIP for KIP-763: Range queries with open endpoints
> .
> In KIP-763, we focused on *ReadOnlyKeyValueStore*, in this KIP, we'll focus
> on *ReadOnlySessionStore* and *ReadOnlyWindowStore, *to have open endpoints
> queries for SessionStore/WindowStore.
> 
> The KIP can be found here:
> https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=186876596
> 
> Thank you.
> Luke

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #409

[Apache Jenkins Server]

See 

Re: [DISCUSS] Apache Kafka 3.0.0 release plan with new updated dates

[Rajini Sivaram]

Hi Konstantine,

We found an issue with replication with IBP 2.7:
https://issues.apache.org/jira/browse/KAFKA-13207. The fix is small and low
risk and has been merged to trunk. Can we include this in 3.0 branch since
it can result in IllegalStateException during replication?

Thank you,

Rajini


On Thu, Aug 5, 2021 at 6:21 PM Konstantine Karantasis <
kkaranta...@apache.org> wrote:

> Jose, thanks for the heads up on the 3 new blocker candidates.
>
> I read the tickets and they have clear descriptions and implementation
> details.
> However, at this stage to be able to make a call and approve new blockers
> I'd appreciate it if we could get some insight regarding the risk and the
> necessity of a fix. A rough ETA would also be helpful.
>
> Having said that, based on the descriptions and the existence of a few
> other blockers, I'm tentatively approving KAFKA-13161, KAFKA-13165, and
> KAFKA-13168 and we might have to make a new assessment if these are the
> only blockers in the next few days or if we notice a regression during
> testing.
>
> Konstantine
>
>
>
> On Thu, Aug 5, 2021 at 10:04 AM Konstantine Karantasis <
> kkaranta...@apache.org> wrote:
>
> >
> > Thanks for reporting this new issue Ryan,
> >
> > It's important and this issue seems to have clearly regressed dynamic
> > default configs in the 3.0 branch.
> > So, it's approved.
> >
> > Konstantine
> >
> >
> > On Wed, Aug 4, 2021 at 4:34 PM José Armando García Sancio
> >  wrote:
> >
> >> Hey all,
> >>
> >> For the KIP-500 work for 3.0 we would like to propose the following
> >> Jiras as blockers:
> >>
> >> 1. https://issues.apache.org/jira/browse/KAFKA-13168
> >> 2. https://issues.apache.org/jira/browse/KAFKA-13165
> >> 3. https://issues.apache.org/jira/browse/KAFKA-13161
> >>
> >> The description for each Jira should have more details.
> >>
> >> Thanks,
> >> -Jose
> >>
> >> On Tue, Aug 3, 2021 at 12:14 PM Ryan Dielhenn
> >>  wrote:
> >> >
> >> > Hi Konstantine,
> >> >
> >> > I would like to report another bug in KRaft.
> >> >
> >> > The ConfigHandler that processes dynamic broker config deltas in KRaft
> >> > expects that the default resource name for dynamic broker configs is
> the
> >> > old default entity name used in ZK: "". Since dynamic default
> >> > broker configs are persisted as empty string in the quorum instead of
> >> > "", the brokers are not updating the their default
> >> configuration
> >> > when they see empty string as a resource name in the config delta and
> >> are
> >> > throwing a NumberFormatException when they try to parse the resource
> >> name
> >> > to process it as a per-broker configuration.
> >> >
> >> > I filed a JIRA: https://issues.apache.org/jira/browse/KAFKA-13160
> >> >
> >> > I also have a PR to fix this:
> >> https://github.com/apache/kafka/pull/11168
> >> >
> >> > I think that this should be a blocker for 3.0 because dynamic default
> >> > broker configs will not be usable in KRaft otherwise.
> >> >
> >> > Best,
> >> > Ryan Dielhenn
> >> >
> >> > On Sat, Jul 31, 2021 at 10:42 AM Konstantine Karantasis <
> >> > kkaranta...@apache.org> wrote:
> >> >
> >> > > Thanks Ryan,
> >> > >
> >> > > Approved. Seems also like a low risk fix.
> >> > > With that opportunity, let's make sure there are no other configs
> that
> >> > > would need a similar validation.
> >> > >
> >> > > Konstantine
> >> > >
> >> > > On Fri, Jul 30, 2021 at 8:33 AM Ryan Dielhenn
> >> > >  wrote:
> >> > >
> >> > > > Hey Konstantine,
> >> > > >
> >> > > > Thanks for the question. If these configs are not validated the
> >> user's
> >> > > > experience will be affected and upgrades from 3.0 will be harder.
> >> > > >
> >> > > > Best,
> >> > > > Ryan Dielhenn
> >> > > >
> >> > > > On Thu, Jul 29, 2021 at 3:59 PM Konstantine Karantasis <
> >> > > > kkaranta...@apache.org> wrote:
> >> > > >
> >> > > > > Thanks for reporting this issue Ryan.
> >> > > > >
> >> > > > > I believe what you mention corresponds to the ticket you created
> >> here:
> >> > > > >
> https://issues.apache.org/jira/projects/KAFKA/issues/KAFKA-13151
> >> > > > >
> >> > > > > What happens if the configurations are present but the broker
> >> doesn't
> >> > > > fail
> >> > > > > at startup when configured to run in KRaft mode?
> >> > > > > Asking to see if we have any workarounds in our availability.
> >> > > > >
> >> > > > > Thanks,
> >> > > > > Konstantine
> >> > > > >
> >> > > > > On Thu, Jul 29, 2021 at 2:51 PM Ryan Dielhenn
> >> > > > >  wrote:
> >> > > > >
> >> > > > > > Hi,
> >> > > > > >
> >> > > > > > Disregard log.clean.policy being included in this blocker.
> >> > > > > >
> >> > > > > > Best,
> >> > > > > > Ryan Dielhenn
> >> > > > > >
> >> > > > > > On Thu, Jul 29, 2021 at 2:38 PM Ryan Dielhenn <
> >> > > rdielh...@confluent.io>
> >> > > > > > wrote:
> >> > > > > >
> >> > > > > > > Hey Konstantine,
> >> > > > > > >
> >> > > > > > > I'd like to report another bug in KRaft.
> >> > > > > > >
> >> > > > > > > log.cleanup.policy, alter.config.policy.class.name, and
> >> > > > 

[GitHub] [kafka-site] hrittikhere removed a comment on pull request #364: Add p3r (https://www.p3r.one/) to the list of the "Powered By ❤️"

[GitBox]

hrittikhere removed a comment on pull request #364:
URL: https://github.com/apache/kafka-site/pull/364#issuecomment-900435157


   @devsayanta


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [kafka-site] hrittikhere commented on pull request #364: Add p3r (https://www.p3r.one/) to the list of the "Powered By ❤️"

[GitBox]

hrittikhere commented on pull request #364:
URL: https://github.com/apache/kafka-site/pull/364#issuecomment-900435157


   @devsayanta


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: dev-unsubscr...@kafka.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[jira] [Created] (KAFKA-13209) Upgrade jetty-server to 9.4.43.v20210629

[Justine Olshan (Jira)]

Justine Olshan created KAFKA-13209:
--

 Summary: Upgrade jetty-server to 9.4.43.v20210629
 Key: KAFKA-13209
 URL: https://issues.apache.org/jira/browse/KAFKA-13209
 Project: Kafka
  Issue Type: Improvement
Reporter: Justine Olshan






--
This message was sent by Atlassian Jira
(v8.3.4#803005)

[VOTE] KIP-766: fetch/findSessions queries with open endpoints for SessionStore/WindowStore

[Luke Chen]

Hi all,
I'd like to start to vote for
*KIP-766: fetch/findSessions queries with open endpoints for
WindowStore/SessionStore*.

This is a follow-up KIP for KIP-763: Range queries with open endpoints
.
In KIP-763, we focused on *ReadOnlyKeyValueStore*, in this KIP, we'll focus
on *ReadOnlySessionStore* and *ReadOnlyWindowStore, *to have open endpoints
queries for SessionStore/WindowStore.

The KIP can be found here:
https://cwiki.apache.org/confluence/pages/viewpage.action?pageId=186876596

Thank you.
Luke