[GitHub] [kafka] AChangFeng commented on pull request #8575: KAFKA-8713 KIP-581 Add accept.optional.null to solve optional null

2021-11-24 Thread GitBox
AChangFeng commented on pull request #8575: URL: https://github.com/apache/kafka/pull/8575#issuecomment-978869581 Any update or possible workaround ? @rhauch -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL abo

[GitHub] [kafka] functioner commented on pull request #11504: KAFKA-13457: SocketChannel in Acceptor#accept is not closed upon IOException

2021-11-24 Thread GitBox
functioner commented on pull request #11504: URL: https://github.com/apache/kafka/pull/11504#issuecomment-978812709 Thanks everybody here for the suggestions and merging the patch! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [kafka] functioner commented on pull request #11520: KAFKA-13468: Consumers may hang because IOException in Log# does not trigger KafkaStorageException

2021-11-24 Thread GitBox
functioner commented on pull request #11520: URL: https://github.com/apache/kafka/pull/11520#issuecomment-978812208 @dajac do you have time to review this patch? I think it is an exception handling bug kind of similar to https://github.com/apache/kafka/pull/11504 merged yesterday. --

[jira] [Created] (KAFKA-13481) poll(Duration) hung forever need restart

2021-11-24 Thread jimmy huang (Jira)
jimmy huang created KAFKA-13481: --- Summary: poll(Duration) hung forever need restart Key: KAFKA-13481 URL: https://issues.apache.org/jira/browse/KAFKA-13481 Project: Kafka Issue Type: Bug

[GitHub] [kafka] abbccdda commented on a change in pull request #11015: KAFKA-12333:KafkaMetadataLog and MockLog should validate that appended epochs are monotonically

2021-11-24 Thread GitBox
abbccdda commented on a change in pull request #11015: URL: https://github.com/apache/kafka/pull/11015#discussion_r756498765 ## File path: core/src/main/scala/kafka/raft/KafkaMetadataLog.scala ## @@ -76,6 +76,9 @@ final class KafkaMetadataLog private ( if (records.sizeInBy

[jira] [Closed] (KAFKA-13480) IQv2: Track Position in KeyValue stores

2021-11-24 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler closed KAFKA-13480. > IQv2: Track Position in KeyValue stores > --- > >

[jira] [Resolved] (KAFKA-13480) IQv2: Track Position in KeyValue stores

2021-11-24 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler resolved KAFKA-13480. -- Resolution: Fixed > IQv2: Track Position in KeyValue stores >

[GitHub] [kafka] vvcephei merged pull request #11514: KAFKA-13480: Track Position in KeyValue stores

2021-11-24 Thread GitBox
vvcephei merged pull request #11514: URL: https://github.com/apache/kafka/pull/11514 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr

[jira] [Assigned] (KAFKA-13480) IQv2: Track Position in KeyValue stores

2021-11-24 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-13480: Assignee: Patrick Stuedi > IQv2: Track Position in KeyValue stores >

[jira] [Assigned] (KAFKA-13479) Interactive Query v2

2021-11-24 Thread John Roesler (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13479?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Roesler reassigned KAFKA-13479: Assignee: John Roesler > Interactive Query v2 > > >

[jira] [Created] (KAFKA-13480) IQv2: Track Position in KeyValue stores

2021-11-24 Thread John Roesler (Jira)
John Roesler created KAFKA-13480: Summary: IQv2: Track Position in KeyValue stores Key: KAFKA-13480 URL: https://issues.apache.org/jira/browse/KAFKA-13480 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-13479) Interactive Query v2

2021-11-24 Thread John Roesler (Jira)
John Roesler created KAFKA-13479: Summary: Interactive Query v2 Key: KAFKA-13479 URL: https://issues.apache.org/jira/browse/KAFKA-13479 Project: Kafka Issue Type: New Feature Compon

[GitHub] [kafka] vvcephei commented on pull request #11514: Tracking latest seen offset in state stores

2021-11-24 Thread GitBox
vvcephei commented on pull request #11514: URL: https://github.com/apache/kafka/pull/11514#issuecomment-978539886 Those test failures are unrelated: Build / JDK 17 and Scala 2.13 / kafka.server.ReplicaManagerTest.[1] usesTopicIds=true Build / JDK 11 and Scala 2.13 / kafka.adm

[GitHub] [kafka] jsancio commented on pull request #11457: MINOR: guard against calls to exit in QuorumTestHarness tests

2021-11-24 Thread GitBox
jsancio commented on pull request #11457: URL: https://github.com/apache/kafka/pull/11457#issuecomment-978176603 Was merged at https://github.com/apache/kafka/commit/0f967828e1d610ab140be1a3f04279b872df7e3c -- This is an automated message from the Apache Git Service. To respond to the me

[GitHub] [kafka] jsancio closed pull request #11457: MINOR: guard against calls to exit in QuorumTestHarness tests

2021-11-24 Thread GitBox
jsancio closed pull request #11457: URL: https://github.com/apache/kafka/pull/11457 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr.

[GitHub] [kafka] jsancio closed pull request #11527: KAFKA-13357: store producer IDs in broker snapshots

2021-11-24 Thread GitBox
jsancio closed pull request #11527: URL: https://github.com/apache/kafka/pull/11527 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr.

[GitHub] [kafka] jsancio commented on pull request #11527: KAFKA-13357: store producer IDs in broker snapshots

2021-11-24 Thread GitBox
jsancio commented on pull request #11527: URL: https://github.com/apache/kafka/pull/11527#issuecomment-978162625 Closing since I merged https://github.com/apache/kafka/commit/e8b53caab475a976fc2ce97d4b41977752b64633. I think GitHub didn't close this PR because I didn't reference the

[GitHub] [kafka] sarah-story opened a new pull request #11537: KAFKA-13477 [WIP]: Add Task ID and Connector Name to Connect Task Context

2021-11-24 Thread GitBox
sarah-story opened a new pull request #11537: URL: https://github.com/apache/kafka/pull/11537 This PR is related to [KIP-803](https://cwiki.apache.org/confluence/x/4pKqCw). ### Committer Checklist (excluded from commit message) - [ ] Verify design and implementation - [ ] Veri

[jira] [Resolved] (KAFKA-13357) Controller snapshot contains producer ids records but broker does not

2021-11-24 Thread Jose Armando Garcia Sancio (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Armando Garcia Sancio resolved KAFKA-13357. Resolution: Fixed > Controller snapshot contains producer ids reco

[jira] [Assigned] (KAFKA-13357) Controller snapshot contains producer ids records but broker does not

2021-11-24 Thread Jose Armando Garcia Sancio (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13357?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jose Armando Garcia Sancio reassigned KAFKA-13357: -- Assignee: Colin McCabe (was: Jose Armando Garcia Sancio) > C

[GitHub] [kafka] jsancio opened a new pull request #11536: MINOR; Update merge script to work against Python3

2021-11-24 Thread GitBox
jsancio opened a new pull request #11536: URL: https://github.com/apache/kafka/pull/11536 Made the following changes so that it works in Python3: 1. Use `print()` instead of `print` 2. Use urllib instead of urllib2 3. Decode all of the cmd outputs from bynary to string using UTF

[jira] [Updated] (KAFKA-13478) KIP-802: Validation Support for Kafka Connect SMT Options

2021-11-24 Thread Gunnar Morling (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13478?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gunnar Morling updated KAFKA-13478: --- Description: Implement [KIP-802|https://cwiki.apache.org/confluence/display/KAFKA/KIP-802%3A

[jira] [Created] (KAFKA-13478) KIP-802: Validation Support for Kafka Connect SMT Options

2021-11-24 Thread Gunnar Morling (Jira)
Gunnar Morling created KAFKA-13478: -- Summary: KIP-802: Validation Support for Kafka Connect SMT Options Key: KAFKA-13478 URL: https://issues.apache.org/jira/browse/KAFKA-13478 Project: Kafka

[jira] [Created] (KAFKA-13477) Add Task ID and Connector Name to Connect Task Context

2021-11-24 Thread Sarah Story (Jira)
Sarah Story created KAFKA-13477: --- Summary: Add Task ID and Connector Name to Connect Task Context Key: KAFKA-13477 URL: https://issues.apache.org/jira/browse/KAFKA-13477 Project: Kafka Issue Ty

[GitHub] [kafka] jsancio commented on a change in pull request #11529: KAFKA-12932: Interfaces for SnapshotReader and SnapshotWriter

2021-11-24 Thread GitBox
jsancio commented on a change in pull request #11529: URL: https://github.com/apache/kafka/pull/11529#discussion_r756176949 ## File path: raft/src/main/java/org/apache/kafka/snapshot/FileSnapshotReader.java ## @@ -0,0 +1,52 @@ +/* + * Licensed to the Apache Software Foundation

[jira] [Created] (KAFKA-13476) Streams crashes when non Base64 Offset Metadata is found

2021-11-24 Thread Richard Bosch (Jira)
Richard Bosch created KAFKA-13476: - Summary: Streams crashes when non Base64 Offset Metadata is found Key: KAFKA-13476 URL: https://issues.apache.org/jira/browse/KAFKA-13476 Project: Kafka Is

[GitHub] [kafka] richard-axual opened a new pull request #11535: KAFKA-13476: Increase resilience timestamp decoding Kafka Streams

2021-11-24 Thread GitBox
richard-axual opened a new pull request #11535: URL: https://github.com/apache/kafka/pull/11535 Kafka Streams decodes the Offset Metadata to extract timestamps. If this metadata is not in Base64 the application fails, with no way to recover except creating a new custom offset commit.

[GitHub] [kafka] jeqo opened a new pull request #11534: KAFKA-12939: After migrating processors, search the codebase for missed migrations

2021-11-24 Thread GitBox
jeqo opened a new pull request #11534: URL: https://github.com/apache/kafka/pull/11534 Replacing for new Processor API where `@SuppressWarnings("deprecation") // Old PAPI. Needs to be migrated.` There are a few places where Processor Context is used and Processors could not be full

[jira] [Updated] (KAFKA-13475) max-compaction-delay-secs reported at one clean "behind" current state

2021-11-24 Thread Joe Wreschnig (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13475?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joe Wreschnig updated KAFKA-13475: -- Description: We have a compacted topic with a very slow rate of incoming messages, along with

[jira] [Created] (KAFKA-13475) max-compaction-delay-secs reported at one clean "behind" current state

2021-11-24 Thread Joe (Jira)
Joe created KAFKA-13475: --- Summary: max-compaction-delay-secs reported at one clean "behind" current state Key: KAFKA-13475 URL: https://issues.apache.org/jira/browse/KAFKA-13475 Project: Kafka Issue T

[jira] [Commented] (KAFKA-12370) Refactor KafkaStreams exposed metadata hierarchy

2021-11-24 Thread Josep Prat (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17448545#comment-17448545 ] Josep Prat commented on KAFKA-12370: I'll start working on this one, I will write th

[jira] [Assigned] (KAFKA-12370) Refactor KafkaStreams exposed metadata hierarchy

2021-11-24 Thread Josep Prat (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12370?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Josep Prat reassigned KAFKA-12370: -- Assignee: Josep Prat > Refactor KafkaStreams exposed metadata hierarchy > ---

[jira] [Updated] (KAFKA-13397) MirrorMaker2 shouldn't mirror Connect's internal topics

2021-11-24 Thread Mickael Maison (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13397?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mickael Maison updated KAFKA-13397: --- Fix Version/s: 3.1.0 > MirrorMaker2 shouldn't mirror Connect's internal topics > ---

[GitHub] [kafka] mimaison commented on pull request #11431: KAFKA-13397: Honor 'replication.policy.separator' configuration when creating MirrorMaker2 internal topics

2021-11-24 Thread GitBox
mimaison commented on pull request #11431: URL: https://github.com/apache/kafka/pull/11431#issuecomment-977746470 Backported to 3.1: https://github.com/apache/kafka/commit/417630d9be91bc62b908d8337fe7fc937eca823c -- This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (KAFKA-13128) Flaky Test StoreQueryIntegrationTest.shouldQueryStoresAfterAddingAndRemovingStreamThread

2021-11-24 Thread Josep Prat (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13128?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17448496#comment-17448496 ] Josep Prat commented on KAFKA-13128: It might be that [https://github.com/apache/kaf

[GitHub] [kafka] socutes commented on pull request #11529: KAFKA-12932: Interfaces for SnapshotReader and SnapshotWriter

2021-11-24 Thread GitBox
socutes commented on pull request #11529: URL: https://github.com/apache/kafka/pull/11529#issuecomment-977674849 @dajac @showuon PTAL, thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to th

[jira] [Resolved] (KAFKA-13457) SocketChannel in Acceptor#accept is not closed upon IOException

2021-11-24 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot resolved KAFKA-13457. - Fix Version/s: 3.2.0 Reviewer: David Jacot Resolution: Fixed > SocketChannel in

[GitHub] [kafka] dajac merged pull request #11504: KAFKA-13457: SocketChannel in Acceptor#accept is not closed upon IOException

2021-11-24 Thread GitBox
dajac merged pull request #11504: URL: https://github.com/apache/kafka/pull/11504 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: jira-unsubscr...

[jira] [Updated] (KAFKA-13457) SocketChannel in Acceptor#accept is not closed upon IOException

2021-11-24 Thread David Jacot (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13457?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] David Jacot updated KAFKA-13457: Summary: SocketChannel in Acceptor#accept is not closed upon IOException (was: socketChannel in A

[GitHub] [kafka] showuon commented on pull request #11530: MINOR:Delete unnecessary comment information

2021-11-24 Thread GitBox
showuon commented on pull request #11530: URL: https://github.com/apache/kafka/pull/11530#issuecomment-977630216 @socutes , sorry that I didn't catch the issue that @dajac mentioned. Please update the PR. Thank you. -- This is an automated message from the Apache Git Service. To respond

[GitHub] [kafka] showuon commented on a change in pull request #11530: MINOR:Delete unnecessary comment information

2021-11-24 Thread GitBox
showuon commented on a change in pull request #11530: URL: https://github.com/apache/kafka/pull/11530#discussion_r755787945 ## File path: raft/src/main/java/org/apache/kafka/snapshot/SnapshotWriter.java ## @@ -113,10 +113,8 @@ private void finalizeSnapshotWithFooter() { *

[GitHub] [kafka] showuon commented on a change in pull request #11530: MINOR:Delete unnecessary comment information

2021-11-24 Thread GitBox
showuon commented on a change in pull request #11530: URL: https://github.com/apache/kafka/pull/11530#discussion_r755787840 ## File path: raft/src/main/java/org/apache/kafka/snapshot/SnapshotWriter.java ## @@ -113,10 +113,8 @@ private void finalizeSnapshotWithFooter() { *

[GitHub] [kafka] dajac commented on a change in pull request #11530: MINOR:Delete unnecessary comment information

2021-11-24 Thread GitBox
dajac commented on a change in pull request #11530: URL: https://github.com/apache/kafka/pull/11530#discussion_r755784474 ## File path: raft/src/main/java/org/apache/kafka/snapshot/SnapshotWriter.java ## @@ -113,10 +113,8 @@ private void finalizeSnapshotWithFooter() { * C