Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi Harsha, The goal we discussed is to aim for preview in AK 3.0. In order to get us there, it will be useful to think about the order in which the code changes will be implemented, reviewed and merged. Since you are driving the development, do you want to layout the order of things? For example,

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #213

See

[GitHub] [kafka-site] showuon commented on pull request #311: MINOR: Fix the wrong HTML format in powered by page

showuon commented on pull request #311: URL: https://github.com/apache/kafka-site/pull/311#issuecomment-725231532 @guozhangwang @scott-confluent , please help review. Thanks. This is an automated message from the Apache Git

[GitHub] [kafka-site] showuon opened a new pull request #311: MINOR: Fix the wrong HTML format in powered by page

showuon opened a new pull request #311: URL: https://github.com/apache/kafka-site/pull/311 When visiting the powered by page, I suddenly found the hyperlink text is weird in SemaText.

[jira] [Created] (KAFKA-10706) Liveness bug in truncation protocol can lead to indefinite URP

Jason Gustafson created KAFKA-10706: --- Summary: Liveness bug in truncation protocol can lead to indefinite URP Key: KAFKA-10706 URL: https://issues.apache.org/jira/browse/KAFKA-10706 Project: Kafka

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #222

See Changes: [github] KAFKA-10470: Zstd upgrade and buffering (#9499) -- [...truncated 3.45 MB...]

[GitHub] [kafka-site] harshach opened a new pull request #310: Add Sriharsha as PMC

harshach opened a new pull request #310: URL: https://github.com/apache/kafka-site/pull/310 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #246

See Changes: [github] KAFKA-10470: Zstd upgrade and buffering (#9499) -- [...truncated 3.46 MB...]

[jira] [Resolved] (KAFKA-10470) zstd decompression with small batches is slow and causes excessive GC

[ https://issues.apache.org/jira/browse/KAFKA-10470?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chia-Ping Tsai resolved KAFKA-10470. Fix Version/s: 2.8.0 Resolution: Fixed > zstd decompression with small batches is

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #212

See Changes: [github] migrate remaining RPCs (#9558) -- [...truncated 3.44 MB...] org.apache.kafka.streams.TopologyTestDriverTest >

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Thanks Kowshik for the link. Seems reasonable, as we discussed on the call, code and completion of this KIP will be taken up by us. Regarding Milestone 2, what you think it needs to be clarified there? I believe what we are promising in the KIP along with unit tests, systems tests will be

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #245

See Changes: [github] migrate remaining RPCs (#9558) -- [...truncated 6.93 MB...] org.apache.kafka.streams.test.ConsumerRecordFactoryTest >

[jira] [Created] (KAFKA-10705) Avoid World Readable RocksDB

Walker Carlson created KAFKA-10705: -- Summary: Avoid World Readable RocksDB Key: KAFKA-10705 URL: https://issues.apache.org/jira/browse/KAFKA-10705 Project: Kafka Issue Type: Bug

[GitHub] [kafka-site] guozhangwang merged pull request #309: adding tencent and bytedance to powered by page

guozhangwang merged pull request #309: URL: https://github.com/apache/kafka-site/pull/309 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [DISCUSS] KIP-631: The Quorum-based Kafka Controller

Hi Coln. Ignore my previous question about ConfigRecord.ResourceType having to be a string -- I now see that org.apache.kafka.common.config.ConfigResource defines the types of configs for an int8. I do have a question about how the broker will connect to the controller. The KIP says that

[GitHub] [kafka-site] scott-confluent opened a new pull request #309: adding tencent and bytedance to powered by page

scott-confluent opened a new pull request #309: URL: https://github.com/apache/kafka-site/pull/309 I also optimized all the logos using imageOptim. This is an automated message from the Apache Git Service. To respond to the

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #220

See Changes: [Ismael Juma] KAFKA-10469: Respect logging hierarchy (KIP-676) (#9266) -- [...truncated 3.45 MB...]

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi Harsha/Satish, Thanks for the discussion today. Here is a link to the KIP-405 development milestones google doc we discussed in the meeting today: https://docs.google.com/document/d/1B5_jaZvWWb2DUpgbgImq0k_IPZ4DWrR8Ru7YpuJrXdc/edit . I have shared it with you. Please have a look and share your

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #244

See Changes: [Ismael Juma] KAFKA-10469: Respect logging hierarchy (KIP-676) (#9266) -- [...truncated 3.45 MB...]

Re: [DISCUSS] KIP-685: Loosen permission for listing reassignments

Makes sense to me. Thanks David. On Tue, Nov 10, 2020 at 6:57 AM David Jacot wrote: > > Hi all, > > I have submitted a small KIP to address KAFKA-10216. This KIP proposes to > change > the permission of the ListPartitionReassignments API to Topic Describe > instead of Cluster Describe. > > KIP:

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #219

See Changes: [github] MINOR: Log resource pattern of ACL updates at INFO level (#9578) -- [...truncated 6.92 MB...]

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #243

See Changes: [github] MINOR: Log resource pattern of ACL updates at INFO level (#9578) -- [...truncated 6.92 MB...]

[DISCUSS] KIP-685: Loosen permission for listing reassignments

Hi all, I have submitted a small KIP to address KAFKA-10216. This KIP proposes to change the permission of the ListPartitionReassignments API to Topic Describe instead of Cluster Describe. KIP:

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

Hi Jun, Thanks for your comments. Please find the inline replies below. 605.2 "Build the local leader epoch cache by cutting the leader epoch sequence received from remote storage to [LSO, ELO]." I mentioned an issue earlier. Suppose the leader's local start offset is 100. The follower finds a

[jira] [Resolved] (KAFKA-10469) Respect logging hierarchy (KIP-676)

[ https://issues.apache.org/jira/browse/KAFKA-10469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ismael Juma resolved KAFKA-10469. - Fix Version/s: 2.8.0 Resolution: Fixed > Respect logging hierarchy (KIP-676) >

Re: Support of virtual threads by Kafka

Hi Leonid, Thanks for looking into this. I think the main question is how virtual threads would help here. Kafka tends to use a small number of threads combined with non blocking IO, but there are some exceptions like disk IO. My understanding is that the latter is still blocking even with the

[jira] [Created] (KAFKA-10704) Mirror maker with TLS at target

Tushar Bhasme created KAFKA-10704: - Summary: Mirror maker with TLS at target Key: KAFKA-10704 URL: https://issues.apache.org/jira/browse/KAFKA-10704 Project: Kafka Issue Type: Bug