Re: [DISCUSSION] Upgrade system tests to python 3

2020-08-24 Thread Nikolay Izhikov
Hello. PR [1] is ready. Please, review. But, I need help with the two following questions: 1. We need a new release of ducktape which includes fixes [2], [3] for python3. I created the issue in ducktape repo [4]. Can someone help me with the release? 2. I know that some companies run system tes

[jira] [Created] (KAFKA-10426) Deadlock in KafkaConfigBackingStore

2020-08-24 Thread Goltseva Taisiia (Jira)
Goltseva Taisiia created KAFKA-10426: Summary: Deadlock in KafkaConfigBackingStore Key: KAFKA-10426 URL: https://issues.apache.org/jira/browse/KAFKA-10426 Project: Kafka Issue Type: Bug

Another nag about PR#9122 addressing StorageException on reassignment with offline log dir

2020-08-24 Thread Noa Resare
As per the instructions in How to Contribute I’m now nagging again about getting a review for PR#9122 which addresses KAFKA-10314 . The PR was was opened 20 day

Re: virtual KIP meeting for KIP-405

2020-08-24 Thread Ben Stopford
Please add me too. On Fri, 21 Aug 2020 at 16:08, Jun Rao wrote: > Hi, Bill, > > Thanks for your interest. Added you. > > Jun > > On Fri, Aug 21, 2020 at 7:42 AM Bill Bejeck wrote: > > > Hi Jun, > > > > I'd like to attend as well. > > > > Thanks, > > Bill > > > > On Fri, Aug 21, 2020 at 10:27 AM

[jira] [Resolved] (KAFKA-10414) Upgrade api-util dependency - CVE-2018-1337

2020-08-24 Thread Daniel Urban (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Urban resolved KAFKA-10414. -- Resolution: Not A Problem api-util is only a test dependency, not an issue. > Upgrade api-uti

Re: virtual KIP meeting for KIP-405

2020-08-24 Thread Jun Rao
Hi, Ben, Thanks for your interest. Added you. Jun On Mon, Aug 24, 2020 at 3:27 AM Ben Stopford wrote: > Please add me too. > > On Fri, 21 Aug 2020 at 16:08, Jun Rao wrote: > > > Hi, Bill, > > > > Thanks for your interest. Added you. > > > > Jun > > > > On Fri, Aug 21, 2020 at 7:42 AM Bill Bej

[jira] [Reopened] (KAFKA-10133) Cannot compress messages in destination cluster with MM2

2020-08-24 Thread Ning Zhang (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-10133?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ning Zhang reopened KAFKA-10133: There is no bug in the code, but need some efforts on doc to clarify on where some frequently used co

[jira] [Created] (KAFKA-10427) Implement FetchSnapshot RPC

2020-08-24 Thread Jose Armando Garcia Sancio (Jira)
Jose Armando Garcia Sancio created KAFKA-10427: -- Summary: Implement FetchSnapshot RPC Key: KAFKA-10427 URL: https://issues.apache.org/jira/browse/KAFKA-10427 Project: Kafka Issue

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2020-08-24 Thread Kowshik Prakasam
Hi Harsha, The following google doc contains a proposal for temporary agenda for the KIP-405 sync meeting tomorrow: https://docs.google.com/document/d/1pqo8X5LU8TpwfC_iqSuVPezhfCfhGkbGN2TqiPA3LBU/edit . Please could you add it to the Google calendar

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2020-08-24 Thread Harsha Ch
"Understand commitments towards driving design & implementation of the KIP further and how it aligns with participant interests in contributing to the efforts (ex: in the context of Uber’s Q3/Q4 roadmap)." What is that about? On Mon, Aug 24, 2020 at 11:05 AM Kowshik Prakasam wrote: > Hi Harsha,

Re: KIP idea: Separate publish request from the subscribe request

2020-08-24 Thread Guozhang Wang
Hello Ming, Thanks for bringing this to the community. Just to clarify your proposal, are you suggesting to use a separate port for fetch requests from all other requests including produce, but also e.g. metadata, commit/fetch-offsets, and other inter-broker requests? If yes that would mean the co

Re: [DISCUSS] KIP-662: Throw Exception when Source Topics of a Streams App are Deleted

2020-08-24 Thread Guozhang Wang
Hello Bruno, Thanks for the KIP, it sounds good to me as well. Just a minor comment: we would include which package the new "MissingSourceTopicException" class belongs to. Guozhang On Fri, Aug 21, 2020 at 11:53 AM John Roesler wrote: > Thanks for the KIP, Bruno! > > Your proposal sounds goo

Build failed in Jenkins: Kafka » kafka-trunk-jdk8 #31

2020-08-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10312; Fix error code returned in Metadata response when leader is not available (#9112) -- [...truncated 3.21 MB...] org.apache.k

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #32

2020-08-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10312; Fix error code returned in Metadata response when leader is not available (#9112) -- [...truncated 3.24 MB...] org.apache

[VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2020-08-24 Thread Leah Thomas
Hi everyone, I'd like to kick-off the vote for KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size. https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+Improve+TimeWindowedDeserializer+and+TimeWindowedSerde+to+handle+window+size Thanks, Leah

Re: [DISCUSS] KIP-640 Add log compression analysis tool

2020-08-24 Thread Alex Wang
Hi, how will this work with encrypted data in logs if/when KIP-317 gets merged? Encrypted data will be hard to compress, so the analyzer tool might need to acquire the decryption key somewhere measure the compression stats. On 2020/08/17 20:23:51, "Christopher Beard (BLOOMBERG/ 919 3RD A)" wro

[jira] [Created] (KAFKA-10428) Mirror Maker connect applies base64 encoding to string headers

2020-08-24 Thread Jennifer Thompson (Jira)
Jennifer Thompson created KAFKA-10428: - Summary: Mirror Maker connect applies base64 encoding to string headers Key: KAFKA-10428 URL: https://issues.apache.org/jira/browse/KAFKA-10428 Project: Kaf

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2020-08-24 Thread John Roesler
Thanks Leah, I’m +1 (binding) -John On Mon, Aug 24, 2020, at 16:54, Leah Thomas wrote: > Hi everyone, > > I'd like to kick-off the vote for KIP-659: Improve > TimeWindowedDeserializer > and TimeWindowedSerde to handle window size. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-659%3A+I

Re: [VOTE] KIP-659: Improve TimeWindowedDeserializer and TimeWindowedSerde to handle window size

2020-08-24 Thread Sophie Blee-Goldman
Thanks for the KIP! +1 (non-binding) Sophie On Mon, Aug 24, 2020 at 5:06 PM John Roesler wrote: > Thanks Leah, > I’m +1 (binding) > > -John > > On Mon, Aug 24, 2020, at 16:54, Leah Thomas wrote: > > Hi everyone, > > > > I'd like to kick-off the vote for KIP-659: Improve > > TimeWindowedDeserial

Build failed in Jenkins: Kafka » kafka-trunk-jdk15 #33

2020-08-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics (#9094) -- [...truncated 3.24 MB...] org.apache.kafka.streams.test.OutputVeri

[jira] [Created] (KAFKA-10429) Group Coordinator is unavailable leads to missing events

2020-08-24 Thread Navinder Brar (Jira)
Navinder Brar created KAFKA-10429: - Summary: Group Coordinator is unavailable leads to missing events Key: KAFKA-10429 URL: https://issues.apache.org/jira/browse/KAFKA-10429 Project: Kafka Is

Jenkins build is back to normal : Kafka » kafka-trunk-jdk8 #32

2020-08-24 Thread Apache Jenkins Server
See

Re: [DISCUSS] KIP-405: Kafka Tiered Storage

2020-08-24 Thread Ying Zheng
We did some basic feature tests at Uber. The test cases and results are shared in this google doc: https://docs.google.com/spreadsheets/d/1XhNJqjzwXvMCcAOhEH0sSXU6RTvyoSf93DHF-YMfGLk/edit?usp=sharing The performance test results were already shared in the KIP last month. On Mon, Aug 24, 2020 at 1

Build failed in Jenkins: Kafka » kafka-trunk-jdk11 #33

2020-08-24 Thread Apache Jenkins Server
See Changes: [github] KAFKA-10054: KIP-613, add TRACE-level e2e latency metrics (#9094) -- [...truncated 6.47 MB...] org.apache.kafka.streams.TopologyTestDriv