[jira] [Created] (KAFKA-14638) Documentation for transaction.timeout.ms should be more precise

2023-01-18 Thread Alex Sorokoumov (Jira)
Alex Sorokoumov created KAFKA-14638: --- Summary: Documentation for transaction.timeout.ms should be more precise Key: KAFKA-14638 URL: https://issues.apache.org/jira/browse/KAFKA-14638 Project: Kafka

Re: Tumbling windows offset

2023-01-18 Thread Matthias J. Sax
You can use a custom window implementation to do this. Cf https://github.com/confluentinc/kafka-streams-examples/blob/7.1.1-post/src/test/java/io/confluent/examples/streams/window/DailyTimeWindows.java -Matthias On 1/18/23 6:33 AM, Amsterdam Luís de Lima Filho wrote: Hello everyone, I

Re: [DISCUSS] KIP-890 Server Side Defense

2023-01-18 Thread Justine Olshan
Yeah -- looks like we already have code to handle bumping the epoch and when the epoch is Short.MAX_VALUE, we get a new producer ID. Since this is already the behavior, do we want to change it further? Justine On Wed, Jan 18, 2023 at 1:12 PM Justine Olshan wrote: > Hey all, just wanted to

Jenkins build is unstable: Kafka » Kafka Branch Builder » trunk #1520

2023-01-18 Thread Apache Jenkins Server
See

Re: [VOTE] 3.3.2 RC1

2023-01-18 Thread Matthias J. Sax
Done. On 1/18/23 10:36 AM, Chris Egerton wrote: Thanks Mickael! @John, @Matthias -- would either of you be able to lend a hand with the push to S3? Cheers, Chris On Tue, Jan 17, 2023 at 12:24 PM Mickael Maison mailto:mickael.mai...@gmail.com>> wrote: Hi Chris, I've pushed the

Re: [DISCUSS] KIP-890 Server Side Defense

2023-01-18 Thread Justine Olshan
Hey all, just wanted to quickly update and say I've modified the KIP to explicitly mention that AddOffsetCommitsToTxnRequest will be replaced by a coordinator-side (inter-broker) AddPartitionsToTxn implicit request. This mirrors the user partitions and will implicitly add offset partitions to

Re: [DISCUSS] KIP-875: First-class offsets support in Kafka Connect

2023-01-18 Thread Greg Harris
Hi Chris, I had some clarifying questions about the alterOffsets hooks. The KIP includes these elements of the design: * The Javadoc for the methods mentions that the alterOffsets methods are only called on started and initialized connector objects. * The 'Altering' and 'Resetting' offsets

[jira] [Created] (KAFKA-14637) Upgrade to 3.4 from old versions (< 0.10) are failing due to incompatible meta.properties check

2023-01-18 Thread Akhilesh Chaganti (Jira)
Akhilesh Chaganti created KAFKA-14637: - Summary: Upgrade to 3.4 from old versions (< 0.10) are failing due to incompatible meta.properties check Key: KAFKA-14637 URL:

[VOTE] KIP-875: First-class offsets support in Kafka Connect

2023-01-18 Thread Chris Egerton
Hi all, I'd like to call for a vote on KIP-875, which adds support for viewing and manipulating the offsets of connectors to the Kafka Connect REST API. The KIP: https://cwiki.apache.org/confluence/display/KAFKA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect The discussion thread:

Re: [VOTE] 3.3.2 RC1

2023-01-18 Thread Chris Egerton
Thanks Mickael! @John, @Matthias -- would either of you be able to lend a hand with the push to S3? Cheers, Chris On Tue, Jan 17, 2023 at 12:24 PM Mickael Maison wrote: > Hi Chris, > > I've pushed the artifacts to > https://dist.apache.org/repos/dist/release/kafka/ and added your key > to

[GitHub] [kafka-site] wcarlson5 merged pull request #479: MINOR: Add Walker as a committer

2023-01-18 Thread GitBox
wcarlson5 merged PR #479: URL: https://github.com/apache/kafka-site/pull/479 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Tumbling windows offset

2023-01-18 Thread Amsterdam Luís de Lima Filho
Hello everyone, I need to perform windowed aggregation for weekly interval, from Monday to Monday, using Tumbling Windows. It does not seem to be supported: https://stackoverflow.com/questions/72785744/how-to-apply-an-offset-to-tumbling-window-in-order-to-delay-the-starting-of-win Can

[jira] [Created] (KAFKA-14636) Compression optimization: Use zstd dictionary based (de)compression

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14636: Summary: Compression optimization: Use zstd dictionary based (de)compression Key: KAFKA-14636 URL: https://issues.apache.org/jira/browse/KAFKA-14636 Project: Kafka

[jira] [Created] (KAFKA-14635) Compression optimization: Use direct memory buffers for (de)compression

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14635: Summary: Compression optimization: Use direct memory buffers for (de)compression Key: KAFKA-14635 URL: https://issues.apache.org/jira/browse/KAFKA-14635 Project:

[jira] [Created] (KAFKA-14634) Compression optimization: Calculate the size of decompressed buffer dynamically at runtime.

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14634: Summary: Compression optimization: Calculate the size of decompressed buffer dynamically at runtime. Key: KAFKA-14634 URL: https://issues.apache.org/jira/browse/KAFKA-14634

[jira] [Created] (KAFKA-14633) Compression optimization: Use BufferSupplier to allocate the intermediate decompressed buffer

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14633: Summary: Compression optimization: Use BufferSupplier to allocate the intermediate decompressed buffer Key: KAFKA-14633 URL: https://issues.apache.org/jira/browse/KAFKA-14633

[jira] [Created] (KAFKA-14632) Compression optimization: Remove unnecessary intermediate buffers

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14632: Summary: Compression optimization: Remove unnecessary intermediate buffers Key: KAFKA-14632 URL: https://issues.apache.org/jira/browse/KAFKA-14632 Project: Kafka

[jira] [Created] (KAFKA-14631) Compression optimization: do not read the key/value for last record in the batch

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14631: Summary: Compression optimization: do not read the key/value for last record in the batch Key: KAFKA-14631 URL: https://issues.apache.org/jira/browse/KAFKA-14631

[jira] [Created] (KAFKA-14630) Update zstd-jni version to 1.5.2-4

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14630: Summary: Update zstd-jni version to 1.5.2-4 Key: KAFKA-14630 URL: https://issues.apache.org/jira/browse/KAFKA-14630 Project: Kafka Issue Type: Sub-task

[jira] [Created] (KAFKA-14629) Performance improvement for Zstd compressed workload

2023-01-18 Thread Divij Vaidya (Jira)
Divij Vaidya created KAFKA-14629: Summary: Performance improvement for Zstd compressed workload Key: KAFKA-14629 URL: https://issues.apache.org/jira/browse/KAFKA-14629 Project: Kafka Issue

[DISCUSS] KIP-899: Allow clients to rebootstrap

2023-01-18 Thread Ivan Yurchenko
Hello! I would like to start the discussion thread on KIP-899: Allow clients to rebootstrap. This KIP proposes to allow Kafka clients to repeat the bootstrap process when fetching metadata if none of the known nodes are available.

Re: [ANNOUNCE] New committer: Stanislav Kozlovski

2023-01-18 Thread Pere Urbón Bayes
Congrats Stan, very well deserved. -- Pere On Wed, Jan 18, 2023 at 7:51 AM Yash Mayya wrote: > Congratulations, Stan! > > On Tue, Jan 17, 2023 at 9:20 PM Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > > Stanislav Kozlovski.

Re: [ANNOUNCE] New committer: Walker Carlson

2023-01-18 Thread Bruno Cadonna
Congrats, Walker! Well deserved! Best, Bruno On 18.01.23 05:29, Sagar wrote: Congratulations Walker! Thanks! Sagar. On Wed, Jan 18, 2023 at 9:32 AM Tom Bentley wrote: Congratulations! On Wed, 18 Jan 2023 at 01:26, John Roesler wrote: Congratulations, Walker! -John On Tue, Jan 17,

Re: [DISCUSS] KIP-895: Dynamically refresh partition count of __consumer_offsets

2023-01-18 Thread Christo Lolov
Greetings, I am bumping the below DISCUSSion thread for KIP-895. The KIP presents a situation where consumer groups are in an undefined state until a rolling restart of a cluster is performed. While I have demonstrated the behaviour using a cluster using Zookeeper I believe the same problem can

[jira] [Created] (KAFKA-14628) Move CommandLineUtils and CommandDefaultOptions shared classes

2023-01-18 Thread Federico Valeri (Jira)
Federico Valeri created KAFKA-14628: --- Summary: Move CommandLineUtils and CommandDefaultOptions shared classes Key: KAFKA-14628 URL: https://issues.apache.org/jira/browse/KAFKA-14628 Project: Kafka

Re: [ANNOUNCE] New committer: Walker Carlson

2023-01-18 Thread Mickael Maison
Congratulations Walker! On Wed, Jan 18, 2023 at 7:52 AM Yash Mayya wrote: > > Congrats, Walker! > > On Wed, Jan 18, 2023 at 3:27 AM Matthias J. Sax wrote: > > > Dear community, > > > > I am pleased to announce Walker Carlson as a new Kafka committer. > > > > Walker has been contributing to