Re: [VOTE] KIP-1018: Introduce max remote fetch timeout config

2024-05-09 Thread Satish Duggana
Thanks Kamal for the KIP. +1 from me. ~Satish. On Thu, 9 May 2024 at 17:52, Christo Lolov wrote: > > Heya Kamal, > > Thanks for the KIP and the answers in the discussion! > > +1 from me :) > > Best, > Christo > > On Thu, 9 May 2024 at 11:11, Federico Valeri wrote: > > > +1 non binding > > > >

Re: [VOTE] KIP-932: Queues for Kafka

2024-05-08 Thread Satish Duggana
Hi Andrew, Thanks for the nice KIP, it will allow other messaging use cases to be onboarded to Kafka. +1 from me. Satish. On Tue, 7 May 2024 at 03:41, Jun Rao wrote: > > Hi, Andrew, > > Thanks for the KIP. +1 > > Jun > > On Mon, Mar 18, 2024 at 11:00 AM Edoardo Comar > wrote: > > > Thanks

Re: [VOTE] KIP-1023: Follower fetch from tiered offset

2024-04-26 Thread Satish Duggana
Thanks Abhijeet for the KIP. +1 from me. ~Satish On Fri, 26 Apr 2024 at 8:35 PM, Jun Rao wrote: > Hi, Abhijeet, > > Thanks for the KIP. +1 > > Jun > > On Thu, Apr 25, 2024 at 10:30 PM Abhijeet Kumar < > abhijeet.cse@gmail.com> > wrote: > > > Hi All, > > > > I would like to start the vote

Re: [ANNOUNCE] New Kafka PMC Member: Greg Harris

2024-04-14 Thread Satish Duggana
Congratulations Greg! On Mon, 15 Apr 2024 at 11:04, Claude Warren wrote: > > Congrats Greg! All the hard work paid off. > > On Mon, Apr 15, 2024 at 6:58 AM Ivan Yurchenko wrote: > > > Congrats Greg! > > > > On Sun, Apr 14, 2024, at 22:51, Sophie Blee-Goldman wrote: > > > Congrats Greg! Happy

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

2024-04-09 Thread Satish Duggana
ed storage disablement request is still being > > > processed on a topic? > > > > > > *If the disablement policy is Delete then a successive topic deletion > > > request is going to be a NOOP because RemoteLogs is already being > > deleted.* > > >

Re: [DISCUSS] KIP-1023: Follower fetch from tiered offset

2024-04-09 Thread Satish Duggana
+1 to Jun for adding the consumer fetching from a follower scenario also to the existing section that talked about the drawback when a node built with last-tiered-offset has become a leader. As Abhijeet mentioned, we plan to have a follow-up KIP that will address these by having a deprioritzation

Re: [ANNOUNCE] New committer: Christo Lolov

2024-03-26 Thread Satish Duggana
Congratulations Christo! On Tue, 26 Mar 2024 at 19:20, Ivan Yurchenko wrote: > > Congrats! > > On Tue, Mar 26, 2024, at 14:48, Lucas Brutschy wrote: > > Congrats! > > > > On Tue, Mar 26, 2024 at 2:44 PM Federico Valeri > > wrote: > > > > > > Congrats! > > > > > > On Tue, Mar 26, 2024 at 2:27 

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

2024-03-26 Thread Satish Duggana
on how it could be improved or should I start a >> voting thread? >> >> Best, >> Christo >> >> On Thu, 14 Mar 2024 at 06:12, Luke Chen wrote: >> >> > Hi Christo, >> > >> > Any update with this KIP? >> > If you don't ha

Re: [DISCUSS] Apache Kafka 3.6.2 release

2024-03-13 Thread Satish Duggana
+1, Thanks Mani for volunteering. On Thu, 14 Mar 2024 at 06:01, Luke Chen wrote: > > +1, Thanks Manikumar! > > On Thu, Mar 14, 2024 at 3:40 AM Bruno Cadonna wrote: > > > Thanks Manikumar! > > > > +1 > > > > Best, > > Bruno > > > > On 3/13/24 5:56 PM, Josep Prat wrote: > > > +1 thanks for

Re: [VOTE] KIP-956: Tiered Storage Quotas

2024-03-09 Thread Satish Duggana
Thanks Abhijeet for the KIP, +1 from me. On Sat, 9 Mar 2024 at 1:51 AM, Kamal Chandraprakash < kamal.chandraprak...@gmail.com> wrote: > +1 (non-binding), Thanks for the KIP, Abhijeet! > > -- > Kamal > > On Fri, Mar 8, 2024 at 11:02 PM Jun Rao wrote: > > > Hi, Abhijeet, > > > > Thanks for the

Re: [DISCUSS] Apache Kafka 3.8.0 release

2024-02-28 Thread Satish Duggana
Thanks Josep, +1. On Tue, 27 Feb 2024 at 17:29, Divij Vaidya wrote: > > Thank you for volunteering Josep. +1 from me. > > -- > Divij Vaidya > > > > On Tue, Feb 27, 2024 at 9:35 AM Bruno Cadonna wrote: > > > Thanks Josep! > > > > +1 > > > > Best, > > Bruno > > > > On 2/26/24 9:53 PM, Chris

Re: [kafka-clients] Re: [ANNOUNCE] Apache Kafka 3.7.0

2024-02-28 Thread Satish Duggana
i Kokhreidze, Lianet > > Magrans, Liu Zeyu, Lucas Brutschy, Lucia Cerchie, Luke Chen, maniekes, > > Manikumar Reddy, mannoopj, Maros Orsak, Matthew de Detrich, Matthias > > J. Sax, Max Riedel, Mayank Shekhar Narula, Mehari Beyene, Michael > > Westerby, Mickael Maison, Nick Tel

[jira] [Created] (KAFKA-16161) Avoid creating remote log metadata snapshot file in partition data directory.

2024-01-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-16161: -- Summary: Avoid creating remote log metadata snapshot file in partition data directory. Key: KAFKA-16161 URL: https://issues.apache.org/jira/browse/KAFKA-16161

Re: [DISCUSS] KIP-950: Tiered Storage Disablement

2024-01-17 Thread Satish Duggana
Hi Christo, Thanks for volunteering to contribute to the KIP discussion. I suggest considering this KIP for both ZK and KRaft as it will be helpful for this feature to be available in 3.8.0 running with ZK clusters. Thanks, Satish. On Wed, 17 Jan 2024 at 19:04, Christo Lolov wrote: > > Hello! >

Re: [VOTE] KIP-1005: Expose EarliestLocalOffset and TieredOffset

2024-01-11 Thread Satish Duggana
+1 (binding) Thanks, Satish. On Thu, 11 Jan 2024 at 17:52, Divij Vaidya wrote: > > +1 (binding) > > Divij Vaidya > > > > On Tue, Dec 26, 2023 at 7:05 AM Kamal Chandraprakash < > kamal.chandraprak...@gmail.com> wrote: > > > +1 (non-binding). Thanks for the KIP! > > > > -- > > Kamal > > > > On

Re: [VOTE] KIP-1007: Introduce Remote Storage Not Ready Exception

2024-01-05 Thread Satish Duggana
Thanks Kamal for the KIP. +1 (binding) On Fri, 5 Jan 2024 at 17:04, Divij Vaidya wrote: > > +1 (binding) > > -- > Divij Vaidya > > > > On Thu, Dec 21, 2023 at 10:30 AM Luke Chen wrote: > > > Hi Kamal, > > > > Thanks for the KIP. > > +1 (binding) from me. > > > > Luke > > > > On Thu, Dec 21,

Re: [DISCUSS] KIP-1007: Introduce Remote Storage Not Ready Exception

2024-01-05 Thread Satish Duggana
Thanks for the KIP Kamal, LGTM. On Tue, 26 Dec 2023 at 10:23, Kamal Chandraprakash wrote: > > Hi Divij, > > Thanks for reviewing the KIP! I've updated the KIP with the below > documentation. Let me know if it needs to be changed: > > The consumer can read the local data as long as it knows the

Re: [VOTE] KIP-1013: Drop broker and tools support for Java 11 in Kafka 4.0 (deprecate in 3.7)

2024-01-02 Thread Satish Duggana
Thanks Ismael for the proposal. Adopting JDK 17 enhances developer productivity and has reached a level of maturity that has led to its adoption by several other major projects, signifying its reliability and effectiveness. +1 (binding) ~Satish. On Wed, 3 Jan 2024 at 06:59, Justine Olshan

Re: [ANNOUNCE] New Kafka PMC Member: Divij Vaidya

2023-12-27 Thread Satish Duggana
Congratulations Divij! On Thu, 28 Dec 2023 at 07:21, Kamal Chandraprakash wrote: > > Congrats Divij! > > On Thu, Dec 28, 2023, 07:09 Kirk True wrote: > > > Congrats Divij!!! > > > > On Wed, Dec 27, 2023, at 1:44 PM, Jorge Esteban Quilcate Otoya wrote: > > > Congratulations Divij!! > > > > > >

Re: New Release Branch 3.7

2023-12-14 Thread Satish Duggana
Hi Stanislav, +1 to what Luke mentioned in the earlier email. I have also replied to your comment on https://issues.apache.org/jira/browse/KAFKA-15147 These are minor changes and we plan to target the remaining changes to be merged in the next few days(before 20th Dec). Thanks, Satish. On Thu,

[jira] [Created] (KAFKA-15864) Add more tests asserting the log-start-offset, local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered storage.

2023-11-20 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15864: -- Summary: Add more tests asserting the log-start-offset, local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered storage. Key: KAFKA-15864 URL: https

Re: [DISCUSS] KIP-1005: Add EarliestLocalOffset to GetOffsetShell

2023-11-20 Thread Satish Duggana
Thanks Christo for starting the discussion on the KIP. As mentioned in KAFKA-15857[1], the goal is to add new entries for local-log-start-offset and tierd-offset in OffsetSpec. This will be used in AdminClient APIs and also to be added as part of GetOffsetShell. This was also raised by Kamal in

Re: [VOTE] KIP-963: Additional metrics in Tiered Storage

2023-11-20 Thread Satish Duggana
+1 (binding) Thanks for the KIP and the discussion. Discussion mail thread for the KIP: https://lists.apache.org/thread/40vsyc240hyody37mf2f0pn90shkzb45 On Tue, 21 Nov 2023 at 05:21, Kamal Chandraprakash wrote: > > +1 (non-binding). Thanks for the KIP! > > On Tue, Nov 21, 2023, 03:04 Divij

[jira] [Created] (KAFKA-15857) Introduce LocalLogStartOffset and TieredOffset in OffsetSpec.

2023-11-20 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15857: -- Summary: Introduce LocalLogStartOffset and TieredOffset in OffsetSpec. Key: KAFKA-15857 URL: https://issues.apache.org/jira/browse/KAFKA-15857 Project: Kafka

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-11-20 Thread Satish Duggana
the .delete > suffix we stop serving traffic from those segments, hence we will be > serving requests for those from remote. Am I wrong? > > Best, > Christo > > On Thu, 16 Nov 2023 at 08:45, Satish Duggana > wrote: > > > Thanks Christo for your reply. > > > >

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-11-16 Thread Satish Duggana
well. > > 7. Yes, this is I believe a better explanation than the one I have in the > KIP, so I will aim to update it with your one. Thank you! LocalDeleteLag > makes sense to me as well, I will aim to include it. > > *re: Kamal* > > 1. I can add this to the KIP, but simi

Re: [VOTE] KIP-997: Partition-Level Throughput Metrics

2023-11-15 Thread Satish Duggana
Thanks Qichao for the KIP. +1 (binding) ~Satish. On Thu, 16 Nov 2023 at 02:20, Jorge Esteban Quilcate Otoya wrote: > > Qichao, thanks again for leading this proposal! > > +1 (non-binding) > > Cheers, > Jorge. > > On Wed, 15 Nov 2023 at 19:17, Divij Vaidya wrote: > > > +1 (binding) > > > > I

Re: [DISCUSS] KIP-963: Upload and delete lag metrics in Tiered Storage

2023-11-10 Thread Satish Duggana
Thanks Christo for the KIP and the interesting discussion. 101. Adding metrics at partition level may increase the cardinality of these metrics. We should be cautious of that and see whether they are really needed. RLM related operations do not generally affect based on partition(s) but it is

Re: [ANNOUNCE] New Kafka PMC Member: Satish Duggana

2023-10-31 Thread Satish Duggana
ish! > > >>>> > > >>>> On Sat, Oct 28, 2023 at 12:59 AM Luke Chen wrote: > > >>>>> > > >>>>> Congrats Satish! > > >>>>> > > >>>>> Luke > > >>>>> > >

Re: [DISCUSS] Apache Kafka 3.5.2 release

2023-10-17 Thread Satish Duggana
Thanks Luke for volunteering for 3.5.2 release. On Tue, 17 Oct 2023 at 11:58, Josep Prat wrote: > > Hi Luke, > > Thanks for taking this one! > > Best, > > On Tue, Oct 17, 2023 at 8:12 AM Luke Chen wrote: > > > Hi all, > > > > I'd like to volunteer as release manager for the Apache Kafka 3.5.2,

[jira] [Created] (KAFKA-15612) Followup on whether the indexes need to be materialized before they are passed to RSM for writing them to tiered storage.

2023-10-16 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15612: -- Summary: Followup on whether the indexes need to be materialized before they are passed to RSM for writing them to tiered storage. Key: KAFKA-15612 URL: https

Re: [ANNOUNCE] Apache Kafka 3.6.0

2023-10-12 Thread Satish Duggana
Chen wrote: > > Thanks for running the release, Satish! > > BTW, 3.6.0 should be a major release, not a minor one. :) > > Luke > > On Wed, Oct 11, 2023 at 1:39 PM Satish Duggana wrote: > > > The Apache Kafka community is pleased to announce the r

[jira] [Created] (KAFKA-15594) Add 3.6.0 to streams upgrade/compatibility tests

2023-10-11 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15594: -- Summary: Add 3.6.0 to streams upgrade/compatibility tests Key: KAFKA-15594 URL: https://issues.apache.org/jira/browse/KAFKA-15594 Project: Kafka Issue

[jira] [Created] (KAFKA-15593) Add 3.6.0 to broker/client upgrade/compatibility tests

2023-10-11 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15593: -- Summary: Add 3.6.0 to broker/client upgrade/compatibility tests Key: KAFKA-15593 URL: https://issues.apache.org/jira/browse/KAFKA-15593 Project: Kafka

[jira] [Created] (KAFKA-15576) Add 3.2.0 to broker/client and streams upgrade/compatibility tests

2023-10-10 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15576: -- Summary: Add 3.2.0 to broker/client and streams upgrade/compatibility tests Key: KAFKA-15576 URL: https://issues.apache.org/jira/browse/KAFKA-15576 Project

[ANNOUNCE] Apache Kafka 3.6.0

2023-10-10 Thread Satish Duggana
, Sambhav Jain, Satish Duggana, sciclon2, Shekhar Rajak, Sungyun Hur, Sushant Mahajan, Tanay Karmarkar, tison, Tom Bentley, vamossagar12, Victoria Xia, Vincent Jiang, vveicc, Walker Carlson, Yash Mayya, Yi-Sheng Lien, Ziming Deng, 蓝士钦 We welcome your help and feedback. For more information on how

[jira] [Resolved] (KAFKA-15535) Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property.

2023-10-10 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15535. Resolution: Fixed > Add documentation of "remote.log.index.file.cache.total.si

Re: Apache Kafka 3.6.0 release

2023-10-08 Thread Satish Duggana
29, 2023 at 1:42 PM Ismael Juma wrote: > > > > > Thanks Satish! > > > > > > Ismael > > > > > > On Thu, Sep 28, 2023 at 6:39 AM Satish Duggana > > > > > wrote: > > > > > > > We do not have any pending release blockers f

Re: [VOTE] 3.6.0 RC2

2023-10-03 Thread Satish Duggana
Chandraprakash * Josep Prat * Proven Provenzano * Greg Harris 0 votes * No votes -1 votes * No votes I will continue with the release process and the release announcement will follow in the next few days. Thanks, Satish. On Tue, 3 Oct 2023 at 12:35, Satish Duggana wrote: > > Hi, >

Re: [VOTE] 3.6.0 RC2

2023-10-03 Thread Satish Duggana
egration tests for Connect and MM2 > > - Verified that the connect-test-plugins module is present in the staging > > Maven artifacts (https://issues.apache.org/jira/browse/KAFKA-15249) > > > > Everything looks good to me! > > > > +1 (binding) > > > > Ch

[jira] [Created] (KAFKA-15535) Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property.

2023-10-03 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15535: -- Summary: Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property. Key: KAFKA-15535 URL: https://issues.apache.org/jira/browse/K

Re: [VOTE] 3.6.0 RC2

2023-10-03 Thread Satish Duggana
gt; > > > > > > On Mon, Oct 2, 2023 at 9:50 AM Federico Valeri < > > fedeval...@gmail.com> > > > > > > wrote: > > > > > > > > > > > > > Hi Satish, I did the following to verify the release: > > > >

Re: [VOTE] 3.6.0 RC2

2023-10-03 Thread Satish Duggana
fbd8b63979532a18 > > > > > > > isn't available in documentation (cc: David). I don't consider > > > this as > > > > > a > > > > > > > release blocker but we should add it as a fast follow-up. > > > > > > > > &g

Re: [VOTE] 3.6.0 RC2

2023-10-03 Thread Satish Duggana
otocols. > > > 4. Verified the tiered storage feature works well. > > > > > > +1 (binding). > > > > > > Thanks. > > > Luke > > > > > > > > > > > > On Mon, Oct 2, 2023 at 5:23 AM Jakub Scholz wrote: > > > > >

[jira] [Created] (KAFKA-15530) Add missing documentation of metrics introduced as part of KAFKA-15196

2023-10-03 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15530: -- Summary: Add missing documentation of metrics introduced as part of KAFKA-15196 Key: KAFKA-15530 URL: https://issues.apache.org/jira/browse/KAFKA-15530 Project

[VOTE] 3.6.0 RC2

2023-09-29 Thread Satish Duggana
Hello Kafka users, developers and client-developers, This is the third candidate for the release of Apache Kafka 3.6.0. Some of the major features include: * KIP-405 : Kafka Tiered Storage * KIP-868 : KRaft Metadata Transactions * KIP-875: First-class offsets support in Kafka Connect * KIP-898:

Re: Apache Kafka 3.6.0 release

2023-09-28 Thread Satish Duggana
t; > Found a bug while testing TS feature in 3.6 - > > > > > https://issues.apache.org/jira/browse/KAFKA-15481 > > > > > > > > > > I don't consider it as a blocker for release since it's a concurrency > > > > > bug that should occur rarely for a feature whi

[jira] [Created] (KAFKA-15503) CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1

2023-09-25 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15503: -- Summary: CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1 Key: KAFKA-15503 URL: https://issues.apache.org/jira/browse/KAFKA-15503

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-25 Thread Satish Duggana
ories/GHSA-55g7-9cwv-5qfv > > > > > > > that will cause OOM error in the server. > > > > Kafka is also impacted by this vulnerability since it's like > > CVE-2023-34455 > > > > <https://nvd.nist.gov/vuln/detail/CVE-2023-34455>. > > > &g

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-25 Thread Satish Duggana
locker in v3.6.0. > > > > > > For KAFKA-15489 <https://issues.apache.org/jira/browse/KAFKA-15489>, I'm > > > fine if we decide to fix it in v3.6.1/v3.7.0. > > > > > > +1 (binding) from me. > > > > > > Thank you. >

Re: [ANNOUNCE] New Kafka PMC Member: Justine Olshan

2023-09-23 Thread Satish Duggana
Congratulations Justine!! On Sat, 23 Sept 2023 at 15:46, Bill Bejeck wrote: > > Congrats Justine! > > -Bill > > On Sat, Sep 23, 2023 at 6:23 PM Greg Harris > wrote: > > > Congratulations Justine! > > > > On Sat, Sep 23, 2023 at 5:49 AM Boudjelda Mohamed Said > > wrote: > > > > > > Congrats

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-23 Thread Satish Duggana
gt; > - Run the unit tests > > - Run integration tests > > - Run the quickstart in KRaft and Zookeeper mode > > > > > > I +1 this release (non-binding) > > > > Thanks for your efforts! > > > > On Thu, Sep 21, 2023 at 2:59 AM Satish Duggana >

Re: Apache Kafka 3.6.0 release

2023-09-21 Thread Satish Duggana
ed. With this in mind, it seems to qualify pretty clearly > as a > > regression and we should not put out a release that includes it. > > > > * - Really, these aren't duplicates; rather, they're multiple copies of > the > > same plugin that come from different locations

Re: [ANNOUNCE] New committer: Lucas Brutschy

2023-09-21 Thread Satish Duggana
Congratulations Lucas! On Thu, 21 Sept 2023 at 22:58, Viktor Somogyi-Vass wrote: > > Congrats Lucas! > > On Thu, Sep 21, 2023 at 7:12 PM Alexander Sorokoumov > wrote: > > > Congratulations, Lucas! > > > > On Thu, Sep 21, 2023 at 10:09 AM Walker Carlson > > wrote: > > > > > Congrats Lucas! > >

Re: [ANNOUNCE] New committer: Yash Mayya

2023-09-21 Thread Satish Duggana
Congratulations Yash!! On Thu, 21 Sept 2023 at 22:57, Viktor Somogyi-Vass wrote: > > Congrats Yash! > > On Thu, Sep 21, 2023 at 7:04 PM Josep Prat > wrote: > > > Congrats Yash! > > > > ——— > > Josep Prat > > > > Aiven Deutschland GmbH > > > > Alexanderufer 3-7, 10117 Berlin > > > > Amtsgericht

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-20 Thread Satish Duggana
uldn't consider them > > as blockers to make RC1 as the final release? > > > > [1] https://lists.apache.org/thread/cokoxzd0jtgjtrlxoq7kkzmvpm75381t > > > > On Wed, Sep 20, 2023 at 4:53 PM Satish Duggana > wrote: > > > > > > Hello Kafka users

Re: [kafka-clients] [VOTE] 3.6.0 RC1

2023-09-20 Thread Satish Duggana
; On Wed, Sep 20, 2023 at 4:53 PM Satish Duggana > wrote: > > > > Hello Kafka users, developers and client-developers, > > > > This is the second candidate for the release of Apache Kafka 3.6.0. Some > of the major features include: > > > > * KIP-405 : Kafka

[jira] [Created] (KAFKA-15483) Update metrics documentation for the new metrics implemented as part of KIP-938

2023-09-20 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15483: -- Summary: Update metrics documentation for the new metrics implemented as part of KIP-938 Key: KAFKA-15483 URL: https://issues.apache.org/jira/browse/KAFKA-15483

[jira] [Resolved] (KAFKA-15092) KafkaClusterTestKit in test jar depends on MockFaultHandler

2023-09-20 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15092?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15092. Resolution: Invalid > KafkaClusterTestKit in test jar depends on MockFaultHand

[jira] [Resolved] (KAFKA-15482) kafka.utils.TestUtils Depends on MockTime Which is Not in Any Jar

2023-09-20 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15482?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15482. Resolution: Invalid > kafka.utils.TestUtils Depends on MockTime Which is Not in Any

[VOTE] 3.6.0 RC1

2023-09-20 Thread Satish Duggana
Hello Kafka users, developers and client-developers, This is the second candidate for the release of Apache Kafka 3.6.0. Some of the major features include: * KIP-405 : Kafka Tiered Storage * KIP-868 : KRaft Metadata Transactions * KIP-875: First-class offsets support in Kafka Connect * KIP-898:

Re: [VOTE] 3.6.0 RC0

2023-09-20 Thread Satish Duggana
Thanks Luke for reviewing and running the changes https://github.com/apache/kafka/pull/14409 for merging into 3.6. On Wed, 20 Sept 2023 at 06:09, Satish Duggana wrote: > > Hi David, > Thanks for the update. Please get it reviewed sooner. I plan to create > RC1 in th

Re: [VOTE] 3.6.0 RC0

2023-09-19 Thread Satish Duggana
afka/pull/14409 > > On Tue, Sep 19, 2023 at 12:57 PM Satish Duggana > wrote: > > > Hi All, > > I will start creating a new RC with the fix and send it for a vote by > > tomorrow as https://issues.apache.org/jira/browse/KAFKA-15473 is > > determined to be a release bloc

Re: [VOTE] 3.6.0 RC0

2023-09-19 Thread Satish Duggana
Hi All, I will start creating a new RC with the fix and send it for a vote by tomorrow as https://issues.apache.org/jira/browse/KAFKA-15473 is determined to be a release blocker. Thanks. Satish. On Tue, 19 Sept 2023 at 22:26, Satish Duggana wrote: > > Thanks Chris for your c

Re: [VOTE] 3.6.0 RC0

2023-09-19 Thread Satish Duggana
documentation contains the newly introduced error code as > > > part of tiered storage > > > > > > 3. verified that public keys for RM are available at > > > https://keys.openpgp.org/ > > > > > > 4. verified that public keys for RM are available at > &g

Re: [VOTE] 3.6.0 RC0

2023-09-19 Thread Satish Duggana
as part of the release. I think we should probably take this down until > > > we're done with the release, otherwise users stumbling on this post could > > > get confused. It also contains some broken links. > > > > > > Thanks! > > > David

Re: Apache Kafka 3.6.0 release

2023-09-19 Thread Satish Duggana
endpoint lists duplicates which may > > cause confusion for users, or poor behavior in clients. > > Using the other REST API endpoints appears unaffected. > > I'll open a PR for this later today. > > > > Thanks, > > Greg > > > > On Thu, Se

Re: [VOTE] 3.6.0 RC0

2023-09-17 Thread Satish Duggana
On Sun, 17 Sept 2023 at 23:00, Satish Duggana wrote: > Hello Kafka users, developers and client-developers, > > This is the first candidate for the release of Apache Kafka 3.6.0. Some of > the major features include: > > * KIP-405 : Kafka Tiered Storage > * KIP-868 : KRaft

[VOTE] 3.6.0 RC0

2023-09-17 Thread Satish Duggana
Hello Kafka users, developers and client-developers, This is the first candidate for the release of Apache Kafka 3.6.0. Some of the major features include: * KIP-405 : Kafka Tiered Storage * KIP-868 : KRaft Metadata Transactions * KIP-875: First-class offsets support in Kafka Connect * KIP-898:

Re: Apache Kafka 3.6.0 release

2023-09-14 Thread Satish Duggana
. > > Hopefully nothing more from me on this release. > > Thanks, > Justine > > On Wed, Sep 13, 2023 at 9:51 PM Satish Duggana > wrote: > > > Thanks Luke for the update. > > > > ~Satish. > > > > On Thu, 14 Sept 2023 at 07:29, Luke Ch

[jira] [Resolved] (KAFKA-7739) Kafka Tiered Storage

2023-09-14 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-7739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-7739. --- Resolution: Fixed > Kafka Tiered Storage > > >

Re: Apache Kafka 3.6.0 release

2023-09-13 Thread Satish Duggana
gt; > > > > Hi Satish, this is a small documentation fix about ZK to KRaft > > > migration, that we would like to backport to 3.5 and 3.6 branches. Are > > > you ok with that? > > > > > > https://github.com/apache/kafka/pull/14366 > > > &g

Re: Apache Kafka 3.6.0 release

2023-09-12 Thread Satish Duggana
gt; > > I'm not as familiar with the rules around minor releases, but adding it > > > there would give more time to ensure stability. > > > > > > Thanks, > > > Justine > > > > > > On Tue, Sep 12, 2023 at 5:49 AM Satish Duggana > > > > > w

Re: Apache Kafka 3.6.0 release

2023-09-12 Thread Satish Duggana
uld > > be > > > > nice to say that hanging transactions are fully covered in a 3.6 > > release. > > > > I'm not as familiar with the rules around minor releases, but adding it > > > > there would give more time to ensure stability. > > > > >

Re: Apache Kafka 3.6.0 release

2023-09-12 Thread Satish Duggana
I think we can get this one committed to trunk today. > > > > -David > > > > > > > > On Sun, Sep 10, 2023 at 7:50 PM Ismael Juma wrote: > > > > > Hi Satish, > > > > > > That sounds great. I think we should aim to only allow blockers >

Re: Apache Kafka 3.6.0 release

2023-09-12 Thread Satish Duggana
> > (regressions, impactful security issues, etc.) on the 3.6 branch until > > 3.6.0 is out. > > > > Ismael > > > > > > On Sat, Sep 9, 2023, 12:20 AM Satish Duggana > > wrote: > > > > > Hi Ismael, > > > It looks like we wil

[jira] [Resolved] (KAFKA-14993) Improve TransactionIndex instance handling while copying to and fetching from RSM.

2023-09-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14993?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-14993. Resolution: Fixed > Improve TransactionIndex instance handling while copy

[jira] [Created] (KAFKA-15453) Enable `testFencingOnTransactionExpiration` in TransactionsWithTieredStoreTest

2023-09-11 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15453: -- Summary: Enable `testFencingOnTransactionExpiration` in TransactionsWithTieredStoreTest Key: KAFKA-15453 URL: https://issues.apache.org/jira/browse/KAFKA-15453

[jira] [Resolved] (KAFKA-15352) Ensure consistency while deleting the remote log segments

2023-09-11 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15352?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15352. Resolution: Fixed > Ensure consistency while deleting the remote log segme

Re: Apache Kafka 3.6.0 release

2023-09-09 Thread Satish Duggana
RSM contract: throw an > > > exception instead of returning an empty InputStream. Maybe it should be > > > included right away to save the migration later? What do you think? > > > > > > Best, > > > Ivan > > > > > > On Fri, Sep 8, 2023, at 0

Re: Apache Kafka 3.6.0 release

2023-09-09 Thread Satish Duggana
be a small, but still a change in the RSM contract: throw an > > exception instead of returning an empty InputStream. Maybe it should be > > included right away to save the migration later? What do you think? > > > > Best, > > Ivan > > > > On Fri, S

Re: Apache Kafka 3.6.0 release

2023-09-09 Thread Satish Duggana
uld be included right > away to save the migration later? What do you think? > > Best, > Ivan > > On Fri, Sep 8, 2023, at 02:52, Satish Duggana wrote: > > Hi Jose, > > Thanks for looking into this issue and resolving it with a quick fix. > > > > ~Satish. &

Re: Apache Kafka 3.6.0 release

2023-09-07 Thread Satish Duggana
Hi Jose, Thanks for looking into this issue and resolving it with a quick fix. ~Satish. On Thu, 7 Sept 2023 at 21:40, José Armando García Sancio wrote: > > Hi Satish, > > On Wed, Sep 6, 2023 at 4:58 PM Satish Duggana > wrote: > > > > Hi Greg, > > It seems http

Re: Apache Kafka 3.6.0 release

2023-09-06 Thread Satish Duggana
o made the migration more reliable and fault > > tolerant with the inclusion of KIP-868 transactions. I'd be happy to write > > something for the release notes when the time comes, if it's helpful. > > > > Thanks! > > David > > > > On Tue, Sep 5, 2023 at 8:13 P

Re: Apache Kafka 3.6.0 release

2023-09-06 Thread Satish Duggana
it's helpful. > > Thanks! > David > > On Tue, Sep 5, 2023 at 8:13 PM Satish Duggana > wrote: > > > Hi David, > > Thanks for bringing this issue to this thread. > > I marked https://issues.apache.org/jira/browse/KAFKA-15435 as a blocker. > > >

[jira] [Resolved] (KAFKA-15245) Improve Tiered Storage Metrics

2023-09-06 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15245. Resolution: Fixed > Improve Tiered Storage Metr

[jira] [Created] (KAFKA-15439) Add transaction tests enabled with tiered storage

2023-09-06 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15439: -- Summary: Add transaction tests enabled with tiered storage Key: KAFKA-15439 URL: https://issues.apache.org/jira/browse/KAFKA-15439 Project: Kafka Issue

Re: Apache Kafka 3.6.0 release

2023-09-05 Thread Satish Duggana
> > I was thinking I could also add it to 3.6 since it is fairly low > > risk. > > > > > What do you think? > > > > > > > > > > Justine > > > > > > > > > > On Sat, Sep 2, 2023 at 6:21 PM Sophie Blee-Goldman <

[jira] [Resolved] (KAFKA-15293) Update metrics doc to add tiered storage metrics

2023-09-05 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15293?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15293. Resolution: Fixed > Update metrics doc to add tiered storage metr

[jira] [Created] (KAFKA-15434) Tiered Storage Quotas

2023-09-05 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15434: -- Summary: Tiered Storage Quotas Key: KAFKA-15434 URL: https://issues.apache.org/jira/browse/KAFKA-15434 Project: Kafka Issue Type: Improvement

[jira] [Created] (KAFKA-15433) Follower fetch from tiered offset

2023-09-05 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15433: -- Summary: Follower fetch from tiered offset Key: KAFKA-15433 URL: https://issues.apache.org/jira/browse/KAFKA-15433 Project: Kafka Issue Type

Re: Apache Kafka 3.6.0 release

2023-09-04 Thread Satish Duggana
Goldman > > wrote: > > > >> Thanks Satish! The fix has been merged and cherrypicked to 3.6 > >> > >> On Sat, Sep 2, 2023 at 6:02 AM Satish Duggana > >> wrote: > >> > >> > Hi Sophie, > >> > Please feel free to add that to

[jira] [Resolved] (KAFKA-15260) RLM Task should wait until RLMM is initialized before copying segments to remote

2023-09-03 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15260?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15260. Resolution: Fixed > RLM Task should wait until RLMM is initialized before copy

[jira] [Resolved] (KAFKA-9564) Integration Test framework for Tiered Storage

2023-09-03 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9564?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-9564. --- Resolution: Fixed > Integration Test framework for Tiered Stor

Re: Apache Kafka 3.6.0 release

2023-09-02 Thread Satish Duggana
owse/KAFKA-15429 > > On Thu, Aug 31, 2023 at 5:45 PM Satish Duggana > wrote: > > > Thanks Chris for bringing this issue here and filing the new JIRA for > > 3.6.0[1]. It seems to be a blocker for 3.6.0. > > > > Please help review https://github.com/a

Re: Apache Kafka 3.6.0 release

2023-08-31 Thread Satish Duggana
if you agree that this qualifies as a blocker. I plan > > on publishing a potential fix sometime this week. > > > > Cheers, > > > > Chris > > > > On Wed, Aug 30, 2023 at 9:19 AM Satish Duggana > > wrote: > > > >> Hi, > >>

[jira] [Resolved] (KAFKA-9565) Implementation of Tiered Storage SPI to integrate with S3

2023-08-31 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9565?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-9565. --- Resolution: Won't Fix > Implementation of Tiered Storage SPI to integrate with

[jira] [Resolved] (KAFKA-12458) Implementation of Tiered Storage Integration with Azure Storage (ADLS + Blob Storage)

2023-08-31 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12458?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-12458. Resolution: Won't Do > Implementation of Tiered Storage Integration with Azure Stor

[jira] [Created] (KAFKA-15420) Kafka Tiered Storage V1

2023-08-31 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15420: -- Summary: Kafka Tiered Storage V1 Key: KAFKA-15420 URL: https://issues.apache.org/jira/browse/KAFKA-15420 Project: Kafka Issue Type: Improvement

[jira] [Resolved] (KAFKA-13097) Handle the requests gracefully to publish the events in TopicBasedRemoteLogMetadataManager when it is not yet initialized.

2023-08-31 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-13097. Resolution: Invalid > Handle the requests gracefully to publish the eve

  1   2   3   4   >