[jira] [Resolved] (KAFKA-13097) Handle the requests gracefully to publish the events in TopicBasedRemoteLogMetadataManager when it is not yet initialized.

2023-08-31 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-13097. Resolution: Invalid > Handle the requests gracefully to publish the eve

Re: Apache Kafka 3.6.0 release

2023-08-30 Thread Satish Duggana
wrote: > > Hey Satish, > Everything should be in 3.6, and I will update the release plan wiki. > Thanks! > > On Fri, Aug 25, 2023 at 4:08 AM Satish Duggana > wrote: > > > Hi Justine, > > Adding KIP-890 part-1 to 3.6.0 seems reasonable to me. This part looks &

Re: Apache Kafka 3.6.0 release

2023-08-25 Thread Satish Duggana
wrote: > > Hey Satish, > Does it make sense to include KIP-890 part 1? It prevents hanging > transactions for older clients. (An optimization and stronger EOS > guarantees will be included in part 2) > > Thanks, > Justine > > On Mon, Aug 21, 2023 at 3:29 AM Satish Dugga

[jira] [Created] (KAFKA-15388) Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

2023-08-21 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15388: -- Summary: Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage. Key: KAFKA-15388 URL

Re: Apache Kafka 3.6.0 release

2023-08-21 Thread Satish Duggana
Hi, 3.6 branch is created. Please make sure any PRs targeted for 3.6.0 should be merged to 3.6 branch once those are merged to trunk. Thanks, Satish. On Wed, 16 Aug 2023 at 15:58, Satish Duggana wrote: > > Hi, > Please plan to merge PRs(including the major features) targeted fo

[jira] [Resolved] (KAFKA-15386) Update log-start-offset in RLM task for a leader partition for the earliest leader epoch of the current leader's leader epoch lineage available in the remote storage.

2023-08-20 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15386?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15386. Resolution: Duplicate > Update log-start-offset in RLM task for a leader partit

[jira] [Created] (KAFKA-15386) Update log-start-offset in RLM task for a leader partition for the earliest leader epoch of the current leader's leader epoch lineage available in the remote storage.

2023-08-20 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15386: -- Summary: Update log-start-offset in RLM task for a leader partition for the earliest leader epoch of the current leader's leader epoch lineage available in the remote storage. Key: KAFKA

[jira] [Created] (KAFKA-15376) Revisit removing data earlier to the current leader for topics enabled with tiered storage.

2023-08-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15376: -- Summary: Revisit removing data earlier to the current leader for topics enabled with tiered storage. Key: KAFKA-15376 URL: https://issues.apache.org/jira/browse/KAFKA-15376

Re: Apache Kafka 3.6.0 release

2023-08-16 Thread Satish Duggana
Aug 2023 at 18:39, Chris Egerton wrote: > > Thanks for adding KIP-949, Satish! > > On Fri, Aug 4, 2023 at 7:06 AM Satish Duggana > wrote: > > > Hi, > > Myself and Divij discussed and added the wiki for Kafka TieredStorage > > Early Access Release[1]. If you h

[jira] [Created] (KAFKA-15313) Delete remote log segments partition asynchronously when a partition is deleted.

2023-08-08 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15313: -- Summary: Delete remote log segments partition asynchronously when a partition is deleted. Key: KAFKA-15313 URL: https://issues.apache.org/jira/browse/KAFKA-15313

Re: Apache Kafka 3.6.0 release

2023-08-04 Thread Satish Duggana
, 4 Aug 2023 at 08:40, Satish Duggana wrote: > > Hi Chris, > Thanks for the update. This looks to be a minor change and is also > useful for backward compatibility. I added it to the release plan as > an exceptional case. > > ~Satish. > > On Thu, 3 Aug 2023 at 21:34, Chris

Re: Apache Kafka 3.6.0 release

2023-08-03 Thread Satish Duggana
e in order to > patch an accidental break in backwards compatibility caused a few versions > ago. > > Best, > > Chris > > On Fri, Jul 28, 2023 at 2:35 AM Satish Duggana > wrote: > > > Hi All, > > Whoever has KIP entries in the 3.6.0 release plan. Please update it

[jira] [Created] (KAFKA-15300) Include remotelog size in complete log size and also add local log size and remote log size separately in kafka-log-dirs tool.

2023-08-02 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15300: -- Summary: Include remotelog size in complete log size and also add local log size and remote log size separately in kafka-log-dirs tool. Key: KAFKA-15300 URL: https

[jira] [Created] (KAFKA-15285) https://github.com/apache/kafka/pull/13990#issuecomment-1659256150

2023-07-31 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15285: -- Summary: https://github.com/apache/kafka/pull/13990#issuecomment-1659256150 Key: KAFKA-15285 URL: https://issues.apache.org/jira/browse/KAFKA-15285 Project

Re: [VOTE] KIP-930: Tiered Storage Metrics

2023-07-30 Thread Satish Duggana
open longer for some duration > (at least 2 weeks) to give an opportunity for folks in the community > to add any thoughts that they might have. The KIP has been published > for only 1 day so far and interested folks may not have had a chance > to look into it yet. > > -- > Divij Va

Re: Apache Kafka 3.6.0 release

2023-07-28 Thread Satish Duggana
Hi All, Whoever has KIP entries in the 3.6.0 release plan. Please update it with the latest status by tomorrow(end of the day 29th Jul UTC ). Thanks Satish. On Fri, 28 Jul 2023 at 12:01, Satish Duggana wrote: > > Thanks Ismael and Divij for the suggestions. > > One way was to follow

Re: Apache Kafka 3.6.0 release

2023-07-28 Thread Satish Duggana
Thanks Ismael and Divij for the suggestions. One way was to follow the earlier guidelines that we set for any early access release. It looks Ismael already mentioned the example of KRaft. KIP-405 mentions upgrade/downgrade and limitations sections. We can clarify that in the release notes for

[jira] [Created] (KAFKA-15265) Remote copy/fetch quotas for tiered storage.

2023-07-27 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15265: -- Summary: Remote copy/fetch quotas for tiered storage. Key: KAFKA-15265 URL: https://issues.apache.org/jira/browse/KAFKA-15265 Project: Kafka Issue Type

Re: Apache Kafka 3.6.0 release

2023-07-26 Thread Satish Duggana
ed ( > https://cwiki.apache.org/confluence/display/KAFKA/Bylaws#Bylaws-Approvals). > The non-binding votes from people who aren't committers (including myself) > don't count towards the required lazy majority. > > Thanks, > Yash > > On Wed, Jul 26, 2023 at 7:35 PM Sati

Re: Apache Kafka 3.6.0 release

2023-07-26 Thread Satish Duggana
ake the necessary updates and inform me so > that I can keep the plan accurate and up to date. > > Thanks, > Satish. > > On Mon, 17 Apr 2023 at 21:17, Luke Chen wrote: > > > > Thanks for volunteering! > > > > +1 > > > > Luke > > > &g

Re: Apache Kafka 3.6.0 release

2023-07-25 Thread Satish Duggana
Thanks for the update, Mayank Shekhar. On Tue, 25 Jul 2023 at 15:48, Mayank Shekhar Narula wrote: > > Hi Satish > > Heads up KIP-951 is under voting. This could be delayed by a day or two for > the 3.6 KIP deadline. > > On Tue, Jul 25, 2023 at 4:19 AM Satish Duggana > w

Re: [VOTE] KIP-930: Tiered Storage Metrics

2023-07-25 Thread Satish Duggana
+1 for the KIP. Thanks, Satish. On Tue, 25 Jul 2023 at 18:31, Kamal Chandraprakash wrote: > > +1 (non-binding) > > -- > Kamal > > On Tue, Jul 25, 2023 at 11:30 AM Abhijeet Kumar > wrote: > > > Hi All, > > > > I would like to start the vote for KIP-930 Tiered Storage Metrics. > > > > The KIP is

Re: [DISCUSS] KIP-930: Tiered Storage Metrics

2023-07-25 Thread Satish Duggana
Hi Abhijeet, Thanks for keeping this KIP only to renaming the existing metrics for better clarity. These new names look good to me. ~Satish. On Tue, 25 Jul 2023 at 13:12, Luke Chen wrote: > > Hi Abhijeet, > > Thanks for the KIP! > I don't have much preference for the name changing. > But if it

Re: Apache Kafka 3.6.0 release

2023-07-24 Thread Satish Duggana
(The JIRA is open now for > review.) Same for KIP-919 which is being voted on now. > > best, > Colin > > On Mon, Jul 24, 2023, at 03:59, Satish Duggana wrote: > > A gentle reminder on the KIP freeze date: 26th Jul. Please try to > > close discussion/vote threads asap. &g

Re: Apache Kafka 3.6.0 release

2023-07-24 Thread Satish Duggana
A gentle reminder on the KIP freeze date: 26th Jul. Please try to close discussion/vote threads asap. Thanks, Satish. On Sun, 23 Jul 2023 at 11:10, Satish Duggana wrote: > > Thanks Colov/Divij for adding the KIP-952. I do not think it is a > blocker for 3.6.0. We can discus

[jira] [Created] (KAFKA-15241) Compute tiered offset by keeping the respective epochs in scope.

2023-07-24 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15241: -- Summary: Compute tiered offset by keeping the respective epochs in scope. Key: KAFKA-15241 URL: https://issues.apache.org/jira/browse/KAFKA-15241 Project: Kafka

Re: Apache Kafka 3.6.0 release

2023-07-22 Thread Satish Duggana
Thanks Colov/Divij for adding the KIP-952. I do not think it is a blocker for 3.6.0. We can discuss the KIP in the respective thread. ~Satish. On Sun, 23 Jul 2023 at 07:21, Satish Duggana wrote: > > Thanks ShunKang for the update. I added both the KIPs to the wiki. > Please feel free

Re: Apache Kafka 3.6.0 release

2023-07-22 Thread Satish Duggana
.org/confluence/display/KAFKA/KIP-952%3A+Regenerate+segment-aligned+producer+snapshots+when+upgrading+to+a+Kafka+version+supporting+Tiered+Storage > > > > > > -- > > Divij Vaidya > > > > > > > > On Sat, Jul 22, 2023 at 6:41 AM Satish Duggana > &g

Re: Apache Kafka 3.6.0 release

2023-07-22 Thread Satish Duggana
ged into 3.6 - > > 3. > https://cwiki.apache.org/confluence/display/KAFKA/KIP-952%3A+Regenerate+segment-aligned+producer+snapshots+when+upgrading+to+a+Kafka+version+supporting+Tiered+Storage > > > -- > Divij Vaidya > > > > On Sat, Jul 22, 2023 at 6:41 AM Satish Duggana

Re: Apache Kafka 3.6.0 release

2023-07-21 Thread Satish Duggana
gt; > > > [1] > > > > https://cwiki.apache.org/confluence/display/KAFKA/KIP-952%3A+Regenerate+segment-aligned+producer+snapshots+when+upgrading+to+a+Kafka+version+supporting+Tiered+Storage > > > > Best, > > Christo > > > > On Sat, 8 Jul 2023 at 13:06

Re: [VOTE] KIP-852: Optimize calculation of size for log in remote tier

2023-07-18 Thread Satish Duggana
+1 Thanks Divij for addressing the comments in the KIP. LGTM. ~Satish. On Thu, 13 Jul 2023 at 18:10, Jorge Esteban Quilcate Otoya wrote: > > +1 (non-binding) > > Thanks for the KIP! > > Jorge. > > On Thu, 13 Jul 2023 at 12:26, Luke Chen wrote: > > > +1 (binding) from me. > > > > Thanks for

Re: [ANNOUNCE] New committer: Greg Harris

2023-07-10 Thread Satish Duggana
Congratulations Greg! On Mon, 10 Jul 2023 at 22:19, Justine Olshan wrote: > > Congrats Greg! > > On Mon, Jul 10, 2023 at 9:40 AM Tom Bentley wrote: > > > Congratulations! > > > > On Mon, 10 Jul 2023 at 17:32, wrote: > > > > > Congrats Greg! > > > > > > - > > > Gaurav > > > > > > > On 10 Jul

[jira] [Created] (KAFKA-15169) Add a test to make sure the remote index file is overwritten for the earlier existing(corrupted) files.

2023-07-09 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15169: -- Summary: Add a test to make sure the remote index file is overwritten for the earlier existing(corrupted) files. Key: KAFKA-15169 URL: https://issues.apache.org/jira/browse

Re: Apache Kafka 3.6.0 release

2023-07-08 Thread Satish Duggana
e to wrap up the > implementation in time for the 3.6.0 feature freeze. Could we add it to the > release plan? > > [1] - > https://cwiki.apache.org/confluence/display/KAFKA/KIP-793%3A+Allow+sink+connectors+to+be+used+with+topic-mutating+SMTs > > Thanks, > Yash > > On Mon, Jun 1

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

2023-07-03 Thread Satish Duggana
; > kamal.chandraprak...@gmail.com> wrote: > > > Hi Divij, > > > > Thanks for the explanation. LGTM. > > > > -- > > Kamal > > > > On Sat, Jul 1, 2023 at 7:28 AM Satish Duggana > > wrote: > > > > > Hi Divij, > > > I am

Re: [DISCUSS] Release plan for Apache Kafka 3.5.1 release

2023-07-03 Thread Satish Duggana
Hi Divij, Thanks for sharing the 3.5.1 release plan. The "Open/Blocked/Merged Issues" sections in the wiki seem to point to 3.4.1 release instead of 3.5.1 release. ~Satish. On Mon, 3 Jul 2023 at 17:22, Divij Vaidya wrote: > > Hi folks > > Here's the release plan for >

Re: Apache Kafka 3.6.0 release

2023-07-01 Thread Satish Duggana
Satish! > > > > On Sat, Jun 24, 2023 at 7:34 AM Satish Duggana > > wrote: > > > > > Thanks Chris for the update. I added KIP-875 to the 3.6.0 release plan > > > wiki. Please feel free to update it. > > > > > > ~Satish. > > > &

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

2023-06-30 Thread Satish Duggana
Hi Divij, I am fine with having an API to compute the size as I mentioned in my earlier reply in this mail thread. But I have the below comment for the motivation for this KIP. As you discussed offline, the main issue here is listing calls for remote log segment metadata is slower because of the

Re: Apache Kafka 3.6.0 release

2023-06-24 Thread Satish Duggana
KA/KIP-875%3A+First-class+offsets+support+in+Kafka+Connect > [2] - https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.5.0 > > Cheers, > > Chris > > On Tue, Jun 20, 2023 at 12:10 AM Satish Duggana > wrote: > > > Thanks Ivan for the update. Added KIP-917 to

Re: Apache Kafka 3.6.0 release

2023-06-19 Thread Satish Duggana
gt; > > On Mon, 19 Jun 2023 at 15:28, Satish Duggana > wrote: > > > Hi Ivan, > > Sure, KIP freeze date is 26th July 23 for 3.6.0. Please close the > > voting for KIP acceptance before that. > > > > Thanks, > > Satish. > > > > On Mon, 19 Jun

Re: Apache Kafka 3.6.0 release

2023-06-19 Thread Satish Duggana
> custom metadata for remote log segment" [1] in the release plan. Would it > be possible? > Thanks! > > Best, > Ivan > > [1] > https://cwiki.apache.org/confluence/display/KAFKA/KIP-917%3A+Additional+custom+metadata+for+remote+log+segment > > On Mon, 12 Jun 2023 at 13:22

[jira] [Created] (KAFKA-15094) Add RemoteIndexCache metrics like misses/evictions/load-failures.

2023-06-16 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15094: -- Summary: Add RemoteIndexCache metrics like misses/evictions/load-failures. Key: KAFKA-15094 URL: https://issues.apache.org/jira/browse/KAFKA-15094 Project: Kafka

Re: [ANNOUNCE] Apache Kafka 3.5.0

2023-06-15 Thread Satish Duggana
Thanks to everyone who contributed to this release. Thanks Mickael for running the release. On Thu, 15 Jun 2023 at 22:20, Tom Bentley wrote: > > Thanks Mickael for the release, and thanks too to all our contributors. > > On Thu, 15 Jun 2023 at 16:22, Chia-Ping Tsai wrote: > > > This is a great

Re: [VOTE] KIP-917: Additional custom metadata for remote log segment

2023-06-14 Thread Satish Duggana
Thanks Ivan for addressing the comments in the KIP, LGTM. +1 On Tue, 13 Jun 2023 at 18:31, Luke Chen wrote: > > Looks good. Thanks for the update. > > On Tue, Jun 13, 2023 at 8:08 PM Ivan Yurchenko > wrote: > > > Hi all! > > > > Thank you for your votes. > > > > Based on the proposal of Satish

Re: [ANNOUNCE] New committer: Divij Vaidya

2023-06-13 Thread Satish Duggana
Congratulations Divij!! On Tue, 13 Jun 2023 at 22:41, Manyanda Chitimbo wrote: > > Congratulations Divij. > > On Tue 13 Jun 2023 at 17:50, Bruno Cadonna wrote: > > > Hi all, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer > > Divij Vaidya. > > > > Divij's major

Re: [DISCUSS] KIP-917: Additional custom metadata for remote log segment

2023-06-13 Thread Satish Duggana
errupted with an error message. > > Does this sound good? > If so, I'll update the KIP accordingly. And I think it may be time for the > vote after that. > > Best, > Ivan > > > > On Sat, 3 Jun 2023 at 17:13, Satish Duggana > wrote: > > > Hi Ivan, >

Re: Apache Kafka 3.6.0 release

2023-06-12 Thread Satish Duggana
> > +1 > > Luke > > On Mon, Apr 17, 2023 at 2:03 AM Ismael Juma wrote: > > > Thanks for volunteering Satish. +1. > > > > Ismael > > > > On Sun, Apr 16, 2023 at 10:08 AM Satish Duggana > > wrote: > > > > > Hi, > > > I woul

Re: [VOTE] 3.5.0 RC1

2023-06-12 Thread Satish Duggana
Hi Mickael, Thanks for running the release. +1 (non-binding) - Ran testAll/releaseTarGzAll successfully with no failures. - Ran through quickstart of core/streams on builds generated from 3.5.0-rc1 tag. - Ran a few internal apps targeting to topics on a 3 node cluster. On Mon, 12 Jun 2023 at

Re: [DISCUSS] KIP-917: Additional custom metadata for remote log segment

2023-06-03 Thread Satish Duggana
Hi Ivan, Thanks for the KIP. The motivation of the KIP looks reasonable to me. It requires a way for RSM providers to add custom metadata with the existing RemoteLogSegmentMetadata. I remember we wanted to introduce a very similar change in the earlier proposals called RemoteLogMetadataContext.

[jira] [Created] (KAFKA-15047) Handle rolling segments when the active segment's retention is breached incase of tiered storage is enabled.

2023-06-01 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15047: -- Summary: Handle rolling segments when the active segment's retention is breached incase of tiered storage is enabled. Key: KAFKA-15047 URL: https://issues.apache.org/jira

Re: [DISCUSS] KIP-932: Queues for Kafka

2023-05-28 Thread Satish Duggana
. It can be HW or LogStableOffset or some other value? Thanks, Satish. On Mon, 29 May 2023 at 10:06, Satish Duggana wrote: > > Hi Andrew, > Thanks for the nice KIP on a very interesting feature about > introducing some of the traditional MessageQueue semantics to Kafka. > It is good

Re: [DISCUSS] KIP-932: Queues for Kafka

2023-05-28 Thread Satish Duggana
Hi Andrew, Thanks for the nice KIP on a very interesting feature about introducing some of the traditional MessageQueue semantics to Kafka. It is good to see that we are extending the existing consumer groups concepts and related mechanisms for shared subscriptions instead of bringing any large

[jira] [Reopened] (KAFKA-12384) Flaky Test ListOffsetsRequestTest.testResponseIncludesLeaderEpoch

2023-05-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12384?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reopened KAFKA-12384: > Flaky Test ListOffsetsRequestTest.testResponseIncludesLeaderEp

[jira] [Created] (KAFKA-14993) Improve TransactionIndex instance handling while copying to and fetching from RSM.

2023-05-12 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14993: -- Summary: Improve TransactionIndex instance handling while copying to and fetching from RSM. Key: KAFKA-14993 URL: https://issues.apache.org/jira/browse/KAFKA-14993

Re: [ANNOUNCE] New PMC chair: Mickael Maison

2023-04-22 Thread Satish Duggana
Thanks a lot Jun for your contributions as PMC chair for all these years. Congratulations Mickael on your new role. On Sat, 22 Apr 2023 at 17:42, Manyanda Chitimbo wrote: > > Congratulations Mickael. > And thanks Jun for the work over the years. > > On Fri, Apr 21, 2023 at 5:10 PM Jun Rao

[jira] [Created] (KAFKA-14915) Option to consume multiple partitions that have their data in remote storage for the target offsets.

2023-04-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14915: -- Summary: Option to consume multiple partitions that have their data in remote storage for the target offsets. Key: KAFKA-14915 URL: https://issues.apache.org/jira/browse

[jira] [Created] (KAFKA-14912) Introduce a configuration for remote index cache size, preferably a dynamic config.

2023-04-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14912: -- Summary: Introduce a configuration for remote index cache size, preferably a dynamic config. Key: KAFKA-14912 URL: https://issues.apache.org/jira/browse/KAFKA-14912

Apache Kafka 3.6.0 release

2023-04-16 Thread Satish Duggana
Hi, I would like to volunteer as release manager for the next release, which will be Apache Kafka 3.6.0. If there are no objections, I will start a release plan a week after 3.5.0 release(around early May). Thanks, Satish.

Re: [DISCUSS] Apache Kafka 3.5.0 release

2023-04-14 Thread Satish Duggana
Thanks Luke for helping with the reviews and adding a few tests in a couple of PRs. Hi Mickael, I raised 3 PRs recently for tiered storage, one is merged. The other 2 PRs are in the critical path of non-tiered storage changes also. Especially, in consumer fetch and retention cleanup paths. These

Re: [ANNOUNCE] New Kafka PMC Member: Chris Egerton

2023-03-13 Thread Satish Duggana
Congratulations Chris! On Mon, 13 Mar 2023 at 16:09, Rajini Sivaram wrote: > Congratulations, Chris! > > Regards, > > Rajini > > On Mon, Mar 13, 2023 at 9:07 AM Bruno Cadonna wrote: > > > Congrats, Chris! > > > > Bruno > > > > On 10.03.23 18:47, Guozhang Wang wrote: > > > Congrats Chris! > > >

[jira] [Created] (KAFKA-14726) Move/rewrite LogReadInfo, LogOffsetSnapshot, and LogStartOffsetIncrementReason to storage module.

2023-02-15 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14726: -- Summary: Move/rewrite LogReadInfo, LogOffsetSnapshot, and LogStartOffsetIncrementReason to storage module. Key: KAFKA-14726 URL: https://issues.apache.org/jira/browse/KAFKA

[jira] [Created] (KAFKA-14714) Move/Rewrite RollParams, LogAppendInfo, and LeaderHwChange to storage module.

2023-02-14 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14714: -- Summary: Move/Rewrite RollParams, LogAppendInfo, and LeaderHwChange to storage module. Key: KAFKA-14714 URL: https://issues.apache.org/jira/browse/KAFKA-14714

[jira] [Created] (KAFKA-14708) Remove kafka.examples.Consumer dependancy on ShutdownableThread

2023-02-12 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14708: -- Summary: Remove kafka.examples.Consumer dependancy on ShutdownableThread Key: KAFKA-14708 URL: https://issues.apache.org/jira/browse/KAFKA-14708 Project: Kafka

[jira] [Created] (KAFKA-14706) Move ShutdownableThread to server-commons module.

2023-02-12 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14706: -- Summary: Move ShutdownableThread to server-commons module. Key: KAFKA-14706 URL: https://issues.apache.org/jira/browse/KAFKA-14706 Project: Kafka Issue

[jira] [Created] (KAFKA-14688) Move org.apache.kafka.server.log.internals to org.apache.kafka.storage.internals.log

2023-02-07 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14688: -- Summary: Move org.apache.kafka.server.log.internals to org.apache.kafka.storage.internals.log Key: KAFKA-14688 URL: https://issues.apache.org/jira/browse/KAFKA-14688

[jira] [Created] (KAFKA-14625) CheckpointFile read and write API consistency

2023-01-16 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14625: -- Summary: CheckpointFile read and write API consistency Key: KAFKA-14625 URL: https://issues.apache.org/jira/browse/KAFKA-14625 Project: Kafka Issue

[jira] [Resolved] (KAFKA-14613) Move BrokerReconfigurable/KafkaConfig to server-common module.

2023-01-11 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14613?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-14613. Resolution: Won't Do > Move BrokerReconfigurable/KafkaConfig to server-common mod

[jira] [Created] (KAFKA-14613) Move BrokerReconfigurable/KafkaConfig to server-common module.

2023-01-10 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14613: -- Summary: Move BrokerReconfigurable/KafkaConfig to server-common module. Key: KAFKA-14613 URL: https://issues.apache.org/jira/browse/KAFKA-14613 Project: Kafka

Re: [ANNOUNCE] New committer: Satish Duggana

2023-01-07 Thread Satish Duggana
Thanks again, everyone! On Sat, 31 Dec 2022 at 01:27, Dhiraj Dwarapudi wrote: > > Congratulations Sato :-) > > Regards, > Dhiraj > > On Thu, Dec 29, 2022 at 10:17 AM Bill Bejeck wrote: > > > Congratulations Satish! > > > > -Bill > > > > On T

Re: [ANNOUNCE] New committer: Edoardo Comar

2023-01-07 Thread Satish Duggana
Congratulations, Edorado! On Sun, 8 Jan 2023 at 00:15, Viktor Somogyi-Vass wrote: > > Congrats Edoardo! > > On Sat, Jan 7, 2023, 18:15 Bill Bejeck wrote: > > > Congratulations, Edoardo! > > > > -Bill > > > > On Sat, Jan 7, 2023 at 12:11 PM John Roesler wrote: > > > > > Congrats, Edoardo! > > >

[jira] [Created] (KAFKA-14603) Move KafkaMetricsGroup to server-common module.

2023-01-07 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14603: -- Summary: Move KafkaMetricsGroup to server-common module. Key: KAFKA-14603 URL: https://issues.apache.org/jira/browse/KAFKA-14603 Project: Kafka Issue

[jira] [Created] (KAFKA-14602) offsetDelta in BatchMetadata is an int but the values are computed as difference of offsets which are longs.

2023-01-06 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14602: -- Summary: offsetDelta in BatchMetadata is an int but the values are computed as difference of offsets which are longs. Key: KAFKA-14602 URL: https://issues.apache.org/jira

[jira] [Created] (KAFKA-14574) Add doc generation as part of the CI build process

2023-01-04 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14574: -- Summary: Add doc generation as part of the CI build process Key: KAFKA-14574 URL: https://issues.apache.org/jira/browse/KAFKA-14574 Project: Kafka Issue

Re: [VOTE] 3.3.2 RC1

2023-01-04 Thread Satish Duggana
Hi Chris, Thanks for running the release. +1 (binding) - Verified signatures and artifacts - Ran testAll/releaseTarGzAll successfully with no failures. - Ran through quickstart of core/streams on builds generated from the tag. - Ran a few internal apps targeting to topics on 3 node cluster. On

[jira] [Created] (KAFKA-14558) Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module.

2022-12-29 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14558: -- Summary: Move LastRecord, TxnMetadata, BatchMetadata, ProducerStateEntry, and ProducerAppendInfo to the storage module. Key: KAFKA-14558 URL: https://issues.apache.org/jira

Re: [ANNOUNCE] New committer: Justine Olshan

2022-12-29 Thread Satish Duggana
Congratulations Justine! Well deserved!! On Fri, 30 Dec 2022 at 08:17, ziming deng wrote: > > Congratulations Justine! > — > Best, > Ziming > > > On Dec 30, 2022, at 10:06, Luke Chen wrote: > > > > Congratulations, Justine! > > Well deserved! > > > > Luke > > > > On Fri, Dec 30, 2022 at 9:15 AM

Re: [ANNOUNCE] New committer: Satish Duggana

2022-12-29 Thread Satish Duggana
> The PMC of Apache Kafka is pleased to announce a new Kafka committer Satish > >> Duggana. > >> > >> Satish has been a long time Kafka contributor since 2017. He is the main > >> driver behind KIP-405 that integrates Kafka with remote storage, a > >>

[jira] [Created] (KAFKA-14551) Move LeaderEpochFileCache to storage module

2022-12-23 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14551: -- Summary: Move LeaderEpochFileCache to storage module Key: KAFKA-14551 URL: https://issues.apache.org/jira/browse/KAFKA-14551 Project: Kafka Issue Type

[jira] [Created] (KAFKA-14550) MoveSnapshotFile and CorruptSnapshotException to storage module

2022-12-22 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14550: -- Summary: MoveSnapshotFile and CorruptSnapshotException to storage module Key: KAFKA-14550 URL: https://issues.apache.org/jira/browse/KAFKA-14550 Project: Kafka

Re: [ANNOUNCE] New committer: Josep Prat

2022-12-22 Thread Satish Duggana
Congratulations Josep! On Wed, 21 Dec 2022 at 22:38, Yash Mayya wrote: > > Congratulations Josep! > > On Tue, Dec 20, 2022, 22:56 Jun Rao wrote: > > > Hi, Everyone, > > > > The PMC of Apache Kafka is pleased to announce a new Kafka committer Josep > > Prat. > > > > Josep has been contributing

[jira] [Resolved] (KAFKA-9990) Supporting transactions in tiered storage

2022-12-19 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-9990. --- Resolution: Fixed > Supporting transactions in tiered stor

Re: [ANNOUNCE] New Kafka PMC Member: Luke Chen

2022-12-18 Thread Satish Duggana
Congratulations Luke!! On Sun, 18 Dec 2022 at 11:58, Sagar wrote: > > Congratulations Luke! Very well deserved! > > Sagar. > > On Sun, 18 Dec 2022 at 6:41 AM, Sam Barker wrote: > > > Congratulations Luke! > > > > On Sat, 17 Dec 2022 at 08:41, Jun Rao wrote: > > > > > Hi, Everyone, > > > > > >

Re: [ANNOUNCE] New committer: Ron Dagostino

2022-12-14 Thread Satish Duggana
Congratulations, Ron!! On Thu, 15 Dec 2022 at 07:48, ziming deng wrote: > Congratulations, Ron! > Well deserved! > > -- > Ziming > > > On Dec 15, 2022, at 09:16, Luke Chen wrote: > > > > Congratulations, Ron! > > Well deserved! > > > > Luke > >

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

2022-12-14 Thread Satish Duggana
be surprised. > > > > > > > > > > > > > > > > > > > > > > Otherwise, LGTM > > > > > > > > > > > > > > > > > > > > > > Thank you for the KIP > > > > > > > > > > > L

[jira] [Created] (KAFKA-14467) Add a test to validate the replica state after processing the OFFSET_MOVED_TO_TIERED_STORAGE error, especially for the transactional state

2022-12-13 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14467: -- Summary: Add a test to validate the replica state after processing the OFFSET_MOVED_TO_TIERED_STORAGE error, especially for the transactional state Key: KAFKA-14467 URL

[jira] [Created] (KAFKA-14466) Refactor ClassLoaderAwareRemoteStorageManager.scala to ClassLoaderAwareRemoteStorageManager.java and move it to storage module.

2022-12-13 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-14466: -- Summary: Refactor ClassLoaderAwareRemoteStorageManager.scala to ClassLoaderAwareRemoteStorageManager.java and move it to storage module. Key: KAFKA-14466 URL: https

Re: [ANNOUNCE] New committer: Deng Ziming

2022-10-10 Thread Satish Duggana
Congratulations Ziming!! On Mon, 10 Oct 2022 at 11:12, Chris Egerton wrote: > Congrats, Ziming! > > On Mon, Oct 10, 2022, 13:29 Tom Bentley wrote: > > > Congratulations! > > > > On Mon, 10 Oct 2022 at 18:24, John Roesler wrote: > > > > > Congratulations, Ziming! > > > > > > On Mon, Oct 10,

Re: [DISCUSS] KIP-852 Optimize calculation of size for log in remote tier

2022-09-05 Thread Satish Duggana
Thanks for the KIP Divij! This is a nice improvement to avoid recalculation of size. Customized RLMMs can implement the best possible approach by caching or maintaining the size in an efficient way. But this is not a big concern for the default topic based RLMM as mentioned in the KIP. ~Satish.

Re: [VOTE] 3.1.0 RC0

2022-01-03 Thread Satish Duggana
+1 (non-binding) - Ran testAll/releaseTarGzAll successfully with no failures. - Ran through quickstart of core/streams on builds generated from 3.1.0. - Ran a few internal dev/test apps with ~2500 topic-partitions on a dev cluster. Thanks, Satish. On Mon, 3 Jan 2022 at 18:27, Mickael Maison

[jira] [Created] (KAFKA-13560) Load indexes and data in async manner in the critical path of replica fetcher threads.

2021-12-21 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-13560: -- Summary: Load indexes and data in async manner in the critical path of replica fetcher threads. Key: KAFKA-13560 URL: https://issues.apache.org/jira/browse/KAFKA-13560

Re: [ANNOUNCE] New Kafka PMC Member: Tom Bentley

2021-11-18 Thread Satish Duggana
Congratulations Tom! On Fri, 19 Nov 2021 at 05:53, John Roesler wrote: > Congratulations, Tom! > > On Thu, Nov 18, 2021, at 17:53, Konstantine Karantasis wrote: > > Congratulations Tom! > > > > Konstantine > > > > > > On Thu, Nov 18, 2021 at 2:44 PM Luke Chen wrote: > > > >> Congrats, Tom! >

[jira] [Created] (KAFKA-13369) Follower fetch protocol enhancements for tiered storage.

2021-10-12 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-13369: -- Summary: Follower fetch protocol enhancements for tiered storage. Key: KAFKA-13369 URL: https://issues.apache.org/jira/browse/KAFKA-13369 Project: Kafka

[jira] [Created] (KAFKA-13355) Shutdown broker eventually when unrecoverable exceptions like IOException encountered in RLMM.

2021-10-06 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-13355: -- Summary: Shutdown broker eventually when unrecoverable exceptions like IOException encountered in RLMM. Key: KAFKA-13355 URL: https://issues.apache.org/jira/browse/KAFKA

Re: [DISCUSS] Apache Kafka 3.1.0 release

2021-09-25 Thread Satish Duggana
Thanks David for running the 3.1.0 release. The proposed plan looks great, +1. On Fri, 24 Sept 2021 at 19:52, David Jacot wrote: > Hi all, > > I just published a release plan here: > https://cwiki.apache.org/confluence/display/KAFKA/Release+Plan+3.1.0 > > The plan suggests the following dates:

[jira] [Resolved] (KAFKA-9569) RemoteStorageManager implementation for HDFS storage.

2021-09-13 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9569?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-9569. --- Resolution: Fixed > RemoteStorageManager implementation for HDFS stor

Re: [DISCUSS] Apache Kafka 2.8.1 release

2021-08-16 Thread Satish Duggana
Thanks David for running 2.8.1 release. +1 On Tue, 17 Aug 2021 at 02:05, John Roesler wrote: > Thanks, David! > > +1 from me as well. > > -John > > On Mon, 2021-08-16 at 12:00 -0400, Bill Bejeck wrote: > > Thanks for volunteering to run the release David. > > > > It's a +1 for me. > > > > Bill

[jira] [Created] (KAFKA-13097) Handle the requests gracefully to publish the events in TopicBasedRemoteLogMetadataManager when it is not yet initialized.

2021-07-16 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-13097: -- Summary: Handle the requests gracefully to publish the events in TopicBasedRemoteLogMetadataManager when it is not yet initialized. Key: KAFKA-13097 URL: https

[jira] [Resolved] (KAFKA-12970) Make tiered storage related schemas adopt flexible versions feature.

2021-07-14 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-12970?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-12970. Resolution: Fixed This is already addressed as mentioned in the comment:  https

Re: [DISCUSS] KIP-501 Avoid out-of-sync or offline partitions when follower fetch requests are not processed in time

2021-07-14 Thread Satish Duggana
er approach is to introduce some kind of > pluggable failure detection module to detect individual broker failure. > Admins can then build a plugin for their environment, configure > replica.lag.max.time.ms that matches how quickly failure can be detected > and build tools to determine what

Re: [DISCUSS] KIP-405 + KAFKA-7739 - Implementation of Tiered Storage Integration with Azure Storage

2021-07-12 Thread Satish Duggana
d the RSM implementations? > > Regards, > Sumant > Kafka Dev, Linkedin > > On Mon, 15 Mar 2021 at 09:08, Satish Duggana > wrote: > > > Hi Israel, > > Thanks for your interest in tiered storage. As mentioned by Jun earlier, we > > decided not to have any implement

<    1   2   3   4   >