[jira] [Commented] (KAFKA-17665) Kafka Tiered Storage retry back off is not used

2024-09-30 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885970#comment-17885970 ] Satish Duggana commented on KAFKA-17665: >What happen to segments that have the

[jira] [Updated] (KAFKA-17665) Kafka Tiered Storage retry back off is not used

2024-09-30 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-17665: --- Fix Version/s: 4.0.0 > Kafka Tiered Storage retry back off is not used > ---

[jira] [Updated] (KAFKA-17637) Invert the search for LIST_OFFSETS request for remote storage topic

2024-09-29 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-17637: --- Description: The timestamp in the records are non-monotonic so we begin the search from ear

[jira] [Commented] (KAFKA-17637) Invert the search for LIST_OFFSETS request for remote storage topic

2024-09-29 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17885806#comment-17885806 ] Satish Duggana commented on KAFKA-17637: Thanks @kamalcph for raising the edge c

[jira] [Assigned] (KAFKA-17637) Invert the search for LIST_OFFSETS request for remote storage topic

2024-09-29 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17637?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reassigned KAFKA-17637: -- Assignee: Kamal Chandraprakash > Invert the search for LIST_OFFSETS request for remot

[jira] [Resolved] (KAFKA-15434) Tiered Storage Quotas

2024-09-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15434?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15434. Resolution: Duplicate Duplicate of https://issues.apache.org/jira/browse/KAFKA-15265 > Ti

[jira] [Assigned] (KAFKA-15132) Implement disable & re-enablement for Tiered Storage

2024-09-04 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reassigned KAFKA-15132: -- Assignee: Divij Vaidya (was: Luke Chen) > Implement disable & re-enablement for Tier

[jira] [Resolved] (KAFKA-16887) document remote copy/fetch quotas metrics

2024-08-13 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16887?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-16887. Resolution: Fixed > document remote copy/fetch quotas metrics > --

[jira] [Commented] (KAFKA-17062) RemoteLogManager - RemoteStorageException causes data loss

2024-07-04 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-17062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17863117#comment-17863117 ] Satish Duggana commented on KAFKA-17062: [~guillaumemallet] Thanks for filing th

[jira] [Commented] (KAFKA-15265) Remote copy/fetch quotas for tiered storage.

2024-06-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17855633#comment-17855633 ] Satish Duggana commented on KAFKA-15265: [~abhijeetkumar] [~jlprat] I think it i

[jira] [Resolved] (KAFKA-15420) Kafka Tiered Storage V1

2024-06-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15420. Resolution: Fixed > Kafka Tiered Storage V1 > --- > >

[jira] [Updated] (KAFKA-16977) remote log manager dynamic configs are not available after broker restart.

2024-06-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16977: --- Fix Version/s: 3.8.0 > remote log manager dynamic configs are not available after broker res

[jira] [Assigned] (KAFKA-16977) remote log manager dynamic configs are not available after broker restart.

2024-06-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16977?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reassigned KAFKA-16977: -- Assignee: Kamal Chandraprakash > remote log manager dynamic configs are not available

[jira] [Created] (KAFKA-16977) remote log manager dynamic configs are not available after broker restart.

2024-06-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-16977: -- Summary: remote log manager dynamic configs are not available after broker restart. Key: KAFKA-16977 URL: https://issues.apache.org/jira/browse/KAFKA-16977 Projec

[jira] [Created] (KAFKA-16976) Improve the dynamic config handling for RemoteLogManagerConfig when a broker is restarted.

2024-06-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-16976: -- Summary: Improve the dynamic config handling for RemoteLogManagerConfig when a broker is restarted. Key: KAFKA-16976 URL: https://issues.apache.org/jira/browse/KAFKA-16976

[jira] [Updated] (KAFKA-13560) Load indexes and data in async manner in the critical path of replica fetcher threads.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-13560: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Load indexes and data in async ma

[jira] [Updated] (KAFKA-15300) Include remotelog size in complete log size and also add local log size and remote log size separately in kafka-log-dirs tool.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15300: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Include remotelog size in complet

[jira] [Updated] (KAFKA-15480) Add RemoteStorageInterruptedException

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15480?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15480: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Add RemoteStorageInterruptedExcep

[jira] [Updated] (KAFKA-15214) Add metrics for OffsetOutOfRangeException when tiered storage is enabled

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15214?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15214: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Add metrics for OffsetOutOfRangeE

[jira] [Updated] (KAFKA-15529) Flaky test ReassignReplicaShrinkTest.executeTieredStorageTest

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15529?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15529: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Flaky test ReassignReplicaShrinkT

[jira] [Updated] (KAFKA-15038) Use topic id/name mapping from the Metadata cache in the RemoteLogManager

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15038: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Use topic id/name mapping from th

[jira] [Updated] (KAFKA-9578) Kafka Tiered Storage - System Tests

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-9578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-9578: -- Fix Version/s: 3.9.0 (was: 3.8.0) > Kafka Tiered Storage - System Tests

[jira] [Updated] (KAFKA-15132) Implement disable & re-enablement for Tiered Storage

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15132?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15132: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Implement disable & re-enablement

[jira] [Updated] (KAFKA-15376) Explore options of removing data earlier to the current leader's leader epoch lineage for topics enabled with tiered storage.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15376?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15376: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Explore options of removing data

[jira] [Updated] (KAFKA-15864) Add more tests asserting the log-start-offset, local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered storage.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15864: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Add more tests asserting the log-

[jira] [Updated] (KAFKA-15094) Add RemoteIndexCache metrics like misses/evictions/load-failures.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15094?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15094: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Add RemoteIndexCache metrics like

[jira] [Updated] (KAFKA-14915) Option to consume multiple partitions that have their data in remote storage for the target offsets.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14915?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-14915: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Option to consume multiple partit

[jira] [Updated] (KAFKA-15195) Regenerate segment-aligned producer snapshots when upgrading to a Kafka version supporting Tiered Storage

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15195?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15195: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Regenerate segment-aligned produc

[jira] [Updated] (KAFKA-15301) [Tiered Storage] Historically compacted topics send request to remote for active segment during consume

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15301?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15301: --- Fix Version/s: 3.9.0 (was: 3.8.0) > [Tiered Storage] Historically com

[jira] [Updated] (KAFKA-15341) Enabling TS for a topic during rolling restart causes problems

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15341?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15341: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Enabling TS for a topic during ro

[jira] [Updated] (KAFKA-13355) Shutdown broker eventually when unrecoverable exceptions like IOException encountered in RLMM.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13355?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-13355: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Shutdown broker eventually when u

[jira] [Updated] (KAFKA-15969) Align RemoteStorageThreadPool metrics name with KIP-405

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15969?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15969: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Align RemoteStorageThreadPool met

[jira] [Updated] (KAFKA-15331) Handle remote log enabled topic deletion when leader is not available

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15331?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15331: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Handle remote log enabled topic d

[jira] [Updated] (KAFKA-15388) Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15388: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Handle topics that were having co

[jira] [Commented] (KAFKA-14877) refactor InMemoryLeaderEpochCheckpoint

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17854579#comment-17854579 ] Satish Duggana commented on KAFKA-14877: InMemoryLeaderEpochCheckpoint seems to

[jira] [Resolved] (KAFKA-14877) refactor InMemoryLeaderEpochCheckpoint

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-14877?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-14877. Resolution: Invalid > refactor InMemoryLeaderEpochCheckpoint > ---

[jira] [Updated] (KAFKA-16947) Kafka Tiered Storage V2

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16947: --- Fix Version/s: 3.9.0 (was: 3.8.0) > Kafka Tiered Storage V2 > ---

[jira] [Updated] (KAFKA-16947) Kafka Tiered Storage V2

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16947?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16947: --- Affects Version/s: (was: 3.6.0) > Kafka Tiered Storage V2 > --- > >

[jira] [Created] (KAFKA-16947) Kafka Tiered Storage V2

2024-06-12 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-16947: -- Summary: Kafka Tiered Storage V2 Key: KAFKA-16947 URL: https://issues.apache.org/jira/browse/KAFKA-16947 Project: Kafka Issue Type: Improvement Affec

[jira] [Resolved] (KAFKA-16890) Failing to build aux state on broker failover

2024-06-12 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-16890. Resolution: Fixed > Failing to build aux state on broker failover > --

[jira] [Updated] (KAFKA-13560) Load indexes and data in async manner in the critical path of replica fetcher threads.

2024-05-29 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-13560: --- Description: https://github.com/apache/kafka/pull/11390#discussion_r762366976 https://githu

[jira] [Commented] (KAFKA-13560) Load indexes and data in async manner in the critical path of replica fetcher threads.

2024-05-29 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-13560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17850290#comment-17850290 ] Satish Duggana commented on KAFKA-13560: https://github.com/apache/kafka/pull/15

[jira] [Commented] (KAFKA-15265) Remote copy/fetch quotas for tiered storage.

2024-03-27 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17831383#comment-17831383 ] Satish Duggana commented on KAFKA-15265: KIP-956 is approved. [~abhijeetkumar] i

[jira] [Assigned] (KAFKA-16259) Immutable MetadataCache to improve client performance

2024-02-14 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reassigned KAFKA-16259: -- Assignee: Zhifeng Chen > Immutable MetadataCache to improve client performance >

[jira] [Assigned] (KAFKA-16161) Avoid creating remote log metadata snapshot file in partition data directory.

2024-01-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reassigned KAFKA-16161: -- Assignee: Kamal Chandraprakash > Avoid creating remote log metadata snapshot file in

[jira] [Created] (KAFKA-16161) Avoid creating remote log metadata snapshot file in partition data directory.

2024-01-17 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-16161: -- Summary: Avoid creating remote log metadata snapshot file in partition data directory. Key: KAFKA-16161 URL: https://issues.apache.org/jira/browse/KAFKA-16161 Pro

[jira] [Updated] (KAFKA-16161) Avoid creating remote log metadata snapshot file in partition data directory.

2024-01-17 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16161?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16161: --- Labels: KIP-405 (was: ) > Avoid creating remote log metadata snapshot file in partition dat

[jira] [Updated] (KAFKA-16073) Kafka Tiered Storage: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

2024-01-15 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16073: --- Summary: Kafka Tiered Storage: Consumer Fetch Error Due to Delayed localLogStartOffset Updat

[jira] [Commented] (KAFKA-16088) Not reading active segments when RemoteFetch return Empty Records.

2024-01-14 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17806572#comment-17806572 ] Satish Duggana commented on KAFKA-16088: Updated the description clarifying the

[jira] [Commented] (KAFKA-15388) Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.

2024-01-13 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15388?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17806413#comment-17806413 ] Satish Duggana commented on KAFKA-15388: [PR-15060|https://github.com/apache/kaf

[jira] [Updated] (KAFKA-16088) Not reading active segments when RemoteFetch return Empty Records.

2024-01-13 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16088?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16088: --- Description: This issue is about covering local log segments also while finding the segment

[jira] [Commented] (KAFKA-16073) Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

2024-01-07 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17804124#comment-17804124 ] Satish Duggana commented on KAFKA-16073: Thanks [~hzh0425@apache], we can discus

[jira] [Commented] (KAFKA-16060) Some questions about tiered storage capabilities

2024-01-05 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17803470#comment-17803470 ] Satish Duggana commented on KAFKA-16060: [~jianbin] There are no short term plan

[jira] [Updated] (KAFKA-16073) Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

2024-01-04 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16073: --- Fix Version/s: 3.8.0 > Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed > loca

[jira] [Comment Edited] (KAFKA-16073) Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

2024-01-03 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802024#comment-17802024 ] Satish Duggana edited comment on KAFKA-16073 at 1/4/24 3:50 AM: --

[jira] [Commented] (KAFKA-16073) Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

2024-01-02 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17802024#comment-17802024 ] Satish Duggana commented on KAFKA-16073: We discussed one possible solution is t

[jira] [Commented] (KAFKA-16073) Kafka Tiered Storage Bug: Consumer Fetch Error Due to Delayed localLogStartOffset Update During Segment Deletion

2024-01-01 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16073?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17801663#comment-17801663 ] Satish Duggana commented on KAFKA-16073: Thanks [~hzh0425@apache] for filing JIR

[jira] [Commented] (KAFKA-16060) Some questions about tiered storage capabilities

2023-12-29 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16060?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17801167#comment-17801167 ] Satish Duggana commented on KAFKA-16060: [~jianbin] For Q2: Do you mean compacti

[jira] [Updated] (KAFKA-15241) Compute tiered offset by keeping the respective epochs in scope.

2023-12-21 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15241?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15241: --- Fix Version/s: 3.7.0 > Compute tiered offset by keeping the respective epochs in scope. > --

[jira] [Updated] (KAFKA-15158) Add metrics for RemoteDeleteRequestsPerSec, RemoteDeleteErrorsPerSec, BuildRemoteLogAuxStateRequestsPerSec, BuildRemoteLogAuxStateErrorsPerSec

2023-12-21 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15158?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15158: --- Labels: tiered-storage (was: ) > Add metrics for RemoteDeleteRequestsPerSec, RemoteDeleteEr

[jira] [Updated] (KAFKA-16014) Implement RemoteLogSizeComputationTime, RemoteLogSizeBytes, RemoteLogMetadataCount

2023-12-18 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-16014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-16014: --- Fix Version/s: 3.7.0 > Implement RemoteLogSizeComputationTime, RemoteLogSizeBytes, > Remote

[jira] [Comment Edited] (KAFKA-15147) Measure pending and outstanding Remote Segment operations

2023-12-14 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796808#comment-17796808 ] Satish Duggana edited comment on KAFKA-15147 at 12/14/23 3:54 PM:

[jira] [Commented] (KAFKA-15147) Measure pending and outstanding Remote Segment operations

2023-12-14 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15147?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17796808#comment-17796808 ] Satish Duggana commented on KAFKA-15147: [~enether] These are minor improvements

[jira] [Commented] (KAFKA-15931) Cached transaction index gets closed if tiered storage read is interrupted

2023-11-30 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17791514#comment-17791514 ] Satish Duggana commented on KAFKA-15931: Sure [~ivanyu] , added it to https://is

[jira] [Updated] (KAFKA-15857) Introduce LocalLogStartOffset and TieredOffset in OffsetSpec.

2023-11-26 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15857: --- Fix Version/s: 3.7.0 > Introduce LocalLogStartOffset and TieredOffset in OffsetSpec. > -

[jira] [Updated] (KAFKA-15864) Add more tests asserting the log-start-offset, local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered storage.

2023-11-20 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15864?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15864: --- Description: Followup on the [comment|https://github.com/apache/kafka/pull/14766/files#r1395

[jira] [Created] (KAFKA-15864) Add more tests asserting the log-start-offset, local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered storage.

2023-11-20 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15864: -- Summary: Add more tests asserting the log-start-offset, local-log-start-offset, and HW/LSO/LEO in rolling over segments with tiered storage. Key: KAFKA-15864 URL: https://iss

[jira] [Created] (KAFKA-15857) Introduce LocalLogStartOffset and TieredOffset in OffsetSpec.

2023-11-20 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15857: -- Summary: Introduce LocalLogStartOffset and TieredOffset in OffsetSpec. Key: KAFKA-15857 URL: https://issues.apache.org/jira/browse/KAFKA-15857 Project: Kafka

[jira] [Updated] (KAFKA-15857) Introduce LocalLogStartOffset and TieredOffset in OffsetSpec.

2023-11-20 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15857: --- Labels: need-kip tiered-storage (was: tiered-storage) > Introduce LocalLogStartOffset and T

[jira] [Commented] (KAFKA-15802) Trying to access uncopied segments metadata on listOffsets

2023-11-19 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17787799#comment-17787799 ] Satish Duggana commented on KAFKA-15802: [~mimaison] Sorry for updating the JIRA

[jira] [Updated] (KAFKA-15802) Trying to access uncopied segments metadata on listOffsets

2023-11-13 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15802: --- Fix Version/s: 3.7.0 3.6.1 > Trying to access uncopied segments metadata

[jira] [Commented] (KAFKA-15802) Trying to access uncopied segments metadata on listOffsets

2023-11-09 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17784698#comment-17784698 ] Satish Duggana commented on KAFKA-15802: [~jeqo] [~divijvaidya] +1 to go with fi

[jira] [Updated] (KAFKA-15802) Trying to access uncopied segments metadata on listOffsets

2023-11-09 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15802: --- Attachment: (was: screenshot-1.png) > Trying to access uncopied segments metadata on lis

[jira] [Updated] (KAFKA-15802) Trying to access uncopied segments metadata on listOffsets

2023-11-09 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15802?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15802: --- Attachment: screenshot-1.png > Trying to access uncopied segments metadata on listOffsets >

[jira] [Comment Edited] (KAFKA-15609) Corrupted index uploaded to remote tier

2023-10-16 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17775964#comment-17775964 ] Satish Duggana edited comment on KAFKA-15609 at 10/17/23 12:55 AM: ---

[jira] [Commented] (KAFKA-15609) Corrupted index uploaded to remote tier

2023-10-16 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17775964#comment-17775964 ] Satish Duggana commented on KAFKA-15609: These memory mapped operations are gene

[jira] [Commented] (KAFKA-15609) Corrupted index uploaded to remote tier

2023-10-16 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15609?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17775961#comment-17775961 ] Satish Duggana commented on KAFKA-15609: [~divijvaidya] How are index files read

[jira] [Updated] (KAFKA-15612) Followup on whether the segment indexes need to be materialized or flushed before they are passed to RSM for writing them to tiered storage.

2023-10-16 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15612: --- Description: Followup on the [PR comment|https://github.com/apache/kafka/pull/14529#discussi

[jira] [Updated] (KAFKA-15612) Followup on whether the segment indexes need to be materialized or flushed before they are passed to RSM for writing them to tiered storage.

2023-10-16 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15612: --- Fix Version/s: 3.7.0 > Followup on whether the segment indexes need to be materialized or fl

[jira] [Updated] (KAFKA-15612) Followup on whether the segment indexes need to be materialized or flushed before they are passed to RSM for writing them to tiered storage.

2023-10-16 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15612?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15612: --- Summary: Followup on whether the segment indexes need to be materialized or flushed before t

[jira] [Created] (KAFKA-15612) Followup on whether the indexes need to be materialized before they are passed to RSM for writing them to tiered storage.

2023-10-16 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15612: -- Summary: Followup on whether the indexes need to be materialized before they are passed to RSM for writing them to tiered storage. Key: KAFKA-15612 URL: https://issues.apache

[jira] [Updated] (KAFKA-15593) Add 3.6.0 to broker/client upgrade/compatibility tests

2023-10-11 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15593: --- Fix Version/s: 3.7.0 > Add 3.6.0 to broker/client upgrade/compatibility tests >

[jira] [Assigned] (KAFKA-15593) Add 3.6.0 to broker/client upgrade/compatibility tests

2023-10-11 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15593?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana reassigned KAFKA-15593: -- Assignee: Satish Duggana > Add 3.6.0 to broker/client upgrade/compatibility tests > -

[jira] [Created] (KAFKA-15593) Add 3.6.0 to broker/client upgrade/compatibility tests

2023-10-11 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15593: -- Summary: Add 3.6.0 to broker/client upgrade/compatibility tests Key: KAFKA-15593 URL: https://issues.apache.org/jira/browse/KAFKA-15593 Project: Kafka Is

[jira] [Created] (KAFKA-15594) Add 3.6.0 to streams upgrade/compatibility tests

2023-10-11 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15594: -- Summary: Add 3.6.0 to streams upgrade/compatibility tests Key: KAFKA-15594 URL: https://issues.apache.org/jira/browse/KAFKA-15594 Project: Kafka Issue Ty

[jira] [Updated] (KAFKA-15576) Add 3.6.0 to broker/client and streams upgrade/compatibility tests

2023-10-10 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15576: --- Summary: Add 3.6.0 to broker/client and streams upgrade/compatibility tests (was: Add 3.2.0

[jira] [Created] (KAFKA-15576) Add 3.2.0 to broker/client and streams upgrade/compatibility tests

2023-10-10 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15576: -- Summary: Add 3.2.0 to broker/client and streams upgrade/compatibility tests Key: KAFKA-15576 URL: https://issues.apache.org/jira/browse/KAFKA-15576 Project: Kafka

[jira] [Commented] (KAFKA-15535) Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property.

2023-10-10 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17773898#comment-17773898 ] Satish Duggana commented on KAFKA-15535: Thanks [~hudeqi] for checking that out.

[jira] [Resolved] (KAFKA-15535) Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property.

2023-10-10 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana resolved KAFKA-15535. Resolution: Fixed > Add documentation of "remote.log.index.file.cache.total.size.bytes" >

[jira] [Created] (KAFKA-15535) Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property.

2023-10-03 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15535: -- Summary: Add documentation of "remote.log.index.file.cache.total.size.bytes" configuration property. Key: KAFKA-15535 URL: https://issues.apache.org/jira/browse/KAFKA-15535

[jira] [Updated] (KAFKA-15530) Add missing documentation of metrics introduced as part of KAFKA-15196

2023-10-03 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15530: --- Affects Version/s: 3.6.0 > Add missing documentation of metrics introduced as part of KAFKA-

[jira] [Created] (KAFKA-15530) Add missing documentation of metrics introduced as part of KAFKA-15196

2023-10-03 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15530: -- Summary: Add missing documentation of metrics introduced as part of KAFKA-15196 Key: KAFKA-15530 URL: https://issues.apache.org/jira/browse/KAFKA-15530 Project: K

[jira] [Updated] (KAFKA-15530) Add missing documentation of metrics introduced as part of KAFKA-15196

2023-10-03 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15530: --- Component/s: documentation > Add missing documentation of metrics introduced as part of KAFK

[jira] [Updated] (KAFKA-15001) CVE vulnerabilities in Jetty

2023-09-25 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15001: --- Fix Version/s: (was: 3.6.0) > CVE vulnerabilities in Jetty > --

[jira] [Commented] (KAFKA-15503) CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1

2023-09-25 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17768810#comment-17768810 ] Satish Duggana commented on KAFKA-15503: https://github.com/apache/kafka/pull/10

[jira] [Updated] (KAFKA-15503) CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1

2023-09-25 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15503: --- Fix Version/s: 3.6.0 (was: 3.0.0) (was: 2.8.0)

[jira] [Updated] (KAFKA-15503) CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1

2023-09-25 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15503?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15503: --- Affects Version/s: (was: 2.7.0) (was: 2.6.1)

[jira] [Created] (KAFKA-15503) CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1

2023-09-25 Thread Satish Duggana (Jira)
Satish Duggana created KAFKA-15503: -- Summary: CVE-2023-40167, CVE-2023-36479 - Upgrade jetty to 9.4.52, 10.0.16, 11.0.16, 12.0.1 Key: KAFKA-15503 URL: https://issues.apache.org/jira/browse/KAFKA-15503

[jira] [Updated] (KAFKA-15498) Upgrade Snappy-Java to 1.1.10.4

2023-09-25 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15498?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15498: --- Priority: Blocker (was: Major) > Upgrade Snappy-Java to 1.1.10.4 >

[jira] [Updated] (KAFKA-15001) CVE vulnerabilities in Jetty

2023-09-25 Thread Satish Duggana (Jira)
[ https://issues.apache.org/jira/browse/KAFKA-15001?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Satish Duggana updated KAFKA-15001: --- Fix Version/s: 3.6.0 > CVE vulnerabilities in Jetty > - > >

  1   2   3   4   5   6   >