[
https://issues.apache.org/jira/browse/PHOENIX-7813?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Himanshu Gwalani updated PHOENIX-7813:
--------------------------------------
Description:
Replay file processing is highly skewed — top 3 RS handle 34% of files while 5
RS process zero (observed during performance testing), due to permanent
scheduler offsets between RS.
Fix: Align all RS to the same round-eligible wall-clock tick instead of using
initial delay of 0.
was:
ReplicationLogProcessor.createLogFileReader() checks for empty files in two
places — once before and once after lease recovery. An empty, unclosed file
still triggers an expensive recoverLease() RPC before being identified as empty
and skipped.
*Definition of Done*
1. Move the empty-file check to the top of the method, before any lease state
inspection, so 0-byte files are skipped unconditionally.
2. Also ensure that logFileReader is closed when initialization fails.
> Align ReplicationLogDiscovery scheduler to round boundaries to fix file
> distribution imbalance across RS
> --------------------------------------------------------------------------------------------------------
>
> Key: PHOENIX-7813
> URL: https://issues.apache.org/jira/browse/PHOENIX-7813
> Project: Phoenix
> Issue Type: Sub-task
> Reporter: Himanshu Gwalani
> Assignee: Himanshu Gwalani
> Priority: Major
>
> Replay file processing is highly skewed — top 3 RS handle 34% of files while
> 5 RS process zero (observed during performance testing), due to permanent
> scheduler offsets between RS.
> Fix: Align all RS to the same round-eligible wall-clock tick instead of using
> initial delay of 0.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
