Layam Pavan Venkat created HDDS-17802:
-----------------------------------------

             Summary: Recon: show incomplete multipart uploads with an Overview 
toggle and an OM DB Insights tab
                 Key: HDDS-17802
                 URL: https://issues.apache.org/jira/browse/HDDS-17802
             Project: Apache Ozone
          Issue Type: Improvement
          Components: Ozone Recon
            Reporter: Layam Pavan Venkat
            Assignee: Layam Pavan Venkat


After HDDS-16364, multipart open keys (\{{isMultipartKey=true}}, size 0) are 
excluded from \{{/keys/open}} and \{{/keys/open/summary}}, and incomplete 
multipart uploads (MPUs) are reported only by \{{/keys/open/mpu/summary}}. That 
endpoint returns only totals (\{{totalOpenMPUKeys}}, 
\{{totalReplicatedDataSize}}, \{{totalDataSize}}), and the Recon UI does not 
call it. Recon has no way to list individual uploads, so an operator who sees a 
large MPU total cannot find which uploads hold the space.

h3. Proposal

*1. Overview: toggle on the "Open Keys Summary" card*
Add a two-option toggle in the card header to switch between:
* *Open Keys* (default): total replicated data, total unreplicated data and 
open key count, from \{{/keys/open/summary}}.
* *Multipart Uploads*: committed replicated data, committed unreplicated data 
and open upload count, from \{{/keys/open/mpu/summary}}.
"View Insights" opens the tab that matches the selected view.

*2. OM DB Insights: new "Open Multipart Uploads" tab*
Add a tab next to "Open Keys" that lists each incomplete upload, with these 
columns:
* key path
* upload ID
* number of committed parts
* committed size
* replicated size
* initiation time
* age
* replication config

Expanding a row shows the upload's committed parts: part number, size and ETag. 
Like the other tabs, it supports the limit selector, search by key path and the 
FSO/OBS filter, and shows totals for the listed uploads.

*3. API: paginated list endpoint*
Add an endpoint such as \{{GET /api/v1/keys/open/mpu?limit=&prevKey=}} that 
pages through \{{multipartInfoTable}} and, for the split layout, reads each 
upload's rows from \{{multipartPartsTable}}. Sizes should be computed the same 
way as \{{MultipartInfoInsightHandler}}, so that the unfiltered totals match 
\{{/keys/open/mpu/summary}}.

h3. Notes
* Open keys of parts that are still being written (\{{isMultipartKey=false}}) 
stay on the "Open Keys" tab until they commit, and then appear in the upload's 
parts list.
* The age column helps find uploads that \{{MultipartUploadCleanupService}} 
should abort (\{{ozone.om.open.mpu.expire.threshold}}, 30 days by default). 
Recon may not have this OM setting, so highlighting expired uploads is optional.



--
This message was sent by Atlassian Jira
(v10.3.26#10030026)

---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to