Layam Pavan Venkat created HDDS-17802:
-----------------------------------------
Summary: Recon: show incomplete multipart uploads with an Overview
toggle and an OM DB Insights tab
Key: HDDS-17802
URL: https://issues.apache.org/jira/browse/HDDS-17802
Project: Apache Ozone
Issue Type: Improvement
Components: Ozone Recon
Reporter: Layam Pavan Venkat
Assignee: Layam Pavan Venkat
After HDDS-16364, multipart open keys (\{{isMultipartKey=true}}, size 0) are
excluded from \{{/keys/open}} and \{{/keys/open/summary}}, and incomplete
multipart uploads (MPUs) are reported only by \{{/keys/open/mpu/summary}}. That
endpoint returns only totals (\{{totalOpenMPUKeys}},
\{{totalReplicatedDataSize}}, \{{totalDataSize}}), and the Recon UI does not
call it. Recon has no way to list individual uploads, so an operator who sees a
large MPU total cannot find which uploads hold the space.
h3. Proposal
*1. Overview: toggle on the "Open Keys Summary" card*
Add a two-option toggle in the card header to switch between:
* *Open Keys* (default): total replicated data, total unreplicated data and
open key count, from \{{/keys/open/summary}}.
* *Multipart Uploads*: committed replicated data, committed unreplicated data
and open upload count, from \{{/keys/open/mpu/summary}}.
"View Insights" opens the tab that matches the selected view.
*2. OM DB Insights: new "Open Multipart Uploads" tab*
Add a tab next to "Open Keys" that lists each incomplete upload, with these
columns:
* key path
* upload ID
* number of committed parts
* committed size
* replicated size
* initiation time
* age
* replication config
Expanding a row shows the upload's committed parts: part number, size and ETag.
Like the other tabs, it supports the limit selector, search by key path and the
FSO/OBS filter, and shows totals for the listed uploads.
*3. API: paginated list endpoint*
Add an endpoint such as \{{GET /api/v1/keys/open/mpu?limit=&prevKey=}} that
pages through \{{multipartInfoTable}} and, for the split layout, reads each
upload's rows from \{{multipartPartsTable}}. Sizes should be computed the same
way as \{{MultipartInfoInsightHandler}}, so that the unfiltered totals match
\{{/keys/open/mpu/summary}}.
h3. Notes
* Open keys of parts that are still being written (\{{isMultipartKey=false}})
stay on the "Open Keys" tab until they commit, and then appear in the upload's
parts list.
* The age column helps find uploads that \{{MultipartUploadCleanupService}}
should abort (\{{ozone.om.open.mpu.expire.threshold}}, 30 days by default).
Recon may not have this OM setting, so highlighting expired uploads is optional.
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]