The GitHub Actions job "Required Checks" on texera.git/main has succeeded. Run started by GitHub user github-merge-queue[bot] (triggered by github-merge-queue[bot]).
Head commit for run: b1c4fd29bd2208abca1d5cc99729c75f850bd127 / carloea2 <[email protected]> feat: skip completed files in resumable dataset uploads (#5929) ### What changes were proposed in this PR? <img width="784" height="471" alt="image" src="https://github.com/user-attachments/assets/bb2a5b9c-a178-43a9-abf4-7c746bc9e0ba"; /> This PR improves dataset upload retry behavior by distinguishing between two cases that currently look similar to users: | Case | Behavior | | --- | --- | | Active multipart upload session exists | Ask whether to resume or restart the upload. | | Matching file already exists in the dataset | Ask whether to upload again or skip it. | The backend adds a dataset endpoint that checks candidate upload files against committed and staged dataset files by path and size. The frontend uses that endpoint after checking active multipart sessions, so failed uploads can still be resumed while completed matching files can be skipped from the retry batch. The user-facing copy intentionally says a file with the same path and size exists, instead of implying byte-for-byte certainty. ### Any related issues, documentation, discussions? Related to discussion #5744: Improve resumable upload: track completion at the batch/session level. ### How was this PR tested? Added backend and frontend tests covering: | Test | Coverage | | --- | --- | | `DatasetResourceSpec` | Finds committed and staged files only when path and size match. | | `DatasetService` spec | Forces one multipart part upload to fail, then verifies retry uploads only the missing part. | | `FilesUploaderComponent` spec | Verifies a mixed retry batch asks Resume/Restart for a failed multipart file and Upload/Skip for a completed matching file. | Commands run: ```powershell sbt "FileService/testOnly org.apache.texera.service.resource.DatasetResourceSpec -- -z findExistingUploadFiles" yarn ng run gui:test --include=src/app/dashboard/service/user/dataset/dataset.service.spec.ts yarn ng run gui:test --include=src/app/dashboard/component/user/files-uploader/files-uploader.component.spec.ts yarn eslint src/app/dashboard/component/user/files-uploader/files-uploader.component.ts src/app/dashboard/component/user/files-uploader/files-uploader.component.spec.ts src/app/dashboard/component/user/files-uploader/conflicting-file-modal-content/conflicting-file-modal-content.component.ts src/app/dashboard/service/user/dataset/dataset.service.ts src/app/dashboard/service/user/dataset/dataset.service.spec.ts ### Was this PR authored or co-authored using generative AI tooling? Generated-by: Me --------- Co-authored-by: Xuan Gu <[email protected]> Report URL: https://github.com/apache/texera/actions/runs/28822582665 With regards, GitHub Actions via GitBox
