Bhhsaurabh opened a new issue, #14874:
URL: https://github.com/apache/pinot/issues/14874
disruption in the storage layer or controller. This issue impacts data
integrity and can cause failures in downstream processes.
Steps to Reproduce
1. Trigger a storage layer or controller disruption during a
segment copy operation.
2. Observe that the segment files in the deep store become
corrupted.
3. Attempt to use the corrupted files and verify the errors.
Expected Behavior
Segment files should remain intact and recover gracefully, even during
disruptions.
Actual Behavior
Segments are corrupted, leading to data integrity issues.
Suggested Fix
Implement a more robust transaction mechanism for the
copyFromSegmentFileToDeepStore operation to handle partial writes and
disruptions.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
