su-article opened a new pull request #3925:
URL: https://github.com/apache/carbondata/pull/3925
### Why is this PR needed?
For data update, in the CarbonProjectForUpdateCommand process, after the
delete delta file is generated, the status of each segment is checked. If the
status is not successful, all the segment directories are traversed to clean up
the timestamp corresponding .carbondata, .carbonindex and .deletedelta files.
If a great many segments have been generated in the Partion directory, it
will be very time-consuming.
### What changes were proposed in this PR?
In the process of generating delete delta, record the segment path involved
in this update; after entering the checkAndUpdateStatusFiles() function, if a
segment status is found to be not successful, it will be cleaned directly
according to the segment path list that has been recorded during generating
delete delta, without searching all the segment directories.
### Does this PR introduce any user interface change?
- No
### Is any new testcase added?
- No
----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
