Kontinuation opened a new pull request, #1528:
URL: https://github.com/apache/sedona/pull/1528

   ## Did you read the Contributor Guide?
   
   - Yes, I have read the [Contributor 
Rules](https://sedona.apache.org/latest-snapshot/community/rule/) and 
[Contributor Development 
Guide](https://sedona.apache.org/latest-snapshot/community/develop/)
   
   ## Is this PR related to a JIRA ticket?
   
   - Yes, the URL of the associated JIRA ticket is 
https://issues.apache.org/jira/browse/SEDONA-632. The PR name follows the 
format `[SEDONA-XXX] my subject`.
   
   ## What changes were proposed in this PR?
   
   Writing large amounts of raster files to distributed file systems or object 
store is super slow, because the output committer has to move files from 
temporary locations to their target locations. Users will see all the tasks are 
completed but the driver is stuck at the committing phase.
   
   This patch an option `useDirectCommitter` to the raster format. By default 
`useDirectCommitter` is true, and the raster format will use a direct committer 
that writes raster files to their target locations directly. Users can manually 
set it to false if they want the original behavior.
   
   ## How was this patch tested?
   
   Passing existing tests
   
   ## Did this PR include necessary documentation updates?
   
   - Yes, I have updated the documentation.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to