provinzkraut opened a new issue, #396:
URL: https://github.com/apache/arrow-rs-object-store/issues/396

   Support conditional multipart uploads throughout the multipart API, i.e.   
   
   - `put_multipart_opts`
   - `MultipartUpload`
   - `MultipartStore` 
   - `BufWriter`
   
   ## Why?
   
   - Generally useful API to have, as currently, `object_store` cannot easily 
fulfill use cases that need both a streaming API *and* an optimistic 
concurrency model easily out of the box
   - Provides the opportunity to streamline some APIs (e.g. `PutOptions` and 
`PutMultipartOpts` only differ on the `mode` field; Supporting `mode` for all 
multipart operations means they could be unified. The S3 implementation also 
already uses `CompleteMultipartMode`, but only implements `Create` and 
`Overwrite` modes)
   - Enable concrete use-cases like [this one in 
polars](https://github.com/pola-rs/polars/issues/23021)
   
   ## Caveats
   
   - GCS doesn't support conditional multipart uploads via the currently used 
XML API
   
   <hr>
   
   If that sounds like something worth doing, I'd be happy to work on it


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

Reply via email to