waynr opened a new issue, #123:
URL: https://github.com/apache/arrow-rs-object-store/issues/123

   **Is your feature request related to a problem or challenge? Please describe 
what you are trying to do.**
   <!--
   A clear and concise description of what the problem is. Ex. I'm always 
frustrated when [...] 
   (This section helps Arrow developers understand the context and *why* for 
this feature, in addition to  the *what*)
   -->
   I am implementing [an HTTP API that supports chunked uploads of 
data](https://github.com/opencontainers/distribution-spec/blob/main/spec.md#pushing-a-blob-in-chunks)
 across multiple HTTP requests. In order to support this I need to be able to 
continue a pre-established multipart upload.
   
   It's not clear to me either from the documentation or from looking at the 
AWS implementation of `ObjectStore.put_multipart` that this would be possible 
since it appears to create a new multipart upload each time. I am leaning 
toward "eh, probably not possible".
   
   **Describe the solution you'd like**
   <!--
   A clear and concise description of what you want to happen.
   -->
   I would like some API for an `ObjectStore` to get a 
[PutPart](https://docs.rs/object_store/latest/object_store/multipart/trait.PutPart.html)
 for an existing multipart upload given that multipart upload's `MultipartId`. 
   
   The implementation could be as simple as providing a constructor method on 
[S3MultiPartUpload](https://github.com/apache/arrow-rs/blob/7e134f4d277c0b62c27529fc15a4739de3ad0afd/object_store/src/aws/mod.rs#L240).
 But that would break the trait-level API boundary, making this approach only 
applicable to the AWS implementation of `ObjectStore` so I imagine it would be 
best to add a new `ObjectStore` trait method.
   
   **Describe alternatives you've considered**
   <!--
   A clear and concise description of any alternative solutions or features 
you've considered.
   -->
   
   Right now my project has its own `ObjectStore` trait that is a bit simpler 
and catered specifically to my needs (also a bit easier to understand since it 
uses AWS's own SDK library). I'll probably continue using this for the 
foreseeable future, but would prefer to use the established `object_store` 
crate if possible.
   
   **Additional context**
   <!--
   Add any other context or screenshots about the feature request here.
   -->
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to