andrew-pienso opened a new issue, #6831:
URL: https://github.com/apache/arrow-rs/issues/6831

   **Describe the bug**
   Using `delta-rs`  to write to gcp configured s3 storage yields a 411 error. 
   
   Relevant ticket in delta-rs: https://github.com/delta-io/delta-rs/issues/2394
   
   **To Reproduce**
   https://github.com/delta-io/delta-rs/issues/2394#issuecomment-2132886429
   
   **Expected behavior**
   Should be able to use gcp configured s3 storage.
   
   **Additional context**
   I did some digging and it appears this may have been fixed at one point by 
https://github.com/apache/arrow-rs/pull/4518
   but was then regressed by 
https://github.com/apache/arrow-rs/commit/873176078abe54b4503ef15b8d1a2509095331e9#diff-0feb099a0931110c214fa9b9c8c5528512f38ebf22448772a815baee5973b8c4L354-L357
   
   I also noticed that the aws client doesn't currently appear to pass content 
length of zero: 
   
https://github.com/apache/arrow-rs/blob/main/object_store/src/aws/client.rs#L615
   
   Yet the gcp client does: 
https://github.com/apache/arrow-rs/blob/main/object_store/src/gcp/client.rs#L441
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: [email protected]

For queries about this service, please contact Infrastructure at:
[email protected]

Reply via email to