Tom-Newton commented on issue #39968: URL: https://github.com/apache/arrow/issues/39968#issuecomment-1936748188
I want to enable the python side tests for Azure but there are a couple of failures. 1. Move operations are not supported yet. https://github.com/apache/arrow/pull/39904 looks like its almost done I believe this will implement file and directory moves for hierarchical namespace accounts but not for flat namespace. These tests run against azurite, which is flat namespace so https://github.com/apache/arrow/pull/39904 actually won't solve this. We should at least add support for file moves to get parity with S3 and GCS. 2. Currently we can't read metadata set by the user, only system metadata generated by azure. This is explained here https://github.com/Tom-Newton/arrow/blob/8d6b96d7269a57317068cbaa59d2ff80d65be1a7/cpp/src/arrow/filesystem/azurefs.cc#L334-L346 I'm hoping its ok to skip these for Azure initially. I can create Github issues to get these ironed out. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
