roeap commented on PR #5018: URL: https://github.com/apache/arrow-rs/pull/5018#issuecomment-1791326418
@tustvold - sorry was a bit to late here, but generally always happy to review :). The more general question around which characters are encoded or not actually came up a little while ago on delta-rs. Essentially Spark can write certain file path (that would be illegal on windows, but are valid on other os i think) that we cannot read as we consider these characters illegal. Haven't seen that edge case in the wild yet, just discovered it trying to do roundtrip tests that contain a bunch of special characters in a partition value and thus show up in the path ... I dismissed that however as something we have to live with, as concistency across platforms and providers is a major aim for object store, right? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
