Turbo87 commented on issue #4498:
URL: https://github.com/apache/arrow-rs/issues/4498#issuecomment-1629263662
> Is this actually an issue, I would have perhaps expected S3 to just ignore
headers it doesn't recognise?
that is a good question. since it's a regular HTTP header I was assuming
that some of the other requests might assign unintentional meaning to it.
> We could also definitely consider adding headers for specific HTTP methods
perhaps 🤔
I guess that would solve the issue to some degree, although it'd be nice to
use the same S3 store for file in the same bucket but with different caching
headers.
> I think I would rather avoid this if possible, as not all stores will have
consistent support for these options.
yeah, I'm not sure how exactly it would work either. we could just have
`PutOptions { extra_headers: HeaderMap }` to make it implementation specific,
or do `PutOptions { cache_control: Something }` and ignore it for
implementations that don't support anything like that.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscr...@arrow.apache.org
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
