Andreas Bergmeier created BEAM-12545:
----------------------------------------
Summary: WriteToFile should support mime/encoding.
Key: BEAM-12545
URL: https://issues.apache.org/jira/browse/BEAM-12545
Project: Beam
Issue Type: Improvement
Components: io-py-files
Affects Versions: 2.30.0
Reporter: Andreas Bergmeier
Assignee: Pablo Estrada
For our use case, we need to write blobs to GCS. Also, we want to have both
*{{Content-Type}}* and *{{Content-Encoding}}* set for these blobs.
Since *{{WriteToFiles}}* currently only calls *{{Filesystem.create}}* without
*{{mime_type}}* and *{{compression_type}}*, the resulting blobs are of type
octet-stream.
We imagine this to look something like:
{code:python}
metadata = sink.metadata()
full_file_name, writer = _create_writer(base_path=self.base_path.get(),
writer_key=(destination, w),
mime_type=metadata.mime_type,
compression_type=metadata.compression_type)
{code}
WDYT?
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
