Hello everyone,

This message is mostly intended for new contributors who look for a good
first issue to work on (everyone else is welcome too!).
We have a 5 yr open issue (#11323
<https://github.com/apache/airflow/issues/11323>) for making the return
value of transfer operators to reflect the file destination uris
consistently.
The original issue presented a GoogleSheetsToGCSOperator as an example, so
I assumed the scope only to the Google provider (although it is probably
relevant for others as well, but left them out of scope so we could
converge this issue).
For that matter, if you copy files A and B from some storage to GCS, the
operator should return something like ['gs://bucket/path/to/A',
'gs://bucket/path/to/B'] where the output URIs apply for the destination
(not the source).
When copying a single entity, let's say only file A - the operator should
eventually return ['gs://bucket/path/to/A'] (list), *but* if it currently
returns 'gs://bucket/path/to/A' (string) - it should be handled for now in
a backward-compatible way (see details in the original issue).
There are 13 relevant operators (at least, hopefully I didn't miss any) - 2
of them were assigned and have open PRs.

If you're interested, please comment on the original issue and I'll assign
you.
Thank you!


Shahar

Reply via email to