Re: [VOTE] AIP-58 Airflow ObjectStore

2023-10-20 Thread Bolke de Bruin
I have added an example for the use of the FileTransferOperator in the PR. This is a 'port' of the local_to_s3 dag that is used elsewhere in the examples. I kept the structure as per that original, but it could be reduced to a two-liner (in dag-speak). I agree with Jens that the PR needs to settle

Re: The "no_status" state

2023-10-20 Thread Pierre Jeambrun
Seems like a good idea. Some kind of "task diagnosis", in case the state is not settled to give more context to users. Happy to help on that one as well. I also think that a small AIP is required, the scope of change could be substantial. Best regards, Pierre Le jeu. 19 oct. 2023 à 17:05, Brent

Re: Airflow Docs Development Issues

2023-10-20 Thread Pierre Jeambrun
+1 from moving archived docs outside of airflow-site. Even if that might mean a little more maintenance in case we need to propagate changes to all historical versions, we would have to handle 2 repositories, but that seems like a minor downside compared to the quality of life improvement that it

RE: [VOTE] AIP-58 Airflow ObjectStore

2023-10-20 Thread Scheffler Jens (XC-DX/ETV5)
+1 (non binding) for making this AIP in general. I had a couple of comments and the rework and comments are very active. I assume the PR needs to settle for a moment and there still a lot of different opinions - which is fair with the given complexity. The value is very high but I fear a bit th