vincbeck commented on PR #27812: URL: https://github.com/apache/airflow/pull/27812#issuecomment-1323953817
I actually should have asked this question before commenting on this PR but what is your use case here? This operator returns the object specified in `s3_bucket` and `s3_key` but can you describe a DAG where this operator would be used? A S3 file can be big and Xcom should not be used to share large amount of data between operators. If what you are trying to achieve is reading data from S3 bucket and send it to another source, maybe a transfer operator would be more suitable for this use case. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
