potiuk edited a comment on issue #15485: URL: https://github.com/apache/airflow/issues/15485#issuecomment-843067448
I guess those artifacts are not huge, those are just meta-data. Can their content be read and stored as XCom values? Sounds like good way to persistently store them and link them with the actual runs. You can then query the XCom and retrieve the manfest and other artifacts content via the XCom API (on top of the existing ability of viewing them via UI): https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html#operation/get_xcom_entry -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: [email protected]
