simonprydden commented on PR #51105: URL: https://github.com/apache/airflow/pull/51105#issuecomment-2912151045
Should the cache directory be located in the tmp folder? As MWAA on AWS, only the `/tmp` is write-able, see comment from [docs](https://docs.aws.amazon.com/mwaa/latest/userguide/mwaa-faqs.html#worker-storage) > Can I store temporary data on the Apache Airflow Worker? > Your Apache Airflow Operators can store temporary data on the Workers. Apache Airflow Workers can access temporary files in the /tmp on the Fargate containers for your environment. I would expect that google cloud composer will have similar restriction. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
