GitHub user ashb added a comment to the discussion: Airflow 3.0.2 configure_logging from airflow.sdk.log ignores logging_config_class
No, the supervisor runs next to the task (it launches and montiors the task process) on the the worker machine. Am I understanding correctly that you want _all logs for all tasks_ to go into a single file as well as the per-task file that Airflow normally outputs? That should be doable by writing a custom logging provider with a processor that would get called for each message emitted. Sort of like https://github.com/apache/airflow/blob/709353f98cdda906a2f4d87dd7ac5aba2fc1555e/providers/amazon/src/airflow/providers/amazon/aws/log/cloudwatch_task_handler.py#L113-L149 -- but this isn't as straight forward of a way of doing it as before I'm afraid. GitHub link: https://github.com/apache/airflow/discussions/53006#discussioncomment-13698045 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
