GitHub user enchant3dmango edited a comment on the discussion: Add a new task status that would exist between Success and Failure, such as Warn, Needs Attention, or Degraded
IMO this sounds like an edge case, so rather than introducing a new task state, I’d recommend sticking with existing features or simple hacks. One approach is to use a custom callback; your task can still return success, but trigger a notification (Slack/email/etc) when it hits certain thresholds. That way, you keep the DAG green but still flag the issue to your team. If you want to make it cleaner, you can also wrap your task with a custom decorator that checks the error rate (like >1%), logs a warning, and fires off alerts, without marking the task as failed. Keeps everything maintainable and avoids messing with Airflow internals. GitHub link: https://github.com/apache/airflow/discussions/54093#discussioncomment-14037777 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
