GitHub user enchant3dmango added a comment to the discussion: Add a new task status that would exist between Success and Failure, such as Warn, Needs Attention, or Degraded
IMO, this appears to be an edge case. So, instead of creating a feature for this, I think leveraging the existing feature or a simple hack is better. You can create a custom callback for that case, so whenever the case happens, you can still return success, but trigger the custom alert so your team gets notified of that. Or, if you want to make it cleaner, you can create a custom decorator around your task that checks the thresholds (like '<1% error') and logs a warning or notifies your team via Slack, email, or whatever it is, without marking the task as failed. GitHub link: https://github.com/apache/airflow/discussions/54093#discussioncomment-14037777 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
