[jira] [Commented] (AIRFLOW-5154) Add ability to generate graph alerts to email
[ https://issues.apache.org/jira/browse/AIRFLOW-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16915295#comment-16915295 ] lovk korm commented on AIRFLOW-5154: Such docs would be great > Add ability to generate graph alerts to email > - > > Key: AIRFLOW-5154 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5154 > Project: Apache Airflow > Issue Type: Wish > Components: contrib >Affects Versions: 1.10.4 >Reporter: lovk korm >Priority: Major > > I'm not sure how this is doable but one of the key components that is missing > in airflow is the ability to notify about detecting anomalies something like > graphana [https://grafana.com/] > It would be great if airflow can add support for such tools > > I'm talking here about +*airflow itself*+. For example: if DAG run normally > takes 5 minutes but now for any reason it's running over 30 minutes than we > want an alert to be sent with graph that shows that anomaly. -- This message was sent by Atlassian Jira (v8.3.2#803003)
[jira] [Commented] (AIRFLOW-5154) Add ability to generate graph alerts to email
[ https://issues.apache.org/jira/browse/AIRFLOW-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16906144#comment-16906144 ] Ash Berlin-Taylor commented on AIRFLOW-5154: We do this in our platform on Astronomer.io by using the metrics emitted by Airflow [http://airflow.apache.org/metrics.html] via statsd to prometheus and grafana. It is useful, but I don't want to build a full monitoring stack in to Airflow, so as Kamil says better docs on how to set this up is probably the way to go. > Add ability to generate graph alerts to email > - > > Key: AIRFLOW-5154 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5154 > Project: Apache Airflow > Issue Type: Wish > Components: contrib >Affects Versions: 1.10.4 >Reporter: lovk korm >Priority: Major > > I'm not sure how this is doable but one of the key components that is missing > in airflow is the ability to notify about detecting anomalies something like > graphana [https://grafana.com/] > It would be great if airflow can add support for such tools > > I'm talking here about +*airflow itself*+. For example: if DAG run normally > takes 5 minutes but now for any reason it's running over 30 minutes than we > want an alert to be sent with graph that shows that anomaly. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
[jira] [Commented] (AIRFLOW-5154) Add ability to generate graph alerts to email
[ https://issues.apache.org/jira/browse/AIRFLOW-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16904181#comment-16904181 ] Kamil Bregula commented on AIRFLOW-5154: I think we should develop instructions for integration with Grafana. Airflow should do one thing in a good way. > Add ability to generate graph alerts to email > - > > Key: AIRFLOW-5154 > URL: https://issues.apache.org/jira/browse/AIRFLOW-5154 > Project: Apache Airflow > Issue Type: Wish > Components: contrib >Affects Versions: 1.10.4 >Reporter: lovk korm >Priority: Major > > I'm not sure how this is doable but one of the key components that is missing > in airflow is the ability to notify about detecting anomalies something like > graphana [https://grafana.com/] > It would be great if airflow can add support for such tools > > I'm talking here about +*airflow itself*+. For example: if DAG run normally > takes 5 minutes but now for any reason it's running over 30 minutes than we > want an alert to be sent with graph that shows that anomaly. -- This message was sent by Atlassian JIRA (v7.6.14#76016)
