[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-22 Thread kunal gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520961#comment-16520961 ] kunal gupta commented on AIRFLOW-2631: -- Can anyone help with this issue please > Worker fails to

incubator-airflow git commit: [AIRFLOW-2657] Add ability to delete dag from web UI

2018-06-22 Thread kaxilnaik
Repository: incubator-airflow Updated Branches: refs/heads/master a504a8fe1 -> 702a57ec5 [AIRFLOW-2657] Add ability to delete dag from web UI Closes #3531 from Noremac201/master Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

incubator-airflow git commit: Revert "[AIRFLOW-2615] Remove not used app creation"

2018-06-22 Thread joygao
Repository: incubator-airflow Updated Branches: refs/heads/master dbcb93c36 -> a504a8fe1 Revert "[AIRFLOW-2615] Remove not used app creation" This reverts commit 9525003ff929020b553c3a9ed7aff121d83a2bd6. Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Updated] (AIRFLOW-2665) No BASH will cause the dag to fail

2018-06-22 Thread Christian Barra (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2665?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Christian Barra updated AIRFLOW-2665: - Description: If you are a running airflow in a system where bash is not available the

[jira] [Commented] (AIRFLOW-2659) Improve Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520768#comment-16520768 ] Alejandro Fernandez commented on AIRFLOW-2659: -- I came across 

[jira] [Comment Edited] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520048#comment-16520048 ] Alejandro Fernandez edited comment on AIRFLOW-2659 at 6/22/18 8:43 PM:

[jira] [Created] (AIRFLOW-2664) Support filtering on /dags//dag_runs

2018-06-22 Thread Ryan Roden-Corrent (JIRA)
Ryan Roden-Corrent created AIRFLOW-2664: --- Summary: Support filtering on /dags//dag_runs Key: AIRFLOW-2664 URL: https://issues.apache.org/jira/browse/AIRFLOW-2664 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alex Guziel (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520661#comment-16520661 ] Alex Guziel commented on AIRFLOW-2659: -- In general, I feel like retries should always have been

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Description: *Problem:* If an infrastructure outage occurs on the Hadoop

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Attachment: Screen Shot 2018-06-22 at 10.53.52 AM.png > Improving Robustness

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Attachment: retry_window.png > Improving Robustness of Operators in Airflow

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Attachment: (was: AIRFLOW_2659.pdf) > Improving Robustness of Operators in

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Attachment: AIRFLOW_2659.pdf > Improving Robustness of Operators in Airflow

[jira] [Resolved] (AIRFLOW-2615) Webserver parent not using cached app

2018-06-22 Thread Joy Gao (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2615?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joy Gao resolved AIRFLOW-2615. -- Resolution: Fixed Fix Version/s: 1.10.0 Issue resolved by pull request #3506

[1/2] incubator-airflow git commit: [AIRFLOW-2615] Remove not used app creation

2018-06-22 Thread joygao
Repository: incubator-airflow Updated Branches: refs/heads/master 1d93d1b54 -> dbcb93c36 [AIRFLOW-2615] Remove not used app creation Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/9525003f Tree:

[2/2] incubator-airflow git commit: Merge pull request #3506 from yrqls21/kevin_yang_remove_extra_step

2018-06-22 Thread joygao
Merge pull request #3506 from yrqls21/kevin_yang_remove_extra_step Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/dbcb93c3 Tree: http://git-wip-us.apache.org/repos/asf/incubator-airflow/tree/dbcb93c3

[jira] [Resolved] (AIRFLOW-2661) Kubernetes Executor - dags_volume_subpath and logs_volume_subpath don't do anything

2018-06-22 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2661. --- Resolution: Fixed Fix Version/s: (was: Airflow 2.0)

[jira] [Updated] (AIRFLOW-2661) Kubernetes Executor - dags_volume_subpath and logs_volume_subpath don't do anything

2018-06-22 Thread Ravi Kotecha (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ravi Kotecha updated AIRFLOW-2661: -- Description: It looks like the configuration options: {code:java} dags_volume_subpath =

[jira] [Commented] (AIRFLOW-2661) Kubernetes Executor - dags_volume_subpath and logs_volume_subpath don't do anything

2018-06-22 Thread Ravi Kotecha (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520427#comment-16520427 ] Ravi Kotecha commented on AIRFLOW-2661: --- I've created a PR here:

incubator-airflow git commit: [AIRFLOW-2661] fix config dags_volume_subpath and logs_volume_subpath

2018-06-22 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 7961ee8f0 -> 1d93d1b54 [AIRFLOW-2661] fix config dags_volume_subpath and logs_volume_subpath Make sure you have checked _all_ steps below. ### JIRA - [x] My PR addresses the following [Airflow JIRA]

[jira] [Resolved] (AIRFLOW-2663) Missing instructions for installing dependencies for SSH hook

2018-06-22 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2663. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3536

[jira] [Work started] (AIRFLOW-2661) Kubernetes Executor - dags_volume_subpath and logs_volume_subpath don't do anything

2018-06-22 Thread Ravi Kotecha (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2661?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2661 started by Ravi Kotecha. - > Kubernetes Executor - dags_volume_subpath and logs_volume_subpath don't

incubator-airflow git commit: [AIRFLOW-2663] Add instructions to install SSH dependencies

2018-06-22 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 07db7a3d7 -> 7961ee8f0 [AIRFLOW-2663] Add instructions to install SSH dependencies Closes #3536 from kaxil/patch-1 Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit:

[jira] [Updated] (AIRFLOW-2663) Missing instructions for installing dependencies for SSH hook

2018-06-22 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2663: Component/s: contrib > Missing instructions for installing dependencies for SSH hook >

[jira] [Updated] (AIRFLOW-2663) Missing instructions for installing dependencies for SSH hook

2018-06-22 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2663: Affects Version/s: 2.0.0 1.10.0 > Missing instructions for installing

[jira] [Created] (AIRFLOW-2663) Missing instructions for installing dependencies for SSH hook

2018-06-22 Thread Kaxil Naik (JIRA)
Kaxil Naik created AIRFLOW-2663: --- Summary: Missing instructions for installing dependencies for SSH hook Key: AIRFLOW-2663 URL: https://issues.apache.org/jira/browse/AIRFLOW-2663 Project: Apache

[jira] [Updated] (AIRFLOW-2663) Missing instructions for installing dependencies for SSH hook

2018-06-22 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2663?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2663: Component/s: Documentation docs > Missing instructions for installing

[jira] [Commented] (AIRFLOW-133) SLAs don't seem to work with schedule_interval=None

2018-06-22 Thread Daniel Mateus Pires (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-133?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520342#comment-16520342 ] Daniel Mateus Pires commented on AIRFLOW-133: - Any update on this ? Seems like SLAs still

[jira] [Created] (AIRFLOW-2662) support affinity & nodeSelector policies for kubernetes executor/operator

2018-06-22 Thread pengchen (JIRA)
pengchen created AIRFLOW-2662: - Summary: support affinity & nodeSelector policies for kubernetes executor/operator Key: AIRFLOW-2662 URL: https://issues.apache.org/jira/browse/AIRFLOW-2662 Project:

[jira] [Created] (AIRFLOW-2661) Kubernetes Executor - dags_volume_subpath and logs_volume_subpath don't do anything

2018-06-22 Thread Ravi Kotecha (JIRA)
Ravi Kotecha created AIRFLOW-2661: - Summary: Kubernetes Executor - dags_volume_subpath and logs_volume_subpath don't do anything Key: AIRFLOW-2661 URL: https://issues.apache.org/jira/browse/AIRFLOW-2661

[jira] [Created] (AIRFLOW-2660) Deadlock error from SQLAlchemy when the parallelism is increased.

2018-06-22 Thread Vignesh (JIRA)
Vignesh created AIRFLOW-2660: Summary: Deadlock error from SQLAlchemy when the parallelism is increased. Key: AIRFLOW-2660 URL: https://issues.apache.org/jira/browse/AIRFLOW-2660 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520135#comment-16520135 ] Ash Berlin-Taylor commented on AIRFLOW-2659: Tasks/Operators in airflow can already be

[jira] [Commented] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16520048#comment-16520048 ] Alejandro Fernandez commented on AIRFLOW-2659: -- Hi [~maxime.beauche...@apache.org], 

[jira] [Closed] (AIRFLOW-2621) Remove unnecessary return statement in TaskConcurrencyDep

2018-06-22 Thread Tao Feng (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2621?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tao Feng closed AIRFLOW-2621. - Resolution: Won't Fix > Remove unnecessary return statement in TaskConcurrencyDep >

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Description: *Problem:* If an infrastructure outage occurs on the Hadoop

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Attachment: test_rules.py > Improving Robustness of Operators in Airflow

[jira] [Updated] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2659?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Alejandro Fernandez updated AIRFLOW-2659: - Attachment: AIRFLOW_2659.pdf > Improving Robustness of Operators in Airflow

[jira] [Created] (AIRFLOW-2659) Improving Robustness of Operators in Airflow during Infra Outages

2018-06-22 Thread Alejandro Fernandez (JIRA)
Alejandro Fernandez created AIRFLOW-2659: Summary: Improving Robustness of Operators in Airflow during Infra Outages Key: AIRFLOW-2659 URL: https://issues.apache.org/jira/browse/AIRFLOW-2659