[jira] [Updated] (AIRFLOW-2635) Add discription column to UI

2018-06-25 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2635?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-2635: -- Affects Version/s: 1.10 Fix Version/s: 2.0.0 Airflow 2.0 > Add discription col

[jira] [Created] (AIRFLOW-2677) Airflow 1.8 : DAGs are getting queued up

2018-06-25 Thread Anurakti Nigam (JIRA)
Anurakti Nigam created AIRFLOW-2677: --- Summary: Airflow 1.8 : DAGs are getting queued up Key: AIRFLOW-2677 URL: https://issues.apache.org/jira/browse/AIRFLOW-2677 Project: Apache Airflow Iss

[jira] [Created] (AIRFLOW-2676) Import Error with Celery Executor

2018-06-25 Thread Swapnil Debarshi (JIRA)
Swapnil Debarshi created AIRFLOW-2676: - Summary: Import Error with Celery Executor Key: AIRFLOW-2676 URL: https://issues.apache.org/jira/browse/AIRFLOW-2676 Project: Apache Airflow Issue

[jira] [Created] (AIRFLOW-2675) Run commands error after installed

2018-06-25 Thread Guoqiang Ding (JIRA)
Guoqiang Ding created AIRFLOW-2675: -- Summary: Run commands error after installed Key: AIRFLOW-2675 URL: https://issues.apache.org/jira/browse/AIRFLOW-2675 Project: Apache Airflow Issue Type:

[jira] [Commented] (AIRFLOW-1104) Concurrency check in scheduler should count queued tasks as well as running

2018-06-25 Thread Jakob Homan (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1104?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522831#comment-16522831 ] Jakob Homan commented on AIRFLOW-1104: -- We should make some progress on this issue

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread kunal gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522816#comment-16522816 ] kunal gupta commented on AIRFLOW-2631: -- [~ashb] Sorry for the confusion, i had do

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread kunal gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522805#comment-16522805 ] kunal gupta commented on AIRFLOW-2631: -- [~ashb] I have updated my Celery to 4.2:

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522802#comment-16522802 ] Ash Berlin-Taylor commented on AIRFLOW-2631: The stack trace and error you

incubator-airflow git commit: closes apache/incubator-airflow#3389 *Obsolete PR*

2018-06-25 Thread kaxilnaik
Repository: incubator-airflow Updated Branches: refs/heads/master 926c62837 -> 5646d3115 closes apache/incubator-airflow#3389 *Obsolete PR* Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/asf/incubator-airflow/commit/5646d311 T

[jira] [Created] (AIRFLOW-2674) BashOperator eats stdout and stderr logs

2018-06-25 Thread Tim Swast (JIRA)
Tim Swast created AIRFLOW-2674: -- Summary: BashOperator eats stdout and stderr logs Key: AIRFLOW-2674 URL: https://issues.apache.org/jira/browse/AIRFLOW-2674 Project: Apache Airflow Issue Type: I

[jira] [Resolved] (AIRFLOW-2671) Webserver does not exit if gunicorn process exits

2018-06-25 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2671?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2671. - Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3545 [https://git

incubator-airflow git commit: [AIRFLOW-2671] Monitor gunicorn process, and exit if it exits

2018-06-25 Thread kaxilnaik
Repository: incubator-airflow Updated Branches: refs/heads/master 53b89b983 -> 926c62837 [AIRFLOW-2671] Monitor gunicorn process, and exit if it exits Closes #3545 from NielsZeilemaker/monitor_webserver Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git

incubator-airflow git commit: [AIRFLOW-1978] Add support for additional WinRM parameters

2018-06-25 Thread kaxilnaik
Repository: incubator-airflow Updated Branches: refs/heads/master 216beacd5 -> 53b89b983 [AIRFLOW-1978] Add support for additional WinRM parameters Implemented all of the WinRM options from pywinrm. Implemented support for streaming stdout/stderr. Closes #3512 from jshvrsn/winrm Project: ht

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread kunal gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522620#comment-16522620 ] kunal gupta commented on AIRFLOW-2631: -- [~ashb] and my broker_url is : redis://:p

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread kunal gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522618#comment-16522618 ] kunal gupta commented on AIRFLOW-2631: -- [~ashb] Here is celery version: {color:#

[jira] [Updated] (AIRFLOW-2668) Missing cryptogrpahy dependency on airflow initdb call

2018-06-25 Thread Nicholas Pezolano (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nicholas Pezolano updated AIRFLOW-2668: --- Component/s: dependencies > Missing cryptogrpahy dependency on airflow initdb call

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522575#comment-16522575 ] Ash Berlin-Taylor commented on AIRFLOW-2631: First: what is the _FULL_ stac

[jira] [Commented] (AIRFLOW-2673) Tree view of manually triggered dags does not respect date

2018-06-25 Thread Matthew Bowden (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522573#comment-16522573 ] Matthew Bowden commented on AIRFLOW-2673: - Update on this ticket: it looks like

[jira] [Comment Edited] (AIRFLOW-2673) Tree view of manually triggered dags does not respect date

2018-06-25 Thread Matthew Bowden (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2673?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522573#comment-16522573 ] Matthew Bowden edited comment on AIRFLOW-2673 at 6/25/18 5:19 PM: ---

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread kunal gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522572#comment-16522572 ] kunal gupta commented on AIRFLOW-2631: -- [~ashb] So you are saying that worker is

[jira] [Commented] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2018-06-25 Thread Matthew Bowden (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522543#comment-16522543 ] Matthew Bowden commented on AIRFLOW-1853: - Yes, issue was on my end. Apologies

[jira] [Commented] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2018-06-25 Thread Matthew Bowden (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522538#comment-16522538 ] Matthew Bowden commented on AIRFLOW-1853: - [~ashb] you're totally right, it sho

[jira] [Comment Edited] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2018-06-25 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522532#comment-16522532 ] Ash Berlin-Taylor edited comment on AIRFLOW-1853 at 6/25/18 5:01 PM:

[jira] [Comment Edited] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2018-06-25 Thread Matthew Bowden (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522520#comment-16522520 ] Matthew Bowden edited comment on AIRFLOW-1853 at 6/25/18 5:01 PM: ---

[jira] [Commented] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2018-06-25 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522532#comment-16522532 ] Ash Berlin-Taylor commented on AIRFLOW-1853: The new query has {{ .limit(nu

[jira] [Comment Edited] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2018-06-25 Thread Matthew Bowden (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522520#comment-16522520 ] Matthew Bowden edited comment on AIRFLOW-1853 at 6/25/18 4:52 PM: ---

[jira] [Commented] (AIRFLOW-1853) tree view of manually triggered dags overpopulate page

2018-06-25 Thread Matthew Bowden (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1853?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522520#comment-16522520 ] Matthew Bowden commented on AIRFLOW-1853: - The changes I made as part of that P

[jira] [Created] (AIRFLOW-2673) Tree view of manually triggered dags does not respect date

2018-06-25 Thread Matthew Bowden (JIRA)
Matthew Bowden created AIRFLOW-2673: --- Summary: Tree view of manually triggered dags does not respect date Key: AIRFLOW-2673 URL: https://issues.apache.org/jira/browse/AIRFLOW-2673 Project: Apache Air

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522438#comment-16522438 ] Ash Berlin-Taylor commented on AIRFLOW-2631: You haven't included a full st

[jira] [Commented] (AIRFLOW-2631) Worker fails to connect with MySQL DB

2018-06-25 Thread kunal gupta (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2631?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16522411#comment-16522411 ] kunal gupta commented on AIRFLOW-2631: -- [~ashb] The worker node has the exact sam

[jira] [Created] (AIRFLOW-2672) Update documentation for S3 connections and logging

2018-06-25 Thread Nicholas Pezolano (JIRA)
Nicholas Pezolano created AIRFLOW-2672: -- Summary: Update documentation for S3 connections and logging Key: AIRFLOW-2672 URL: https://issues.apache.org/jira/browse/AIRFLOW-2672 Project: Apache Airf

[jira] [Resolved] (AIRFLOW-2648) Mapred job name in HiveOperator hard to parse and order can be improved

2018-06-25 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2648?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2648. --- Resolution: Fixed Fix Version/s: 2.0.0 Issue resolved by pull request #3534

incubator-airflow git commit: [AIRFLOW-2648] Update mapred job name in HiveOperator

2018-06-25 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 5a3f39913 -> 216beacd5 [AIRFLOW-2648] Update mapred job name in HiveOperator Closes #3534 from yrqls21/keivn_yang_reorder_mapred Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.

[jira] [Assigned] (AIRFLOW-1945) Pass --autoscale to celery workers

2018-06-25 Thread Sai Phanindhra (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Sai Phanindhra reassigned AIRFLOW-1945: --- Assignee: Sai Phanindhra > Pass --autoscale to celery workers > --

[jira] [Resolved] (AIRFLOW-2669) In worker_configuration.py, use dags_volume_subpath determine whether logs_volume_subpath exists

2018-06-25 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2669?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2669. --- Resolution: Fixed Issue resolved by pull request #3543 [https://github.com/apache/i

incubator-airflow git commit: [AIRFLOW-2669] Fix bug when setting logs_volume_subpath

2018-06-25 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master adb648c94 -> 5a3f39913 [AIRFLOW-2669] Fix bug when setting logs_volume_subpath Closes #3543 from Cplo/subpath Project: http://git-wip-us.apache.org/repos/asf/incubator-airflow/repo Commit: http://git-wip-us.apache.org/repos/as

[jira] [Resolved] (AIRFLOW-2662) support affinity & nodeSelector policies for kubernetes executor/operator

2018-06-25 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2662?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2662. --- Resolution: Fixed Issue resolved by pull request #3535 [https://github.com/apache/i

incubator-airflow git commit: [AIRFLOW-2662][AIRFLOW-2397] Add k8s node_selectors and affinity

2018-06-25 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 0ce068e08 -> adb648c94 [AIRFLOW-2662][AIRFLOW-2397] Add k8s node_selectors and affinity Add the ability to set the node selection and the affinity for the k8s executor Closes #3535 from Cplo/affinity Project: http://git-wip-u

incubator-airflow git commit: [AIRFLOW-XXX] Fix typo in http_operator.py

2018-06-25 Thread fokko
Repository: incubator-airflow Updated Branches: refs/heads/master 702a57ec5 -> 0ce068e08 [AIRFLOW-XXX] Fix typo in http_operator.py Replace sensor by operator in the comment: `:param http_conn_id: The connection to run the sensor against` by `:param http_conn_id: The connection to run the oper

[jira] [Created] (AIRFLOW-2671) Webserver does not exit if gunicorn process exits

2018-06-25 Thread Niels Zeilemaker (JIRA)
Niels Zeilemaker created AIRFLOW-2671: - Summary: Webserver does not exit if gunicorn process exits Key: AIRFLOW-2671 URL: https://issues.apache.org/jira/browse/AIRFLOW-2671 Project: Apache Airflow

[jira] [Created] (AIRFLOW-2670) SSHOperator's timeout parameter doesn't affect SSHook timeoot

2018-06-25 Thread jin zhang (JIRA)
jin zhang created AIRFLOW-2670: -- Summary: SSHOperator's timeout parameter doesn't affect SSHook timeoot Key: AIRFLOW-2670 URL: https://issues.apache.org/jira/browse/AIRFLOW-2670 Project: Apache Airflow