[jira] [Commented] (AIRFLOW-5801) CloudSqlProxyRunner always assumes GCP credentials are passed via file instead of JSON blob

2020-03-01 Thread nexoriv (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5801?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048852#comment-17048852 ] nexoriv commented on AIRFLOW-5801: -- is it even possible to pass the connection as json BLOB?

[GitHub] [airflow] codecov-io edited a comment on issue #7437: [AIRFLOW-2325] Add CloudwatchTaskHandler option for remote task loggi…

2020-03-01 Thread GitBox
codecov-io edited a comment on issue #7437: [AIRFLOW-2325] Add CloudwatchTaskHandler option for remote task loggi… URL: https://github.com/apache/airflow/pull/7437#issuecomment-586842394 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7437?src=pr=h1) Report > Merging

[GitHub] [airflow] vardancse commented on a change in pull request #7476: [AIRFLOW-6856] Bulk fetch paused_dag_ids

2020-03-01 Thread GitBox
vardancse commented on a change in pull request #7476: [AIRFLOW-6856] Bulk fetch paused_dag_ids URL: https://github.com/apache/airflow/pull/7476#discussion_r386208633 ## File path: airflow/jobs/scheduler_job.py ## @@ -816,7 +811,12 @@ def process_file(self, file_path,

[jira] [Assigned] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-03-01 Thread Ebrima Jallow (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ebrima Jallow reassigned AIRFLOW-6747: -- Assignee: (was: Ebrima Jallow) > UI - Show count of tasks in each dag on the

[jira] [Assigned] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-03-01 Thread Ebrima Jallow (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ebrima Jallow reassigned AIRFLOW-6747: -- Assignee: Ebrima Jallow > UI - Show count of tasks in each dag on the main dags

[jira] [Assigned] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-03-01 Thread Ebrima Jallow (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ebrima Jallow reassigned AIRFLOW-6747: -- Assignee: Ebrima Jallow (was: Nityananda Gohain) > UI - Show count of tasks in

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-03-01 Thread Adam Angeli (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048730#comment-17048730 ] Adam Angeli commented on AIRFLOW-5071: -- [~cjsekl] - I'm still running {{1.10.6}}, so can't confirm

[jira] [Commented] (AIRFLOW-6969) Move backport packages to test

2020-03-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048709#comment-17048709 ] ASF subversion and git services commented on AIRFLOW-6969: -- Commit

[jira] [Commented] (AIRFLOW-6969) Move backport packages to test

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048708#comment-17048708 ] ASF GitHub Bot commented on AIRFLOW-6969: - potiuk commented on pull request #7603:

[GitHub] [airflow] potiuk merged pull request #7603: [AIRFLOW-6969] Move backport build to test

2020-03-01 Thread GitBox
potiuk merged pull request #7603: [AIRFLOW-6969] Move backport build to test URL: https://github.com/apache/airflow/pull/7603 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] potiuk commented on issue #7603: [AIRFLOW-6969] Move backport build to test

2020-03-01 Thread GitBox
potiuk commented on issue #7603: [AIRFLOW-6969] Move backport build to test URL: https://github.com/apache/airflow/pull/7603#issuecomment-593164108 I prefer to run everything, always. This way you find problems immediately when they appear and not after they are merged. I want this to be

[GitHub] [airflow] kaxil commented on issue #6606: [AIRFLOW-6014] - handle pods which are preempted and deleted by kuber…

2020-03-01 Thread GitBox
kaxil commented on issue #6606: [AIRFLOW-6014] - handle pods which are preempted and deleted by kuber… URL: https://github.com/apache/airflow/pull/6606#issuecomment-593153484 cc @dimberman This is an automated message from

[GitHub] [airflow] mik-laj commented on issue #7603: [AIRFLOW-6969] Move backport build to test

2020-03-01 Thread GitBox
mik-laj commented on issue #7603: [AIRFLOW-6969] Move backport build to test URL: https://github.com/apache/airflow/pull/7603#issuecomment-593153416 I'm not sure. Maybe we should run it only on master or manually? This is an

[GitHub] [airflow] atrbgithub opened a new pull request #6606: [AIRFLOW-6014] - handle pods which are preempted and deleted by kuber…

2020-03-01 Thread GitBox
atrbgithub opened a new pull request #6606: [AIRFLOW-6014] - handle pods which are preempted and deleted by kuber… URL: https://github.com/apache/airflow/pull/6606 …netes but not restarted Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the

[jira] [Commented] (AIRFLOW-6014) Kubernetes executor - handle preempted deleted pods - queued tasks

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048694#comment-17048694 ] ASF GitHub Bot commented on AIRFLOW-6014: - atrbgithub commented on pull request #6606:

[GitHub] [airflow] potiuk opened a new pull request #7603: [AIRFLOW-6969] Move backport build to test

2020-03-01 Thread GitBox
potiuk opened a new pull request #7603: [AIRFLOW-6969] Move backport build to test URL: https://github.com/apache/airflow/pull/7603 When one of the test builds fails even restarting it does not help to succeed the whole job if there is "post-test" stage. The post-test job will remain in

[jira] [Commented] (AIRFLOW-6969) Move backport packages to test

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6969?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048683#comment-17048683 ] ASF GitHub Bot commented on AIRFLOW-6969: - potiuk commented on pull request #7603:

[jira] [Created] (AIRFLOW-6969) Move backport packages to test

2020-03-01 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-6969: - Summary: Move backport packages to test Key: AIRFLOW-6969 URL: https://issues.apache.org/jira/browse/AIRFLOW-6969 Project: Apache Airflow Issue Type:

[jira] [Comment Edited] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-03-01 Thread Johan Eklund (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048642#comment-17048642 ] Johan Eklund edited comment on AIRFLOW-5071 at 3/1/20 9:02 PM: --- We are

[jira] [Commented] (AIRFLOW-4176) [security] webui shows password - admin/log/?flt1_extra_contains=conn_password

2020-03-01 Thread Giorgio Zoppi (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048664#comment-17048664 ] Giorgio Zoppi commented on AIRFLOW-4176: I get into this.   > [security] webui shows password

[jira] [Assigned] (AIRFLOW-4176) [security] webui shows password - admin/log/?flt1_extra_contains=conn_password

2020-03-01 Thread Giorgio Zoppi (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4176?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Giorgio Zoppi reassigned AIRFLOW-4176: -- Assignee: Giorgio Zoppi > [security] webui shows password -

[jira] [Created] (AIRFLOW-6968) Failing when executing a dag: 'log file does not exist'

2020-03-01 Thread Jira
Omar Suárez created AIRFLOW-6968: Summary: Failing when executing a dag: 'log file does not exist' Key: AIRFLOW-6968 URL: https://issues.apache.org/jira/browse/AIRFLOW-6968 Project: Apache Airflow

[GitHub] [airflow] stale[bot] commented on issue #7088: [WIP][AIRFLOW-6494] SSH host_proxy has to be fresh

2020-03-01 Thread GitBox
stale[bot] commented on issue #7088: [WIP][AIRFLOW-6494] SSH host_proxy has to be fresh URL: https://github.com/apache/airflow/pull/7088#issuecomment-593135484 This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further

[GitHub] [airflow] codecov-io edited a comment on issue #7597: [AIRFLOW-6497][WIP] Avoid loading DAGs in the main scheduler loop

2020-03-01 Thread GitBox
codecov-io edited a comment on issue #7597: [AIRFLOW-6497][WIP] Avoid loading DAGs in the main scheduler loop URL: https://github.com/apache/airflow/pull/7597#issuecomment-593006305 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7597?src=pr=h1) Report > Merging

[jira] [Comment Edited] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-03-01 Thread Johan Eklund (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048642#comment-17048642 ] Johan Eklund edited comment on AIRFLOW-5071 at 3/1/20 6:17 PM: --- We are

[jira] [Resolved] (AIRFLOW-6962) Fix "compeleted" to "completed"

2020-03-01 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6962. Resolution: Fixed > Fix "compeleted" to "completed" > --- >

[jira] [Commented] (AIRFLOW-6962) Fix "compeleted" to "completed"

2020-03-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048647#comment-17048647 ] ASF subversion and git services commented on AIRFLOW-6962: -- Commit

[jira] [Commented] (AIRFLOW-6962) Fix "compeleted" to "completed"

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048646#comment-17048646 ] ASF GitHub Bot commented on AIRFLOW-6962: - mik-laj commented on pull request #7600:

[GitHub] [airflow] mik-laj merged pull request #7600: [AIRFLOW-6962] Fix "compeleted" to "completed"

2020-03-01 Thread GitBox
mik-laj merged pull request #7600: [AIRFLOW-6962] Fix "compeleted" to "completed" URL: https://github.com/apache/airflow/pull/7600 This is an automated message from the Apache Git Service. To respond to the message, please

[jira] [Comment Edited] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-03-01 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048645#comment-17048645 ] t oo edited comment on AIRFLOW-6747 at 3/1/20 5:56 PM: --- [~maubeh1] you can

[jira] [Commented] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-03-01 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048645#comment-17048645 ] t oo commented on AIRFLOW-6747: --- [~maubeh1] you can contact me if u get stuck > UI - Show count of tasks

[jira] [Commented] (AIRFLOW-5842) Switch to Buster base images

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5842?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048643#comment-17048643 ] ASF GitHub Bot commented on AIRFLOW-5842: - potiuk commented on pull request #6499:

[GitHub] [airflow] potiuk opened a new pull request #6499: [AIRFLOW-5842] Switch to Debian buster image. Depends on [AIRFLOW-5704]

2020-03-01 Thread GitBox
potiuk opened a new pull request #6499: [AIRFLOW-5842] Switch to Debian buster image. Depends on [AIRFLOW-5704] URL: https://github.com/apache/airflow/pull/6499 NOTE FOR REVIEWER: This change depends on #6373 . Please check only last commit. As part of the production migration we

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-03-01 Thread Johan Eklund (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048642#comment-17048642 ] Johan Eklund commented on AIRFLOW-5071: --- We are also seeing these issues after upgrading from

[jira] [Updated] (AIRFLOW-6941) Add queries count test for create_dagrun

2020-03-01 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6941?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6941: --- Summary: Add queries count test for create_dagrun (was: Add queries ccount test for

[GitHub] [airflow] mik-laj opened a new pull request #7602: [AIRFLOW-6967] Add tests to avoid performance regression in DagFileProcessor

2020-03-01 Thread GitBox
mik-laj opened a new pull request #7602: [AIRFLOW-6967] Add tests to avoid performance regression in DagFileProcessor URL: https://github.com/apache/airflow/pull/7602 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to

[jira] [Commented] (AIRFLOW-6967) Add tests to avoid performance regression in DagFileProcessor

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6967?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048628#comment-17048628 ] ASF GitHub Bot commented on AIRFLOW-6967: - mik-laj commented on pull request #7602:

[jira] [Created] (AIRFLOW-6967) Add tests to avoid performance regression in DagFileProcessor

2020-03-01 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-6967: -- Summary: Add tests to avoid performance regression in DagFileProcessor Key: AIRFLOW-6967 URL: https://issues.apache.org/jira/browse/AIRFLOW-6967 Project: Apache

[jira] [Resolved] (AIRFLOW-6966) Move reap_process_group to process_utils

2020-03-01 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6966. Fix Version/s: 2.0.0 Resolution: Fixed > Move reap_process_group to process_utils

[jira] [Commented] (AIRFLOW-6966) Move reap_process_group to process_utils

2020-03-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048625#comment-17048625 ] ASF subversion and git services commented on AIRFLOW-6966: -- Commit

[jira] [Commented] (AIRFLOW-6966) Move reap_process_group to process_utils

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048624#comment-17048624 ] ASF GitHub Bot commented on AIRFLOW-6966: - mik-laj commented on pull request #7601:

[GitHub] [airflow] mik-laj merged pull request #7601: [AIRFLOW-6966] Move reap_process_group to process_utils

2020-03-01 Thread GitBox
mik-laj merged pull request #7601: [AIRFLOW-6966] Move reap_process_group to process_utils URL: https://github.com/apache/airflow/pull/7601 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7591: [AIRFLOW-XXXX] Add Docker installation in WSL

2020-03-01 Thread GitBox
boring-cyborg[bot] commented on issue #7591: [AIRFLOW-] Add Docker installation in WSL URL: https://github.com/apache/airflow/pull/7591#issuecomment-593116953 Awesome work, congrats on your first merged pull request!

[GitHub] [airflow] potiuk merged pull request #7591: [AIRFLOW-XXXX] Add Docker installation in WSL

2020-03-01 Thread GitBox
potiuk merged pull request #7591: [AIRFLOW-] Add Docker installation in WSL URL: https://github.com/apache/airflow/pull/7591 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] stale[bot] commented on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-03-01 Thread GitBox
stale[bot] commented on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-593116198 This issue has been automatically marked as stale because it has not had recent activity. It will be

[GitHub] [airflow] potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py

2020-03-01 Thread GitBox
potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py URL: https://github.com/apache/airflow/pull/7596#discussion_r386121187 ## File path: airflow/models/__init__.py ## @@ -16,25 +16,36 @@ # specific language

[GitHub] [airflow] potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py

2020-03-01 Thread GitBox
potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py URL: https://github.com/apache/airflow/pull/7596#discussion_r386119298 ## File path: airflow/providers/amazon/aws/example_dags/example_datasync_1.py ## @@ -28,7

[GitHub] [airflow] potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py

2020-03-01 Thread GitBox
potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py URL: https://github.com/apache/airflow/pull/7596#discussion_r386120764 ## File path: airflow/models/all_models.py ## @@ -0,0 +1,46 @@ +# +# Licensed to the

[GitHub] [airflow] potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py

2020-03-01 Thread GitBox
potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py URL: https://github.com/apache/airflow/pull/7596#discussion_r386119172 ## File path: airflow/models/all_models.py ## @@ -0,0 +1,46 @@ +# +# Licensed to the

[GitHub] [airflow] zhongjiajie commented on issue #7148: [AIRFLOW-6472] Correct short and long option in cli

2020-03-01 Thread GitBox
zhongjiajie commented on issue #7148: [AIRFLOW-6472] Correct short and long option in cli URL: https://github.com/apache/airflow/pull/7148#issuecomment-593112504 Thanks everyone review. This is an automated message from the

[GitHub] [airflow] potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py

2020-03-01 Thread GitBox
potiuk commented on a change in pull request #7596: [AIRFLOW-6870] [WIP] remove imports from models/__init__.py URL: https://github.com/apache/airflow/pull/7596#discussion_r386118072 ## File path: airflow/models/all_models.py ## @@ -0,0 +1,46 @@ +# +# Licensed to the

[GitHub] [airflow] codecov-io commented on issue #7601: [AIRFLOW-6966] Move reap_process_group to process_utils

2020-03-01 Thread GitBox
codecov-io commented on issue #7601: [AIRFLOW-6966] Move reap_process_group to process_utils URL: https://github.com/apache/airflow/pull/7601#issuecomment-593109505 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7601?src=pr=h1) Report > Merging

[jira] [Resolved] (AIRFLOW-6472) Some of the options we have are long options with single -

2020-03-01 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-6472. --- Fix Version/s: 2.0.0 Resolution: Fixed > Some of the options we have are long

[jira] [Commented] (AIRFLOW-6472) Some of the options we have are long options with single -

2020-03-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048597#comment-17048597 ] ASF subversion and git services commented on AIRFLOW-6472: -- Commit

[jira] [Commented] (AIRFLOW-6472) Some of the options we have are long options with single -

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048595#comment-17048595 ] ASF GitHub Bot commented on AIRFLOW-6472: - potiuk commented on pull request #7148:

[jira] [Commented] (AIRFLOW-6472) Some of the options we have are long options with single -

2020-03-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6472?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048596#comment-17048596 ] ASF subversion and git services commented on AIRFLOW-6472: -- Commit

[GitHub] [airflow] potiuk merged pull request #7148: [AIRFLOW-6472] Correct short and long option in cli

2020-03-01 Thread GitBox
potiuk merged pull request #7148: [AIRFLOW-6472] Correct short and long option in cli URL: https://github.com/apache/airflow/pull/7148 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] potiuk commented on issue #7148: [AIRFLOW-6472] Correct short and long option in cli

2020-03-01 Thread GitBox
potiuk commented on issue #7148: [AIRFLOW-6472] Correct short and long option in cli URL: https://github.com/apache/airflow/pull/7148#issuecomment-593107450 Thanks @zhongjiajie ! This is an automated message from the Apache

[GitHub] [airflow] potiuk commented on issue #7148: [AIRFLOW-6472] Correct short and long option in cli

2020-03-01 Thread GitBox
potiuk commented on issue #7148: [AIRFLOW-6472] Correct short and long option in cli URL: https://github.com/apache/airflow/pull/7148#issuecomment-593107408 I think it looks really good now and see all the comments addressed! Merging :)

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7583: [AIRFLOW-6954] Use DagRunType instead of ID_PREFIX in run_id

2020-03-01 Thread GitBox
nuclearpinguin commented on a change in pull request #7583: [AIRFLOW-6954] Use DagRunType instead of ID_PREFIX in run_id URL: https://github.com/apache/airflow/pull/7583#discussion_r386114848 ## File path: airflow/api/common/experimental/mark_tasks.py ## @@ -187,7 +188,7

[GitHub] [airflow] codecov-io commented on issue #7599: [AIRFLOW-6961] Create tags in bulk during bulk_sync_to_db

2020-03-01 Thread GitBox
codecov-io commented on issue #7599: [AIRFLOW-6961] Create tags in bulk during bulk_sync_to_db URL: https://github.com/apache/airflow/pull/7599#issuecomment-593105351 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7599?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-6966) Move reap_process_group to process_utils

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6966?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048587#comment-17048587 ] ASF GitHub Bot commented on AIRFLOW-6966: - mik-laj commented on pull request #7601:

[jira] [Commented] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-03-01 Thread Ebrima Jallow (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048588#comment-17048588 ] Ebrima Jallow commented on AIRFLOW-6747: [~toopt4] Thank you for the reply.  one of the

[GitHub] [airflow] mik-laj opened a new pull request #7601: [AIRFLOW-6966] Move reap_process_group to process_utils

2020-03-01 Thread GitBox
mik-laj opened a new pull request #7601: [AIRFLOW-6966] Move reap_process_group to process_utils URL: https://github.com/apache/airflow/pull/7601 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below before

[jira] [Created] (AIRFLOW-6966) Move reap_process_group to process_utils

2020-03-01 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-6966: -- Summary: Move reap_process_group to process_utils Key: AIRFLOW-6966 URL: https://issues.apache.org/jira/browse/AIRFLOW-6966 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-4078) Allow filtering by all columns in Browse Logs view

2020-03-01 Thread Ebrima Jallow (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048573#comment-17048573 ] Ebrima Jallow commented on AIRFLOW-4078: [~sreekar] since I have not gotten a reply [~brylie] 

[jira] [Updated] (AIRFLOW-6965) The get_task_instances method is performed three times during one creation of the DAGRun file.

2020-03-01 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6965?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6965: --- Summary: The get_task_instances method is performed three times during one creation of the

[GitHub] [airflow] mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r…

2020-03-01 Thread GitBox
mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r… URL: https://github.com/apache/airflow/pull/7593#discussion_r386109679 ## File path: airflow/www/templates/airflow/dag.html ## @@ -33,7 +33,8 @@

[GitHub] [airflow] pvcnt commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

2020-03-01 Thread GitBox
pvcnt commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-593099391 @sbrandtb From what I understood it is exactly the purpose to set a server-side timeout and handle it gracefully, instead of

[GitHub] [airflow] sbrandtb commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

2020-03-01 Thread GitBox
sbrandtb commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-593092077 @pvcnt Please check out my last comment: The fix does *not* work as intended. The Kubernetes job watcher is a

[GitHub] [airflow] donotpush commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

2020-03-01 Thread GitBox
donotpush commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-593084707 I found this guide very useful for those setting up Airflow on Kubernetes executor for the first time

[GitHub] [airflow] donotpush removed a comment on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

2020-03-01 Thread GitBox
donotpush removed a comment on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-592950905 @maxirus @dimberman it seems that Kubernetes executor on 1.10.9 is broken, the KubernetesJobWatcher bug is still

[jira] [Resolved] (AIRFLOW-6532) Fetch celery states using batch method instead Pool

2020-03-01 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6532?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6532. Resolution: Duplicate > Fetch celery states using batch method instead Pool >

[jira] [Created] (AIRFLOW-6965) The method is performed playthree times during one creation of the DAGRun file.

2020-03-01 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-6965: -- Summary: The method is performed playthree times during one creation of the DAGRun file. Key: AIRFLOW-6965 URL: https://issues.apache.org/jira/browse/AIRFLOW-6965

[jira] [Commented] (AIRFLOW-6747) UI - Show count of tasks in each dag on the main dags page

2020-03-01 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048527#comment-17048527 ] t oo commented on AIRFLOW-6747: --- you can [~maubeh1] > UI - Show count of tasks in each dag on the main

[jira] [Created] (AIRFLOW-6964) create_dag_run method queries individual values from the database

2020-03-01 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-6964: -- Summary: create_dag_run method queries individual values from the database Key: AIRFLOW-6964 URL: https://issues.apache.org/jira/browse/AIRFLOW-6964 Project:

[jira] [Resolved] (AIRFLOW-6880) Do not check task instances for new DAGRuns

2020-03-01 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6880. Resolution: Abandoned > Do not check task instances for new DAGRuns >

[jira] [Resolved] (AIRFLOW-6857) Bulk sync DAGs

2020-03-01 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6857?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6857. Fix Version/s: 2.0.0 Resolution: Fixed > Bulk sync DAGs > -- > >

[jira] [Created] (AIRFLOW-6963) Use low-level API for bulk insert

2020-03-01 Thread Kamil Bregula (Jira)
Kamil Bregula created AIRFLOW-6963: -- Summary: Use low-level API for bulk insert Key: AIRFLOW-6963 URL: https://issues.apache.org/jira/browse/AIRFLOW-6963 Project: Apache Airflow Issue Type:

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r…

2020-03-01 Thread GitBox
zhongjiajie commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r… URL: https://github.com/apache/airflow/pull/7593#discussion_r386094614 ## File path: airflow/www/templates/airflow/dags.html ## @@ -99,7 +99,8

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r…

2020-03-01 Thread GitBox
zhongjiajie commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r… URL: https://github.com/apache/airflow/pull/7593#discussion_r386094551 ## File path: airflow/www/templates/airflow/dag.html ## @@ -33,7 +33,8 @@

[GitHub] [airflow] mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r…

2020-03-01 Thread GitBox
mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r… URL: https://github.com/apache/airflow/pull/7593#discussion_r386094173 ## File path: airflow/www/templates/airflow/dags.html ## @@ -99,7 +99,8 @@

[GitHub] [airflow] mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r…

2020-03-01 Thread GitBox
mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r… URL: https://github.com/apache/airflow/pull/7593#discussion_r386094127 ## File path: airflow/www/templates/airflow/dag.html ## @@ -33,7 +33,8 @@

[GitHub] [airflow] mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r…

2020-03-01 Thread GitBox
mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r… URL: https://github.com/apache/airflow/pull/7593#discussion_r386094173 ## File path: airflow/www/templates/airflow/dags.html ## @@ -99,7 +99,8 @@

[GitHub] [airflow] mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r…

2020-03-01 Thread GitBox
mik-laj commented on a change in pull request #7593: [AIRFLOW-6959] Use NULL as dag.description default value and change r… URL: https://github.com/apache/airflow/pull/7593#discussion_r386094127 ## File path: airflow/www/templates/airflow/dag.html ## @@ -33,7 +33,8 @@

[GitHub] [airflow] codecov-io edited a comment on issue #6354: [AIRFLOW-5664] Store timestamps with microseconds precision in GCSToPSQL

2020-03-01 Thread GitBox
codecov-io edited a comment on issue #6354: [AIRFLOW-5664] Store timestamps with microseconds precision in GCSToPSQL URL: https://github.com/apache/airflow/pull/6354#issuecomment-571234741 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6354?src=pr=h1) Report > Merging

[GitHub] [airflow] BasPH closed pull request #7504: [AIRFLOW-6882] Implement SageMakerHook list_training_jobs method + convenience method for iterating list_* requests

2020-03-01 Thread GitBox
BasPH closed pull request #7504: [AIRFLOW-6882] Implement SageMakerHook list_training_jobs method + convenience method for iterating list_* requests URL: https://github.com/apache/airflow/pull/7504 This is an automated

[GitHub] [airflow] BasPH commented on issue #7504: [AIRFLOW-6882] Implement SageMakerHook list_training_jobs method + convenience method for iterating list_* requests

2020-03-01 Thread GitBox
BasPH commented on issue #7504: [AIRFLOW-6882] Implement SageMakerHook list_training_jobs method + convenience method for iterating list_* requests URL: https://github.com/apache/airflow/pull/7504#issuecomment-593076941 Closing in favour of https://github.com/apache/airflow/pull/7598

[jira] [Commented] (AIRFLOW-6882) Add an AWS SageMakerHook method for listing training jobs

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048509#comment-17048509 ] ASF GitHub Bot commented on AIRFLOW-6882: - BasPH commented on pull request #7504:

[GitHub] [airflow] codecov-io commented on issue #7600: [AIRFLOW-6962] Fix "compeleted" to "completed"

2020-03-01 Thread GitBox
codecov-io commented on issue #7600: [AIRFLOW-6962] Fix "compeleted" to "completed" URL: https://github.com/apache/airflow/pull/7600#issuecomment-593076201 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7600?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-4547) Negative priority_weight should not be permitted

2020-03-01 Thread Roster (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048501#comment-17048501 ] Roster commented on AIRFLOW-4547: - [~alexabraham] your scenario is specific to your needs. I work with

[jira] [Commented] (AIRFLOW-6962) Fix "compeleted" to "completed"

2020-03-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6962?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17048498#comment-17048498 ] ASF GitHub Bot commented on AIRFLOW-6962: - BasPH commented on pull request #7600:

[GitHub] [airflow] BasPH opened a new pull request #7600: [AIRFLOW-6962] Fix "compeleted" to "completed"

2020-03-01 Thread GitBox
BasPH opened a new pull request #7600: [AIRFLOW-6962] Fix "compeleted" to "completed" URL: https://github.com/apache/airflow/pull/7600 "Completed" is misspelled as "compeleted" is various places in the codebase. This PR fixes all mistakes. --- Issue link: WILL BE INSERTED BY

[jira] [Created] (AIRFLOW-6962) Fix "compeleted" to "completed"

2020-03-01 Thread Bas Harenslak (Jira)
Bas Harenslak created AIRFLOW-6962: -- Summary: Fix "compeleted" to "completed" Key: AIRFLOW-6962 URL: https://issues.apache.org/jira/browse/AIRFLOW-6962 Project: Apache Airflow Issue Type: