[jira] [Created] (AIRFLOW-2939) `set` fails in case of `exisiting_files is None` and in case of `json.dumps`

Kiyoshi Nomo created AIRFLOW-2939: - Summary: `set` fails in case of `exisiting_files is None` and in case of `json.dumps` Key: AIRFLOW-2939 URL: https://issues.apache.org/jira/browse/AIRFLOW-2939

[GitHub] feng-tao commented on a change in pull request #3785: [AIRFLOW-2938] Handle improperly formatted extra field in connection …

feng-tao commented on a change in pull request #3785: [AIRFLOW-2938] Handle improperly formatted extra field in connection … URL: https://github.com/apache/incubator-airflow/pull/3785#discussion_r212146153 ## File path: airflow/www_rbac/views.py ## @@ -1923,7 +1923,10 @@

[jira] [Commented] (AIRFLOW-2779) Verify and correct licenses

[ https://issues.apache.org/jira/browse/AIRFLOW-2779?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589445#comment-16589445 ] Matt Pelland commented on AIRFLOW-2779: --- Hello, it recently came to my attention that someone has

[GitHub] feng-tao commented on issue #3784: [AIRFLOW-2930] Fix celery excecutor scheduler crash

feng-tao commented on issue #3784: [AIRFLOW-2930] Fix celery excecutor scheduler crash URL: https://github.com/apache/incubator-airflow/pull/3784#issuecomment-415198872 CI fails. This is an automated message from the Apache

[GitHub] hscasn commented on issue #3697: [AIRFLOW-2854] kubernetes_pod_operator add more configuration items

hscasn commented on issue #3697: [AIRFLOW-2854] kubernetes_pod_operator add more configuration items URL: https://github.com/apache/incubator-airflow/pull/3697#issuecomment-415194221 Any updates on this PR? Support for private repos is a really important feature.

[jira] [Commented] (AIRFLOW-2938) Invalid 'extra' field in connection can raise an AttributeError when attempting to edit

[ https://issues.apache.org/jira/browse/AIRFLOW-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589374#comment-16589374 ] ASF GitHub Bot commented on AIRFLOW-2938: - wrp opened a new pull request #3785: [AIRFLOW-2938]

[GitHub] wrp opened a new pull request #3785: [AIRFLOW-2938] Handle improperly formatted extra field in connection …

wrp opened a new pull request #3785: [AIRFLOW-2938] Handle improperly formatted extra field in connection … URL: https://github.com/apache/incubator-airflow/pull/3785 …gracefully Make sure you have checked _all_ steps below. ### Jira - [ X] My PR addresses the

[jira] [Created] (AIRFLOW-2938) Invalid 'extra' field in connection can raise an AttributeError when attempting to edit

William Pursell created AIRFLOW-2938: Summary: Invalid 'extra' field in connection can raise an AttributeError when attempting to edit Key: AIRFLOW-2938 URL: https://issues.apache.org/jira/browse/AIRFLOW-2938

[jira] [Comment Edited] (AIRFLOW-2930) scheduler exit when using celery executor

[ https://issues.apache.org/jira/browse/AIRFLOW-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589364#comment-16589364 ] Yingbo Wang edited comment on AIRFLOW-2930 at 8/22/18 9:28 PM: ---

[jira] [Commented] (AIRFLOW-2930) scheduler exit when using celery executor

[ https://issues.apache.org/jira/browse/AIRFLOW-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589368#comment-16589368 ] ASF GitHub Bot commented on AIRFLOW-2930: - YingboWang opened a new pull request #3784:

[GitHub] YingboWang opened a new pull request #3784: [AIRFLOW-2930] Fix celery excecutor scheduler crash

YingboWang opened a new pull request #3784: [AIRFLOW-2930] Fix celery excecutor scheduler crash URL: https://github.com/apache/incubator-airflow/pull/3784 Caused by an update in PR #3740. execute_command.apply_async(args=command, ...) -command is a list of short unicode strings and

[jira] [Resolved] (AIRFLOW-2930) scheduler exit when using celery executor

[ https://issues.apache.org/jira/browse/AIRFLOW-2930?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yingbo Wang resolved AIRFLOW-2930. -- Resolution: Fixed https://github.com/YingboWang/incubator-airflow/pull/1 > scheduler exit

[GitHub] matt2000 opened a new pull request #3783: Fix URI scheme selection

matt2000 opened a new pull request #3783: Fix URI scheme selection URL: https://github.com/apache/incubator-airflow/pull/3783 Per airflow.models.Connection.parse_from_uri, the URI scheme is stored in Connection.conn_type. Preserving conn.schema fallback for backward compatibility.

[jira] [Commented] (AIRFLOW-2841) HttpsHook support for airflow

[ https://issues.apache.org/jira/browse/AIRFLOW-2841?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589328#comment-16589328 ] Matt Chapman commented on AIRFLOW-2841: --- HttpHooks doesn't do https when the Connection is

[jira] [Created] (AIRFLOW-2937) HttpHook doesn't respect the URI scheme when the connection is defined via Environment Variable

Matt Chapman created AIRFLOW-2937: - Summary: HttpHook doesn't respect the URI scheme when the connection is defined via Environment Variable Key: AIRFLOW-2937 URL:

[jira] [Updated] (AIRFLOW-2937) HttpHook doesn't respect the URI scheme when the connection is defined via Environment Variable

[ https://issues.apache.org/jira/browse/AIRFLOW-2937?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Matt Chapman updated AIRFLOW-2937: -- Description: AIRFLOW-645 almost solved this, but not quite. I believe AIRFLOW-2841 is

[GitHub] feng-tao closed pull request #3777: [AIRFLOW-XXX] Add Flipp to list of Airflow users

feng-tao closed pull request #3777: [AIRFLOW-XXX] Add Flipp to list of Airflow users URL: https://github.com/apache/incubator-airflow/pull/3777 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] feng-tao commented on issue #3777: [AIRFLOW-XXX] Add Flipp to list of Airflow users

feng-tao commented on issue #3777: [AIRFLOW-XXX] Add Flipp to list of Airflow users URL: https://github.com/apache/incubator-airflow/pull/3777#issuecomment-415174084 lgtm This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-2909) Remove deprecated airflow.operators.sensors module

[ https://issues.apache.org/jira/browse/AIRFLOW-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589322#comment-16589322 ] Taylor Edmiston commented on AIRFLOW-2909: -- [~TaoFeng] done > Remove deprecated

[jira] [Resolved] (AIRFLOW-2909) Remove deprecated airflow.operators.sensors module

[ https://issues.apache.org/jira/browse/AIRFLOW-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taylor Edmiston resolved AIRFLOW-2909. -- Resolution: Resolved Fix Version/s: 2.0.0 > Remove deprecated

[GitHub] dimberman commented on issue #3782: [AIRFLOW-2936] Use official Python images as base image for Docker

dimberman commented on issue #3782: [AIRFLOW-2936] Use official Python images as base image for Docker URL: https://github.com/apache/incubator-airflow/pull/3782#issuecomment-415148385 @jpds this looks great. Could you build the k8s executor from py3 instead of py2?

[GitHub] andrewmchen commented on issue #2932: [AIRFLOW-1974] Improve Databricks Hook/Operator

andrewmchen commented on issue #2932: [AIRFLOW-1974] Improve Databricks Hook/Operator URL: https://github.com/apache/incubator-airflow/pull/2932#issuecomment-415127187 I'm in support of adding a `DatabricksRunNowOperator`. I don't think sharing logic through a base `DatabricksOperator`

[GitHub] odracci commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync

odracci commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#discussion_r212039145 ## File path: .travis.yml ## @@ -80,9 +82,13 @@ matrix: - python: "2.7"

[GitHub] codecov-io edited a comment on issue #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods

codecov-io edited a comment on issue #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods URL: https://github.com/apache/incubator-airflow/pull/3774#issuecomment-414376529 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3774?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods

codecov-io edited a comment on issue #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods URL: https://github.com/apache/incubator-airflow/pull/3774#issuecomment-414376529 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3774?src=pr=h1) Report > Merging

[GitHub] ashb commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync

ashb commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#discussion_r212028163 ## File path: .travis.yml ## @@ -80,9 +82,13 @@ matrix: - python: "2.7" env:

[GitHub] ashb commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync

ashb commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#discussion_r212023069 ## File path: .travis.yml ## @@ -80,9 +82,13 @@ matrix: - python: "2.7" env:

[jira] [Commented] (AIRFLOW-2909) Remove deprecated airflow.operators.sensors module

[ https://issues.apache.org/jira/browse/AIRFLOW-2909?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589096#comment-16589096 ] ASF GitHub Bot commented on AIRFLOW-2909: - feng-tao closed pull request #3760: [AIRFLOW-2909]

[GitHub] jpds commented on issue #3782: [AIRFLOW-2936] Use official Python images as base image for Docker

jpds commented on issue #3782: [AIRFLOW-2936] Use official Python images as base image for Docker URL: https://github.com/apache/incubator-airflow/pull/3782#issuecomment-415093822 Difference in sizes: ``` airflowlatest

[jira] [Commented] (AIRFLOW-2936) Docker images should use official Python images as base

[ https://issues.apache.org/jira/browse/AIRFLOW-2936?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589094#comment-16589094 ] ASF GitHub Bot commented on AIRFLOW-2936: - jpds opened a new pull request #3782: [AIRFLOW-2936]

[GitHub] feng-tao closed pull request #3760: [AIRFLOW-2909] Deprecate airflow.operators.sensors module

feng-tao closed pull request #3760: [AIRFLOW-2909] Deprecate airflow.operators.sensors module URL: https://github.com/apache/incubator-airflow/pull/3760 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] jpds opened a new pull request #3782: [AIRFLOW-2936] Use official Python images as base image for Docker

jpds opened a new pull request #3782: [AIRFLOW-2936] Use official Python images as base image for Docker URL: https://github.com/apache/incubator-airflow/pull/3782 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-2936) Docker images should use official Python images as base

Jon Davies created AIRFLOW-2936: --- Summary: Docker images should use official Python images as base Key: AIRFLOW-2936 URL: https://issues.apache.org/jira/browse/AIRFLOW-2936 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-2920) Kubernetes pod operator: namespace is a hard requirement

[ https://issues.apache.org/jira/browse/AIRFLOW-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589090#comment-16589090 ] ASF GitHub Bot commented on AIRFLOW-2920: - jpds opened a new pull request #3774: [AIRFLOW-2920]

[GitHub] jpds opened a new pull request #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods

jpds opened a new pull request #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods URL: https://github.com/apache/incubator-airflow/pull/3774 ### Jira - [X] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) issues and

[jira] [Commented] (AIRFLOW-2920) Kubernetes pod operator: namespace is a hard requirement

[ https://issues.apache.org/jira/browse/AIRFLOW-2920?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589080#comment-16589080 ] ASF GitHub Bot commented on AIRFLOW-2920: - jpds closed pull request #3774: [AIRFLOW-2920] Added

[GitHub] jpds closed pull request #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods

jpds closed pull request #3774: [AIRFLOW-2920] Added downward API metadata to Kubernetes pods URL: https://github.com/apache/incubator-airflow/pull/3774 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] xoen commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync

xoen commented on a change in pull request #3770: [AIRFLOW-XXX] Fix Kubernetes operator with git-sync URL: https://github.com/apache/incubator-airflow/pull/3770#discussion_r212016737 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -566,7 +566,6 @@

[GitHub] tedmiston commented on issue #3760: [AIRFLOW-2909] Deprecate airflow.operators.sensors module

tedmiston commented on issue #3760: [AIRFLOW-2909] Deprecate airflow.operators.sensors module URL: https://github.com/apache/incubator-airflow/pull/3760#issuecomment-415084809 I'm hoping straight to 2.0 as I've already had 1 PR merged that fully deprecates a "this will be deprecated

[jira] [Assigned] (AIRFLOW-774) dagbag_size/collect_dags/dagbag_import_errors stats incorrect

[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Taylor Edmiston reassigned AIRFLOW-774: --- Assignee: Taylor Edmiston > dagbag_size/collect_dags/dagbag_import_errors stats

[jira] [Commented] (AIRFLOW-774) dagbag_size/collect_dags/dagbag_import_errors stats incorrect

[ https://issues.apache.org/jira/browse/AIRFLOW-774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16589054#comment-16589054 ] Taylor Edmiston commented on AIRFLOW-774: - I've recently started investigating this one with one

[jira] [Commented] (AIRFLOW-971) Remove mysql as a dependency when not explicitly required

[ https://issues.apache.org/jira/browse/AIRFLOW-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588994#comment-16588994 ] Ash Berlin-Taylor commented on AIRFLOW-971: --- S3 might be included in the "minimum dev

[jira] [Commented] (AIRFLOW-971) Remove mysql as a dependency when not explicitly required

[ https://issues.apache.org/jira/browse/AIRFLOW-971?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588960#comment-16588960 ] jack commented on AIRFLOW-971: -- not sure why {{setup.py}}{color:#00} :{color}{{devel_minreq = devel +

[GitHub] dimberman commented on issue #3393: [AIRFLOW-2499] Dockerised CI pipeline

dimberman commented on issue #3393: [AIRFLOW-2499] Dockerised CI pipeline URL: https://github.com/apache/incubator-airflow/pull/3393#issuecomment-415050279 On Wed, Aug 22, 2018, 1:27 AM Fokko Driesprong wrote: > Merged #3393

[GitHub] sethwilsonwishabi commented on issue #3777: Add Flipp to list of Airflow users

sethwilsonwishabi commented on issue #3777: Add Flipp to list of Airflow users URL: https://github.com/apache/incubator-airflow/pull/3777#issuecomment-415048859 Entry format corrected This is an automated message from the

[jira] [Commented] (AIRFLOW-2929) Add get and set for pool class in models.py

[ https://issues.apache.org/jira/browse/AIRFLOW-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=1652#comment-1652 ] Chengzhi Zhao commented on AIRFLOW-2929: Update: After exploring API, I noticed we already

[jira] [Updated] (AIRFLOW-2929) Add get and set for pool class in models.py

[ https://issues.apache.org/jira/browse/AIRFLOW-2929?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Chengzhi Zhao updated AIRFLOW-2929: --- Affects Version/s: (was: 1.9.0) > Add get and set for pool class in models.py >

[jira] [Updated] (AIRFLOW-2898) Task not entering queued state for pool

[ https://issues.apache.org/jira/browse/AIRFLOW-2898?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] rana updated AIRFLOW-2898: -- Description: I have a pool of 3 and have several jobs (over 10) which use the pool. Tasks timeout (after 10

[GitHub] Fokko commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build

Fokko commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build URL: https://github.com/apache/incubator-airflow/pull/3780#issuecomment-415029501 Hmm, I'm not exaclty sure what triggers the notification This

[jira] [Resolved] (AIRFLOW-2931) Make Quick Start work when user doesn't have `cryptography` installed

[ https://issues.apache.org/jira/browse/AIRFLOW-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-2931. Resolution: Fixed Fix Version/s: 1.10.0 This has been fixed in 1.10.0 and

[jira] [Updated] (AIRFLOW-2934) Pools not respected for internal subdag tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Vianna updated AIRFLOW-2934: --- Labels: pool subdag (was: pool) > Pools not respected for internal subdag tasks >

[jira] [Updated] (AIRFLOW-2934) Pools not respected for internal subdag tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Vianna updated AIRFLOW-2934: --- Labels: pool (was: ) > Pools not respected for internal subdag tasks >

[GitHub] Fokko closed pull request #3781: [AIRFLOW-XXX] doc typo: airflow_tas_runner -> airflow_task_runner

Fokko closed pull request #3781: [AIRFLOW-XXX] doc typo: airflow_tas_runner -> airflow_task_runner URL: https://github.com/apache/incubator-airflow/pull/3781 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-2935) CLONE - Tasks never run in externally triggered DAGRun

[ https://issues.apache.org/jira/browse/AIRFLOW-2935?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588690#comment-16588690 ] Loveleen Kaur commented on AIRFLOW-2935: Hi, I have similar issue as mentioned

[jira] [Created] (AIRFLOW-2935) CLONE - Tasks never run in externally triggered DAGRun

Loveleen Kaur created AIRFLOW-2935: -- Summary: CLONE - Tasks never run in externally triggered DAGRun Key: AIRFLOW-2935 URL: https://issues.apache.org/jira/browse/AIRFLOW-2935 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-2934) Pools not respected for internal subdag tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Vianna updated AIRFLOW-2934: --- Attachment: Screenshot from 2018-08-22 12-32-32.png > Pools not respected for internal

[jira] [Updated] (AIRFLOW-2934) Pools not respected for internal subdag tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Vianna updated AIRFLOW-2934: --- Environment: Linux victorvianna 4.14.65-1-MANJARO #1 SMP PREEMPT Sat Aug 18 13:29:56 UTC

[jira] [Updated] (AIRFLOW-2934) Pools not respected for internal subdag tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Victor Vianna updated AIRFLOW-2934: --- Description: I'm trying to have some subdags execute one task at a time. The way I found

[GitHub] Fokko commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build

Fokko commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build URL: https://github.com/apache/incubator-airflow/pull/3780#issuecomment-414985127 Lets add `coveralls` as well :) This is an automated message

[jira] [Commented] (AIRFLOW-2934) Pools not respected for internal subdag tasks

[ https://issues.apache.org/jira/browse/AIRFLOW-2934?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588664#comment-16588664 ] Victor Vianna commented on AIRFLOW-2934: I added a DummyOperator at the beggining of each

[GitHub] ashb commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build

ashb commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build URL: https://github.com/apache/incubator-airflow/pull/3780#issuecomment-414982985 Definitely looks like it! This is an automated message from

[jira] [Created] (AIRFLOW-2934) Pools not respected for internal subdag tasks

Victor Vianna created AIRFLOW-2934: -- Summary: Pools not respected for internal subdag tasks Key: AIRFLOW-2934 URL: https://issues.apache.org/jira/browse/AIRFLOW-2934 Project: Apache Airflow

[GitHub] XD-DENG commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor()

XD-DENG commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor() URL: https://github.com/apache/incubator-airflow/pull/3773#issuecomment-414979888 Thanks both @yrqls21 @ashb This is

[GitHub] ashb commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor()

ashb commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor() URL: https://github.com/apache/incubator-airflow/pull/3773#issuecomment-414979183 K. Just getting a sense of urgency. We might have a 1.10.1 anyway, and if we do I'll pull this in to

[GitHub] yrqls21 commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor()

yrqls21 commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor() URL: https://github.com/apache/incubator-airflow/pull/3773#issuecomment-414978936 @ashb I don't think they are so severe that we need to call celery executor broken. The 1st bug

[GitHub] XD-DENG commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor()

XD-DENG commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor() URL: https://github.com/apache/incubator-airflow/pull/3773#issuecomment-414978702 Hi @ashb , to my understanding: - bug 1 will not result in any explicit error. It was just missing

[GitHub] haavardw opened a new pull request #3781: [AIRFLOW-XXX] doc typo: airflow_tas_runner -> airflow_task_runner

haavardw opened a new pull request #3781: [AIRFLOW-XXX] doc typo: airflow_tas_runner -> airflow_task_runner URL: https://github.com/apache/incubator-airflow/pull/3781 This is an automated message from the Apache Git

[GitHub] ashb commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor()

ashb commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor() URL: https://github.com/apache/incubator-airflow/pull/3773#issuecomment-414977326 Does this mean that CeleryExecutor is totally broken in 1.10.0, and we need to get a 1.10.1 out

[GitHub] mishikaSingh commented on issue #3650: [AIRFLOW-2703] exceptions from scheduler's heartbeat is handled so that scheduler does not crash

mishikaSingh commented on issue #3650: [AIRFLOW-2703] exceptions from scheduler's heartbeat is handled so that scheduler does not crash URL: https://github.com/apache/incubator-airflow/pull/3650#issuecomment-414975351 @ashb please review the change.

[GitHub] XD-DENG commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor()

XD-DENG commented on issue #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor() URL: https://github.com/apache/incubator-airflow/pull/3773#issuecomment-414969013 Thanks @Fokko This is an automated

[jira] [Commented] (AIRFLOW-2921) A trivial incorrectness in CeleryExecutor()

[ https://issues.apache.org/jira/browse/AIRFLOW-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588593#comment-16588593 ] ASF GitHub Bot commented on AIRFLOW-2921: - Fokko closed pull request #3773:

[jira] [Resolved] (AIRFLOW-2922) Potential deal-lock bug in CeleryExecutor()

[ https://issues.apache.org/jira/browse/AIRFLOW-2922?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2922. --- Resolution: Fixed Fix Version/s: 2.0.0 > Potential deal-lock bug in

[jira] [Resolved] (AIRFLOW-2921) A trivial incorrectness in CeleryExecutor()

[ https://issues.apache.org/jira/browse/AIRFLOW-2921?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2921. --- Resolution: Fixed Fix Version/s: 2.0.0 > A trivial incorrectness in

[GitHub] Fokko closed pull request #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor()

Fokko closed pull request #3773: [AIRFLOW-2921][AIRFLOW-2922] Fix two potential bugs in CeleryExecutor() URL: https://github.com/apache/incubator-airflow/pull/3773 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake

[GitHub] Fokko commented on issue #3760: [AIRFLOW-2909] Deprecate airflow.operators.sensors module

Fokko commented on issue #3760: [AIRFLOW-2909] Deprecate airflow.operators.sensors module URL: https://github.com/apache/incubator-airflow/pull/3760#issuecomment-414964518 @tedmiston @feng-tao Oops, yes, this is some old build stuff dangling around in my airflow folder. Are we going to

[jira] [Commented] (AIRFLOW-74) SubdagOperators can consume all celeryd worker processes

[ https://issues.apache.org/jira/browse/AIRFLOW-74?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588585#comment-16588585 ] Eran commented on AIRFLOW-74: - # What are the consequences of this when there is a subdag running and the

[GitHub] Fokko commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build

Fokko commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build URL: https://github.com/apache/incubator-airflow/pull/3780#issuecomment-414962306 @ashb I was also confused by this, but the comment is by Codecov, right? An example:

[jira] [Resolved] (AIRFLOW-2856) Update Docker Env Setup Docs to Account for verify_gpl_dependency()

[ https://issues.apache.org/jira/browse/AIRFLOW-2856?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2856. - Resolution: Fixed Fix Version/s: 2.0.0 > Update Docker Env Setup Docs to Account for

[jira] [Resolved] (AIRFLOW-2499) Dockerised CI pipeline

[ https://issues.apache.org/jira/browse/AIRFLOW-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2499. --- Resolution: Fixed > Dockerised CI pipeline > -- > >

[GitHub] ashb commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build

ashb commented on issue #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build URL: https://github.com/apache/incubator-airflow/pull/3780#issuecomment-414956588 Does this mean no more coverals-io comments in github? This is

[jira] [Commented] (AIRFLOW-2933) Enable Codecov on Docker CI

[ https://issues.apache.org/jira/browse/AIRFLOW-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588552#comment-16588552 ] ASF GitHub Bot commented on AIRFLOW-2933: - Fokko opened a new pull request #3780:

[GitHub] Fokko opened a new pull request #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build

Fokko opened a new pull request #3780: [AIRFLOW-2933] Enable Codecov on Docker-CI Build URL: https://github.com/apache/incubator-airflow/pull/3780 Add missing variables and use codecov instead of coveralls. The issue why it wasn't working was because missing environment variables. The

[jira] [Commented] (AIRFLOW-2931) Make Quick Start work when user doesn't have `cryptography` installed

[ https://issues.apache.org/jira/browse/AIRFLOW-2931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588551#comment-16588551 ] jack commented on AIRFLOW-2931: --- The instructions are written in the configuration guide:

[jira] [Created] (AIRFLOW-2933) Enable Codecov on Docker CI

Fokko Driesprong created AIRFLOW-2933: - Summary: Enable Codecov on Docker CI Key: AIRFLOW-2933 URL: https://issues.apache.org/jira/browse/AIRFLOW-2933 Project: Apache Airflow Issue Type:

[jira] [Updated] (AIRFLOW-2933) Enable Codecov on Docker CI

[ https://issues.apache.org/jira/browse/AIRFLOW-2933?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong updated AIRFLOW-2933: -- Description: Right now the Codecov plugin is not working on the docker-ci that we're

[jira] [Commented] (AIRFLOW-2499) Dockerised CI pipeline

[ https://issues.apache.org/jira/browse/AIRFLOW-2499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16588544#comment-16588544 ] ASF GitHub Bot commented on AIRFLOW-2499: - Fokko closed pull request #3393: [AIRFLOW-2499]

[GitHub] Fokko commented on issue #3393: [AIRFLOW-2499] Dockerised CI pipeline

Fokko commented on issue #3393: [AIRFLOW-2499] Dockerised CI pipeline URL: https://github.com/apache/incubator-airflow/pull/3393#issuecomment-414953905 LGTM, Thanks @gerardo This is an automated message from the Apache Git

[jira] [Assigned] (AIRFLOW-602) Unit Test Cases Doesn't run in Master Branch

[ https://issues.apache.org/jira/browse/AIRFLOW-602?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerardo Curiel reassigned AIRFLOW-602: -- Assignee: Gerardo Curiel I'm hoping to address this in 

[jira] [Assigned] (AIRFLOW-1042) Easy Unit Testing with Docker

[ https://issues.apache.org/jira/browse/AIRFLOW-1042?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerardo Curiel reassigned AIRFLOW-1042: --- Assignee: Gerardo Curiel (was: Joe Schmid) Being addressed in

[jira] [Assigned] (AIRFLOW-404) Travis cache can get borked make sure to retry downloading if unpacking fails

[ https://issues.apache.org/jira/browse/AIRFLOW-404?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerardo Curiel reassigned AIRFLOW-404: -- Assignee: Gerardo Curiel This might not be the case anymore, given we extracted most

[jira] [Assigned] (AIRFLOW-87) Setup a development environment

[ https://issues.apache.org/jira/browse/AIRFLOW-87?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerardo Curiel reassigned AIRFLOW-87: - Assignee: Gerardo Curiel Parts of it are initially address in 

[jira] [Assigned] (AIRFLOW-2157) Builds in TravisCI are so unstable now

[ https://issues.apache.org/jira/browse/AIRFLOW-2157?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Gerardo Curiel reassigned AIRFLOW-2157: --- Assignee: Gerardo Curiel This is being addressed in 

[GitHub] bolkedebruin commented on issue #3754: [Airflow-1737] Handle `execution_date`s with fractional seconds in www/views

bolkedebruin commented on issue #3754: [Airflow-1737] Handle `execution_date`s with fractional seconds in www/views URL: https://github.com/apache/incubator-airflow/pull/3754#issuecomment-414936698 @feng-tao officially we can. We support N-1 but we haven't really been doing it until now

[jira] [Created] (AIRFLOW-2932) GoogleCloudStorageHook - allow compression of file

jack created AIRFLOW-2932: - Summary: GoogleCloudStorageHook - allow compression of file Key: AIRFLOW-2932 URL: https://issues.apache.org/jira/browse/AIRFLOW-2932 Project: Apache Airflow Issue Type: