[GitHub] dlamblin commented on a change in pull request #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop

dlamblin commented on a change in pull request #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop URL: https://github.com/apache/incubator-airflow/pull/3873#discussion_r219384327 ## File path: airflow/utils/dag_processing.py ## @@ -308,6 +369,249 @@ def

[GitHub] feng-tao commented on issue #3903: [AIRFLOW-3067] Display www_rbac Flask flash msg properly

feng-tao commented on issue #3903: [AIRFLOW-3067] Display www_rbac Flask flash msg properly URL: https://github.com/apache/incubator-airflow/pull/3903#issuecomment-423414186 Overall LGTM. Thanks @XD-DENG . Could you attach the latest UI with your pr? If the UI figure looks good, we are

[GitHub] dlamblin commented on a change in pull request #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop

dlamblin commented on a change in pull request #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop URL: https://github.com/apache/incubator-airflow/pull/3873#discussion_r219384327 ## File path: airflow/utils/dag_processing.py ## @@ -308,6 +369,249 @@ def

[jira] [Commented] (AIRFLOW-2747) Explicit re-schedule of sensors

[ https://issues.apache.org/jira/browse/AIRFLOW-2747?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16623071#comment-16623071 ] ASF GitHub Bot commented on AIRFLOW-2747: - feng-tao closed pull request #3596: [AIRFLOW-2747]

[GitHub] feng-tao closed pull request #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

feng-tao closed pull request #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] feng-tao commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

feng-tao commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-423413759 Thanks @seelmann . LGTM. This is an automated message from

[GitHub] codecov-io edited a comment on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

codecov-io edited a comment on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-422536512 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3596?src=pr=h1) Report > Merging

[GitHub] ubermen commented on issue #3885: [AIRFLOW-3001] Add index 'ti_dag_date' to taskinstance

ubermen commented on issue #3885: [AIRFLOW-3001] Add index 'ti_dag_date' to taskinstance URL: https://github.com/apache/incubator-airflow/pull/3885#issuecomment-423393327 I've resolved some CI issues. Please confirm or correct any problems. Thanks :)

[GitHub] yrqls21 commented on a change in pull request #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop

yrqls21 commented on a change in pull request #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop URL: https://github.com/apache/incubator-airflow/pull/3873#discussion_r219360728 ## File path: airflow/utils/dag_processing.py ## @@ -22,17 +22,39 @@ from

[jira] [Commented] (AIRFLOW-2548) Output Plugin Import Errors to WebUI

[ https://issues.apache.org/jira/browse/AIRFLOW-2548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622898#comment-16622898 ] ASF GitHub Bot commented on AIRFLOW-2548: - jcao219 opened a new pull request #3930:

[GitHub] jcao219 opened a new pull request #3930: [AIRFLOW-2548] Output plugin import errors to web UI

jcao219 opened a new pull request #3930: [AIRFLOW-2548] Output plugin import errors to web UI URL: https://github.com/apache/incubator-airflow/pull/3930 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] feng-tao commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

feng-tao commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-423371851 Will take a look tonight. This is an automated message from

[GitHub] gwax commented on issue #3772: [AIRFLOW-2918] Fix Flake8 violations

gwax commented on issue #3772: [AIRFLOW-2918] Fix Flake8 violations URL: https://github.com/apache/incubator-airflow/pull/3772#issuecomment-423363715  for black and strong support for using `pre-commit` as well This is an

[GitHub] codecov-io edited a comment on issue #3922: AIRFLOW-2952 Fix Kubernetes CI

codecov-io edited a comment on issue #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#issuecomment-422988611 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3922?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3922: AIRFLOW-2952 Fix Kubernetes CI

codecov-io edited a comment on issue #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#issuecomment-422988611 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3922?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-3098) Dag run succeeds (all related tasks green) yet airflow marks it as failed

[ https://issues.apache.org/jira/browse/AIRFLOW-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yassine updated AIRFLOW-3098: - Summary: Dag run succeeds (all related tasks green) yet airflow marks it as failed (was: Dag run

[jira] [Updated] (AIRFLOW-3098) Dag run succeeds (all related tasks green) yet airflow marks as failed

[ https://issues.apache.org/jira/browse/AIRFLOW-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yassine updated AIRFLOW-3098: - Description: The setup is a standard airflow install backed by sqlite db running a sequential

[jira] [Updated] (AIRFLOW-3098) Dag run succeeds (all related tasks green) yet airflow marks as failed

[ https://issues.apache.org/jira/browse/AIRFLOW-3098?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Yassine updated AIRFLOW-3098: - Description: The setup is a standard airflow install backed by sqlite db running a sequential

[jira] [Created] (AIRFLOW-3098) Dag run succeeds (all related tasks green) yet airflow marks as failed

Yassine created AIRFLOW-3098: Summary: Dag run succeeds (all related tasks green) yet airflow marks as failed Key: AIRFLOW-3098 URL: https://issues.apache.org/jira/browse/AIRFLOW-3098 Project: Apache

[GitHub] odracci commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI

odracci commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#discussion_r219308984 ## File path: tests/contrib/minikube/test_kubernetes_executor.py ## @@ -25,18 +26,25 @@ import re try:

[GitHub] Fokko commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI

Fokko commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#discussion_r219303693 ## File path: tests/contrib/minikube/test_kubernetes_executor.py ## @@ -25,18 +26,25 @@ import re try: -

[jira] [Commented] (AIRFLOW-1410) BigQuery Operator flattens the repeated column and it's not configurable

[ https://issues.apache.org/jira/browse/AIRFLOW-1410?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622614#comment-16622614 ] Iuliia Volkova commented on AIRFLOW-1410: -

[jira] [Commented] (AIRFLOW-2407) Undefined names in Python code

[ https://issues.apache.org/jira/browse/AIRFLOW-2407?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622610#comment-16622610 ] ASF GitHub Bot commented on AIRFLOW-2407: - Fokko closed pull request #3298: [AIRFLOW-2407] Use

[GitHub] Fokko closed pull request #3298: [AIRFLOW-2407] Use feature detection for reload()

Fokko closed pull request #3298: [AIRFLOW-2407] Use feature detection for reload() URL: https://github.com/apache/incubator-airflow/pull/3298 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[jira] [Closed] (AIRFLOW-3090) INFO logs are too verbose

[ https://issues.apache.org/jira/browse/AIRFLOW-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong closed AIRFLOW-3090. - Resolution: Fixed Fix Version/s: 1.10.1 > INFO logs are too verbose >

[jira] [Commented] (AIRFLOW-3090) INFO logs are too verbose

[ https://issues.apache.org/jira/browse/AIRFLOW-3090?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622589#comment-16622589 ] ASF GitHub Bot commented on AIRFLOW-3090: - Fokko closed pull request #3920: [AIRFLOW-3090]

[GitHub] Fokko closed pull request #3920: [AIRFLOW-3090] Demote dag start/stop log messages to debug

Fokko closed pull request #3920: [AIRFLOW-3090] Demote dag start/stop log messages to debug URL: https://github.com/apache/incubator-airflow/pull/3920 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] xnuinside commented on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook

xnuinside commented on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook URL: https://github.com/apache/incubator-airflow/pull/3894#issuecomment-423303142 @kaxil, wanna to add methods to hook - get_dataset and get_datasets_list, please, review

[GitHub] yrqls21 commented on issue #3920: [AIRFLOW-3090] Demote dag start/stop log messages to debug

yrqls21 commented on issue #3920: [AIRFLOW-3090] Demote dag start/stop log messages to debug URL: https://github.com/apache/incubator-airflow/pull/3920#issuecomment-423296311 I'm +1 for this change This is an automated

[jira] [Resolved] (AIRFLOW-3072) Only admin can view logs in RBAC UI

[ https://issues.apache.org/jira/browse/AIRFLOW-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joy Gao resolved AIRFLOW-3072. -- Resolution: Fixed Fix Version/s: 1.10.1 > Only admin can view logs in RBAC UI >

[jira] [Commented] (AIRFLOW-3072) Only admin can view logs in RBAC UI

[ https://issues.apache.org/jira/browse/AIRFLOW-3072?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622515#comment-16622515 ] ASF GitHub Bot commented on AIRFLOW-3072: - jgao54 closed pull request #3913: [AIRFLOW-3072]

[GitHub] jgao54 closed pull request #3913: [AIRFLOW-3072] Assign permission get_logs_with_metadata to viewer role

jgao54 closed pull request #3913: [AIRFLOW-3072] Assign permission get_logs_with_metadata to viewer role URL: https://github.com/apache/incubator-airflow/pull/3913 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake

[GitHub] codecov-io commented on issue #3894: WIP: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook

codecov-io commented on issue #3894: WIP: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook URL: https://github.com/apache/incubator-airflow/pull/3894#issuecomment-423291432 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3894?src=pr=h1) Report >

[GitHub] dimberman commented on issue #3922: AIRFLOW-2952 Fix Kubernetes CI

dimberman commented on issue #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#issuecomment-423289297 cc: @ashb @kaxil any help on merging this would be awesome since it's blocking all other k8s work :).

[jira] [Commented] (AIRFLOW-3096) Reduce DaysUntilStale in .github/stale.yml

[ https://issues.apache.org/jira/browse/AIRFLOW-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622376#comment-16622376 ] ASF GitHub Bot commented on AIRFLOW-3096: - r39132 closed pull request #3929: [AIRFLOW-3096]

[jira] [Commented] (AIRFLOW-3096) Reduce DaysUntilStale in .github/stale.yml

[ https://issues.apache.org/jira/browse/AIRFLOW-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622375#comment-16622375 ] ASF GitHub Bot commented on AIRFLOW-3096: - r39132 opened a new pull request #3929:

[GitHub] r39132 closed pull request #3929: [AIRFLOW-3096] Further reduce DaysUntilStale for probo/stale

r39132 closed pull request #3929: [AIRFLOW-3096] Further reduce DaysUntilStale for probo/stale URL: https://github.com/apache/incubator-airflow/pull/3929 This is an automated message from the Apache Git Service. To respond

[GitHub] r39132 opened a new pull request #3929: [AIRFLOW-3096] Further reduce DaysUntilStale for probo/stale

r39132 opened a new pull request #3929: [AIRFLOW-3096] Further reduce DaysUntilStale for probo/stale URL: https://github.com/apache/incubator-airflow/pull/3929 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-3097) Capability for nested SubDags

[ https://issues.apache.org/jira/browse/AIRFLOW-3097?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] John Longo updated AIRFLOW-3097: Description: Unless I'm doing something incorrectly, it appears that you cannot nest SubDags

[jira] [Created] (AIRFLOW-3097) Capability for nested SubDags

John Longo created AIRFLOW-3097: --- Summary: Capability for nested SubDags Key: AIRFLOW-3097 URL: https://issues.apache.org/jira/browse/AIRFLOW-3097 Project: Apache Airflow Issue Type: New

[jira] [Commented] (AIRFLOW-3078) Basic operators for Google Compute Engine

[ https://issues.apache.org/jira/browse/AIRFLOW-3078?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622320#comment-16622320 ] Feng Lu commented on AIRFLOW-3078: -- Thank you both for closing the loop here, appreciate your help

[GitHub] codecov-io commented on issue #3926: [AIRFLOW-XXX] add 90 Seconds to list of companies

codecov-io commented on issue #3926: [AIRFLOW-XXX] add 90 Seconds to list of companies URL: https://github.com/apache/incubator-airflow/pull/3926#issuecomment-423246639 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3926?src=pr=h1) Report > Merging

[GitHub] dimberman commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI

dimberman commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#discussion_r219228533 ## File path: scripts/ci/kubernetes/kube/configmaps.yaml ## @@ -27,7 +27,7 @@ data: logging_level =

[jira] [Commented] (AIRFLOW-3095) Password Auth fails to forbid access when it should

[ https://issues.apache.org/jira/browse/AIRFLOW-3095?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622261#comment-16622261 ] Ash Berlin-Taylor commented on AIRFLOW-3095: Your suspicion sounds correct - your new

[jira] [Resolved] (AIRFLOW-3096) Reduce DaysUntilStale in .github/stale.yml

[ https://issues.apache.org/jira/browse/AIRFLOW-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand resolved AIRFLOW-3096. -- Resolution: Fixed > Reduce DaysUntilStale in .github/stale.yml >

[jira] [Commented] (AIRFLOW-3096) Reduce DaysUntilStale in .github/stale.yml

[ https://issues.apache.org/jira/browse/AIRFLOW-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622250#comment-16622250 ] ASF GitHub Bot commented on AIRFLOW-3096: - r39132 closed pull request #3928: [AIRFLOW-3096]

[GitHub] r39132 closed pull request #3928: [AIRFLOW-3096] Reduce DaysUntilStale for probot/stale

r39132 closed pull request #3928: [AIRFLOW-3096] Reduce DaysUntilStale for probot/stale URL: https://github.com/apache/incubator-airflow/pull/3928 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-3096) Reduce DaysUntilStale in .github/stale.yml

[ https://issues.apache.org/jira/browse/AIRFLOW-3096?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622248#comment-16622248 ] ASF GitHub Bot commented on AIRFLOW-3096: - r39132 opened a new pull request #3928:

[GitHub] r39132 opened a new pull request #3928: [AIRFLOW-3096] Reduce DaysUntilStale for probot/stale

r39132 opened a new pull request #3928: [AIRFLOW-3096] Reduce DaysUntilStale for probot/stale URL: https://github.com/apache/incubator-airflow/pull/3928 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] r39132 closed pull request #3927: [AIRFLOW-XXX] Add 90 Seconds to companies

r39132 closed pull request #3927: [AIRFLOW-XXX] Add 90 Seconds to companies URL: https://github.com/apache/incubator-airflow/pull/3927 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As this is a

[GitHub] r39132 edited a comment on issue #3927: [AIRFLOW-XXX] Add 90 Seconds to companies

r39132 edited a comment on issue #3927: [AIRFLOW-XXX] Add 90 Seconds to companies URL: https://github.com/apache/incubator-airflow/pull/3927#issuecomment-423232676 +1 Welcome to the Apache Airflow community @aaronmak ! This

[GitHub] r39132 commented on issue #3927: [AIRFLOW-XXX] Add 90 Seconds to companies

r39132 commented on issue #3927: [AIRFLOW-XXX] Add 90 Seconds to companies URL: https://github.com/apache/incubator-airflow/pull/3927#issuecomment-423232676 +1 Welcome to the Apache Airflow community! This is an automated

[GitHub] smith-m edited a comment on issue #3908: [AIRFLOW-3036] Add relevant ECS options to ECS operator.

smith-m edited a comment on issue #3908: [AIRFLOW-3036] Add relevant ECS options to ECS operator. URL: https://github.com/apache/incubator-airflow/pull/3908#issuecomment-423231025 @jmcarp JIRA marked this issue (Also Airflow-3036? GCP CloudSQL/mysql configuration issues with 1.10)

[GitHub] smith-m edited a comment on issue #3908: [AIRFLOW-3036] Add relevant ECS options to ECS operator.

smith-m edited a comment on issue #3908: [AIRFLOW-3036] Add relevant ECS options to ECS operator. URL: https://github.com/apache/incubator-airflow/pull/3908#issuecomment-423231025 @jmcarp JIRA marked this issue (Also Airflow-3036? GCP CloudSQL/mysql configuration issues with 1.10)

[jira] [Created] (AIRFLOW-3096) Reduce DaysUntilStale in .github/stale.yml

Siddharth Anand created AIRFLOW-3096: Summary: Reduce DaysUntilStale in .github/stale.yml Key: AIRFLOW-3096 URL: https://issues.apache.org/jira/browse/AIRFLOW-3096 Project: Apache Airflow

[GitHub] smith-m commented on issue #3908: [AIRFLOW-3036] Add relevant ECS options to ECS operator.

smith-m commented on issue #3908: [AIRFLOW-3036] Add relevant ECS options to ECS operator. URL: https://github.com/apache/incubator-airflow/pull/3908#issuecomment-423231025 @jmcarp JIRA marked this issue (Also Airflow-3036? GCP CloudSQL/mysql configuration issues with 1.10) as

[GitHub] aaronmak opened a new pull request #3927: [AIRFLOW-XXX] Add 90 Seconds to companies

aaronmak opened a new pull request #3927: [AIRFLOW-XXX] Add 90 Seconds to companies URL: https://github.com/apache/incubator-airflow/pull/3927 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-3095) Password Auth fails to forbid access when it should

Victor created AIRFLOW-3095: --- Summary: Password Auth fails to forbid access when it should Key: AIRFLOW-3095 URL: https://issues.apache.org/jira/browse/AIRFLOW-3095 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622200#comment-16622200 ] jack commented on AIRFLOW-2902: --- [~cfei] well I havn't found solution yet. I have many tasks to convert

[GitHub] aaronmak closed pull request #3926: [AIRFLOW-XXX] add 90 Seconds to list of companies

aaronmak closed pull request #3926: [AIRFLOW-XXX] add 90 Seconds to list of companies URL: https://github.com/apache/incubator-airflow/pull/3926 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] aaronmak opened a new pull request #3926: [AIRFLOW-XXX] add 90 Seconds to list of companies

aaronmak opened a new pull request #3926: [AIRFLOW-XXX] add 90 Seconds to list of companies URL: https://github.com/apache/incubator-airflow/pull/3926 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622162#comment-16622162 ] Christopher Fei commented on AIRFLOW-2902: -- You make a good point—obviously if BigQuery's Jobs

[jira] [Commented] (AIRFLOW-1063) A manually-created DAG run can prevent a scheduled run to be created

[ https://issues.apache.org/jira/browse/AIRFLOW-1063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622127#comment-16622127 ] Morten Post commented on AIRFLOW-1063: -- I am seeing this issue as well. What backend are you

[GitHub] codecov-io edited a comment on issue #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator

codecov-io edited a comment on issue #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator URL: https://github.com/apache/incubator-airflow/pull/3741#issuecomment-412492251 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3741?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3138: [AIRFLOW-2221] Create DagFetcher abstraction

codecov-io edited a comment on issue #3138: [AIRFLOW-2221] Create DagFetcher abstraction URL: https://github.com/apache/incubator-airflow/pull/3138#issuecomment-373965660 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3138?src=pr=h1) Report > Merging

[GitHub] ron819 commented on issue #2776: [AIRFLOW-1793] fix DockerOperator using docker_conn_id

ron819 commented on issue #2776: [AIRFLOW-1793] fix DockerOperator using docker_conn_id URL: https://github.com/apache/incubator-airflow/pull/2776#issuecomment-423196176 @m1racoli There are conflicts to resolve This is an

[jira] [Updated] (AIRFLOW-3055) add get_dataset and get_datasets_list to bigquery_hook

[ https://issues.apache.org/jira/browse/AIRFLOW-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova updated AIRFLOW-3055: Summary: add get_dataset and get_datasets_list to bigquery_hook (was: Add

[GitHub] ron819 commented on issue #2113: [AIRFLOW-920] Allow marking tasks in zoomed in subdags

ron819 commented on issue #2113: [AIRFLOW-920] Allow marking tasks in zoomed in subdags URL: https://github.com/apache/incubator-airflow/pull/2113#issuecomment-423192710 @bolkedebruin are you still working on this? This is

[jira] [Commented] (AIRFLOW-428) Scheduler restart (via SIGKILL) leaves orphaned celery and airflow run processes

[ https://issues.apache.org/jira/browse/AIRFLOW-428?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622057#comment-16622057 ] Nick Bauer commented on AIRFLOW-428: The PR

[jira] [Commented] (AIRFLOW-3094) XCOM - show actual value - not pickled one

[ https://issues.apache.org/jira/browse/AIRFLOW-3094?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16622030#comment-16622030 ] Ash Berlin-Taylor commented on AIRFLOW-3094: Note for anyone picking up this, there's a

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621961#comment-16621961 ] jack commented on AIRFLOW-2902: --- [~cfei] The problem is that you pay double for storage. It involves a

[jira] [Created] (AIRFLOW-3094) XCOM - show actual value - not pickled one

jack created AIRFLOW-3094: - Summary: XCOM - show actual value - not pickled one Key: AIRFLOW-3094 URL: https://issues.apache.org/jira/browse/AIRFLOW-3094 Project: Apache Airflow Issue Type: Bug

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621941#comment-16621941 ] Christopher Fei commented on AIRFLOW-2902: -- I do S3 to BigQuery in production and would be

[jira] [Commented] (AIRFLOW-1595) SqliteHook is broken

[ https://issues.apache.org/jira/browse/AIRFLOW-1595?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621800#comment-16621800 ] Ash Berlin-Taylor commented on AIRFLOW-1595: (x-post from Githb) To resurrect an old PR:

[jira] [Commented] (AIRFLOW-26) GCP hook naming alignment

[ https://issues.apache.org/jira/browse/AIRFLOW-26?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621799#comment-16621799 ] Jarek Potiuk commented on AIRFLOW-26: - Fine with 2.0. For breakup into sub-repositories. I am happy

[GitHub] ashb commented on issue #2598: [AIRFLOW-1595] Change to construct sqlite_hook from connection schema

ashb commented on issue #2598: [AIRFLOW-1595] Change to construct sqlite_hook from connection schema URL: https://github.com/apache/incubator-airflow/pull/2598#issuecomment-423131504 To resurrect an old PR: This PR might make sense, but as it is it would break any existing connections

[GitHub] xnuinside commented on issue #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

xnuinside commented on issue #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#issuecomment-423126280 @kaxil , fixed, sorry for taking a long time

[jira] [Commented] (AIRFLOW-26) GCP hook naming alignment

[ https://issues.apache.org/jira/browse/AIRFLOW-26?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16621761#comment-16621761 ] Ash Berlin-Taylor commented on AIRFLOW-26: -- Yes, this will likely be 2.0 so we can break

[GitHub] ashb commented on issue #3925: [AIRFLOW-3091]Deactivate inactive DAGs after collecting DagBag

ashb commented on issue #3925: [AIRFLOW-3091]Deactivate inactive DAGs after collecting DagBag URL: https://github.com/apache/incubator-airflow/pull/3925#issuecomment-423104714 What testing of this have you performed? I'm not sure the fix is this simple - due to all the processes,

[GitHub] odracci commented on issue #3922: AIRFLOW-2952 Fix Kubernetes CI

odracci commented on issue #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#issuecomment-423095904 @dimberman correct, the key is to set `network_mode: host` in the docker-compose file.

[jira] [Updated] (AIRFLOW-3093) Airflow UnicodeEncodeError with logging (file_task_handler.py)

[ https://issues.apache.org/jira/browse/AIRFLOW-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Minh Quan TRAN updated AIRFLOW-3093: Labels: encoding (was: ) > Airflow UnicodeEncodeError with logging

[jira] [Updated] (AIRFLOW-3093) Airflow UnicodeEncodeError with logging (file_task_handler.py)

[ https://issues.apache.org/jira/browse/AIRFLOW-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Minh Quan TRAN updated AIRFLOW-3093: Affects Version/s: 1.10.0 > Airflow UnicodeEncodeError with logging

[jira] [Created] (AIRFLOW-3093) Airflow UnicodeEncodeError with logging (file_task_handler.py)

Minh Quan TRAN created AIRFLOW-3093: --- Summary: Airflow UnicodeEncodeError with logging (file_task_handler.py) Key: AIRFLOW-3093 URL: https://issues.apache.org/jira/browse/AIRFLOW-3093 Project:

[jira] [Updated] (AIRFLOW-3093) Airflow UnicodeEncodeError with logging (file_task_handler.py)

[ https://issues.apache.org/jira/browse/AIRFLOW-3093?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Minh Quan TRAN updated AIRFLOW-3093: Component/s: logging > Airflow UnicodeEncodeError with logging (file_task_handler.py) >

[jira] [Updated] (AIRFLOW-3069) Decode output of S3 file transform operator

[ https://issues.apache.org/jira/browse/AIRFLOW-3069?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Szymon Bilinski updated AIRFLOW-3069: - Priority: Minor (was: Trivial) > Decode output of S3 file transform operator >

[GitHub] odracci commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI

odracci commented on a change in pull request #3922: AIRFLOW-2952 Fix Kubernetes CI URL: https://github.com/apache/incubator-airflow/pull/3922#discussion_r219071347 ## File path: scripts/ci/kubernetes/kube/configmaps.yaml ## @@ -27,7 +27,7 @@ data: logging_level =

[jira] [Created] (AIRFLOW-3092) Sqoop hook is needed to support postgres/mssql parameter --schema

Forestlzj created AIRFLOW-3092: -- Summary: Sqoop hook is needed to support postgres/mssql parameter --schema Key: AIRFLOW-3092 URL: https://issues.apache.org/jira/browse/AIRFLOW-3092 Project: Apache

[GitHub] codecov-io edited a comment on issue #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

codecov-io edited a comment on issue #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#issuecomment-420583503 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3876?src=pr=h1)

[jira] [Closed] (AIRFLOW-428) Scheduler restart (via SIGKILL) leaves orphaned celery and airflow run processes

[ https://issues.apache.org/jira/browse/AIRFLOW-428?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong closed AIRFLOW-428. Resolution: Auto Closed > Scheduler restart (via SIGKILL) leaves orphaned celery and

[GitHub] seelmann commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

seelmann commented on issue #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#issuecomment-423052692 @feng-tao I replied and resolved all your questions and comments, PTAL. Currently I added additional commits on top, when

[GitHub] seelmann commented on a change in pull request #3596: [AIRFLOW-2747] Explicit re-schedule of sensors

seelmann commented on a change in pull request #3596: [AIRFLOW-2747] Explicit re-schedule of sensors URL: https://github.com/apache/incubator-airflow/pull/3596#discussion_r219044092 ## File path: airflow/models.py ## @@ -1744,6 +1749,29 @@ def dry_run(self):