[GitHub] [airflow] auvipy commented on issue #7754: update celery to 4.4.2

2020-04-01 Thread GitBox
auvipy commented on issue #7754: update celery to 4.4.2 URL: https://github.com/apache/airflow/pull/7754#issuecomment-607632726 it seems to upgrade to Redis server 5 solved the issue! https://github.com/celery/kombu/issues/1063#issuecomment-607532782

[GitHub] [airflow] kuromt commented on issue #7365: [AIRFLOW-5221] add host_aliases to KubernetesPodOperator

2020-04-01 Thread GitBox
kuromt commented on issue #7365: [AIRFLOW-5221] add host_aliases to KubernetesPodOperator URL: https://github.com/apache/airflow/pull/7365#issuecomment-607611924 The latest test failed due to timeout, but this fail is due to timing problem. Should I kick off test again?

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8060: Debug Executor fails to work

2020-04-01 Thread GitBox
boring-cyborg[bot] commented on issue #8060: Debug Executor fails to work URL: https://github.com/apache/airflow/issues/8060#issuecomment-607609524 Thanks for opening your first issue here! Be sure to follow the issue template!

[GitHub] [airflow] githubsaritasa opened a new issue #8060: Debug Executor fails to work

2020-04-01 Thread GitBox
githubsaritasa opened a new issue #8060: Debug Executor fails to work URL: https://github.com/apache/airflow/issues/8060 I am following the instructions here https://airflow.readthedocs.io/en/stable/executor/debug.html ``` root@ip-172-16-101-169:/usr/local/airflow/dags/dbscore#

[jira] [Resolved] (AIRFLOW-7045) RenderedTIFields: Update Sqlalchemy query to support all backends

2020-04-01 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-7045. - Resolution: Fixed > RenderedTIFields: Update Sqlalchemy query to support all backends >

[jira] [Commented] (AIRFLOW-7045) RenderedTIFields: Update Sqlalchemy query to support all backends

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073353#comment-17073353 ] ASF subversion and git services commented on AIRFLOW-7045: -- Commit

[jira] [Commented] (AIRFLOW-7045) RenderedTIFields: Update Sqlalchemy query to support all backends

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073350#comment-17073350 ] ASF GitHub Bot commented on AIRFLOW-7045: - kaxil commented on pull request #8051:

[GitHub] [airflow] kaxil merged pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
kaxil merged pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#discussion_r402035653 ## File path: tests/models/test_renderedtifields.py ## @@ -139,29 +147,27 @@

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#discussion_r402035176 ## File path: airflow/models/renderedtifields.py ## @@ -110,28 +110,20 @@ def

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] kaxil commented on issue #8058: [AIP-31] Add lazy way to get Airflow context from a wrapped function

2020-04-01 Thread GitBox
kaxil commented on issue #8058: [AIP-31] Add lazy way to get Airflow context from a wrapped function URL: https://github.com/apache/airflow/issues/8058#issuecomment-607603050 Just a comment, provide_context is no longer requires in Master:

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] casassg opened a new issue #8059: [AIP-31] Enable customized XCom class

2020-04-01 Thread GitBox
casassg opened a new issue #8059: [AIP-31] Enable customized XCom class URL: https://github.com/apache/airflow/issues/8059 **Description** - Enable custom XCom backend functionality for custom serialization/deserialization. - XCom backend can be set from airflow.cfg

[GitHub] [airflow] casassg opened a new issue #8058: [AIP-31] Add lazy way to get Airflow context from a wrapped function

2020-04-01 Thread GitBox
casassg opened a new issue #8058: [AIP-31] Add lazy way to get Airflow context from a wrapped function URL: https://github.com/apache/airflow/issues/8058 **Description** Currently the only way to access the context object from a PythonOperator wrapped function is by setting

[GitHub] [airflow] kaxil commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
kaxil commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#discussion_r402024161 ## File path: tests/models/test_renderedtifields.py ## @@ -139,29 +147,27 @@ def

[GitHub] [airflow] casassg opened a new issue #8057: [AIP-31] Create @task decorator for functionally defined operators

2020-04-01 Thread GitBox
casassg opened a new issue #8057: [AIP-31] Create @task decorator for functionally defined operators URL: https://github.com/apache/airflow/issues/8057 **Description** Add simple way to wrap a function into a PythonFunctionalOperator. - Should be used without args or with

[GitHub] [airflow] kaxil commented on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
kaxil commented on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607591263 > What do you think about support two paths? on supported databases, we can use faster single queries. On less

[GitHub] [airflow] kaxil edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
kaxil edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607591263 > What do you think about support two paths? on supported databases, we can use faster single queries. On

[GitHub] [airflow] kaxil commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
kaxil commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#discussion_r402022036 ## File path: airflow/models/renderedtifields.py ## @@ -110,28 +110,20 @@ def

[GitHub] [airflow] casassg opened a new issue #8056: [AIP-31] Create PythonFunctionalOperator

2020-04-01 Thread GitBox
casassg opened a new issue #8056: [AIP-31] Create PythonFunctionalOperator URL: https://github.com/apache/airflow/issues/8056 **Description** Operator that enables wrapping a python function and call it as a function in the DAG. - Should have` __call__` method that captures

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#discussion_r402020441 ## File path: airflow/models/renderedtifields.py ## @@ -110,28 +110,20 @@ def

[GitHub] [airflow] codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] casassg opened a new issue #8055: [AIP-31] Add "output" property in BaseOperator

2020-04-01 Thread GitBox
casassg opened a new issue #8055: [AIP-31] Add "output" property in BaseOperator URL: https://github.com/apache/airflow/issues/8055 **Description** Output property should return the default `XComArg` for the operator (using `return_value` as key). **Use case /

[GitHub] [airflow] codecov-io commented on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
codecov-io commented on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607588595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8051?src=pr=h1) Report > Merging

[GitHub] [airflow] casassg opened a new issue #8054: [AIP-31] Add dependency relationship on operator when templated_field is XComArg

2020-04-01 Thread GitBox
casassg opened a new issue #8054: [AIP-31] Add dependency relationship on operator when templated_field is XComArg URL: https://github.com/apache/airflow/issues/8054 **Description** XComArg allow us to set explicit XCom messages between operators. Adding a dependency between

[GitHub] [airflow] mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#discussion_r402015638 ## File path: tests/models/test_renderedtifields.py ## @@ -139,29 +147,27 @@

[GitHub] [airflow] casassg opened a new issue #8053: [AIP-31] Resolve XComArg in template_fields

2020-04-01 Thread GitBox
casassg opened a new issue #8053: [AIP-31] Resolve XComArg in template_fields URL: https://github.com/apache/airflow/issues/8053 **Description** As a DAG Author, I want to set a templated_field as XComArg and for it to get resolved into the XCom object at execution time.

[GitHub] [airflow] mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
mik-laj commented on a change in pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#discussion_r402015516 ## File path: tests/models/test_renderedtifields.py ## @@ -139,29 +147,27 @@

[GitHub] [airflow] casassg opened a new issue #8052: [AIP-31] Create XComArg model

2020-04-01 Thread GitBox
casassg opened a new issue #8052: [AIP-31] Create XComArg model URL: https://github.com/apache/airflow/issues/8052 **Description** XComArg is a class that references an XCom entry from an operator. Can be used to explicitly set XCom dependencies and explictly pass results between

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8052: [AIP-31] Create XComArg model

2020-04-01 Thread GitBox
boring-cyborg[bot] commented on issue #8052: [AIP-31] Create XComArg model URL: https://github.com/apache/airflow/issues/8052#issuecomment-607582555 Thanks for opening your first issue here! Be sure to follow the issue template!

[GitHub] [airflow] potiuk commented on issue #7832: Add production image support

2020-04-01 Thread GitBox
potiuk commented on issue #7832: Add production image support URL: https://github.com/apache/airflow/pull/7832#issuecomment-607582286 All corrected - please take another look This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-6871) Tree view unusable for large DAGs

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073310#comment-17073310 ] ASF subversion and git services commented on AIRFLOW-6871: -- Commit

[GitHub] [airflow] mik-laj commented on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
mik-laj commented on issue #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051#issuecomment-607582198 What do you think about support two paths? on supported databases, we can use faster single queries. On less

[GitHub] [airflow] kaxil merged pull request #8047: Add Jiajie Zhong to committers list

2020-04-01 Thread GitBox
kaxil merged pull request #8047: Add Jiajie Zhong to committers list URL: https://github.com/apache/airflow/pull/8047 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (AIRFLOW-7045) RenderedTIFields: Update Sqlalchemy query to support all backends

2020-04-01 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073303#comment-17073303 ] ASF GitHub Bot commented on AIRFLOW-7045: - kaxil commented on pull request #8051:

[GitHub] [airflow] kaxil opened a new pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields

2020-04-01 Thread GitBox
kaxil opened a new pull request #8051: [AIRFLOW-7045] Update SQL query to delete RenderedTaskInstanceFields URL: https://github.com/apache/airflow/pull/8051 This is because "The composite IN construct is not supported by all backends" Based on the discussion in

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming and batch db call for scheduler metrics URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr=h1) Report > Merging

[GitHub] [airflow] mik-laj opened a new pull request #8050: Fix airflow.www.views import

2020-04-01 Thread GitBox
mik-laj opened a new pull request #8050: Fix airflow.www.views import URL: https://github.com/apache/airflow/pull/8050 Before: ``` 03:20 $ python -c 'import airflow.www.views' [2020-04-02 03:20:51,157] {dagbag.py:368} INFO - Filling up the DagBag from

[jira] [Work started] (AIRFLOW-7045) RenderedTIFields: Update Sqlalchemy query to support all backends

2020-04-01 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-7045 started by Kaxil Naik. --- > RenderedTIFields: Update Sqlalchemy query to support all backends >

[jira] [Updated] (AIRFLOW-7045) RenderedTIFields: Update Sqlalchemy query to support all backends

2020-04-01 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7045?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-7045: Summary: RenderedTIFields: Update Sqlalchemy query to support all backends (was: Update

[GitHub] [airflow] whynick1 opened a new pull request #8049: Mysql to gcs

2020-04-01 Thread GitBox
whynick1 opened a new pull request #8049: Mysql to gcs URL: https://github.com/apache/airflow/pull/8049 --- Issue link: [AIRFLOW-7117](https://issues.apache.org/jira/browse/AIRFLOW-7117) Make sure to mark the boxes below before creating PR: [x] - [x] Description above

[GitHub] [airflow] dabdine-r7 commented on issue #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration

2020-04-01 Thread GitBox
dabdine-r7 commented on issue #6007: [AIRFLOW-2310] Enable AWS Glue Job Integration URL: https://github.com/apache/airflow/pull/6007#issuecomment-607527333 Thanks for following up on this all. Super interested in seeing it land!

[GitHub] [airflow] boring-cyborg[bot] commented on issue #8048: Add yaml load for connection

2020-04-01 Thread GitBox
boring-cyborg[bot] commented on issue #8048: Add yaml load for connection URL: https://github.com/apache/airflow/pull/8048#issuecomment-607519267 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything

[GitHub] [airflow] sherryzhao1006 opened a new pull request #8048: Add yaml load for connection

2020-04-01 Thread GitBox
sherryzhao1006 opened a new pull request #8048: Add yaml load for connection URL: https://github.com/apache/airflow/pull/8048 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below before creating PR: [x]

[GitHub] [airflow] sherryzhao1006 closed pull request #8048: Add yaml load for connection

2020-04-01 Thread GitBox
sherryzhao1006 closed pull request #8048: Add yaml load for connection URL: https://github.com/apache/airflow/pull/8048 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[GitHub] [airflow] kaxil opened a new pull request #8047: Add Jiajie Zhong to committers list

2020-04-01 Thread GitBox
kaxil opened a new pull request #8047: Add Jiajie Zhong to committers list URL: https://github.com/apache/airflow/pull/8047 Add Jiajie Zhong to committers list --- Make sure to mark the boxes below before creating PR: [x] - [x] Description above provides context of the

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073211#comment-17073211 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073212#comment-17073212 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[jira] [Commented] (AIRFLOW-6871) Tree view unusable for large DAGs

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073213#comment-17073213 ] ASF subversion and git services commented on AIRFLOW-6871: -- Commit

[jira] [Commented] (AIRFLOW-6871) Tree view unusable for large DAGs

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073210#comment-17073210 ] ASF subversion and git services commented on AIRFLOW-6871: -- Commit

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073209#comment-17073209 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073208#comment-17073208 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[jira] [Commented] (AIRFLOW-6871) Tree view unusable for large DAGs

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073202#comment-17073202 ] ASF subversion and git services commented on AIRFLOW-6871: -- Commit

[jira] [Resolved] (AIRFLOW-6871) Tree view unusable for large DAGs

2020-04-01 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6871. - Fix Version/s: 1.10.10 Resolution: Fixed > Tree view unusable for large DAGs >

[jira] [Commented] (AIRFLOW-6871) Tree view unusable for large DAGs

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6871?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073200#comment-17073200 ] ASF subversion and git services commented on AIRFLOW-6871: -- Commit

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073188#comment-17073188 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073187#comment-17073187 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[jira] [Commented] (AIRFLOW-6798) Add option for service account values for KubernetesPodOperator

2020-04-01 Thread Parhy (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6798?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073181#comment-17073181 ] Parhy commented on AIRFLOW-6798: [~itayb] when you deploy the scheduler  you need to give it a service

[GitHub] [airflow] ryanahamilton commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI

2020-04-01 Thread GitBox
ryanahamilton commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI URL: https://github.com/apache/airflow/pull/8046#discussion_r401912024 ## File path: airflow/www/templates/appbuilder/navbar_right.html ## @@ -46,8 +46,22 @@

[GitHub] [airflow] ryanahamilton commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI

2020-04-01 Thread GitBox
ryanahamilton commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI URL: https://github.com/apache/airflow/pull/8046#discussion_r401905542 ## File path: airflow/www/static/css/main.css ## @@ -238,6 +238,19 @@ div.square {

[GitHub] [airflow] ashb commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI

2020-04-01 Thread GitBox
ashb commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI URL: https://github.com/apache/airflow/pull/8046#discussion_r401904396 ## File path: airflow/www/static/css/main.css ## @@ -238,6 +238,19 @@ div.square { box-shadow:

[GitHub] [airflow] mik-laj commented on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p…

2020-04-01 Thread GitBox
mik-laj commented on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p… URL: https://github.com/apache/airflow/pull/7503#issuecomment-607485712 @houqp In Q2 I want to add more tests that allow you to count the number of queries. We have

[GitHub] [airflow] danieltahara commented on issue #7100: [AIRFLOW-6508] Update the version of cattrs from 0.9 to 1.0

2020-04-01 Thread GitBox
danieltahara commented on issue #7100: [AIRFLOW-6508] Update the version of cattrs from 0.9 to 1.0 URL: https://github.com/apache/airflow/pull/7100#issuecomment-607484310 Can you issue a patch version bump? This was merged Jan 8 but I still can't use it :(

[GitHub] [airflow] ryanahamilton commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI

2020-04-01 Thread GitBox
ryanahamilton commented on a change in pull request #8046: [AIRFLOW-7048] Allow user to convert timezone in UI URL: https://github.com/apache/airflow/pull/8046#discussion_r401902103 ## File path: airflow/www/static/css/main.css ## @@ -238,6 +238,19 @@ div.square {

[GitHub] [airflow] nicklip edited a comment on issue #5876: [AIRFLOW-5270] JSONDecodeError in DockerOperator when force_pull

2020-04-01 Thread GitBox
nicklip edited a comment on issue #5876: [AIRFLOW-5270] JSONDecodeError in DockerOperator when force_pull URL: https://github.com/apache/airflow/pull/5876#issuecomment-607465023 This is still a bug in case anyone is wondering. @mattpetersen

[GitHub] [airflow] mustafagok commented on issue #7731: [AIRFLOW-7068] Create EC2 Hook, Operator and Sensor

2020-04-01 Thread GitBox
mustafagok commented on issue #7731: [AIRFLOW-7068] Create EC2 Hook, Operator and Sensor URL: https://github.com/apache/airflow/pull/7731#issuecomment-607469395 > I've fixed up the other ticket, so we just need to give that a final review+merge @ashb please let me know when #7541

[GitHub] [airflow] nicklip edited a comment on issue #5876: [AIRFLOW-5270] JSONDecodeError in DockerOperator when force_pull

2020-04-01 Thread GitBox
nicklip edited a comment on issue #5876: [AIRFLOW-5270] JSONDecodeError in DockerOperator when force_pull URL: https://github.com/apache/airflow/pull/5876#issuecomment-607465023 This is still a bug in case anyone is wondering.

[GitHub] [airflow] nicklip commented on issue #5876: [AIRFLOW-5270] JSONDecodeError in DockerOperator when force_pull

2020-04-01 Thread GitBox
nicklip commented on issue #5876: [AIRFLOW-5270] JSONDecodeError in DockerOperator when force_pull URL: https://github.com/apache/airflow/pull/5876#issuecomment-607465023 This is still bug in case anyone is wondering. This

[GitHub] [airflow] houqp edited a comment on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p…

2020-04-01 Thread GitBox
houqp edited a comment on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p… URL: https://github.com/apache/airflow/pull/7503#issuecomment-607457730 This change looks correct to me. In my original fix, I also added unit tests to prevent

[GitHub] [airflow] randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator

2020-04-01 Thread GitBox
randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator URL: https://github.com/apache/airflow/pull/8008#discussion_r401837518 ## File path: airflow/providers/facebook/ads/operators/ads.py ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache

[GitHub] [airflow] houqp commented on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p…

2020-04-01 Thread GitBox
houqp commented on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p… URL: https://github.com/apache/airflow/pull/7503#issuecomment-607457730 This change looks correct to me. In my original fix, I also added unit tests to prevent regressions

[jira] [Updated] (AIRFLOW-3607) Decreasing scheduler delay between tasks

2020-04-01 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3607?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3607: Fix Version/s: (was: 1.10.10) 2.0.0 > Decreasing scheduler delay between

[jira] [Created] (AIRFLOW-7118) Honor schema type for mysql to gcs data pre-process

2020-04-01 Thread Hongyi Wang (Jira)
Hongyi Wang created AIRFLOW-7118: Summary: Honor schema type for mysql to gcs data pre-process Key: AIRFLOW-7118 URL: https://issues.apache.org/jira/browse/AIRFLOW-7118 Project: Apache Airflow

[GitHub] [airflow] codecov-io edited a comment on issue #8024: [AIRFLOW-4529] Add support for Azure Batch Service

2020-04-01 Thread GitBox
codecov-io edited a comment on issue #8024: [AIRFLOW-4529] Add support for Azure Batch Service URL: https://github.com/apache/airflow/pull/8024#issuecomment-607445924 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8024?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #8024: [AIRFLOW-4529] Add support for Azure Batch Service

2020-04-01 Thread GitBox
codecov-io commented on issue #8024: [AIRFLOW-4529] Add support for Azure Batch Service URL: https://github.com/apache/airflow/pull/8024#issuecomment-607445924 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8024?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6685: Fix Version/s: (was: 2.0.0) 1.10.10 > Add ThresholdCheckOperator for Data

[GitHub] [airflow] houqp commented on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p…

2020-04-01 Thread GitBox
houqp commented on issue #7503: [AIRFLOW-3607] fixed the bug with picking just special cases while maintaining the p… URL: https://github.com/apache/airflow/pull/7503#issuecomment-607437919 sorry, my github mention is overwhelmed, so I missed them. taking a look at this now.

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073109#comment-17073109 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[jira] [Commented] (AIRFLOW-7017) Respect default dag view on redirect after trigger

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7017?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073108#comment-17073108 ] ASF subversion and git services commented on AIRFLOW-7017: -- Commit

[jira] [Commented] (AIRFLOW-6685) Add ThresholdCheckOperator for Data Quality Checking

2020-04-01 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6685?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17073110#comment-17073110 ] ASF subversion and git services commented on AIRFLOW-6685: -- Commit

[GitHub] [airflow] randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator

2020-04-01 Thread GitBox
randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator URL: https://github.com/apache/airflow/pull/8008#discussion_r401837412 ## File path: airflow/providers/facebook/ads/operators/ads.py ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache

[GitHub] [airflow] randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator

2020-04-01 Thread GitBox
randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator URL: https://github.com/apache/airflow/pull/8008#discussion_r401837518 ## File path: airflow/providers/facebook/ads/operators/ads.py ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache

[GitHub] [airflow] randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator

2020-04-01 Thread GitBox
randr97 commented on a change in pull request #8008: Custom Facebook Ads Operator URL: https://github.com/apache/airflow/pull/8008#discussion_r401831272 ## File path: airflow/providers/facebook/ads/operators/ads.py ## @@ -0,0 +1,111 @@ +# +# Licensed to the Apache

[jira] [Assigned] (AIRFLOW-7117) Honor self.schema in sql_to_gcs as schema to upload

2020-04-01 Thread Hongyi Wang (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Hongyi Wang reassigned AIRFLOW-7117: Assignee: Hongyi Wang > Honor self.schema in sql_to_gcs as schema to upload >

[jira] [Created] (AIRFLOW-7117) Honor self.schema in sql_to_gcs as schema to upload

2020-04-01 Thread Hongyi Wang (Jira)
Hongyi Wang created AIRFLOW-7117: Summary: Honor self.schema in sql_to_gcs as schema to upload Key: AIRFLOW-7117 URL: https://issues.apache.org/jira/browse/AIRFLOW-7117 Project: Apache Airflow

[GitHub] [airflow] potiuk commented on a change in pull request #7832: Add production image support

2020-04-01 Thread GitBox
potiuk commented on a change in pull request #7832: Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r401828047 ## File path: BREEZE.rst ## @@ -263,8 +310,8 @@ to enter the running container. It's as easy as launching ``breeze

[GitHub] [airflow] mik-laj commented on issue #8036: SalesforceHook not compatible with simple_salesforce 1.0.0

2020-04-01 Thread GitBox
mik-laj commented on issue #8036: SalesforceHook not compatible with simple_salesforce 1.0.0 URL: https://github.com/apache/airflow/issues/8036#issuecomment-607423173 @eladkal We do not do these packages just to give you the option to use these operators earlier. There is also a second

[GitHub] [airflow] potiuk commented on a change in pull request #7832: Add production image support

2020-04-01 Thread GitBox
potiuk commented on a change in pull request #7832: Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r401826532 ## File path: entrypoint.sh ## @@ -0,0 +1,122 @@ +#!/usr/bin/env bash +# Licensed to the Apache Software Foundation (ASF)

  1   2   3   >