[GitHub] [airflow] auvipy commented on issue #7754: update celery to 4.4.2

2020-03-27 Thread GitBox
auvipy commented on issue #7754: update celery to 4.4.2 URL: https://github.com/apache/airflow/pull/7754#issuecomment-604860427 I want to be a regular contributor to airflow and improve celery upstream :) This is an automated

[jira] [Commented] (AIRFLOW-3819) k8s executor - Allow the configuration of a global default for pod resource request/limits

2020-03-27 Thread Lihan Li (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068394#comment-17068394 ] Lihan Li commented on AIRFLOW-3819: --- [~aizhamal] Just hit by this issue again, that w

[GitHub] [airflow] mik-laj commented on issue #7900: Convert properties with query to real methods

2020-03-27 Thread GitBox
mik-laj commented on issue #7900: Convert properties with query to real methods URL: https://github.com/apache/airflow/pull/7900#issuecomment-604873922 @potiuk Good point. I will add backward compatibility. This is an automat

[GitHub] [airflow] stijndehaes commented on issue #7168: [AIRFLOW-6561] Add possibility to specify default resources for airfl…

2020-03-27 Thread GitBox
stijndehaes commented on issue #7168: [AIRFLOW-6561] Add possibility to specify default resources for airfl… URL: https://github.com/apache/airflow/pull/7168#issuecomment-604874352 @potiuk rebased the branch to master This is

[GitHub] [airflow] codecov-io edited a comment on issue #7739: [AIRFLOW-7044] Add host_key option to SSH connection extras

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7739: [AIRFLOW-7044] Add host_key option to SSH connection extras URL: https://github.com/apache/airflow/pull/7739#issuecomment-600042897 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7739?src=pr&el=h1) Report > Merging [#7739](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #7739: [AIRFLOW-7044] Add host_key option to SSH connection extras

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7739: [AIRFLOW-7044] Add host_key option to SSH connection extras URL: https://github.com/apache/airflow/pull/7739#issuecomment-600042897 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7739?src=pr&el=h1) Report > Merging [#7739](https://code

[GitHub] [airflow] BasPH commented on issue #7426: [AIRFLOW-6765] Add CLI "airflow dags test" command

2020-03-27 Thread GitBox
BasPH commented on issue #7426: [AIRFLOW-6765] Add CLI "airflow dags test" command URL: https://github.com/apache/airflow/pull/7426#issuecomment-604879635 Hi @mik-laj, it's on my todo list. Sorry, very busy lately... This is

[GitHub] [airflow] codecov-io commented on issue #7898: Decouple DAG and SerializedDagModel

2020-03-27 Thread GitBox
codecov-io commented on issue #7898: Decouple DAG and SerializedDagModel URL: https://github.com/apache/airflow/pull/7898#issuecomment-604898682 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7898?src=pr&el=h1) Report > Merging [#7898](https://codecov.io/gh/apache/airflow/pull/78

[GitHub] [airflow] turbaszek commented on issue #7754: update celery to 4.4.2

2020-03-27 Thread GitBox
turbaszek commented on issue #7754: update celery to 4.4.2 URL: https://github.com/apache/airflow/pull/7754#issuecomment-604906461 > celery/kombu#1063 (comment) Does this issue can potentially impact Airflow? @kaxil @auvipy ? I know about this issue because I one of our customers onc

[GitHub] [airflow] turbaszek edited a comment on issue #7754: update celery to 4.4.2

2020-03-27 Thread GitBox
turbaszek edited a comment on issue #7754: update celery to 4.4.2 URL: https://github.com/apache/airflow/pull/7754#issuecomment-604906461 > celery/kombu#1063 (comment) Does this issue can potentially impact Airflow? @kaxil @auvipy ? I know about this issue because one of our customer

[GitHub] [airflow] potiuk commented on a change in pull request #7841: Requirements now depend on python version

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7841: Requirements now depend on python version URL: https://github.com/apache/airflow/pull/7841#discussion_r399147202 ## File path: .travis.yml ## @@ -41,24 +41,24 @@ jobs: stage: pre-test script: ./scripts/ci/ci

[GitHub] [airflow] potiuk commented on a change in pull request #7841: Requirements now depend on python version

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7841: Requirements now depend on python version URL: https://github.com/apache/airflow/pull/7841#discussion_r399147338 ## File path: .travis.yml ## @@ -41,24 +41,24 @@ jobs: stage: pre-test script: ./scripts/ci/ci

[GitHub] [airflow] mik-laj merged pull request #7897: Extract DAG cycle tester

2020-03-27 Thread GitBox
mik-laj merged pull request #7897: Extract DAG cycle tester URL: https://github.com/apache/airflow/pull/7897 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use

[jira] [Created] (AIRFLOW-7112) Kubernetes pod template - add ability to specify schedulerName

2020-03-27 Thread Nikolay (Jira)
Nikolay created AIRFLOW-7112: Summary: Kubernetes pod template - add ability to specify schedulerName Key: AIRFLOW-7112 URL: https://issues.apache.org/jira/browse/AIRFLOW-7112 Project: Apache Airflow

[GitHub] [airflow] turbaszek commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
turbaszek commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399158527 ## File path: .travis.yml ## @@ -41,24 +41,24 @@ jobs: stage: pre-test script: ./scripts/ci/ci_run

[GitHub] [airflow] turbaszek commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
turbaszek commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399158985 ## File path: BREEZE.rst ## @@ -348,18 +349,43 @@ In case of disk space errors on macOS, increase the disk spac

[GitHub] [airflow] turbaszek commented on a change in pull request #7743: [AIRFLOW-7075] Operators for storing information from GCS into GA

2020-03-27 Thread GitBox
turbaszek commented on a change in pull request #7743: [AIRFLOW-7075] Operators for storing information from GCS into GA URL: https://github.com/apache/airflow/pull/7743#discussion_r399164880 ## File path: airflow/providers/google/cloud/hooks/gcs.py ## @@ -185,6 +185,10 @@

[GitHub] [airflow] codecov-io edited a comment on issue #7841: Requirements now depend on python version

2020-03-27 Thread GitBox
codecov-io edited a comment on issue #7841: Requirements now depend on python version URL: https://github.com/apache/airflow/pull/7841#issuecomment-603512068 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7841?src=pr&el=h1) Report > Merging [#7841](https://codecov.io/gh/apache/a

[GitHub] [airflow] michalslowikowski00 commented on a change in pull request #7743: [AIRFLOW-7075] Operators for storing information from GCS into GA

2020-03-27 Thread GitBox
michalslowikowski00 commented on a change in pull request #7743: [AIRFLOW-7075] Operators for storing information from GCS into GA URL: https://github.com/apache/airflow/pull/7743#discussion_r399168775 ## File path: airflow/providers/google/marketing_platform/example_dags/example_a

[GitHub] [airflow] potiuk commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399168374 ## File path: .travis.yml ## @@ -41,24 +41,24 @@ jobs: stage: pre-test script: ./scripts/ci/ci_run_al

[GitHub] [airflow] potiuk commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399168374 ## File path: .travis.yml ## @@ -41,24 +41,24 @@ jobs: stage: pre-test script: ./scripts/ci/ci_run_al

[GitHub] [airflow] potiuk commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399171768 ## File path: BREEZE.rst ## @@ -348,18 +349,43 @@ In case of disk space errors on macOS, increase the disk space a

[GitHub] [airflow] potiuk commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399171768 ## File path: BREEZE.rst ## @@ -348,18 +349,43 @@ In case of disk space errors on macOS, increase the disk space a

[GitHub] [airflow] potiuk commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399172203 ## File path: BREEZE.rst ## @@ -348,18 +349,43 @@ In case of disk space errors on macOS, increase the disk space a

[GitHub] [airflow] zeroam closed pull request #7873: Add help message in celery command

2020-03-27 Thread GitBox
zeroam closed pull request #7873: Add help message in celery command URL: https://github.com/apache/airflow/pull/7873 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

[jira] [Commented] (AIRFLOW-3674) Adding documentation on official docker images

2020-03-27 Thread Ngwe Becky (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3674?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068543#comment-17068543 ] Ngwe Becky commented on AIRFLOW-3674: - Please I’ll like to work on this issue > Ad

[GitHub] [airflow] zeroam commented on issue #7873: Add help message in celery command

2020-03-27 Thread GitBox
zeroam commented on issue #7873: Add help message in celery command URL: https://github.com/apache/airflow/pull/7873#issuecomment-604931338 I will propose another PR to set visible celery command This is an automated message f

[GitHub] [airflow] codecov-io commented on issue #7168: [AIRFLOW-6561] Add possibility to specify default resources for airfl…

2020-03-27 Thread GitBox
codecov-io commented on issue #7168: [AIRFLOW-6561] Add possibility to specify default resources for airfl… URL: https://github.com/apache/airflow/pull/7168#issuecomment-604932024 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7168?src=pr&el=h1) Report > Merging [#7168](https://

[GitHub] [airflow] mik-laj commented on issue #7888: Avoid loading executors in jobs

2020-03-27 Thread GitBox
mik-laj commented on issue #7888: Avoid loading executors in jobs URL: https://github.com/apache/airflow/pull/7888#issuecomment-604935824 I have no idea why Travis is sad. This is an automated message from the Apache Git Servi

[GitHub] [airflow] potiuk commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399181180 ## File path: BREEZE.rst ## @@ -348,18 +349,43 @@ In case of disk space errors on macOS, increase the disk space a

[GitHub] [airflow] zeroam opened a new pull request #7902: Enable celery command in any environment

2020-03-27 Thread GitBox
zeroam opened a new pull request #7902: Enable celery command in any environment URL: https://github.com/apache/airflow/pull/7902 Set celery command visible even if the executor is not CeleryExecutor Instead, raise AirflowException using celery command when the executor is not CeleryEx

[GitHub] [airflow] zhongjiajie opened a new pull request #7903: Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie opened a new pull request #7903: Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) Make sure to mark the boxes below before creating PR: [x]

[GitHub] [airflow] zhongjiajie commented on issue #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#issuecomment-604942825 We have one subclass hook still WIP in https://github.com/apache/airflow/pull/7901 --

[GitHub] [airflow] auvipy commented on issue #7754: update celery to 4.4.2

2020-03-27 Thread GitBox
auvipy commented on issue #7754: update celery to 4.4.2 URL: https://github.com/apache/airflow/pull/7754#issuecomment-604944299 > > [celery/kombu#1063](https://github.com/celery/kombu/issues/1063) (comment) > > Does this issue can potentially impact Airflow? @kaxil @auvipy ? I know

[jira] [Commented] (AIRFLOW-265) Custom parameters for DockerOperator

2020-03-27 Thread Ngwe Becky (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-265?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068578#comment-17068578 ] Ngwe Becky commented on AIRFLOW-265: Please I’ll like to work on this issue > Cust

[GitHub] [airflow] Javier162380 opened a new issue #7904: Airflow Kubernetes Pod Operator Debugger

2020-03-27 Thread GitBox
Javier162380 opened a new issue #7904: Airflow Kubernetes Pod Operator Debugger URL: https://github.com/apache/airflow/issues/7904 so **Description** Airflow and Kubernetes integration are great. Although one of the hardest part comes when we need to debug. I found som

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7904: Airflow Kubernetes Pod Operator Debugger

2020-03-27 Thread GitBox
boring-cyborg[bot] commented on issue #7904: Airflow Kubernetes Pod Operator Debugger URL: https://github.com/apache/airflow/issues/7904#issuecomment-604950418 Thanks for opening your first issue here! Be sure to follow the issue template! -

[jira] [Commented] (AIRFLOW-2289) Add additional quick start to INSTALL

2020-03-27 Thread Ngwe Becky (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068583#comment-17068583 ] Ngwe Becky commented on AIRFLOW-2289: - Please I’ll like to work on this issue > A

[GitHub] [airflow] zhongjiajie commented on issue #7570: [AIRFLOW-6946] Switch to MySQL 5.7 in 2.0 as base

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7570: [AIRFLOW-6946] Switch to MySQL 5.7 in 2.0 as base URL: https://github.com/apache/airflow/pull/7570#issuecomment-604963676 @potiuk FYI, I still get ```sh sqlalchemy.exc.OperationalError: (_mysql_exceptions.OperationalError) (1071, 'Specified key

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399219644 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kw

[GitHub] [airflow] potiuk commented on issue #7570: [AIRFLOW-6946] Switch to MySQL 5.7 in 2.0 as base

2020-03-27 Thread GitBox
potiuk commented on issue #7570: [AIRFLOW-6946] Switch to MySQL 5.7 in 2.0 as base URL: https://github.com/apache/airflow/pull/7570#issuecomment-604967385 Correct @zhongjiajie . We dropped support for 5.6 in Airflow 2.0. That was one of the reasons. https://github.com/apache/airflow/#maste

[jira] [Updated] (AIRFLOW-7109) HiveServer2Hook and pyHive do not handle timeout correctly

2020-03-27 Thread Oliver Ricken (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7109?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Oliver Ricken updated AIRFLOW-7109: --- Description: Dear experts, using the 1.10.6 vanilla "HiveServer2Hook" from airflow/hooks/h

[GitHub] [airflow] zhongjiajie commented on issue #7901: Remove sql like function in base_hook

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7901: Remove sql like function in base_hook URL: https://github.com/apache/airflow/pull/7901#issuecomment-604968747 Seem unrelated failed ```sh self = def test_local_run(self): args = self.parser.parse_args([ 'tasks',

[GitHub] [airflow] zhongjiajie commented on issue #7570: [AIRFLOW-6946] Switch to MySQL 5.7 in 2.0 as base

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7570: [AIRFLOW-6946] Switch to MySQL 5.7 in 2.0 as base URL: https://github.com/apache/airflow/pull/7570#issuecomment-604971585 I got it, thank @potiuk This is an automated message from the Ap

[jira] [Commented] (AIRFLOW-6399) Serialization: DAG access_control field should be decorated field in DAG serialization

2020-03-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068631#comment-17068631 ] ASF subversion and git services commented on AIRFLOW-6399: -- Co

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-03-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068629#comment-17068629 ] ASF subversion and git services commented on AIRFLOW-4453: -- Co

[jira] [Commented] (AIRFLOW-6399) Serialization: DAG access_control field should be decorated field in DAG serialization

2020-03-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068630#comment-17068630 ] ASF subversion and git services commented on AIRFLOW-6399: -- Co

[GitHub] [airflow] turbaszek commented on issue #7902: Enable celery command in any environment

2020-03-27 Thread GitBox
turbaszek commented on issue #7902: Enable celery command in any environment URL: https://github.com/apache/airflow/pull/7902#issuecomment-604985038 What would you say to write a nice message in case of `airflow celery` + LocalExecutor instead of raising an exception? I would feel better wi

[GitHub] [airflow] zhongjiajie commented on issue #7901: Remove sql like function in base_hook

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7901: Remove sql like function in base_hook URL: https://github.com/apache/airflow/pull/7901#issuecomment-604990151 Still failing PG test 😿 , will try in local with breeze. This is an automated

[GitHub] [airflow] zeroam commented on issue #7902: Enable celery command in any environment

2020-03-27 Thread GitBox
zeroam commented on issue #7902: Enable celery command in any environment URL: https://github.com/apache/airflow/pull/7902#issuecomment-60499 > What would you say to write a nice message in case of airflow celery + LocalExecutor instead of raising an exception? I would feel better with

[GitHub] [airflow] potiuk commented on issue #7841: Requirements now depend on python version

2020-03-27 Thread GitBox
potiuk commented on issue #7841: Requirements now depend on python version URL: https://github.com/apache/airflow/pull/7841#issuecomment-605003271 OK. fixed separate requirements for different python versions is green in CI @kaxil @mik-laj -> do you want to take a look ? --

[GitHub] [airflow] potiuk edited a comment on issue #7841: Requirements now depend on python version

2020-03-27 Thread GitBox
potiuk edited a comment on issue #7841: Requirements now depend on python version URL: https://github.com/apache/airflow/pull/7841#issuecomment-605003271 OK. fixed separate requirements for different python versions is green in CI @kaxil @mik-laj -> do you want to take a look before I merg

[jira] [Commented] (AIRFLOW-6399) Serialization: DAG access_control field should be decorated field in DAG serialization

2020-03-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068700#comment-17068700 ] ASF subversion and git services commented on AIRFLOW-6399: -- Co

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-03-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068699#comment-17068699 ] ASF subversion and git services commented on AIRFLOW-4453: -- Co

[jira] [Commented] (AIRFLOW-6399) Serialization: DAG access_control field should be decorated field in DAG serialization

2020-03-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6399?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068701#comment-17068701 ] ASF subversion and git services commented on AIRFLOW-6399: -- Co

[GitHub] [airflow] turbaszek edited a comment on issue #7902: Enable celery command in any environment

2020-03-27 Thread GitBox
turbaszek edited a comment on issue #7902: Enable celery command in any environment URL: https://github.com/apache/airflow/pull/7902#issuecomment-605004203 > > What would you say to write a nice message in case of airflow celery + LocalExecutor instead of raising an exception? I would feel

[GitHub] [airflow] turbaszek commented on issue #7902: Enable celery command in any environment

2020-03-27 Thread GitBox
turbaszek commented on issue #7902: Enable celery command in any environment URL: https://github.com/apache/airflow/pull/7902#issuecomment-605004203 > > What would you say to write a nice message in case of airflow celery + LocalExecutor instead of raising an exception? I would feel better

[GitHub] [airflow] turbaszek commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
turbaszek commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399268830 ## File path: .travis.yml ## @@ -41,24 +41,24 @@ jobs: stage: pre-test script: ./scripts/ci/ci_run

[GitHub] [airflow] turbaszek commented on a change in pull request #7832: [WIP] Add production image support

2020-03-27 Thread GitBox
turbaszek commented on a change in pull request #7832: [WIP] Add production image support URL: https://github.com/apache/airflow/pull/7832#discussion_r399269486 ## File path: BREEZE.rst ## @@ -348,18 +349,43 @@ In case of disk space errors on macOS, increase the disk spac

[GitHub] [airflow] MatthewRBruce commented on issue #7424: [AIRFLOW-6796] Clean up DAG serializations based on last_updated

2020-03-27 Thread GitBox
MatthewRBruce commented on issue #7424: [AIRFLOW-6796] Clean up DAG serializations based on last_updated URL: https://github.com/apache/airflow/pull/7424#issuecomment-605027141 Sure thing, I wasn't sure if this would still be needed with all the other serialization changes going on --

[GitHub] [airflow] turbaszek commented on a change in pull request #7866: Add download/upload operators for GCS and Google Sheets

2020-03-27 Thread GitBox
turbaszek commented on a change in pull request #7866: Add download/upload operators for GCS and Google Sheets URL: https://github.com/apache/airflow/pull/7866#discussion_r399300943 ## File path: airflow/providers/google/suite/operators/sheets.py ## @@ -0,0 +1,215 @@ +# Li

[GitHub] [airflow] potiuk merged pull request #7841: Requirements now depend on python version

2020-03-27 Thread GitBox
potiuk merged pull request #7841: Requirements now depend on python version URL: https://github.com/apache/airflow/pull/7841 This is an automated message from the Apache Git Service. To respond to the message, please log on t

[GitHub] [airflow] zhongjiajie commented on issue #7901: Remove sql like function in base_hook

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7901: Remove sql like function in base_hook URL: https://github.com/apache/airflow/pull/7901#issuecomment-605033222 Passing in breeze, will try to force-push to restart the failing test. This is

[GitHub] [airflow] michalslowikowski00 commented on issue #7866: Add download/upload operators for GCS and Google Sheets

2020-03-27 Thread GitBox
michalslowikowski00 commented on issue #7866: Add download/upload operators for GCS and Google Sheets URL: https://github.com/apache/airflow/pull/7866#issuecomment-605033459 🚀 This is an automated message from the Apache

[jira] [Updated] (AIRFLOW-6530) Allow for custom Statsd client

2020-03-27 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6530?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6530: Fix Version/s: (was: 1.10.10) 2.0.0 > Allow for custom Statsd client > ---

[jira] [Updated] (AIRFLOW-6711) Drop plugin support for stat_name_handler

2020-03-27 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6711?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6711: Fix Version/s: (was: 1.10.10) 2.0.0 > Drop plugin support for stat_name_ha

[jira] [Updated] (AIRFLOW-4057) airflow should handle invalid stats name

2020-03-27 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4057?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-4057: Fix Version/s: (was: 1.10.10) 2.0.0 > airflow should handle invalid stats

[jira] [Updated] (AIRFLOW-2906) DataDog Integration for Airflow

2020-03-27 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2906?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2906: Fix Version/s: (was: 1.10.10) 2.0.0 > DataDog Integration for Airflow > --

[GitHub] [airflow] zeroam commented on issue #7902: Enable celery command in any environment

2020-03-27 Thread GitBox
zeroam commented on issue #7902: Enable celery command in any environment URL: https://github.com/apache/airflow/pull/7902#issuecomment-605037589 @turbaszek your suggestion is more clear! I've changed help message and changed `celery` subcommand help message ---

[GitHub] [airflow] potiuk commented on a change in pull request #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent URL: https://github.com/apache/airflow/pull/7891#discussion_r399327812 ## File path: airflow/providers/amazon/aws/operators/sagemaker_endpoint.py ## @@ -120,6 +12

[GitHub] [airflow] potiuk commented on a change in pull request #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent

2020-03-27 Thread GitBox
potiuk commented on a change in pull request #7891: [AIRFLOW-5825] SageMakerEndpointOperator is not idempotent URL: https://github.com/apache/airflow/pull/7891#discussion_r399327231 ## File path: airflow/providers/amazon/aws/operators/sagemaker_endpoint.py ## @@ -66,6 +68,

[GitHub] [airflow] zhongjiajie edited a comment on issue #7834: [WIP]Enable super init not called check in pylint

2020-03-27 Thread GitBox
zhongjiajie edited a comment on issue #7834: [WIP]Enable super init not called check in pylint URL: https://github.com/apache/airflow/pull/7834#issuecomment-605051932 > Great. Wouldn't you like to review other exclusions too? > These look easy to fix: > deprecated-pragma, > depreca

[GitHub] [airflow] zhongjiajie commented on issue #7834: [WIP]Enable super init not called check in pylint

2020-03-27 Thread GitBox
zhongjiajie commented on issue #7834: [WIP]Enable super init not called check in pylint URL: https://github.com/apache/airflow/pull/7834#issuecomment-605051932 > Great. Wouldn't you like to review other exclusions too? > These look easy to fix: > deprecated-pragma, > deprecated-str

[GitHub] [airflow] feluelle commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
feluelle commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399329884 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kwarg

[GitHub] [airflow] feluelle commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
feluelle commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399325848 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kwarg

[GitHub] [airflow] JPFrancoia opened a new issue #7905: Pandas version pinned to < 1.0.0

2020-03-27 Thread GitBox
JPFrancoia opened a new issue #7905: Pandas version pinned to < 1.0.0 URL: https://github.com/apache/airflow/issues/7905 Hi, I noticed that pandas is pinned to < 1.0.0 in Airflow's dependencies. It has now started to impact other dependencies in my pipelines, and it will gradually b

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7905: Pandas version pinned to < 1.0.0

2020-03-27 Thread GitBox
boring-cyborg[bot] commented on issue #7905: Pandas version pinned to < 1.0.0 URL: https://github.com/apache/airflow/issues/7905#issuecomment-605055623 Thanks for opening your first issue here! Be sure to follow the issue template! --

[GitHub] [airflow] potiuk commented on issue #7866: Add download/upload operators for GCS and Google Sheets

2020-03-27 Thread GitBox
potiuk commented on issue #7866: Add download/upload operators for GCS and Google Sheets URL: https://github.com/apache/airflow/pull/7866#issuecomment-605060365 Go! This is an automated message from the Apache Git Service. To

[GitHub] [airflow] feluelle commented on a change in pull request #7900: Convert properties with query to real methods

2020-03-27 Thread GitBox
feluelle commented on a change in pull request #7900: Convert properties with query to real methods URL: https://github.com/apache/airflow/pull/7900#discussion_r399343659 ## File path: airflow/www/views.py ## @@ -93,7 +93,7 @@ def get_date_time_num_runs_dag_runs_form_data(

[GitHub] [airflow] feluelle commented on a change in pull request #7900: Convert properties with query to real methods

2020-03-27 Thread GitBox
feluelle commented on a change in pull request #7900: Convert properties with query to real methods URL: https://github.com/apache/airflow/pull/7900#discussion_r399342406 ## File path: airflow/ti_deps/deps/dag_unpaused_dep.py ## @@ -29,6 +29,6 @@ class DagUnpausedDep(BaseT

[GitHub] [airflow] feluelle commented on a change in pull request #7900: Convert properties with query to real methods

2020-03-27 Thread GitBox
feluelle commented on a change in pull request #7900: Convert properties with query to real methods URL: https://github.com/apache/airflow/pull/7900#discussion_r399342749 ## File path: airflow/ti_deps/deps/prev_dagrun_dep.py ## @@ -64,7 +64,7 @@ def _get_dep_statuses(self,

[GitHub] [airflow] feluelle commented on a change in pull request #7900: Convert properties with query to real methods

2020-03-27 Thread GitBox
feluelle commented on a change in pull request #7900: Convert properties with query to real methods URL: https://github.com/apache/airflow/pull/7900#discussion_r399344592 ## File path: airflow/www/views.py ## @@ -93,7 +93,7 @@ def get_date_time_num_runs_dag_runs_form_data(

[GitHub] [airflow] jrwalk commented on issue #7870: migrate from `dill` to `cloudpickle` for advanced serialization

2020-03-27 Thread GitBox
jrwalk commented on issue #7870: migrate from `dill` to `cloudpickle` for advanced serialization URL: https://github.com/apache/airflow/issues/7870#issuecomment-605065110 so `dill` is optional to use (set by a flag in the `PythonVirtualenvOperator`) but is always imported and treated as a

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399355984 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kw

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399355323 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kw

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399356160 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kw

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399354993 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kw

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399355323 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kw

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook

2020-03-27 Thread GitBox
zhongjiajie commented on a change in pull request #7903: [dont-merge] Add property conn_name to dbapi_hook URL: https://github.com/apache/airflow/pull/7903#discussion_r399354993 ## File path: airflow/hooks/dbapi_hook.py ## @@ -61,10 +61,17 @@ def __init__(self, *args, **kw

[GitHub] [airflow] codecov-io commented on issue #7834: [WIP]Enable super init not called check in pylint

2020-03-27 Thread GitBox
codecov-io commented on issue #7834: [WIP]Enable super init not called check in pylint URL: https://github.com/apache/airflow/pull/7834#issuecomment-605097551 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7834?src=pr&el=h1) Report > Merging [#7834](https://codecov.io/gh/apache/

[GitHub] [airflow] potiuk commented on issue #7834: [WIP]Enable super init not called check in pylint

2020-03-27 Thread GitBox
potiuk commented on issue #7834: [WIP]Enable super init not called check in pylint URL: https://github.com/apache/airflow/pull/7834#issuecomment-605100405 Looks good . Do we remove WIP from the name :) ? This is an automated

[GitHub] [airflow] kaxil merged pull request #7834: Enable super init not called check in pylint

2020-03-27 Thread GitBox
kaxil merged pull request #7834: Enable super init not called check in pylint URL: https://github.com/apache/airflow/pull/7834 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] stale[bot] closed pull request #7357: [AIRFLOW-6273] Fixes Databricks Connection when using Token

2020-03-27 Thread GitBox
stale[bot] closed pull request #7357: [AIRFLOW-6273] Fixes Databricks Connection when using Token URL: https://github.com/apache/airflow/pull/7357 This is an automated message from the Apache Git Service. To respond to the m

[jira] [Commented] (AIRFLOW-6273) databricks_hook.py changed how host is pulled

2020-03-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6273?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068881#comment-17068881 ] ASF GitHub Bot commented on AIRFLOW-6273: - stale[bot] commented on pull request

[jira] [Closed] (AIRFLOW-14) DagRun Refactor (Scheduler 2.0)

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-14?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-14. -- Resolution: Auto Closed > DagRun Refactor (Scheduler 2.0) > --- > >

[jira] [Closed] (AIRFLOW-18) Alembic's constraints and indexes are unnamed thus hard to drop or change

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-18?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-18. -- Resolution: Auto Closed > Alembic's constraints and indexes are unnamed thus hard to drop or ch

[GitHub] [airflow] dimberman opened a new issue #7906: Special tags when referring to other tasks

2020-03-27 Thread GitBox
dimberman opened a new issue #7906: Special tags when referring to other tasks URL: https://github.com/apache/airflow/issues/7906 **Description** At the moment when you need to refer to other tasks, you either have to refer to them by name or search though a list of upstream

[jira] [Closed] (AIRFLOW-54) Special tags when referring to other tasks

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-54?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-54. -- Resolution: Auto Closed > Special tags when referring to other tasks >

[jira] [Commented] (AIRFLOW-54) Special tags when referring to other tasks

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-54?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17068917#comment-17068917 ] Daniel Imberman commented on AIRFLOW-54: moved to https://github.com/apache/airfl

[jira] [Closed] (AIRFLOW-55) Add HDFS Log Support

2020-03-27 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-55?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman closed AIRFLOW-55. -- Resolution: Auto Closed > Add HDFS Log Support > > > Key:

  1   2   3   >