[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547281122 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547281122 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] Fokko commented on a change in pull request #6210: [AIRFLOW-5567] BaseReschedulePokeOperator

2019-10-28 Thread GitBox
Fokko commented on a change in pull request #6210: [AIRFLOW-5567] BaseReschedulePokeOperator URL: https://github.com/apache/airflow/pull/6210#discussion_r339914291 ## File path: tests/models/test_base_async_operator.py ## @@ -0,0 +1,288 @@ +# -*- coding: utf-8 -*- +# +# Li

[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547281122 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547219587 I updated the `UPDATING.md` and other reference file.

[GitHub] [airflow] dstandish commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547281122 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operator. I

[GitHub] [airflow] Fokko commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
Fokko commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547280956 > Unless I switch a pickle flag it complains that it is not JSON serializable, the comments in the code indicate pickling is go

[GitHub] [airflow] dstandish removed a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish removed a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547273710 What motivated this PR was the need to persist state through reschedules, in the service of creating an async opera

[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547273710 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547273710 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547273710 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547273710 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish edited a comment on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547273710 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operat

[GitHub] [airflow] dstandish commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
dstandish commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547273710 What motivated this PR was the need to persist state through reschedules, in the service of creating an async operator. I

[GitHub] [airflow] KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th…

2019-10-28 Thread GitBox
KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th… URL: https://github.com/apache/airflow/pull/4931#issuecomment-547254353 I'm having the same issue but if I set the following: ``` AIRFLOW__KUBERNETES_ENVIRONMENT_VA

[GitHub] [airflow] KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th…

2019-10-28 Thread GitBox
KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th… URL: https://github.com/apache/airflow/pull/4931#issuecomment-547254353 I'm having the same issue but if I set the following: ``` AIRFLOW__KUBERNETES_ENVIRONMENT_VA

[GitHub] [airflow] KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th…

2019-10-28 Thread GitBox
KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th… URL: https://github.com/apache/airflow/pull/4931#issuecomment-547254353 I'm having the same issue but if I set the following: ``` AIRFLOW__KUBERNETES_ENVIRONMENT_VA

[GitHub] [airflow] KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th…

2019-10-28 Thread GitBox
KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th… URL: https://github.com/apache/airflow/pull/4931#issuecomment-547254353 I'm having the same issue but if I set the following: ``` AIRFLOW__KUBERNETES_ENVIRONMENT_VA

[GitHub] [airflow] KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th…

2019-10-28 Thread GitBox
KyleJamesWalker edited a comment on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th… URL: https://github.com/apache/airflow/pull/4931#issuecomment-547254353 I'm having the same issue but if I set the following: ``` AIRFLOW__KUBERNETES_ENVIRONMENT_VA

[GitHub] [airflow] KyleJamesWalker commented on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th…

2019-10-28 Thread GitBox
KyleJamesWalker commented on issue #4931: [AIRFLOW-4109] Added support for passing the airflow fernet key to th… URL: https://github.com/apache/airflow/pull/4931#issuecomment-547254353 I'm having the same issue but if I set the following. ``` AIRFLOW__KUBERNETES_ENVIRONMENT_VARIABLES

[GitHub] [airflow] KevinYang21 commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution

2019-10-28 Thread GitBox
KevinYang21 commented on issue #6370: AIRFLOW-5701: Don't clear xcom explicitly before execution URL: https://github.com/apache/airflow/pull/6370#issuecomment-547248960 Hi @Fokko, Sry I'm late again. Read all the discussion and history but I have to say I'm not really a big fan of t

[GitHub] [airflow] codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547227476 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6443?src=pr&el=h1) Report > Merging [#6443](https://codecov.

[GitHub] [airflow] codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547227476 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6443?src=pr&el=h1) Report > Merging [#6443](https://codecov.

[GitHub] [airflow] mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547228345 And, Should I change the all import paths with new module path in the other files including test files? (in separate P

[GitHub] [airflow] mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547228345 And, Should I change the all import paths with new module path in the other files including test files (in separate PR

[GitHub] [airflow] mingrammer commented on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
mingrammer commented on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547228345 And, Should I change the all import paths with new module path in the other files (in separate PR) -

[GitHub] [airflow] mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
mingrammer edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547228345 And, Should I change the all import paths with new module path in the other files (in separate PR)? -

[GitHub] [airflow] codecov-io commented on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
codecov-io commented on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547227476 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6443?src=pr&el=h1) Report > Merging [#6443](https://codecov.io/gh/a

[GitHub] [airflow] codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547227476 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6443?src=pr&el=h1) Report > Merging [#6443](https://codecov.

[GitHub] [airflow] codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547227476 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6443?src=pr&el=h1) Report > Merging [#6443](https://codecov.

[GitHub] [airflow] mingrammer commented on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks

2019-10-28 Thread GitBox
mingrammer commented on issue #6443: [AIRFLOW-5769] Move the S3_hook to /providers/aws/hooks URL: https://github.com/apache/airflow/pull/6443#issuecomment-547219587 I updated the `UPDATING.md` and other reference. This is an

[GitHub] [airflow] mik-laj commented on issue #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2019-10-28 Thread GitBox
mik-laj commented on issue #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455#issuecomment-547209506 why did you transfer transfer operators to another file?

[jira] [Commented] (AIRFLOW-5739) Move Cloud Functions to providers packagae

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5739?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961567#comment-16961567 ] ASF GitHub Bot commented on AIRFLOW-5739: - chicochico commented on pull request

[GitHub] [airflow] chicochico opened a new pull request #6456: [AIRFLOW-5739] Move airflow.gcp.*.functions to airflow.providers.google.cloud.*.funct…

2019-10-28 Thread GitBox
chicochico opened a new pull request #6456: [AIRFLOW-5739] Move airflow.gcp.*.functions to airflow.providers.google.cloud.*.funct… URL: https://github.com/apache/airflow/pull/6456 …ions Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the fol

[jira] [Commented] (AIRFLOW-5290) Add is updated before and between to GoogleCloudStorageHook

2019-10-28 Thread Derrik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961543#comment-16961543 ] Derrik commented on AIRFLOW-5290: - I have code for this, I have just been too lazy / bu

[GitHub] [airflow] codecov-io edited a comment on issue #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455#issuecomment-547186369 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6455?src=pr&el=h1) Report > :exclamation: No coverage

[jira] [Commented] (AIRFLOW-3514) Documentation for run_query slightly off for bigquery_hook

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3514?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961538#comment-16961538 ] jack commented on AIRFLOW-3514: --- [~kamil.bregula] [~kaxilnaik]  can be closed? > Documen

[GitHub] [airflow] codecov-io commented on issue #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2019-10-28 Thread GitBox
codecov-io commented on issue #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455#issuecomment-547186369 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6455?src=pr&el=h1) Report > :exclamation: No coverage uploade

[jira] [Commented] (AIRFLOW-1663) Redshift Connection, Hook, & Operator for COPY command usability

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1663?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961540#comment-16961540 ] jack commented on AIRFLOW-1663: --- Possibly what was meant to be done on: https://issues.a

[jira] [Commented] (AIRFLOW-4734) Upsert functionality for PostgresHook.insert_rows()

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4734?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961532#comment-16961532 ] jack commented on AIRFLOW-4734: --- [~oxymor0n] ahh :/ did you make any progress with it?

[jira] [Commented] (AIRFLOW-4560) Tez queue parameter passed by mapred_queue is incorrect

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4560?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961535#comment-16961535 ] jack commented on AIRFLOW-4560: --- [~ash] merged ages ago but still open :) 1.10.7? > Tez

[GitHub] [airflow] OmerJog commented on issue #6234: [AIRFLOW-5529] support apache drill hook

2019-10-28 Thread GitBox
OmerJog commented on issue #6234: [AIRFLOW-5529] support apache drill hook URL: https://github.com/apache/airflow/pull/6234#issuecomment-547181335 @blcksrx it failed because: `airflow/hooks/drill_hook.py:39:39: E999 SyntaxError: invalid syntax` ---

[jira] [Commented] (AIRFLOW-5616) PrestoHook to use prestodb

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5616?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961528#comment-16961528 ] jack commented on AIRFLOW-5616: --- [~brilhana] You can PR when ready > PrestoHook to use p

[GitHub] [airflow] codecov-io edited a comment on issue #6410: [AIRFLOW-5677] rename GCPSpeechToTextHook to CloudSpeechToTextHook

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6410: [AIRFLOW-5677] rename GCPSpeechToTextHook to CloudSpeechToTextHook URL: https://github.com/apache/airflow/pull/6410#issuecomment-545942246 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6410?src=pr&el=h1) Report > Merging [#6410](https

[jira] [Commented] (AIRFLOW-5286) Add requeue logic to airflow scheduler and executor

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961526#comment-16961526 ] jack commented on AIRFLOW-5286: --- Sounds useful! Are you planing to PR your code? > Add r

[jira] [Commented] (AIRFLOW-5290) Add is updated before and between to GoogleCloudStorageHook

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5290?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961522#comment-16961522 ] jack commented on AIRFLOW-5290: --- [~kamil.bregula] GCP related but not component set > Ad

[jira] [Commented] (AIRFLOW-5333) Move __init__ docstring to class docstring in PubSub

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5333?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961521#comment-16961521 ] jack commented on AIRFLOW-5333: --- [~kamil.bregula]  Jira still open... can u also add doc

[jira] [Assigned] (AIRFLOW-3140) Add MongoDBToGoogleStorage Opearator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack reassigned AIRFLOW-3140: - Assignee: lightQ (was: Tanay Tummalapalli) > Add MongoDBToGoogleStorage Opearator > -

[GitHub] [airflow] codecov-io edited a comment on issue #6410: [AIRFLOW-5677] rename GCPSpeechToTextHook to CloudSpeechToTextHook

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6410: [AIRFLOW-5677] rename GCPSpeechToTextHook to CloudSpeechToTextHook URL: https://github.com/apache/airflow/pull/6410#issuecomment-545942246 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6410?src=pr&el=h1) Report > Merging [#6410](https

[jira] [Commented] (AIRFLOW-5338) Add a RedsfhitToS3Operator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961520#comment-16961520 ] jack commented on AIRFLOW-5338: --- [~feluelle] I think it's a refactor task something like

[jira] [Commented] (AIRFLOW-3140) Add MongoDBToGoogleStorage Opearator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961514#comment-16961514 ] jack commented on AIRFLOW-3140: --- [~quichu] changed assign to you > Add MongoDBToGoogleSt

[jira] [Assigned] (AIRFLOW-3140) Add MongoDBToGoogleStorage Opearator

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack reassigned AIRFLOW-3140: - Assignee: Q C (was: lightQ) > Add MongoDBToGoogleStorage Opearator >

[jira] [Updated] (AIRFLOW-4927) Airflow task stuck in Scheduled mode due to pool not existed

2019-10-28 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4927?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-4927: -- Affects Version/s: 1.10.6 1.10.5 > Airflow task stuck in Scheduled mode due to pool no

[GitHub] [airflow] codecov-io edited a comment on issue #6452: [AIRFLOW-5669] Rename GoogleCloudBaseHook to CloudBaseHook

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6452: [AIRFLOW-5669] Rename GoogleCloudBaseHook to CloudBaseHook URL: https://github.com/apache/airflow/pull/6452#issuecomment-547169288 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6452?src=pr&el=h1) Report > Merging [#6452](https://codec

[GitHub] [airflow] codecov-io commented on issue #6452: [AIRFLOW-5669] Rename GoogleCloudBaseHook to CloudBaseHook

2019-10-28 Thread GitBox
codecov-io commented on issue #6452: [AIRFLOW-5669] Rename GoogleCloudBaseHook to CloudBaseHook URL: https://github.com/apache/airflow/pull/6452#issuecomment-547169288 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6452?src=pr&el=h1) Report > Merging [#6452](https://codecov.io/g

[GitHub] [airflow] kaxil commented on issue #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer

2019-10-28 Thread GitBox
kaxil commented on issue #6396: [AIRFLOW-5726] Delete table as file name in RedshiftToS3Transfer URL: https://github.com/apache/airflow/pull/6396#issuecomment-547169180 It looks good but can you please add tests or update the current tests !

[jira] [Commented] (AIRFLOW-5731) Make output format from list commands configurable

2019-10-28 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961503#comment-16961503 ] ASF subversion and git services commented on AIRFLOW-5731: -- Co

[jira] [Resolved] (AIRFLOW-5731) Make output format from list commands configurable

2019-10-28 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5731. - Fix Version/s: 1.10.7 2.0.0 Resolution: Fixed > Make output format fr

[jira] [Commented] (AIRFLOW-5731) Make output format from list commands configurable

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5731?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961502#comment-16961502 ] ASF GitHub Bot commented on AIRFLOW-5731: - kaxil commented on pull request #640

[GitHub] [airflow] kaxil commented on issue #6400: [AIRFLOW-5731] Make output format from list commands configurable

2019-10-28 Thread GitBox
kaxil commented on issue #6400: [AIRFLOW-5731] Make output format from list commands configurable URL: https://github.com/apache/airflow/pull/6400#issuecomment-547166756 Good to see your contributions again @sekikn :) This i

[GitHub] [airflow] kaxil merged pull request #6400: [AIRFLOW-5731] Make output format from list commands configurable

2019-10-28 Thread GitBox
kaxil merged pull request #6400: [AIRFLOW-5731] Make output format from list commands configurable URL: https://github.com/apache/airflow/pull/6400 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-5799) Add freshworks company name in README

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961473#comment-16961473 ] ASF GitHub Bot commented on AIRFLOW-5799: - kaxil commented on pull request #645

[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-10-28 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961479#comment-16961479 ] ASF subversion and git services commented on AIRFLOW-5729: -- Co

[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-10-28 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961480#comment-16961480 ] ASF subversion and git services commented on AIRFLOW-5729: -- Co

[GitHub] [airflow] BasPH merged pull request #6398: [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config

2019-10-28 Thread GitBox
BasPH merged pull request #6398: [AIRFLOW-5729] Make InputDataConfig optional in Sagemaker's training config URL: https://github.com/apache/airflow/pull/6398 This is an automated message from the Apache Git Service. To respo

[jira] [Commented] (AIRFLOW-5729) Make InputDataConfig in SageMakerTrainingOperator optional

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5729?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961478#comment-16961478 ] ASF GitHub Bot commented on AIRFLOW-5729: - BasPH commented on pull request #639

[jira] [Commented] (AIRFLOW-5799) Add freshworks company name in README

2019-10-28 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961474#comment-16961474 ] ASF subversion and git services commented on AIRFLOW-5799: -- Co

[jira] [Updated] (AIRFLOW-5799) Add freshworks company name in README

2019-10-28 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-5799: Fix Version/s: (was: 1.10.6) > Add freshworks company name in README > --

[jira] [Resolved] (AIRFLOW-5799) Add freshworks company name in README

2019-10-28 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5799?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5799. - Resolution: Fixed > Add freshworks company name in README > ---

[GitHub] [airflow] kaxil merged pull request #6453: [AIRFLOW-5799] Freshworks readme update

2019-10-28 Thread GitBox
kaxil merged pull request #6453: [AIRFLOW-5799] Freshworks readme update URL: https://github.com/apache/airflow/pull/6453 This is an automated message from the Apache Git Service. To respond to the message, please log on to G

[jira] [Commented] (AIRFLOW-5777) Migrate AWS DynamoDB to /providers/aws [AIP-21]

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961467#comment-16961467 ] ASF GitHub Bot commented on AIRFLOW-5777: - BasPH commented on pull request #645

svn commit: r36527 - in /release/airflow: 1.10.5/ 1.10.6/

2019-10-28 Thread ash
Author: ash Date: Mon Oct 28 21:27:20 2019 New Revision: 36527 Log: Release Airflow 1.10.6 from 1.10.6rc2 Added: release/airflow/1.10.6/ release/airflow/1.10.6/apache-airflow-1.10.6-bin.tar.gz - copied unchanged from r36501, dev/airflow/1.10.6rc2/apache-airflow-1.10.6rc2-bin.tar.gz

[GitHub] [airflow] BasPH opened a new pull request #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2019-10-28 Thread GitBox
BasPH opened a new pull request #6455: [AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455 Mostly moving around files. Most important change is merging `airflow/contrib/operators/dynamodb_to_s3.py` and `airflow/contrib/operators/

[GitHub] [airflow] tvalentyn commented on a change in pull request #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests

2019-10-28 Thread GitBox
tvalentyn commented on a change in pull request #6368: [AIRFLOW-5698][part of AIRFLOW-5697] Organize Dataflow tests URL: https://github.com/apache/airflow/pull/6368#discussion_r339795212 ## File path: tests/gcp/hooks/test_dataflow.py ## @@ -178,95 +178,34 @@ def test_start

[jira] [Updated] (AIRFLOW-5788) Change import paths for AWS modules

2019-10-28 Thread Bas Harenslak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bas Harenslak updated AIRFLOW-5788: --- Description: When migrating, think of the following: * UPDATING.MD * pylint_todo.txt * d

[GitHub] [airflow] OmerJog commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream

2019-10-28 Thread GitBox
OmerJog commented on issue #5308: [AIRFLOW-4549] skipped tasks should be ok for wait_for_downstream URL: https://github.com/apache/airflow/pull/5308#issuecomment-547140012 @dima-asana @milton0825 a rebase is needed This is an

[GitHub] [airflow] OmerJog commented on a change in pull request #5360: [AIRFLOW-4101] Add documentation note if dags directory does not exis…

2019-10-28 Thread GitBox
OmerJog commented on a change in pull request #5360: [AIRFLOW-4101] Add documentation note if dags directory does not exis… URL: https://github.com/apache/airflow/pull/5360#discussion_r339784987 ## File path: docs/start.rst ## @@ -36,6 +36,10 @@ The installation is quick a

[GitHub] [airflow] houqp commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-28 Thread GitBox
houqp commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-547139076 I agree it would have been cleaner to not have to manually destruct the stats dictionary in the scheduler loop. However

[jira] [Work started] (AIRFLOW-5777) Migrate AWS DynamoDB to /providers/aws [AIP-21]

2019-10-28 Thread Bas Harenslak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5777 started by Bas Harenslak. -- > Migrate AWS DynamoDB to /providers/aws [AIP-21] > --

[GitHub] [airflow] OmerJog commented on issue #5716: Log decision to skip task instance when start_date > dag.exec_date

2019-10-28 Thread GitBox
OmerJog commented on issue #5716: Log decision to skip task instance when start_date > dag.exec_date URL: https://github.com/apache/airflow/pull/5716#issuecomment-547137951 @gar1t It's a code change hence you need a Jira ticket, after you open Jira edit commit message with : [AIRFLO

[GitHub] [airflow] OmerJog commented on issue #5826: [AIRFLOW-5221] Add ability to add DNS entries to Kubernetes Pods

2019-10-28 Thread GitBox
OmerJog commented on issue #5826: [AIRFLOW-5221] Add ability to add DNS entries to Kubernetes Pods URL: https://github.com/apache/airflow/pull/5826#issuecomment-547137153 @derrick-mink-sp can you please fix the errors? ``` airflow/kubernetes/hostalias.py:1:0: C0111: Missing module doc

[jira] [Updated] (AIRFLOW-5788) Change import paths for AWS modules

2019-10-28 Thread Bas Harenslak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bas Harenslak updated AIRFLOW-5788: --- Description: When migrating, think of the following: * UPDATING.MD * pylint_todo.txt * d

[jira] [Commented] (AIRFLOW-5775) Migrate AWS Batch to /providers/aws [AIP-21]

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961447#comment-16961447 ] ASF GitHub Bot commented on AIRFLOW-5775: - BasPH commented on pull request #645

[GitHub] [airflow] BasPH opened a new pull request #6454: [AIRFLOW-5775] Migrate AWS Batch components to /providers/aws [AIP-21]

2019-10-28 Thread GitBox
BasPH opened a new pull request #6454: [AIRFLOW-5775] Migrate AWS Batch components to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6454 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://iss

[jira] [Updated] (AIRFLOW-5788) Change import paths for AWS modules

2019-10-28 Thread Bas Harenslak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bas Harenslak updated AIRFLOW-5788: --- Description: When migrating, think of the following: * UPDATING.MD * pylint_todo.txt * d

[jira] [Updated] (AIRFLOW-5788) Change import paths for AWS modules

2019-10-28 Thread Bas Harenslak (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Bas Harenslak updated AIRFLOW-5788: --- Description: When migrating, think of the following: * UPDATING.MD * pylint_todo.txt * d

[GitHub] [airflow] ashb commented on issue #6395: [AIRFLOW-5724] Remove side effects from local settings tests

2019-10-28 Thread GitBox
ashb commented on issue #6395: [AIRFLOW-5724] Remove side effects from local settings tests URL: https://github.com/apache/airflow/pull/6395#issuecomment-547131562 @nuclearpinguin Check out the latest commits on https://github.com/ashb/airflow/commits/pytest-runner (last two specifically,

[GitHub] [airflow] ashb commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-28 Thread GitBox
ashb commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-547130770 What do you think of making slot_stats "caching" like this? Then slot_stats could also become `_load_slot_stats` and the

[GitHub] [airflow] OmerJog commented on issue #6196: [AIRFLOW-3152] Kubernetes Pod Operator should support init containers.

2019-10-28 Thread GitBox
OmerJog commented on issue #6196: [AIRFLOW-3152] Kubernetes Pod Operator should support init containers. URL: https://github.com/apache/airflow/pull/6196#issuecomment-547130246 cc @dimberman This is an automated message from

[GitHub] [airflow] OmerJog commented on issue #6399: [AIRFLOW-5730] Enable get_pandas_df on PinotDbApiHook

2019-10-28 Thread GitBox
OmerJog commented on issue #6399: [AIRFLOW-5730] Enable get_pandas_df on PinotDbApiHook URL: https://github.com/apache/airflow/pull/6399#issuecomment-547129123 @sekikn tests did not run yet due to flake8 error: `tests/dags/test_impersonation_custom.py:53:1: E302 expected 2 blank lines,

[jira] [Resolved] (AIRFLOW-5773) Migrate AWS Athena components to /providers/aws

2019-10-28 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5773. - Fix Version/s: 2.0.0 Resolution: Fixed > Migrate AWS Athena components to /providers/aws

[jira] [Commented] (AIRFLOW-5773) Migrate AWS Athena components to /providers/aws

2019-10-28 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961444#comment-16961444 ] ASF subversion and git services commented on AIRFLOW-5773: -- Co

[jira] [Commented] (AIRFLOW-5773) Migrate AWS Athena components to /providers/aws

2019-10-28 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5773?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16961442#comment-16961442 ] ASF GitHub Bot commented on AIRFLOW-5773: - kaxil commented on pull request #644

[GitHub] [airflow] kaxil merged pull request #6446: [AIRFLOW-5773] Migrate AWS Athena components to /providers/aws [AIP-21]

2019-10-28 Thread GitBox
kaxil merged pull request #6446: [AIRFLOW-5773] Migrate AWS Athena components to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6446 This is an automated message from the Apache Git Service. To respond t

[GitHub] [airflow] shaikshakeel commented on a change in pull request #6453: [AIRFLOW-5799] Freshworks readme update

2019-10-28 Thread GitBox
shaikshakeel commented on a change in pull request #6453: [AIRFLOW-5799] Freshworks readme update URL: https://github.com/apache/airflow/pull/6453#discussion_r339772289 ## File path: README.md ## @@ -434,6 +434,7 @@ Currently **officially** using Airflow: 1. [Zenly](https

[GitHub] [airflow] kaxil commented on a change in pull request #6453: [AIRFLOW-5799] Freshworks readme update

2019-10-28 Thread GitBox
kaxil commented on a change in pull request #6453: [AIRFLOW-5799] Freshworks readme update URL: https://github.com/apache/airflow/pull/6453#discussion_r339771760 ## File path: README.md ## @@ -434,6 +434,7 @@ Currently **officially** using Airflow: 1. [Zenly](https://zen.

[GitHub] [airflow] michalslowikowski00 commented on issue #6410: [AIRFLOW-5677] rename GCPSpeechToTextHook to CloudSpeechToTextHook

2019-10-28 Thread GitBox
michalslowikowski00 commented on issue #6410: [AIRFLOW-5677] rename GCPSpeechToTextHook to CloudSpeechToTextHook URL: https://github.com/apache/airflow/pull/6410#issuecomment-547125165 @mik-laj Conflict has been resolved This

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr&el=h1) Report > Merging [#6342](https

[GitHub] [airflow] codecov-io commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-28 Thread GitBox
codecov-io commented on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr&el=h1) Report > Merging [#6342](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric

2019-10-28 Thread GitBox
codecov-io edited a comment on issue #6342: [AIRFLOW-5662] fix incorrect naming for scheduler used slot metric URL: https://github.com/apache/airflow/pull/6342#issuecomment-547121627 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6342?src=pr&el=h1) Report > Merging [#6342](https

  1   2   3   >