[jira] [Created] (AIRFLOW-6654) AWS DataSync - bugfix when creating locations

2020-01-27 Thread Bjorn Olsen (Jira)
Bjorn Olsen created AIRFLOW-6654: Summary: AWS DataSync - bugfix when creating locations Key: AIRFLOW-6654 URL: https://issues.apache.org/jira/browse/AIRFLOW-6654 Project: Apache Airflow

[jira] [Updated] (AIRFLOW-6649) Google storage to Snowflake

2020-01-27 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6649?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-6649: --- Labels: snowflake (was: ) > Google storage to Snowflake > --- > >

[jira] [Commented] (AIRFLOW-6650) Google Cloud Platform Connection key json documentation or code is wrong

2020-01-27 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024905#comment-17024905 ] Kamil Bregula commented on AIRFLOW-6650: Does this problem occur in the master branch? 

[jira] [Reopened] (AIRFLOW-2289) Add additional quick start to INSTALL

2020-01-27 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula reopened AIRFLOW-2289: > Add additional quick start to INSTALL > - > >

[jira] [Resolved] (AIRFLOW-6451) self._print_stat() in dag_processing.py should be skippable by config option

2020-01-27 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6451. Fix Version/s: (was: 2.0.0) 1.10.8 Resolution: Fixed >

[jira] [Commented] (AIRFLOW-6451) self._print_stat() in dag_processing.py should be skippable by config option

2020-01-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024904#comment-17024904 ] ASF subversion and git services commented on AIRFLOW-6451: -- Commit

[jira] [Commented] (AIRFLOW-6451) self._print_stat() in dag_processing.py should be skippable by config option

2020-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6451?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024903#comment-17024903 ] ASF GitHub Bot commented on AIRFLOW-6451: - mik-laj commented on pull request #7134:

[jira] [Resolved] (AIRFLOW-2289) Add additional quick start to INSTALL

2020-01-27 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2289?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-2289. Resolution: Fixed > Add additional quick start to INSTALL >

[GitHub] [airflow] mik-laj merged pull request #7134: [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable

2020-01-27 Thread GitBox
mik-laj merged pull request #7134: [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable URL: https://github.com/apache/airflow/pull/7134 This is an automated message from the Apache Git Service. To

[jira] [Created] (AIRFLOW-6653) Add option to use local or DAG's timezone in jinja template macros

2020-01-27 Thread Chuan Qiu (Jira)
Chuan Qiu created AIRFLOW-6653: -- Summary: Add option to use local or DAG's timezone in jinja template macros Key: AIRFLOW-6653 URL: https://issues.apache.org/jira/browse/AIRFLOW-6653 Project: Apache

[jira] [Created] (AIRFLOW-6652) Set is_delete_operator_pod=True by default in KubernetesPodOperator()

2020-01-27 Thread Mathew Wicks (Jira)
Mathew Wicks created AIRFLOW-6652: - Summary: Set is_delete_operator_pod=True by default in KubernetesPodOperator() Key: AIRFLOW-6652 URL: https://issues.apache.org/jira/browse/AIRFLOW-6652 Project:

[GitHub] [airflow] akki commented on a change in pull request #6552: [AIRFLOW-5850] Capture task logs in DockerSwarmOperator

2020-01-27 Thread GitBox
akki commented on a change in pull request #6552: [AIRFLOW-5850] Capture task logs in DockerSwarmOperator URL: https://github.com/apache/airflow/pull/6552#discussion_r371607250 ## File path: airflow/providers/docker/operators/docker_swarm.py ## @@ -123,11 +129,43 @@ def

[GitHub] [airflow] zhongjiajie edited a comment on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE]

2020-01-27 Thread GitBox
zhongjiajie edited a comment on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE] URL: https://github.com/apache/airflow/pull/5659#issuecomment-579059497 @elukey Thanks for you working here, Yeah I think it could be done in separately PR, but I think we should done

[GitHub] [airflow] zhongjiajie edited a comment on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE]

2020-01-27 Thread GitBox
zhongjiajie edited a comment on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE] URL: https://github.com/apache/airflow/pull/5659#issuecomment-579059497 Thanks for you working here, Yeah I think it could be done in separately PR, but I think we should done before

[GitHub] [airflow] zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE]

2020-01-27 Thread GitBox
zhongjiajie commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE] URL: https://github.com/apache/airflow/pull/5659#issuecomment-579059497 Thanks for you working here, Yeah I think it could be done in separately PR, but I think we should done before Airflow 2.0

[GitHub] [airflow] zhongjiajie commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2020-01-27 Thread GitBox
zhongjiajie commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r371591219 ## File path: docs/operators-and-hooks-ref.rst ## @@ -98,6 +98,12 @@ Foundation.

[GitHub] [airflow] zhongjiajie commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2020-01-27 Thread GitBox
zhongjiajie commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r371591125 ## File path: docs/operators-and-hooks-ref.rst ## @@ -98,6 +98,12 @@ Foundation.

[GitHub] [airflow] zhongjiajie commented on issue #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2020-01-27 Thread GitBox
zhongjiajie commented on issue #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#issuecomment-579057953 FYI, ci sad, you should add new hook operator and sensor to `operators-and-hooks-ref.rst` @lucacavazzana ``` Missing

[GitHub] [airflow] roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-27 Thread GitBox
roitvt commented on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-579006913 @mik-laj can you make another review? :) I fixed the connection according to your recommendations

[GitHub] [airflow] codecov-io edited a comment on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574641714 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7163?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574641714 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7163?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#issuecomment-574641714 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7163?src=pr=h1) Report > Merging

[GitHub] [airflow] tooptoop4 edited a comment on issue #7134: [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable

2020-01-27 Thread GitBox
tooptoop4 edited a comment on issue #7134: [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable URL: https://github.com/apache/airflow/pull/7134#issuecomment-576452064 @mik-laj pls merge This is an

[GitHub] [airflow] tooptoop4 commented on issue #7157: [AIRFLOW-6251] add config for max tasks per dag

2020-01-27 Thread GitBox
tooptoop4 commented on issue #7157: [AIRFLOW-6251] add config for max tasks per dag URL: https://github.com/apache/airflow/pull/7157#issuecomment-578975631 @kaxil WDYT This is an automated message from the Apache Git

[jira] [Commented] (AIRFLOW-6651) Make Heartbeat available on Redis

2020-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024701#comment-17024701 ] ASF GitHub Bot commented on AIRFLOW-6651: - saguziel commented on pull request #7269:

[GitHub] [airflow] saguziel opened a new pull request #7269: [AIRFLOW-6651][WIP] Add Redis Heartbeat option

2020-01-27 Thread GitBox
saguziel opened a new pull request #7269: [AIRFLOW-6651][WIP] Add Redis Heartbeat option URL: https://github.com/apache/airflow/pull/7269 Adds the option to use Redis to store the heartbeat data. This will reduce load on the DB. All the guarantees a DB provides is not needed for the

[jira] [Commented] (AIRFLOW-6629) Dask executor tests fail in master

2020-01-27 Thread Loren Brindze (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024694#comment-17024694 ] Loren Brindze commented on AIRFLOW-6629: Able to reproduce, working on a PR to fix these. >

[jira] [Assigned] (AIRFLOW-6629) Dask executor tests fail in master

2020-01-27 Thread Loren Brindze (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6629?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Loren Brindze reassigned AIRFLOW-6629: -- Assignee: Loren Brindze > Dask executor tests fail in master >

[jira] [Created] (AIRFLOW-6651) Make Heartbeat available on Redis

2020-01-27 Thread Alex Guziel (Jira)
Alex Guziel created AIRFLOW-6651: Summary: Make Heartbeat available on Redis Key: AIRFLOW-6651 URL: https://issues.apache.org/jira/browse/AIRFLOW-6651 Project: Apache Airflow Issue Type:

[jira] [Comment Edited] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-01-27 Thread Ignacio Peluffo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024541#comment-17024541 ] Ignacio Peluffo edited comment on AIRFLOW-5071 at 1/27/20 6:15 PM: ---

[jira] [Commented] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-01-27 Thread Ignacio Peluffo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024541#comment-17024541 ] Ignacio Peluffo commented on AIRFLOW-5071: -- Another one here, below is a capture of Flower

[jira] [Updated] (AIRFLOW-5071) Thousand os Executor reports task instance X finished (success) although the task says its queued. Was the task killed externally?

2020-01-27 Thread Ignacio Peluffo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5071?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ignacio Peluffo updated AIRFLOW-5071: - Attachment: image-2020-01-27-18-10-29-124.png > Thousand os Executor reports task

[GitHub] [airflow] JavierLopezT commented on issue #6670: [AIRFLOW-4816]MySqlToS3Operator

2020-01-27 Thread GitBox
JavierLopezT commented on issue #6670: [AIRFLOW-4816]MySqlToS3Operator URL: https://github.com/apache/airflow/pull/6670#issuecomment-578857598 Could anyone help me a little more with the unittest please? Thank you very much in advance

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
nuclearpinguin commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r371366880 ## File path: airflow/contrib/hooks/yandexcloud_dataproc_hook.py ## @@ -0,0 +1,571 @@ +#

[GitHub] [airflow] osule commented on issue #6354: [AIRFLOW-5664] Store timestamps with microseconds precision in GCSToPSQL

2020-01-27 Thread GitBox
osule commented on issue #6354: [AIRFLOW-5664] Store timestamps with microseconds precision in GCSToPSQL URL: https://github.com/apache/airflow/pull/6354#issuecomment-578836750 > @osule can you please, rebase onto new master? Sure, I'll resolve the conflicts and push a changed

[GitHub] [airflow] roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor

2020-01-27 Thread GitBox
roitvt commented on a change in pull request #7163: [AIRFLOW-6542] add spark-on-k8s operator/hook/sensor URL: https://github.com/apache/airflow/pull/7163#discussion_r371317220 ## File path: airflow/contrib/operators/spark_kubernetes_operator.py ## @@ -0,0 +1,77 @@ +# -*-

[jira] [Commented] (AIRFLOW-6650) Google Cloud Platform Connection key json documentation or code is wrong

2020-01-27 Thread Evgeniy Sokolov (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6650?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024434#comment-17024434 ] Evgeniy Sokolov commented on AIRFLOW-6650: -- Either documentation or the code should be fixed. 

[GitHub] [airflow] aviemzur commented on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-578805415 @feluelle committed all suggestions you made + made the changes you requested and all tests are passing on Travis.

[jira] [Created] (AIRFLOW-6650) Google Cloud Platform Connection key json documentation or code is wrong

2020-01-27 Thread Evgeniy Sokolov (Jira)
Evgeniy Sokolov created AIRFLOW-6650: Summary: Google Cloud Platform Connection key json documentation or code is wrong Key: AIRFLOW-6650 URL: https://issues.apache.org/jira/browse/AIRFLOW-6650

[GitHub] [airflow] codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-571189190 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6824?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-571189190 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6824?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-571189190 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6824?src=pr=h1) Report > Merging

[GitHub] [airflow] robinedwards commented on a change in pull request #7251: [AIRFLOW-6628] Fix search auto complete behaviour

2020-01-27 Thread GitBox
robinedwards commented on a change in pull request #7251: [AIRFLOW-6628] Fix search auto complete behaviour URL: https://github.com/apache/airflow/pull/7251#discussion_r371300306 ## File path: airflow/www/views.py ## @@ -325,10 +319,36 @@ def get_int_arg(value,

[jira] [Commented] (AIRFLOW-5777) Migrate AWS DynamoDB to /providers/aws [AIP-21]

2020-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5777?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024393#comment-17024393 ] ASF GitHub Bot commented on AIRFLOW-5777: - potiuk commented on pull request #6455:

[GitHub] [airflow] potiuk closed pull request #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2020-01-27 Thread GitBox
potiuk closed pull request #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] potiuk commented on issue #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2020-01-27 Thread GitBox
potiuk commented on issue #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455#issuecomment-578787118 Closing as the whole migration is automated by @mik-laj

[GitHub] [airflow] aviemzur removed a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur removed a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-578776781 @feluelle committed all suggested changes and all tests passed on Travis

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371262602 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371276037 ## File path: airflow/providers/amazon/aws/sensors/cloud_formation.py ## @@ -0,0 +1,98

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371274926 ## File path: airflow/providers/amazon/aws/sensors/cloud_formation.py ## @@ -0,0 +1,98

[GitHub] [airflow] aviemzur commented on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-578776781 @feluelle committed all suggested changes and all tests passed on Travis

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371271765 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[jira] [Commented] (AIRFLOW-3007) Scheduler docs use deprecated use of `schedule_interval`

2020-01-27 Thread Jira
[ https://issues.apache.org/jira/browse/AIRFLOW-3007?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024378#comment-17024378 ] Matjaž Mav commented on AIRFLOW-3007: - [~kaxilnaik] Does this fixes annoying warning message on

[GitHub] [airflow] codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-571189190 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6824?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#issuecomment-571189190 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6824?src=pr=h1) Report > Merging

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371262602 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] codecov-io edited a comment on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#issuecomment-578369583 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7252?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#issuecomment-578369583 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7252?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#issuecomment-578369583 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7252?src=pr=h1) Report > Merging

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371262602 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371262602 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371262602 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r369977013 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371262602 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[jira] [Closed] (AIRFLOW-6633) S3 Logging Configurations Are Ignored For Local

2020-01-27 Thread Evan Hlavaty (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6633?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Evan Hlavaty closed AIRFLOW-6633. - Resolution: Not A Problem Finally found logs in the dask worker and found out s3 url needed

[jira] [Resolved] (AIRFLOW-6646) Move protocols classes to providers package

2020-01-27 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula resolved AIRFLOW-6646. Resolution: Fixed > Move protocols classes to providers package >

[jira] [Commented] (AIRFLOW-6646) Move protocols classes to providers package

2020-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024341#comment-17024341 ] ASF GitHub Bot commented on AIRFLOW-6646: - mik-laj commented on pull request #7268:

[jira] [Commented] (AIRFLOW-6646) Move protocols classes to providers package

2020-01-27 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6646?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024343#comment-17024343 ] ASF subversion and git services commented on AIRFLOW-6646: -- Commit

[GitHub] [airflow] mik-laj merged pull request #7268: [AIRFLOW-6646][AIP-21] Move protocols classes to providers package

2020-01-27 Thread GitBox
mik-laj merged pull request #7268: [AIRFLOW-6646][AIP-21] Move protocols classes to providers package URL: https://github.com/apache/airflow/pull/7268 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] mik-laj commented on issue #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2020-01-27 Thread GitBox
mik-laj commented on issue #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455#issuecomment-578748942 Yes. I've already done it in my fork. This is an

[jira] [Commented] (AIRFLOW-6649) Google storage to Snowflake

2020-01-27 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6649?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024340#comment-17024340 ] Kamil Bregula commented on AIRFLOW-6649: Can't you use the snowflake operator? This is the

[jira] [Created] (AIRFLOW-6649) Google storage to Snowflake

2020-01-27 Thread nexoriv (Jira)
nexoriv created AIRFLOW-6649: Summary: Google storage to Snowflake Key: AIRFLOW-6649 URL: https://issues.apache.org/jira/browse/AIRFLOW-6649 Project: Apache Airflow Issue Type: New Feature

[GitHub] [airflow] RosterIn commented on a change in pull request #6931: [AIRFLOW-6372] Align WASB remote logging URI scheme (2.0.x)

2020-01-27 Thread GitBox
RosterIn commented on a change in pull request #6931: [AIRFLOW-6372] Align WASB remote logging URI scheme (2.0.x) URL: https://github.com/apache/airflow/pull/6931#discussion_r371222582 ## File path: airflow/config_templates/airflow_local_settings.py ## @@ -184,6 +184,9

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371219323 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371219248 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,87

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371219387 ## File path: airflow/providers/amazon/aws/operators/cloud_formation.py ## @@ -0,0

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371219164 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,87

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371218379 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371218379 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371217057 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
feluelle commented on a change in pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824#discussion_r371216580 ## File path: airflow/providers/amazon/aws/hooks/cloud_formation.py ## @@ -0,0 +1,88

[GitHub] [airflow] codecov-io commented on issue #7251: [AIRFLOW-6628] Fix search auto complete behaviour

2020-01-27 Thread GitBox
codecov-io commented on issue #7251: [AIRFLOW-6628] Fix search auto complete behaviour URL: https://github.com/apache/airflow/pull/7251#issuecomment-578727497 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7251?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7251: [AIRFLOW-6628] Fix search auto complete behaviour

2020-01-27 Thread GitBox
codecov-io edited a comment on issue #7251: [AIRFLOW-6628] Fix search auto complete behaviour URL: https://github.com/apache/airflow/pull/7251#issuecomment-578727497 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7251?src=pr=h1) Report > Merging

[GitHub] [airflow] peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r371186897 ## File path: airflow/contrib/hooks/yandexcloud_dataproc_hook.py ## @@ -0,0 +1,571 @@ +#

[GitHub] [airflow] peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r371206590 ## File path: airflow/contrib/operators/yandexcloud_base_operator.py ## @@ -0,0 +1,42 @@

[GitHub] [airflow] peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r371206550 ## File path: airflow/contrib/operators/yandexcloud_base_operator.py ## @@ -0,0 +1,42 @@

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7126: [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator

2020-01-27 Thread GitBox
nuclearpinguin commented on a change in pull request #7126: [AIRFLOW-6405] Add GCP BigQuery Table Upsert Operator URL: https://github.com/apache/airflow/pull/7126#discussion_r371205169 ## File path: airflow/gcp/hooks/bigquery.py ## @@ -1109,6 +1110,16 @@ def

[GitHub] [airflow] nuclearpinguin commented on issue #6354: [AIRFLOW-5664] Store timestamps with microseconds precision in GCSToPSQL

2020-01-27 Thread GitBox
nuclearpinguin commented on issue #6354: [AIRFLOW-5664] Store timestamps with microseconds precision in GCSToPSQL URL: https://github.com/apache/airflow/pull/6354#issuecomment-578713715 @osule can you please, rebase onto new master?

[jira] [Created] (AIRFLOW-6648) Timeout Feature - Provided statistical solution to long running/stuck jobs and take appropriate actions

2020-01-27 Thread Golokesh Patra (Jira)
Golokesh Patra created AIRFLOW-6648: --- Summary: Timeout Feature - Provided statistical solution to long running/stuck jobs and take appropriate actions Key: AIRFLOW-6648 URL:

[GitHub] [airflow] potiuk commented on issue #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21]

2020-01-27 Thread GitBox
potiuk commented on issue #6455: [WIP][AIRFLOW-5777] Migrate AWS DynamoDB to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6455#issuecomment-578710607 @mik-laj is doing automated migration now for all contrib packages - I guess this one can be closed?

[GitHub] [airflow] aviemzur opened a new pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur opened a new pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-6258) CloudFormation create_stack and delete_stack operators

2020-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024276#comment-17024276 ] ASF GitHub Bot commented on AIRFLOW-6258: - aviemzur commented on pull request #6824:

[GitHub] [airflow] aviemzur closed pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers

2020-01-27 Thread GitBox
aviemzur closed pull request #6824: [AIRFLOW-6258] add CloudFormation operators to AWS providers URL: https://github.com/apache/airflow/pull/6824 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-6258) CloudFormation create_stack and delete_stack operators

2020-01-27 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17024275#comment-17024275 ] ASF GitHub Bot commented on AIRFLOW-6258: - aviemzur commented on pull request #6824:

[GitHub] [airflow] peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r371186897 ## File path: airflow/contrib/hooks/yandexcloud_dataproc_hook.py ## @@ -0,0 +1,571 @@ +#

[GitHub] [airflow] peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support

2020-01-27 Thread GitBox
peter-volkov commented on a change in pull request #7252: [AIRFLOW-6531] Initial Yandex.Cloud Dataproc support URL: https://github.com/apache/airflow/pull/7252#discussion_r371186897 ## File path: airflow/contrib/hooks/yandexcloud_dataproc_hook.py ## @@ -0,0 +1,571 @@ +#

[jira] [Assigned] (AIRFLOW-6647) Reduce the cluttering of Airflow UI by merging create and check into a single CHECK step.

2020-01-27 Thread Nidhi Chourasia (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6647?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Nidhi Chourasia reassigned AIRFLOW-6647: Assignee: Nidhi Chourasia > Reduce the cluttering of Airflow UI by merging

[jira] [Created] (AIRFLOW-6647) Reduce the cluttering of Airflow UI by merging create and check into a single CHECK step.

2020-01-27 Thread Nidhi Chourasia (Jira)
Nidhi Chourasia created AIRFLOW-6647: Summary: Reduce the cluttering of Airflow UI by merging create and check into a single CHECK step. Key: AIRFLOW-6647 URL:

[GitHub] [airflow] mik-laj commented on a change in pull request #6552: [AIRFLOW-5850] Capture task logs in DockerSwarmOperator

2020-01-27 Thread GitBox
mik-laj commented on a change in pull request #6552: [AIRFLOW-5850] Capture task logs in DockerSwarmOperator URL: https://github.com/apache/airflow/pull/6552#discussion_r371165897 ## File path: airflow/providers/docker/operators/docker_swarm.py ## @@ -123,11 +129,43 @@

[GitHub] [airflow] akki edited a comment on issue #6552: [AIRFLOW-5850] Capture task logs in DockerSwarmOperator

2020-01-27 Thread GitBox
akki edited a comment on issue #6552: [AIRFLOW-5850] Capture task logs in DockerSwarmOperator URL: https://github.com/apache/airflow/pull/6552#issuecomment-578582943 Hi Airflow team I have rebased my work on top of master (again!) as suggested in the JIRA ticket recently. CI also seems

  1   2   >