[jira] [Created] (AIRFLOW-2999) S3_hook - add the ability to download file to local disk

2018-09-03 Thread jack (JIRA)
jack created AIRFLOW-2999: - Summary: S3_hook - add the ability to download file to local disk Key: AIRFLOW-2999 URL: https://issues.apache.org/jira/browse/AIRFLOW-2999 Project: Apache Airflow Issue

[GitHub] gerardo commented on issue #2187: [AIRFLOW-1042] Easy Unit Testing with Docker

2018-09-03 Thread GitBox
gerardo commented on issue #2187: [AIRFLOW-1042] Easy Unit Testing with Docker URL: https://github.com/apache/incubator-airflow/pull/2187#issuecomment-418254747 @kaxil this PR can be closed. This is an automated message from

[jira] [Resolved] (AIRFLOW-1066) Replace instances of airf...@airflow.com with airf...@example.com

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1066?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-1066. - Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/2217 > Replace

[GitHub] feng-tao commented on issue #3839: [AIRFLOW-208] Add badge to show supported Python versions

2018-09-03 Thread GitBox
feng-tao commented on issue #3839: [AIRFLOW-208] Add badge to show supported Python versions URL: https://github.com/apache/incubator-airflow/pull/3839#issuecomment-418205266 lgtm This is an automated message from the Apache

[jira] [Closed] (AIRFLOW-940) Failing to unencrypt one variable shouldn't break the admin/variable page

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-940?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-940. -- Resolution: Fixed > Failing to unencrypt one variable shouldn't break the admin/variable page > --

[jira] [Closed] (AIRFLOW-689) Okta Authentication

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-689?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-689. -- Resolution: Incomplete > Okta Authentication > --- > > Key: AIRFLOW-68

[jira] [Resolved] (AIRFLOW-641) Improve pull request instructions

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-641?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-641. Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/1897 > Improve pul

[jira] [Closed] (AIRFLOW-576) Add superuser judgement for password auth

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-576?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-576. -- Resolution: Not A Problem > Add superuser judgement for password auth > --

[jira] [Resolved] (AIRFLOW-554) Add Jinja templating support to Spark SQL Operator

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-554?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-554. Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/1828 > Add Jinja t

[jira] [Resolved] (AIRFLOW-500) github enterprise auth teams are implemented naively

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-500?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-500. Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/1788 > github ente

[GitHub] codecov-io edited a comment on issue #3839: [AIRFLOW-208] Add badge to show supported Python versions

2018-09-03 Thread GitBox
codecov-io edited a comment on issue #3839: [AIRFLOW-208] Add badge to show supported Python versions URL: https://github.com/apache/incubator-airflow/pull/3839#issuecomment-418203983 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3839?src=pr&el=h1) Report > Merging

[GitHub] codecov-io commented on issue #3839: [AIRFLOW-208] Add badge to show supported Python versions

2018-09-03 Thread GitBox
codecov-io commented on issue #3839: [AIRFLOW-208] Add badge to show supported Python versions URL: https://github.com/apache/incubator-airflow/pull/3839#issuecomment-418203983 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3839?src=pr&el=h1) Report > Merging [#3839]

[jira] [Closed] (AIRFLOW-501) Revert change from sqla one to first

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-501?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-501. -- Resolution: Implemented > Revert change from sqla one to first >

[jira] [Resolved] (AIRFLOW-469) Add MFG Labs as Airflow user

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-469. Resolution: Fixed https://github.com/apache/incubator-airflow/pull/1768 > Add MFG Labs as Airflow

[jira] [Resolved] (AIRFLOW-410) Improve the FAQ part of the docs

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-410?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-410. Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/1720 > Improve the

[jira] [Closed] (AIRFLOW-438) "airflow initdb" not working

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-438?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-438. -- Resolution: Not A Problem > "airflow initdb" not working > > >

[jira] [Resolved] (AIRFLOW-406) Syntax error in sphinx rst docstrings

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-406?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-406. Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/1717 > Syntax erro

[jira] [Resolved] (AIRFLOW-309) Add requirements of dependencies to CONTRIBUTING.md

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-309?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-309. Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/1647 > Add require

[jira] [Resolved] (AIRFLOW-273) Vectorized Logos

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-273?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-273. Resolution: Fixed Was resolved by https://github.com/apache/incubator-airflow/pull/1619 > Vectori

[jira] [Commented] (AIRFLOW-251) Add optional parameter SQL_ALCHEMY_SCHEMA to control schema for metadata repository

2018-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-251?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602477#comment-16602477 ] ASF GitHub Bot commented on AIRFLOW-251: kaxil closed pull request #1600: [AIRFL

[GitHub] kaxil closed pull request #1600: [AIRFLOW-251] Add option SQL_ALCHEMY_SCHEMA parameter to use SQL Server for metadata.

2018-09-03 Thread GitBox
kaxil closed pull request #1600: [AIRFLOW-251] Add option SQL_ALCHEMY_SCHEMA parameter to use SQL Server for metadata. URL: https://github.com/apache/incubator-airflow/pull/1600 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below

[jira] [Resolved] (AIRFLOW-219) Impersonation - Unix user impersonation task parameter

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-219?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-219. Resolution: Fixed Was Resolved by https://github.com/apache/incubator-airflow/pull/1934 > Imperso

[jira] [Resolved] (AIRFLOW-398) Option to use cgroups to limit task resource utilization

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-398?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-398. Resolution: Fixed Was Resolved by https://github.com/apache/incubator-airflow/pull/1934 > Option

[jira] [Updated] (AIRFLOW-208) Adding badge to README.md to show supported Python versions

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-208: --- Fix Version/s: 2.0.0 > Adding badge to README.md to show supported Python versions > ---

[jira] [Assigned] (AIRFLOW-208) Adding badge to README.md to show supported Python versions

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-208?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-208: -- Assignee: Kaxil Naik (was: Maxime Beauchemin) > Adding badge to README.md to show supported

[jira] [Commented] (AIRFLOW-208) Adding badge to README.md to show supported Python versions

2018-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602472#comment-16602472 ] ASF GitHub Bot commented on AIRFLOW-208: kaxil opened a new pull request #3839:

[GitHub] kaxil opened a new pull request #3839: [AIRFLOW-208] Add badge to show supported Python versions

2018-09-03 Thread GitBox
kaxil opened a new pull request #3839: [AIRFLOW-208] Add badge to show supported Python versions URL: https://github.com/apache/incubator-airflow/pull/3839 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues

[jira] [Resolved] (AIRFLOW-169) Hide expire dags in UI

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-169. Resolution: Not A Problem This can be achieved by turning the DAG off and changing the airflow.cfg

[jira] [Closed] (AIRFLOW-67) Dag is not avaialble on UI

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-67?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-67. - Resolution: Not A Problem Closing this as "Not a Problem" > Dag is not avaialble on UI > ---

[jira] [Comment Edited] (AIRFLOW-491) Add cache parameter in BigQuery query method

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602436#comment-16602436 ] Kaxil Naik edited comment on AIRFLOW-491 at 9/3/18 8:32 PM:

[GitHub] xnuinside commented on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
xnuinside commented on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-418189110 @kaxil , thank you for review! --

[jira] [Resolved] (AIRFLOW-491) Add cache parameter in BigQuery query method

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-491. Resolution: Fixed Fix Version/s: (was: 1.8.0) 2.0.0 Resolved by http

[jira] [Commented] (AIRFLOW-491) Add cache parameter in BigQuery query method

2018-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-491?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602435#comment-16602435 ] ASF GitHub Bot commented on AIRFLOW-491: kaxil closed pull request #3733: [AIRFL

[GitHub] kaxil commented on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
kaxil commented on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-418188961 Thanks @xnuinside for this great work. ---

[GitHub] kaxil closed pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
kaxil closed pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed be

[GitHub] codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-413105867 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3733?src=p

[GitHub] codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
codecov-io edited a comment on issue #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#issuecomment-413105867 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3733?src=p

[GitHub] xnuinside commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
xnuinside commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#discussion_r214749960 ## File path: airflow/contrib/hooks/bigquery_hook.py

[jira] [Resolved] (AIRFLOW-2938) Invalid 'extra' field in connection can raise an AttributeError when attempting to edit

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2938?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2938. - Resolution: Fixed Fix Version/s: 1.10.1 Resolved by https://github.com/apache/incubator-

[jira] [Updated] (AIRFLOW-2905) Switch to regional dataflow job service.

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2905?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2905: Fix Version/s: (was: 2.0.0) 1.10.1 > Switch to regional dataflow job servi

[jira] [Updated] (AIRFLOW-2907) Sendgrid - Attachments - ERROR - Object of type 'bytes' is not JSON serializable

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2907?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2907: Fix Version/s: (was: 2.0.0) 1.10.1 > Sendgrid - Attachments - ERROR - Obje

[jira] [Updated] (AIRFLOW-2893) Stuck dataflow job due to jobName mismatch.

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2893?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2893: Fix Version/s: (was: 2.0.0) 1.10.1 > Stuck dataflow job due to jobName mis

[jira] [Updated] (AIRFLOW-2860) DruidHook: time variable is not updated correctly when checking for timeout

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2860?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2860: Fix Version/s: (was: 2.0.0) 1.10.1 > DruidHook: time variable is not updat

[jira] [Resolved] (AIRFLOW-2786) Variables view fails to render if a variable has an empty key

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2786?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2786. - Resolution: Fixed Fix Version/s: 1.10.1 Resolved by https://github.com/apache/incubator-

[jira] [Updated] (AIRFLOW-1874) Support standard SQL in Check, ValueCheck and IntervalCheck BigQuery operators

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1874?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-1874: Fix Version/s: (was: 2.0.0) 1.10.1 > Support standard SQL in Check, ValueC

[jira] [Updated] (AIRFLOW-2763) No precheck mechanism in place during worker initialisation for the connection to metadata database

2018-09-03 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2763?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-2763: Fix Version/s: 1.10.1 > No precheck mechanism in place during worker initialisation for the > co

[GitHub] kaxil commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#discussion_r214747903 ## File path: airflow/contrib/hooks/bigquery_hook.py

[GitHub] kaxil commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs'

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3733: [AIRFLOW-491] Add cache parameter in BigQuery query method - with 'api_resource_configs' URL: https://github.com/apache/incubator-airflow/pull/3733#discussion_r214748001 ## File path: airflow/contrib/hooks/bigquery_hook.py

[GitHub] kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables URL: https://github.com/apache/incubator-airflow/pull/3838#discussion_r214747386 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -879,6 +893,11 @@ def run_loa

[GitHub] kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables URL: https://github.com/apache/incubator-airflow/pull/3838#discussion_r214747529 ## File path: airflow/contrib/operators/bigquery_operator.py ## @@ -93,6 +93,11 @@ class

[GitHub] kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables URL: https://github.com/apache/incubator-airflow/pull/3838#discussion_r214747514 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -943,6 +962,14 @@ def run_loa

[GitHub] kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables URL: https://github.com/apache/incubator-airflow/pull/3838#discussion_r214747467 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -548,7 +549,11 @@ def run_que

[GitHub] kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables URL: https://github.com/apache/incubator-airflow/pull/3838#discussion_r214747327 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -548,7 +549,11 @@ def run_que

[GitHub] kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables

2018-09-03 Thread GitBox
kaxil commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables URL: https://github.com/apache/incubator-airflow/pull/3838#discussion_r214746643 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -548,7 +549,11 @@ def run_que

[jira] [Assigned] (AIRFLOW-7) Unit test for ExternalTaskSensor depends on a different unit test

2018-09-03 Thread Ry Walker (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ry Walker reassigned AIRFLOW-7: --- Assignee: Ry Walker > Unit test for ExternalTaskSensor depends on a different unit test > ---

[jira] [Assigned] (AIRFLOW-7) Unit test for ExternalTaskSensor depends on a different unit test

2018-09-03 Thread Ry Walker (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-7?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ry Walker reassigned AIRFLOW-7: --- Assignee: (was: Ry Walker) > Unit test for ExternalTaskSensor depends on a different unit test >

[GitHub] Fokko commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables

2018-09-03 Thread GitBox
Fokko commented on a change in pull request #3838: [AIRFLOW-2997] Support for Bigquery clustered tables URL: https://github.com/apache/incubator-airflow/pull/3838#discussion_r214744783 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -943,6 +962,14 @@ def run_loa

[jira] [Commented] (AIRFLOW-2866) Missing CSRF Token Error on Web RBAC UI Create/Update Operations

2018-09-03 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602389#comment-16602389 ] ASF GitHub Bot commented on AIRFLOW-2866: - Fokko closed pull request #3804: [AI

[GitHub] Fokko closed pull request #3804: [AIRFLOW-2866] Fix missing CSRF token header when using RBAC UI

2018-09-03 Thread GitBox
Fokko closed pull request #3804: [AIRFLOW-2866] Fix missing CSRF token header when using RBAC UI URL: https://github.com/apache/incubator-airflow/pull/3804 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of prove

[jira] [Resolved] (AIRFLOW-2866) Missing CSRF Token Error on Web RBAC UI Create/Update Operations

2018-09-03 Thread Fokko Driesprong (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Fokko Driesprong resolved AIRFLOW-2866. --- Resolution: Fixed Fix Version/s: 1.10.1 > Missing CSRF Token Error on Web RB

[GitHub] Fokko commented on issue #3767: [AIRFLOW-2524]Add SageMaker Batch Inference

2018-09-03 Thread GitBox
Fokko commented on issue #3767: [AIRFLOW-2524]Add SageMaker Batch Inference URL: https://github.com/apache/incubator-airflow/pull/3767#issuecomment-418174664 @troychen728 can you shed a light on the error @schipiga is encountering? -

[GitHub] Fokko commented on a change in pull request #3767: [AIRFLOW-2524]Add SageMaker Batch Inference

2018-09-03 Thread GitBox
Fokko commented on a change in pull request #3767: [AIRFLOW-2524]Add SageMaker Batch Inference URL: https://github.com/apache/incubator-airflow/pull/3767#discussion_r214744389 ## File path: airflow/contrib/sensors/sagemaker_transform_sensor.py ## @@ -0,0 +1,67 @@ +# -*- co

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214703526 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214702197 ## File path: airflow/contrib/operators/s3_copy_object_operator.py ## @@ -0,0 +1,129

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214702044 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0 +1,

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214702135 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0 +1,

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214696318 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214695125 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214695125 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214694659 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214692209 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0

[GitHub] codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417296502 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3823?src=pr&el=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
codecov-io edited a comment on issue #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-417296502 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3823?src=pr&el=h1) Report > Merging

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214691985 ## File path: airflow/contrib/operators/s3_copy_object_operator.py ## @@ -0,0 +1,

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214691589 ## File path: airflow/contrib/operators/s3_copy_object_operator.py ## @@ -0,0 +1,

[GitHub] XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214690977 ## File path: airflow/contrib/operators/s3_copy_object_operator.py ## @@ -0,0 +1,

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214689382 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0 +1,

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214284433 ## File path: airflow/contrib/operators/s3_copy_object_operator.py ## @@ -0,0 +1,129

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214282264 ## File path: airflow/contrib/operators/s3_copy_object_operator.py ## @@ -0,0 +1,129

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214688527 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0 +1,

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214688794 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0 +1,

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214688405 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0 +1,

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214688589 ## File path: airflow/contrib/operators/s3_delete_objects_operator.py ## @@ -0,0 +1,

[GitHub] ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
ashb commented on a change in pull request #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#discussion_r214284262 ## File path: airflow/contrib/operators/s3_copy_object_operator.py ## @@ -0,0 +1,129

[jira] [Updated] (AIRFLOW-2642) [kubernetes executor worker] the value of git-sync init container ENV GIT_SYNC_ROOT is wrong

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2642: --- Affects Version/s: (was: 1.10) (was: 2.0.0)

[jira] [Updated] (AIRFLOW-2746) UI shows error while there is no error.

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2746?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2746: --- Fix Version/s: (was: 1.10) (was: 2.0.0) > UI shows error

[jira] [Updated] (AIRFLOW-2985) Operators for S3 object copying/deleting [boto3.client.copy_object()/delete_object()]

2018-09-03 Thread Xiaodong DENG (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-2985: --- Description: Currently we don't have an operator in Airflow to help copy/delete objects wit

[jira] [Closed] (AIRFLOW-2727) Utils functions to create and delete connections

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2727?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor closed AIRFLOW-2727. -- Resolution: Incomplete Fix Version/s: (was: 1.10) Closed due to lack of re

[jira] [Updated] (AIRFLOW-2985) Operators for S3 object copying/deleting [boto3.client.copy_object()/delete_object()]

2018-09-03 Thread Xiaodong DENG (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2985?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaodong DENG updated AIRFLOW-2985: --- Summary: Operators for S3 object copying/deleting [boto3.client.copy_object()/delete_object

[jira] [Updated] (AIRFLOW-2882) Add import and export for pool cli using JSON

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2882: --- Affects Version/s: 1.10.0 Fix Version/s: (was: 1.10) > Add import and e

[jira] [Updated] (AIRFLOW-2724) Change the background color of running DAG to green

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2724?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2724: --- Fix Version/s: (was: 1.10) (was: 2.0.0) > Change the bac

[jira] [Resolved] (AIRFLOW-2496) v1-10-test branch reports version 2.0 instead of 1.10

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2496?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-2496. Resolution: Fixed Fix Version/s: (was: 1.10) 1.10.0

[jira] [Resolved] (AIRFLOW-1197) Contrib Spark Submit Hook on_kill error

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1197?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-1197. Resolution: Fixed Fix Version/s: (was: 1.10.0) 1.9.0

[jira] [Resolved] (AIRFLOW-2295) Correct license headers

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2295?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-2295. Resolution: Fixed > Correct license headers > --- > >

[jira] [Resolved] (AIRFLOW-2294) Fix missing sub dependency licenses

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2294?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-2294. Resolution: Fixed > Fix missing sub dependency licenses > ---

[GitHub] XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting

2018-09-03 Thread GitBox
XD-DENG commented on issue #3823: [AIRFLOW-2985] An operator for S3 object copying/deleting URL: https://github.com/apache/incubator-airflow/pull/3823#issuecomment-418109266 I have added another commit into this PR, which is another new operator providing feature to delete object from S3

[jira] [Commented] (AIRFLOW-2902) Add S3ToBigQuery operator

2018-09-03 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2902?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16602141#comment-16602141 ] jack commented on AIRFLOW-2902: --- [~ashb] Maybe this could be used as reference? https:/

[jira] [Updated] (AIRFLOW-2784) Don't allow to create two Connections with same name but different types.

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2784: --- Description: Currently, airflow allow to create two Connections with the same name

[jira] [Reopened] (AIRFLOW-2784) Don't allow to create two CONNECTIONS with same name

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2784?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor reopened AIRFLOW-2784: Two connections of different types doesn't make sense, this is true! > Don't allow t

[jira] [Updated] (AIRFLOW-2866) Missing CSRF Token Error on Web RBAC UI Create/Update Operations

2018-09-03 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-2866: --- Summary: Missing CSRF Token Error on Web RBAC UI Create/Update Operations (was: Mi

  1   2   >