[GitHub] [airflow] potiuk commented on issue #4763: [AIRFLOW-3946] Deprecate utils.file.TemporaryDirectory

2019-09-06 Thread GitBox
potiuk commented on issue #4763: [AIRFLOW-3946] Deprecate utils.file.TemporaryDirectory URL: https://github.com/apache/airflow/pull/4763#issuecomment-528738796 Hey @BasPH -> i marked all those issues as 'pinned' - and for commiters this is the best way to mark task as "not stale-able' :)

[GitHub] [airflow] bharathpalaksha closed pull request #6024: AIRFLOW-5419 - Marking task failed doesn't kill the task - https://issues.apache.org/jira/browse/AIRFLOW-5419

2019-09-06 Thread GitBox
bharathpalaksha closed pull request #6024: AIRFLOW-5419 - Marking task failed doesn't kill the task - https://issues.apache.org/jira/browse/AIRFLOW-5419 URL: https://github.com/apache/airflow/pull/6024 This is an automated m

[jira] [Commented] (AIRFLOW-5419) Marking task failed doesn't kill the task when it is run through impersonation(run_as_user)

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924011#comment-16924011 ] ASF GitHub Bot commented on AIRFLOW-5419: - bharathpalaksha commented on pull re

[GitHub] [airflow] bharathpalaksha opened a new pull request #6026: AIRFLOW-5419 - Marking task failed doesn't kill the task - https://issues.apache.org/jira/browse/AIRFLOW-5419

2019-09-06 Thread GitBox
bharathpalaksha opened a new pull request #6026: AIRFLOW-5419 - Marking task failed doesn't kill the task - https://issues.apache.org/jira/browse/AIRFLOW-5419 URL: https://github.com/apache/airflow/pull/6026 Marking task failed doesn't kill task, when it is run through impersonation(run_a

[jira] [Commented] (AIRFLOW-5419) Marking task failed doesn't kill the task when it is run through impersonation(run_as_user)

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5419?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924021#comment-16924021 ] ASF GitHub Bot commented on AIRFLOW-5419: - bharathpalaksha commented on pull re

[jira] [Created] (AIRFLOW-5420) README.md update

2019-09-06 Thread Bharath Palaksha (Jira)
Bharath Palaksha created AIRFLOW-5420: - Summary: README.md update Key: AIRFLOW-5420 URL: https://issues.apache.org/jira/browse/AIRFLOW-5420 Project: Apache Airflow Issue Type: Improvement

[GitHub] [airflow] bharathpalaksha closed pull request #6025: Adding walmart labs to the official companies list

2019-09-06 Thread GitBox
bharathpalaksha closed pull request #6025: Adding walmart labs to the official companies list URL: https://github.com/apache/airflow/pull/6025 This is an automated message from the Apache Git Service. To respond to the messa

[GitHub] [airflow] bharathpalaksha opened a new pull request #6027: [AIRFLOW-5420] - Adding walmart labs as user

2019-09-06 Thread GitBox
bharathpalaksha opened a new pull request #6027: [AIRFLOW-5420] - Adding walmart labs as user URL: https://github.com/apache/airflow/pull/6027 ### Jira - [ ] https://issues.apache.org/jira/browse/AIRFLOW-5420 ### Description - [ ] OK ### Tests - [ ] OK

[jira] [Commented] (AIRFLOW-5420) README.md update

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924035#comment-16924035 ] ASF GitHub Bot commented on AIRFLOW-5420: - bharathpalaksha commented on pull re

[GitHub] [airflow] ashb commented on issue #6027: [AIRFLOW-5420] - Adding walmart labs as user

2019-09-06 Thread GitBox
ashb commented on issue #6027: [AIRFLOW-5420] - Adding walmart labs as user URL: https://github.com/apache/airflow/pull/6027#issuecomment-528763679 :wave: Welcome! This is an automated message from the Apache Git Service. To r

[GitHub] [airflow] ashb merged pull request #6027: [AIRFLOW-5420] - Adding walmart labs as user

2019-09-06 Thread GitBox
ashb merged pull request #6027: [AIRFLOW-5420] - Adding walmart labs as user URL: https://github.com/apache/airflow/pull/6027 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Deleted] (AIRFLOW-5420) README.md update

2019-09-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor deleted AIRFLOW-5420: --- > README.md update > > > Key: AIRFLOW-5420 >

[jira] [Commented] (AIRFLOW-5420) README.md update

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5420?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924043#comment-16924043 ] ASF GitHub Bot commented on AIRFLOW-5420: - ashb commented on pull request #6027

[GitHub] [airflow] nuclearpinguin commented on issue #5720: [AIRFLOW-5099] Implement Google Cloud AutoML operators

2019-09-06 Thread GitBox
nuclearpinguin commented on issue #5720: [AIRFLOW-5099] Implement Google Cloud AutoML operators URL: https://github.com/apache/airflow/pull/5720#issuecomment-528766183 @Ark-kun here is our internal repo with generators for GCP stuff: https://github.com/PolideaInternal/airflow-munchkin

[jira] [Commented] (AIRFLOW-5343) pool_pre_ping support for SQLAlchemy connection

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924069#comment-16924069 ] ASF GitHub Bot commented on AIRFLOW-5343: - ashb commented on pull request #5949

[GitHub] [airflow] ashb merged pull request #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy

2019-09-06 Thread GitBox
ashb merged pull request #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy URL: https://github.com/apache/airflow/pull/5949 This is an automated message from the Apache Git Service. To respond to the message, please log o

[jira] [Commented] (AIRFLOW-5343) pool_pre_ping support for SQLAlchemy connection

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924070#comment-16924070 ] ASF subversion and git services commented on AIRFLOW-5343: -- Co

[jira] [Commented] (AIRFLOW-5343) pool_pre_ping support for SQLAlchemy connection

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924071#comment-16924071 ] ASF subversion and git services commented on AIRFLOW-5343: -- Co

[jira] [Created] (AIRFLOW-5421) Request for PrestoToGoogleStorageOperator

2019-09-06 Thread HaloKu (Jira)
HaloKu created AIRFLOW-5421: --- Summary: Request for PrestoToGoogleStorageOperator Key: AIRFLOW-5421 URL: https://issues.apache.org/jira/browse/AIRFLOW-5421 Project: Apache Airflow Issue Type: Wish

[jira] [Resolved] (AIRFLOW-5343) pool_pre_ping support for SQLAlchemy connection

2019-09-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5343?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-5343. Fix Version/s: 1.10.6 Resolution: Done > pool_pre_ping support for SQLAlch

[jira] [Commented] (AIRFLOW-4991) 401 Unauthorized in read_pod() when EKS Kubernetes TaskInstance runs longer than 15 minutes

2019-09-06 Thread HaloKu (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924074#comment-16924074 ] HaloKu commented on AIRFLOW-4991: - I faced similar the same issue. I'll try your baypa

[jira] [Commented] (AIRFLOW-4991) 401 Unauthorized in read_pod() when EKS Kubernetes TaskInstance runs longer than 15 minutes

2019-09-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924076#comment-16924076 ] Ash Berlin-Taylor commented on AIRFLOW-4991: Possible duplicate/fixed by AI

[jira] [Comment Edited] (AIRFLOW-4991) 401 Unauthorized in read_pod() when EKS Kubernetes TaskInstance runs longer than 15 minutes

2019-09-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4991?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924076#comment-16924076 ] Ash Berlin-Taylor edited comment on AIRFLOW-4991 at 9/6/19 9:19 AM: -

[jira] [Updated] (AIRFLOW-5117) Airflow K8S not working with EKS when not deployed in cluster

2019-09-06 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5117?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-5117: --- Affects Version/s: (was: 2.0.0) 1.10.4 > Airflow K8S not

[jira] [Commented] (AIRFLOW-5295) DAG doesn't take the last value of XCOM

2019-09-06 Thread Pierrick Boitel (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5295?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924077#comment-16924077 ] Pierrick Boitel commented on AIRFLOW-5295: -- running_cluster is took from an Ai

[GitHub] [airflow] ashb commented on a change in pull request #6026: [AIRFLOW-5419] - Marking task failed doesn't kill the task when it is run through impersonation

2019-09-06 Thread GitBox
ashb commented on a change in pull request #6026: [AIRFLOW-5419] - Marking task failed doesn't kill the task when it is run through impersonation URL: https://github.com/apache/airflow/pull/6026#discussion_r321656029 ## File path: airflow/utils/helpers.py ## @@ -305,6 +305

[GitHub] [airflow] benjamingrenier commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-09-06 Thread GitBox
benjamingrenier commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-528792474 > Yes. Please do rebase on latest apache/master. Thanks, but how do you proceed to make that proper

[GitHub] [airflow] bharathpalaksha commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy

2019-09-06 Thread GitBox
bharathpalaksha commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy URL: https://github.com/apache/airflow/pull/5949#issuecomment-528796006 @Khrol setup_event_handlers(engine, reconnect_timeout) is already present at line 198 which is legacy way of handling pessim

[GitHub] [airflow] bharathpalaksha commented on a change in pull request #6026: [AIRFLOW-5419] - Use `sudo` to kill cleared tasks when running with impersonation

2019-09-06 Thread GitBox
bharathpalaksha commented on a change in pull request #6026: [AIRFLOW-5419] - Use `sudo` to kill cleared tasks when running with impersonation URL: https://github.com/apache/airflow/pull/6026#discussion_r321668345 ## File path: airflow/utils/helpers.py ## @@ -305,6 +305,9

[GitHub] [airflow] ashb commented on a change in pull request #6026: [AIRFLOW-5419] - Use `sudo` to kill cleared tasks when running with impersonation

2019-09-06 Thread GitBox
ashb commented on a change in pull request #6026: [AIRFLOW-5419] - Use `sudo` to kill cleared tasks when running with impersonation URL: https://github.com/apache/airflow/pull/6026#discussion_r321670076 ## File path: airflow/utils/helpers.py ## @@ -307,7 +308,7 @@ def on_t

[GitHub] [airflow] potiuk commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-09-06 Thread GitBox
potiuk commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-528799251 See CONTRIBUTING guide: https://github.com/apache/airflow/blob/master/CONTRIBUTING.md#pull-request-guidelines - i

[GitHub] [airflow] potiuk merged pull request #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests

2019-09-06 Thread GitBox
potiuk merged pull request #6018: [AIRFLOW-5412] Add get_conn/get_client to hooks tests URL: https://github.com/apache/airflow/pull/6018 This is an automated message from the Apache Git Service. To respond to the message, pl

[jira] [Commented] (AIRFLOW-5412) Add get_conn/get_client tests to hooks

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924114#comment-16924114 ] ASF subversion and git services commented on AIRFLOW-5412: -- Co

[jira] [Commented] (AIRFLOW-5412) Add get_conn/get_client tests to hooks

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924113#comment-16924113 ] ASF GitHub Bot commented on AIRFLOW-5412: - potiuk commented on pull request #60

[jira] [Commented] (AIRFLOW-5412) Add get_conn/get_client tests to hooks

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924115#comment-16924115 ] ASF subversion and git services commented on AIRFLOW-5412: -- Co

[jira] [Resolved] (AIRFLOW-5412) Add get_conn/get_client tests to hooks

2019-09-06 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5412?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5412. --- Fix Version/s: 2.0.0 Resolution: Fixed > Add get_conn/get_client tests to hooks > --

[GitHub] [airflow] potiuk commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE

2019-09-06 Thread GitBox
potiuk commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE URL: https://github.com/apache/airflow/pull/6002#issuecomment-528804751 rebase please @nuclearpinguin This is an automated mes

[GitHub] [airflow] potiuk merged pull request #5999: [AIRFLOW-XXX] Fix incorrect GCP integration sections

2019-09-06 Thread GitBox
potiuk merged pull request #5999: [AIRFLOW-XXX] Fix incorrect GCP integration sections URL: https://github.com/apache/airflow/pull/5999 This is an automated message from the Apache Git Service. To respond to the message, ple

[GitHub] [airflow] potiuk commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE

2019-09-06 Thread GitBox
potiuk commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE URL: https://github.com/apache/airflow/pull/6002#issuecomment-528805176 Rebase + pylint checks to fix @mik-laj :) This is an au

[GitHub] [airflow] potiuk merged pull request #5923: [AIRFLOW-5318] Option to specify location of the new BQ dataset

2019-09-06 Thread GitBox
potiuk merged pull request #5923: [AIRFLOW-5318] Option to specify location of the new BQ dataset URL: https://github.com/apache/airflow/pull/5923 This is an automated message from the Apache Git Service. To respond to the m

[jira] [Commented] (AIRFLOW-5318) BigQuery - Option to specify location when creating an empty dataset

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924126#comment-16924126 ] ASF GitHub Bot commented on AIRFLOW-5318: - potiuk commented on pull request #59

[jira] [Resolved] (AIRFLOW-5318) BigQuery - Option to specify location when creating an empty dataset

2019-09-06 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5318. --- Fix Version/s: 2.0.0 Resolution: Fixed > BigQuery - Option to specify location when

[jira] [Commented] (AIRFLOW-5318) BigQuery - Option to specify location when creating an empty dataset

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5318?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924127#comment-16924127 ] ASF subversion and git services commented on AIRFLOW-5318: -- Co

[GitHub] [airflow] potiuk merged pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator operator

2019-09-06 Thread GitBox
potiuk merged pull request #5822: [AIRFLOW-4758] Add GcsToGDriveOperator operator URL: https://github.com/apache/airflow/pull/5822 This is an automated message from the Apache Git Service. To respond to the message, please l

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924130#comment-16924130 ] ASF GitHub Bot commented on AIRFLOW-4758: - potiuk commented on pull request #58

[jira] [Resolved] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-09-06 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-4758. --- Fix Version/s: 2.0.0 Resolution: Fixed > Add GoogleCloudStorageToGoogleDrive Operato

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924131#comment-16924131 ] ASF subversion and git services commented on AIRFLOW-4758: -- Co

[jira] [Commented] (AIRFLOW-4758) Add GoogleCloudStorageToGoogleDrive Operator

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4758?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924132#comment-16924132 ] ASF subversion and git services commented on AIRFLOW-4758: -- Co

[GitHub] [airflow] potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement

2019-09-06 Thread GitBox
potiuk commented on issue #5770: [AIRFLOW-5162] GCS Hook Upload Method Improvement URL: https://github.com/apache/airflow/pull/5770#issuecomment-528807276 No worries @steven-freed - glad that you are contributing it :) This

[GitHub] [airflow] potiuk merged pull request #5769: [AIRFLOW-4964] Add BigQuery Data Transfer Hook and Operator

2019-09-06 Thread GitBox
potiuk merged pull request #5769: [AIRFLOW-4964] Add BigQuery Data Transfer Hook and Operator URL: https://github.com/apache/airflow/pull/5769 This is an automated message from the Apache Git Service. To respond to the messa

[jira] [Commented] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924136#comment-16924136 ] ASF subversion and git services commented on AIRFLOW-4964: -- Co

[jira] [Commented] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924134#comment-16924134 ] ASF GitHub Bot commented on AIRFLOW-4964: - potiuk commented on pull request #57

[jira] [Commented] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924135#comment-16924135 ] ASF subversion and git services commented on AIRFLOW-4964: -- Co

[jira] [Created] (AIRFLOW-5422) Add type annotations to GCP operators

2019-09-06 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5422: --- Summary: Add type annotations to GCP operators Key: AIRFLOW-5422 URL: https://issues.apache.org/jira/browse/AIRFLOW-5422 Project: Apache Airflow

[GitHub] [airflow] TobKed opened a new pull request #6028: [AIRFLOW-5422] Add type annotations to GCP operators

2019-09-06 Thread GitBox
TobKed opened a new pull request #6028: [AIRFLOW-5422] Add type annotations to GCP operators URL: https://github.com/apache/airflow/pull/6028 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/ji

[jira] [Commented] (AIRFLOW-5422) Add type annotations to GCP operators

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5422?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924142#comment-16924142 ] ASF GitHub Bot commented on AIRFLOW-5422: - TobKed commented on pull request #60

[jira] [Created] (AIRFLOW-5423) Type annotations for GCP sensors

2019-09-06 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5423: --- Summary: Type annotations for GCP sensors Key: AIRFLOW-5423 URL: https://issues.apache.org/jira/browse/AIRFLOW-5423 Project: Apache Airflow Iss

[GitHub] [airflow] TobKed opened a new pull request #6029: [AIRFLOW-5423] Type annotations for GCP sensors

2019-09-06 Thread GitBox
TobKed opened a new pull request #6029: [AIRFLOW-5423] Type annotations for GCP sensors URL: https://github.com/apache/airflow/pull/6029 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/br

[jira] [Commented] (AIRFLOW-5423) Type annotations for GCP sensors

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5423?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924148#comment-16924148 ] ASF GitHub Bot commented on AIRFLOW-5423: - TobKed commented on pull request #60

[jira] [Created] (AIRFLOW-5424) Type annotations for GCP hooks

2019-09-06 Thread Tobiasz Kedzierski (Jira)
Tobiasz Kedzierski created AIRFLOW-5424: --- Summary: Type annotations for GCP hooks Key: AIRFLOW-5424 URL: https://issues.apache.org/jira/browse/AIRFLOW-5424 Project: Apache Airflow Issue

[GitHub] [airflow] TobKed opened a new pull request #6030: [AIRFLOW-5424] Type annotations for GCP hooks

2019-09-06 Thread GitBox
TobKed opened a new pull request #6030: [AIRFLOW-5424] Type annotations for GCP hooks URL: https://github.com/apache/airflow/pull/6030 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/brow

[jira] [Commented] (AIRFLOW-5424) Type annotations for GCP hooks

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5424?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924159#comment-16924159 ] ASF GitHub Bot commented on AIRFLOW-5424: - TobKed commented on pull request #60

[GitHub] [airflow] potiuk opened a new pull request #6031: Fix pre commit noise and failing master

2019-09-06 Thread GitBox
potiuk opened a new pull request #6031: Fix pre commit noise and failing master URL: https://github.com/apache/airflow/pull/6031 This PR has to commits (will rebase rather than squash): Removes the noise for pre-commit tests: * [AIRFLOW-5411] Remove the noise produced while run

[jira] [Work started] (AIRFLOW-5411) Too much noise is printed during pre-commit checks

2019-09-06 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5411 started by Jarek Potiuk. - > Too much noise is printed during pre-commit checks > -

[GitHub] [airflow] potiuk commented on issue #5944: [AIRFLOW-5362] Reorder imports

2019-09-06 Thread GitBox
potiuk commented on issue #5944: [AIRFLOW-5362] Reorder imports URL: https://github.com/apache/airflow/pull/5944#issuecomment-528831538 OK. Sure. Let me merge my PR and you can redo yours afterwards. I am ok with one single commit for everything as well as linking it with pylint changes. B

[GitHub] [airflow] potiuk commented on issue #6031: Fix pre commit noise and failing master

2019-09-06 Thread GitBox
potiuk commented on issue #6031: Fix pre commit noise and failing master URL: https://github.com/apache/airflow/pull/6031#issuecomment-528833694 @mik-laj -> should we merge that before Travis is complete? With the nature of the changes and fact that master is broken we should merge it asap.

[jira] [Commented] (AIRFLOW-5411) Too much noise is printed during pre-commit checks

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924216#comment-16924216 ] ASF subversion and git services commented on AIRFLOW-5411: -- Co

[GitHub] [airflow] potiuk merged pull request #6031: Fix pre commit noise and failing master

2019-09-06 Thread GitBox
potiuk merged pull request #6031: Fix pre commit noise and failing master URL: https://github.com/apache/airflow/pull/6031 This is an automated message from the Apache Git Service. To respond to the message, please log on to

[jira] [Commented] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-09-06 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924217#comment-16924217 ] ASF subversion and git services commented on AIRFLOW-4964: -- Co

[GitHub] [airflow] Khrol commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy

2019-09-06 Thread GitBox
Khrol commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy URL: https://github.com/apache/airflow/pull/5949#issuecomment-528837690 @bharathpalaksha, that's interesting. It means we are observing something different on our local env. -

[GitHub] [airflow] ashb commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager

2019-09-06 Thread GitBox
ashb commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager URL: https://github.com/apache/airflow/pull/5998#discussion_r321713313 ## File path: airflow/contrib/example_dags/example_azure_cosmosdb_sensor.py ## @@ -41,24 +

[GitHub] [airflow] ashb commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager

2019-09-06 Thread GitBox
ashb commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager URL: https://github.com/apache/airflow/pull/5998#discussion_r321713401 ## File path: airflow/contrib/example_dags/example_azure_cosmosdb_sensor.py ## @@ -41,24 +

[GitHub] [airflow] Khrol commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy

2019-09-06 Thread GitBox
Khrol commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy URL: https://github.com/apache/airflow/pull/5949#issuecomment-528841556 Also does it mean we should remove legacy one and set `sql_alchemy_pool_pre_ping` to default as True? -

[GitHub] [airflow] eladkal commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager

2019-09-06 Thread GitBox
eladkal commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager URL: https://github.com/apache/airflow/pull/5998#discussion_r321721827 ## File path: airflow/contrib/example_dags/example_azure_cosmosdb_sensor.py ## @@ -41,2

[jira] [Created] (AIRFLOW-5425) Use logging not printing in LoggingCommandExecutor

2019-09-06 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-5425: Summary: Use logging not printing in LoggingCommandExecutor Key: AIRFLOW-5425 URL: https://issues.apache.org/jira/browse/AIRFLOW-5425 Project: Apache Airflow

[GitHub] [airflow] potiuk commented on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params

2019-09-06 Thread GitBox
potiuk commented on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params URL: https://github.com/apache/airflow/pull/6022#issuecomment-528852601 aaand rebase is needed :) This is an automated message from th

[GitHub] [airflow] potiuk removed a comment on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params

2019-09-06 Thread GitBox
potiuk removed a comment on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params URL: https://github.com/apache/airflow/pull/6022#issuecomment-528852601 aaand rebase is needed :) This is an automated message

[GitHub] [airflow] nuclearpinguin opened a new pull request #6032: [AIRFLOW-5425] Use logging not printing in LoggingCommandExecutor

2019-09-06 Thread GitBox
nuclearpinguin opened a new pull request #6032: [AIRFLOW-5425] Use logging not printing in LoggingCommandExecutor URL: https://github.com/apache/airflow/pull/6032 This will show proper message in log (yellow color) which will be harder to miss. Make sure you have checked _all_ steps

[GitHub] [airflow] potiuk commented on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params

2019-09-06 Thread GitBox
potiuk commented on issue #6022: [AIRFLOW-XXX] Add clarity to gcs_download_operator params URL: https://github.com/apache/airflow/pull/6022#issuecomment-528853028 Can you please rebase to latest apache/master @leahecole ? I think it will solve all the checks. -

[GitHub] [airflow] potiuk edited a comment on issue #6011: [AIRFLOW-2842] Add GoogleCloudStorageSynchronizeBuckets operator

2019-09-06 Thread GitBox
potiuk edited a comment on issue #6011: [AIRFLOW-2842] Add GoogleCloudStorageSynchronizeBuckets operator URL: https://github.com/apache/airflow/pull/6011#issuecomment-528436725 @mik-laj -> can you please rebase to latest master ?

[jira] [Commented] (AIRFLOW-5425) Use logging not printing in LoggingCommandExecutor

2019-09-06 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16924244#comment-16924244 ] ASF GitHub Bot commented on AIRFLOW-5425: - nuclearpinguin commented on pull req

[GitHub] [airflow] potiuk commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE

2019-09-06 Thread GitBox
potiuk commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE URL: https://github.com/apache/airflow/pull/6002#issuecomment-528853771 Can you please rebase @nuclearpinguin ? :) This is an a

[GitHub] [airflow] potiuk commented on issue #5957: [AIRFLOW-3511][AIRFLOW-3512] Add Cloud Memorystore integration

2019-09-06 Thread GitBox
potiuk commented on issue #5957: [AIRFLOW-3511][AIRFLOW-3512] Add Cloud Memorystore integration URL: https://github.com/apache/airflow/pull/5957#issuecomment-528854118 Travis is sad :( @mik-laj This is an automated message f

[GitHub] [airflow] potiuk commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-09-06 Thread GitBox
potiuk commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#issuecomment-528854661 Hey @jaketf - can you please rebase to the latest apache/master - there are a number of conflicts to be solved

[GitHub] [airflow] potiuk commented on a change in pull request #5566: [AIRFLOW-4935] Add method in the bigquery hook to list tables in a dataset

2019-09-06 Thread GitBox
potiuk commented on a change in pull request #5566: [AIRFLOW-4935] Add method in the bigquery hook to list tables in a dataset URL: https://github.com/apache/airflow/pull/5566#discussion_r321734925 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -1793,6 +1793,68

[GitHub] [airflow] potiuk commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next…

2019-09-06 Thread GitBox
potiuk commented on issue #5565: [AIRFLOW-4899] Fix get_dataset_list from bigquery hook to return next… URL: https://github.com/apache/airflow/pull/5565#issuecomment-528856468 Sam here @benjamingrenier -> we want to play nice and move the operators only after we merge outstanding requests

[GitHub] [airflow] potiuk commented on issue #5419: [AIRFLOW-XXXX] Update pydoc of mlengine_operator

2019-09-06 Thread GitBox
potiuk commented on issue #5419: [AIRFLOW-] Update pydoc of mlengine_operator URL: https://github.com/apache/airflow/pull/5419#issuecomment-528856929 @dossett -> we are in the middle of moving operators from contrib to core. It would be great if you rebase your change on top of apache

[GitHub] [airflow] nuclearpinguin commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE

2019-09-06 Thread GitBox
nuclearpinguin commented on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE URL: https://github.com/apache/airflow/pull/6002#issuecomment-528857602 Sure! I did it but I see some sad travis so I am running pre-commit on all files.

[GitHub] [airflow] potiuk commented on issue #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU

2019-09-06 Thread GitBox
potiuk commented on issue #4785: [AIRFLOW-3965] Fixing GoogleCloudStorageToBigQueryOperator failing for jobs outside US and EU URL: https://github.com/apache/airflow/pull/4785#issuecomment-528857720 Hey @lihan - it blocks us a bit from moving operators from contrib to core, so it would be

[GitHub] [airflow] nuclearpinguin edited a comment on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE

2019-09-06 Thread GitBox
nuclearpinguin edited a comment on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE URL: https://github.com/apache/airflow/pull/6002#issuecomment-528857602 Sure! I did it but I see a sad travis so I am running pre-commit on all files.

[GitHub] [airflow] nuclearpinguin edited a comment on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE

2019-09-06 Thread GitBox
nuclearpinguin edited a comment on issue #6002: [AIRFLOW-5401] Add support for project_id from connection in GKE URL: https://github.com/apache/airflow/pull/6002#issuecomment-528857602 Sure! I did it but I see some a travis so I am running pre-commit on all files. ---

[GitHub] [airflow] ashb commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager

2019-09-06 Thread GitBox
ashb commented on a change in pull request #5998: [AIRFLOW-5398] Update contrib example DAGs to context manager URL: https://github.com/apache/airflow/pull/5998#discussion_r321738411 ## File path: airflow/contrib/example_dags/example_azure_cosmosdb_sensor.py ## @@ -41,24 +

[GitHub] [airflow] potiuk commented on issue #4607: WIP: [AIRFLOW-1894] Google cloud bigquery

2019-09-06 Thread GitBox
potiuk commented on issue #4607: WIP: [AIRFLOW-1894] Google cloud bigquery URL: https://github.com/apache/airflow/pull/4607#issuecomment-528858322 @jmcarp - is it possible to rebase/complete the work on this one ? It blocks us from moving operators/hook from contrib to core - after we move

[GitHub] [airflow] potiuk commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR

2019-09-06 Thread GitBox
potiuk commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR URL: https://github.com/apache/airflow/pull/4064#issuecomment-528859821 Same here @dossett -> we are just moving from contrib to core and we would love to get this one rebased/merged.

[GitHub] [airflow] ashb commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy

2019-09-06 Thread GitBox
ashb commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy URL: https://github.com/apache/airflow/pull/5949#issuecomment-528860307 That possibly might make sense, yeah. Can you check the version of SQLA that added pool_pre_ping and check our version is >= to that ---

[GitHub] [airflow] ashb edited a comment on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy

2019-09-06 Thread GitBox
ashb edited a comment on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy URL: https://github.com/apache/airflow/pull/5949#issuecomment-528860307 That possibly might make sense, yeah. Can you check the version of SQLA that added pool_pre_ping and check our version is >= to that.

[GitHub] [airflow] mik-laj commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3

2019-09-06 Thread GitBox
mik-laj commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#issuecomment-528862947 Today, I will do it. This is an automated message from the Apache Git

[GitHub] [airflow] Khrol commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy

2019-09-06 Thread GitBox
Khrol commented on issue #5949: [AIRFLOW-5343] Add pool_pre_ping to SQLAlchemy URL: https://github.com/apache/airflow/pull/5949#issuecomment-528869760 @ashb Yes, we are good to go. I'll do a new PR. https://github.com/apache/airflow/blob/master/setup.py#L357 `'sqlalchemy~=1.3'`

[jira] [Created] (AIRFLOW-5426) Adjust import path in Dataproc example

2019-09-06 Thread Tomasz Urbaszek (Jira)
Tomasz Urbaszek created AIRFLOW-5426: Summary: Adjust import path in Dataproc example Key: AIRFLOW-5426 URL: https://issues.apache.org/jira/browse/AIRFLOW-5426 Project: Apache Airflow Iss

[GitHub] [airflow] nuclearpinguin opened a new pull request #6033: [AIRFLOW-5426] Adjust import path in Dataproc example

2019-09-06 Thread GitBox
nuclearpinguin opened a new pull request #6033: [AIRFLOW-5426] Adjust import path in Dataproc example URL: https://github.com/apache/airflow/pull/6033 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://issues.apac

  1   2   >