[jira] [Created] (AIRFLOW-6876) Add method to BigQueryHook and corresponding operator to get tables

2020-02-21 Thread Joel Croteau (Jira)
Joel Croteau created AIRFLOW-6876: - Summary: Add method to BigQueryHook and corresponding operator to get tables Key: AIRFLOW-6876 URL: https://issues.apache.org/jira/browse/AIRFLOW-6876 Project: Apac

[jira] [Updated] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-07 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau updated AIRFLOW-4453: -- Attachment: 3_step.png > none_failed trigger rule cascading skipped state to downstream tasks

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-07 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010257#comment-17010257 ] Joel Croteau commented on AIRFLOW-4453: --- [~kamil.bregula], added an extra step wi

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-07 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010232#comment-17010232 ] Joel Croteau commented on AIRFLOW-4453: --- The problem seems to be [this code|http

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-07 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17010208#comment-17010208 ] Joel Croteau commented on AIRFLOW-4453: --- [~kamil.bregula], this ticket is about a

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-02 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007203#comment-17007203 ] Joel Croteau commented on AIRFLOW-4453: --- I can actually reproduce this on 1.10.3

[jira] [Updated] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-02 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau updated AIRFLOW-4453: -- Attachment: simple_skip.png > none_failed trigger rule cascading skipped state to downstream

[jira] [Commented] (AIRFLOW-4453) none_failed trigger rule cascading skipped state to downstream tasks

2020-01-02 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4453?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007170#comment-17007170 ] Joel Croteau commented on AIRFLOW-4453: --- [https://xkcd.com/979/.|https://xkcd.com

[jira] [Created] (AIRFLOW-5635) Add expiration_time option to BigQueryCreateEmptyTableOperator and BigQueryCreateExternalTableOperator

2019-10-10 Thread Joel Croteau (Jira)
Joel Croteau created AIRFLOW-5635: - Summary: Add expiration_time option to BigQueryCreateEmptyTableOperator and BigQueryCreateExternalTableOperator Key: AIRFLOW-5635 URL: https://issues.apache.org/jira/browse/AIRF

[jira] [Updated] (AIRFLOW-5046) Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom

2019-10-08 Thread Joel Croteau (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau updated AIRFLOW-5046: -- Priority: Major (was: Minor) > Allow GoogleCloudStorageToBigQueryOperator to accept source_o

[jira] [Created] (AIRFLOW-5612) Add ability to actually do things with created and modified date in GoogleCloudStorageHook

2019-10-07 Thread Joel Croteau (Jira)
Joel Croteau created AIRFLOW-5612: - Summary: Add ability to actually do things with created and modified date in GoogleCloudStorageHook Key: AIRFLOW-5612 URL: https://issues.apache.org/jira/browse/AIRFLOW-5612

[jira] [Created] (AIRFLOW-5611) Add ability to specify a maximum modified time for objects in GoogleCloudStorageToGoogleCloudStorageOperator

2019-10-07 Thread Joel Croteau (Jira)
Joel Croteau created AIRFLOW-5611: - Summary: Add ability to specify a maximum modified time for objects in GoogleCloudStorageToGoogleCloudStorageOperator Key: AIRFLOW-5611 URL: https://issues.apache.org/jira/brows

[jira] [Created] (AIRFLOW-5610) Add ability to specify multiple objects to copy to GoogleCloudStorageToGoogleCloudStorageOperator

2019-10-07 Thread Joel Croteau (Jira)
Joel Croteau created AIRFLOW-5610: - Summary: Add ability to specify multiple objects to copy to GoogleCloudStorageToGoogleCloudStorageOperator Key: AIRFLOW-5610 URL: https://issues.apache.org/jira/browse/AIRFLOW-5

[jira] [Created] (AIRFLOW-5281) GCP transfer operators do not detect previous successful runs if interrupted

2019-08-21 Thread Joel Croteau (Jira)
Joel Croteau created AIRFLOW-5281: - Summary: GCP transfer operators do not detect previous successful runs if interrupted Key: AIRFLOW-5281 URL: https://issues.apache.org/jira/browse/AIRFLOW-5281 Proj

[jira] [Created] (AIRFLOW-5116) Provide useful error messages from S3DeleteObjectsOperator

2019-08-05 Thread Joel Croteau (JIRA)
Joel Croteau created AIRFLOW-5116: - Summary: Provide useful error messages from S3DeleteObjectsOperator Key: AIRFLOW-5116 URL: https://issues.apache.org/jira/browse/AIRFLOW-5116 Project: Apache Airflow

[jira] [Created] (AIRFLOW-5114) TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments

2019-08-05 Thread Joel Croteau (JIRA)
Joel Croteau created AIRFLOW-5114: - Summary: TypeError when running S3ToGoogleCloudStorageTransferOperator or GoogleCloudStorageToGoogleCloudStorageTransferOperator with default arguments Key: AIRFLOW-5114 URL: h

[jira] [Assigned] (AIRFLOW-5104) "Schedule was not specified." error from GCS API when using gcp_transfer_operator.S3ToGoogleCloudStorageTransferOperator without specifying a schedule

2019-08-03 Thread Joel Croteau (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau reassigned AIRFLOW-5104: - Assignee: Joel Croteau > "Schedule was not specified." error from GCS API when using

[jira] [Comment Edited] (AIRFLOW-5046) Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom

2019-08-03 Thread Joel Croteau (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894725#comment-16894725 ] Joel Croteau edited comment on AIRFLOW-5046 at 8/3/19 5:00 PM: --

[jira] [Updated] (AIRFLOW-5104) "Schedule was not specified." error from GCS API when using gcp_transfer_operator.S3ToGoogleCloudStorageTransferOperator without specifying a schedule

2019-08-02 Thread Joel Croteau (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5104?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau updated AIRFLOW-5104: -- Description:  The docstring for `airflow.contrib.operators.gcp_transfer_operator.S3ToGoogleC

[jira] [Created] (AIRFLOW-5104) "Schedule was not specified." error from GCS API when using gcp_transfer_operator.S3ToGoogleCloudStorageTransferOperator without specifying a schedule

2019-08-02 Thread Joel Croteau (JIRA)
Joel Croteau created AIRFLOW-5104: - Summary: "Schedule was not specified." error from GCS API when using gcp_transfer_operator.S3ToGoogleCloudStorageTransferOperator without specifying a schedule Key: AIRFLOW-5104

[jira] [Commented] (AIRFLOW-5046) Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom

2019-07-28 Thread Joel Croteau (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894725#comment-16894725 ] Joel Croteau commented on AIRFLOW-5046: --- [~m1racoli], I would agree that the thir

[jira] [Created] (AIRFLOW-5046) Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom

2019-07-25 Thread Joel Croteau (JIRA)
Joel Croteau created AIRFLOW-5046: - Summary: Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom Key: AIRFLOW-5046 URL: https://issues.apache.org/jira/

[jira] [Created] (AIRFLOW-4408) Add template expansion support to properties arguments for DataProc operators

2019-04-24 Thread Joel Croteau (JIRA)
Joel Croteau created AIRFLOW-4408: - Summary: Add template expansion support to properties arguments for DataProc operators Key: AIRFLOW-4408 URL: https://issues.apache.org/jira/browse/AIRFLOW-4408 Pro

[jira] [Assigned] (AIRFLOW-3143) Support auto-zone in DataprocClusterCreateOperator

2019-04-23 Thread Joel Croteau (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3143?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joel Croteau reassigned AIRFLOW-3143: - Assignee: Joel Croteau (was: fengya li) > Support auto-zone in DataprocClusterCreateO