[ https://issues.apache.org/jira/browse/AIRFLOW-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
jack updated AIRFLOW-3278: -------------------------- Description: gzip flag was added to GoogleCloudStorageHook by PR: [https://issues.apache.org/jira/browse/AIRFLOW-2932|https://github.com/apache/incubator-airflow/pull/3893] Operators interact with the hook that upload files to storage can use this property to compress the file. *Needs to modify following operators to support the gzip flag:* ||Operator Name||Status||Notes|| |S3ToGoogleCloudStorageOperator| | | |PostgresToGoogleCloudStorageOperator| | | |CassandraToGoogleCloudStorageOperator| | | |MySqlToGoogleCloudStorageOperator| | | |GoogleCloudStorageToGoogleCloudStorageOperator | |can be used to convert non gzip file to gzip| |FileToGoogleCloudStorageOperator|Done|[https://issues.apache.org/jira/browse/AIRFLOW-2932|https://github.com/apache/incubator-airflow/pull/3893]| |BigQueryToCloudStorageOperator |Done|has separated compression flag| |AdlsToGoogleCloudStorageOperator| | | |MsSqlToGoogleCloudStorageOperator|Done|https://issues.apache.org/jira/browse/AIRFLOW-4268| was: gzip flag was added to GoogleCloudStorageHook by PR: [https://issues.apache.org/jira/browse/AIRFLOW-2932|https://github.com/apache/incubator-airflow/pull/3893] Operators interact with the hook that upload files to storage can use this property to compress the file. *Needs to modify following operators to support the gzip flag:* ||Operator Name||Status||Notes|| |S3ToGoogleCloudStorageOperator| | | |PostgresToGoogleCloudStorageOperator| | | |CassandraToGoogleCloudStorageOperator| | | |MySqlToGoogleCloudStorageOperator| | | |GoogleCloudStorageToGoogleCloudStorageOperator | |can be used to convert non gzip file to gzip| |FileToGoogleCloudStorageOperator|Done|[https://issues.apache.org/jira/browse/AIRFLOW-2932|https://github.com/apache/incubator-airflow/pull/3893]| |BigQueryToCloudStorageOperator |Done|has separated compression flag| |AdlsToGoogleCloudStorageOperator| | | Summary: GZIP support for Operators loading to GCS (was: Operators loading to GCS to support GZIP) > GZIP support for Operators loading to GCS > ----------------------------------------- > > Key: AIRFLOW-3278 > URL: https://issues.apache.org/jira/browse/AIRFLOW-3278 > Project: Apache Airflow > Issue Type: Task > Affects Versions: 1.10.0 > Reporter: jack > Priority: Major > > gzip flag was added to GoogleCloudStorageHook by PR: > [https://issues.apache.org/jira/browse/AIRFLOW-2932|https://github.com/apache/incubator-airflow/pull/3893] > Operators interact with the hook that upload files to storage can use this > property to compress the file. > > *Needs to modify following operators to support the gzip flag:* > > ||Operator Name||Status||Notes|| > |S3ToGoogleCloudStorageOperator| | | > |PostgresToGoogleCloudStorageOperator| | | > |CassandraToGoogleCloudStorageOperator| | | > |MySqlToGoogleCloudStorageOperator| | | > |GoogleCloudStorageToGoogleCloudStorageOperator | |can be used to convert non > gzip file to gzip| > |FileToGoogleCloudStorageOperator|Done|[https://issues.apache.org/jira/browse/AIRFLOW-2932|https://github.com/apache/incubator-airflow/pull/3893]| > |BigQueryToCloudStorageOperator |Done|has separated compression flag| > |AdlsToGoogleCloudStorageOperator| | | > |MsSqlToGoogleCloudStorageOperator|Done|https://issues.apache.org/jira/browse/AIRFLOW-4268| > > -- This message was sent by Atlassian JIRA (v7.6.3#76005)