[GitHub] [airflow] durch commented on issue #5488: [AIRFLOW-4880] Add success, failure and fail_on_empty params to SqlSensor

durch commented on issue #5488: [AIRFLOW-4880] Add success, failure and fail_on_empty params to SqlSensor URL: https://github.com/apache/airflow/pull/5488#issuecomment-515740239 @pgagnon, @potiuk thank you both fur the feedback and the time you took! ---

[jira] [Commented] (AIRFLOW-5046) Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom

[ https://issues.apache.org/jira/browse/AIRFLOW-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894652#comment-16894652 ] Cedrik Neumann commented on AIRFLOW-5046: - Yeah, this problem - lists from xcom

[jira] [Comment Edited] (AIRFLOW-5046) Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom

[ https://issues.apache.org/jira/browse/AIRFLOW-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894652#comment-16894652 ] Cedrik Neumann edited comment on AIRFLOW-5046 at 7/28/19 8:35 AM: ---

[jira] [Commented] (AIRFLOW-3503) GoogleCloudStorageHook delete return success when nothing was done

[ https://issues.apache.org/jira/browse/AIRFLOW-3503?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894640#comment-16894640 ] jack commented on AIRFLOW-3503: --- [~Urbaszek] I think the difference is that you are delei

[jira] [Commented] (AIRFLOW-2154) Dataflow Operators do not inherit default_args

[ https://issues.apache.org/jira/browse/AIRFLOW-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894641#comment-16894641 ] jack commented on AIRFLOW-2154: --- [~higrys] have you noticed this? > Dataflow Operators d

[jira] [Created] (AIRFLOW-5059) Use .mypy_cache in CI builds to speed-up static checks

Jarek Potiuk created AIRFLOW-5059: - Summary: Use .mypy_cache in CI builds to speed-up static checks Key: AIRFLOW-5059 URL: https://issues.apache.org/jira/browse/AIRFLOW-5059 Project: Apache Airflow

[GitHub] [airflow] potiuk commented on issue #5664: [AIRFLOW-XXX] fix all missing type annotation errors from dmypy

potiuk commented on issue #5664: [AIRFLOW-XXX] fix all missing type annotation errors from dmypy URL: https://github.com/apache/airflow/pull/5664#issuecomment-515746094 That's an interesting one. Once I get breeze out, I will add mypyd as a default option for local development in breeze. I

[jira] [Created] (AIRFLOW-5058) Add support for dmypy (Mypy daemon) to Breeze environment

Jarek Potiuk created AIRFLOW-5058: - Summary: Add support for dmypy (Mypy daemon) to Breeze environment Key: AIRFLOW-5058 URL: https://issues.apache.org/jira/browse/AIRFLOW-5058 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-4825) BigQueryOperator execute a list of SQL queries doesn't work

[ https://issues.apache.org/jira/browse/AIRFLOW-4825?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894642#comment-16894642 ] jack commented on AIRFLOW-4825: --- Solved in https://issues.apache.org/jira/browse/AIRFLOW-

[jira] [Created] (AIRFLOW-5057) Provide bucket name to functions in S3 Hook when none is specified

Felix Uellendall created AIRFLOW-5057: - Summary: Provide bucket name to functions in S3 Hook when none is specified Key: AIRFLOW-5057 URL: https://issues.apache.org/jira/browse/AIRFLOW-5057 Projec

[GitHub] [airflow] feluelle opened a new pull request #5674: [AIRFLOW-5057] Provide bucket name to functions in S3 Hook when none is specified

feluelle opened a new pull request #5674: [AIRFLOW-5057] Provide bucket name to functions in S3 Hook when none is specified URL: https://github.com/apache/airflow/pull/5674 ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/jira/browse/AIRFLOW/) is

[jira] [Commented] (AIRFLOW-5057) Provide bucket name to functions in S3 Hook when none is specified

[ https://issues.apache.org/jira/browse/AIRFLOW-5057?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894662#comment-16894662 ] ASF GitHub Bot commented on AIRFLOW-5057: - feluelle commented on pull request #

[GitHub] [airflow] potiuk commented on issue #5633: [AIRFLOW-3189] fix DbAPI get_uri returns invalid uri if schema is None

potiuk commented on issue #5633: [AIRFLOW-3189] fix DbAPI get_uri returns invalid uri if schema is None URL: https://github.com/apache/airflow/pull/5633#issuecomment-515753939 Can you please add a unit test for that @eladkal ? --

[GitHub] [airflow] potiuk merged pull request #5669: [AIRFLOW-5053] Add support for configuring under-the-hood csv writer for handling special char, like double quote from json columns

potiuk merged pull request #5669: [AIRFLOW-5053] Add support for configuring under-the-hood csv writer for handling special char, like double quote from json columns URL: https://github.com/apache/airflow/pull/5669 This is

[GitHub] [airflow] potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators.

potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators. URL: https://github.com/apache/airflow/pull/5504#discussion_r307997235 ## File path: scripts/ci/pylint_todo.txt ## @@ -101,6 +101,7 @@ ./airflow/contrib/operators/mongo_to_

[GitHub] [airflow] potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators.

potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators. URL: https://github.com/apache/airflow/pull/5504#discussion_r307997235 ## File path: scripts/ci/pylint_todo.txt ## @@ -101,6 +101,7 @@ ./airflow/contrib/operators/mongo_to_

[GitHub] [airflow] potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators.

potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators. URL: https://github.com/apache/airflow/pull/5504#discussion_r307997235 ## File path: scripts/ci/pylint_todo.txt ## @@ -101,6 +101,7 @@ ./airflow/contrib/operators/mongo_to_

[jira] [Commented] (AIRFLOW-2154) Dataflow Operators do not inherit default_args

[ https://issues.apache.org/jira/browse/AIRFLOW-2154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894679#comment-16894679 ] Jarek Potiuk commented on AIRFLOW-2154: --- I think this is invalid. Something that

[GitHub] [airflow] potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators.

potiuk commented on a change in pull request #5504: [AIRFLOW-4869] Reorganize sql to gcs operators. URL: https://github.com/apache/airflow/pull/5504#discussion_r307998362 ## File path: airflow/contrib/operators/mysql_to_gcs.py ## @@ -170,139 +85,15 @@ def _query_mysql(self

[jira] [Commented] (AIRFLOW-3617) Kubernetes pod operator: Add support for specifying GPU resources/limits

[ https://issues.apache.org/jira/browse/AIRFLOW-3617?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894704#comment-16894704 ] ASF subversion and git services commented on AIRFLOW-3617: -- Co

[jira] [Commented] (AIRFLOW-4880) Allow for value based failure and success criteria in SqlSensor

[ https://issues.apache.org/jira/browse/AIRFLOW-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894705#comment-16894705 ] ASF subversion and git services commented on AIRFLOW-4880: -- Co

[jira] [Commented] (AIRFLOW-4880) Allow for value based failure and success criteria in SqlSensor

[ https://issues.apache.org/jira/browse/AIRFLOW-4880?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894706#comment-16894706 ] ASF subversion and git services commented on AIRFLOW-4880: -- Co

[jira] [Commented] (AIRFLOW-5053) Add support for configuring under-the-hood csv writer in MySqlToHiveTransfer Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894707#comment-16894707 ] ASF subversion and git services commented on AIRFLOW-5053: -- Co

[GitHub] [airflow] potiuk commented on a change in pull request #5671: [AIRFLOW-5049] Add validation for src_fmt_configs in bigquery hook

potiuk commented on a change in pull request #5671: [AIRFLOW-5049] Add validation for src_fmt_configs in bigquery hook URL: https://github.com/apache/airflow/pull/5671#discussion_r308003701 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -1199,11 +1185,26 @@ def

[GitHub] [airflow] potiuk merged pull request #5670: [AIRFLOW-XXX] Ignore rbac node_modules when running pylint

potiuk merged pull request #5670: [AIRFLOW-XXX] Ignore rbac node_modules when running pylint URL: https://github.com/apache/airflow/pull/5670 This is an automated message from the Apache Git Service. To respond to the messag

[GitHub] [airflow] potiuk commented on a change in pull request #5673: [AIRFLOW-4451] Allow templated named tuples

potiuk commented on a change in pull request #5673: [AIRFLOW-4451] Allow templated named tuples URL: https://github.com/apache/airflow/pull/5673#discussion_r308004916 ## File path: tests/operators/test_python_operator.py ## @@ -163,7 +170,8 @@ def test_python_callable_argu

[jira] [Commented] (AIRFLOW-5046) Allow GoogleCloudStorageToBigQueryOperator to accept source_objects as a string or otherwise take input from XCom

[ https://issues.apache.org/jira/browse/AIRFLOW-5046?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894725#comment-16894725 ] Joel Croteau commented on AIRFLOW-5046: --- [~m1racoli], I would agree that the thir

[jira] [Closed] (AIRFLOW-340) Unused Babel dependency

[ https://issues.apache.org/jira/browse/AIRFLOW-340?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Deldycke closed AIRFLOW-340. -- Resolution: Fixed > Unused Babel dependency > --- > > Key:

[jira] [Commented] (AIRFLOW-340) Unused Babel dependency

[ https://issues.apache.org/jira/browse/AIRFLOW-340?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894724#comment-16894724 ] Kevin Deldycke commented on AIRFLOW-340: Has been merged in [https://github.com

[jira] [Created] (AIRFLOW-5060) Add support of CatalogId to AwsGlueCatalogHook

Ilya Kisil created AIRFLOW-5060: --- Summary: Add support of CatalogId to AwsGlueCatalogHook Key: AIRFLOW-5060 URL: https://issues.apache.org/jira/browse/AIRFLOW-5060 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-5053) Add support for configuring under-the-hood csv writer in MySqlToHiveTransfer Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk updated AIRFLOW-5053: -- Fix Version/s: (was: 1.10.4) 2.0.0 > Add support for configuring under

[jira] [Closed] (AIRFLOW-439) Add Scaleway as an Airflow user.

[ https://issues.apache.org/jira/browse/AIRFLOW-439?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kevin Deldycke closed AIRFLOW-439. -- > Add Scaleway as an Airflow user. > > > Key: AIR

[jira] [Created] (AIRFLOW-5061) test_pod_resources in KubernetesPodOperatorTest does not have resources specified

Jarek Potiuk created AIRFLOW-5061: - Summary: test_pod_resources in KubernetesPodOperatorTest does not have resources specified Key: AIRFLOW-5061 URL: https://issues.apache.org/jira/browse/AIRFLOW-5061

[GitHub] [airflow] potiuk opened a new pull request #5675: [AIRFLOW-5061] Add resources specification to KubernetesPodTests

potiuk opened a new pull request #5675: [AIRFLOW-5061] Add resources specification to KubernetesPodTests URL: https://github.com/apache/airflow/pull/5675 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.a

[jira] [Commented] (AIRFLOW-5061) test_pod_resources in KubernetesPodOperatorTest does not have resources specified

[ https://issues.apache.org/jira/browse/AIRFLOW-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894753#comment-16894753 ] ASF GitHub Bot commented on AIRFLOW-5061: - potiuk commented on pull request #56

[GitHub] [airflow] potiuk closed pull request #5675: [AIRFLOW-5061] Add resources specification to KubernetesPodTests

potiuk closed pull request #5675: [AIRFLOW-5061] Add resources specification to KubernetesPodTests URL: https://github.com/apache/airflow/pull/5675 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] potiuk commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3

potiuk commented on issue #5602: [AIRFLOW-4983] Feature/dataflow operator python3 URL: https://github.com/apache/airflow/pull/5602#issuecomment-515785638 Thanks for making the tests parameterized @jaketf . I think conceptually, there is not much relation between the python version of Airfl

[GitHub] [airflow] potiuk merged pull request #5654: [AIRFLOW-4981][AIRFLOW-4788] Always use pendulum DateTimes in task in…

potiuk merged pull request #5654: [AIRFLOW-4981][AIRFLOW-4788] Always use pendulum DateTimes in task in… URL: https://github.com/apache/airflow/pull/5654 This is an automated message from the Apache Git Service. To respond t

[jira] [Commented] (AIRFLOW-4981) execution_date in macro is not a pendulum DateTime for fixed cron schedules

[ https://issues.apache.org/jira/browse/AIRFLOW-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894765#comment-16894765 ] ASF subversion and git services commented on AIRFLOW-4981: -- Co

[jira] [Commented] (AIRFLOW-4788) prev_execution_date is not always pendulum.datetime class

[ https://issues.apache.org/jira/browse/AIRFLOW-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894766#comment-16894766 ] ASF subversion and git services commented on AIRFLOW-4788: -- Co

[jira] [Commented] (AIRFLOW-4788) prev_execution_date is not always pendulum.datetime class

[ https://issues.apache.org/jira/browse/AIRFLOW-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894768#comment-16894768 ] ASF subversion and git services commented on AIRFLOW-4788: -- Co

[jira] [Commented] (AIRFLOW-4981) execution_date in macro is not a pendulum DateTime for fixed cron schedules

[ https://issues.apache.org/jira/browse/AIRFLOW-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894767#comment-16894767 ] ASF subversion and git services commented on AIRFLOW-4981: -- Co

[jira] [Commented] (AIRFLOW-4981) execution_date in macro is not a pendulum DateTime for fixed cron schedules

[ https://issues.apache.org/jira/browse/AIRFLOW-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894764#comment-16894764 ] ASF GitHub Bot commented on AIRFLOW-4981: - potiuk commented on pull request #56

[jira] [Commented] (AIRFLOW-4788) prev_execution_date is not always pendulum.datetime class

[ https://issues.apache.org/jira/browse/AIRFLOW-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894772#comment-16894772 ] ASF subversion and git services commented on AIRFLOW-4788: -- Co

[jira] [Commented] (AIRFLOW-4788) prev_execution_date is not always pendulum.datetime class

[ https://issues.apache.org/jira/browse/AIRFLOW-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894774#comment-16894774 ] ASF subversion and git services commented on AIRFLOW-4788: -- Co

[jira] [Commented] (AIRFLOW-4981) execution_date in macro is not a pendulum DateTime for fixed cron schedules

[ https://issues.apache.org/jira/browse/AIRFLOW-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894773#comment-16894773 ] ASF subversion and git services commented on AIRFLOW-4981: -- Co

[jira] [Resolved] (AIRFLOW-4788) prev_execution_date is not always pendulum.datetime class

[ https://issues.apache.org/jira/browse/AIRFLOW-4788?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-4788. --- Resolution: Fixed Fix Version/s: 1.10.4 > prev_execution_date is not always pendulum

[jira] [Resolved] (AIRFLOW-4981) execution_date in macro is not a pendulum DateTime for fixed cron schedules

[ https://issues.apache.org/jira/browse/AIRFLOW-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-4981. --- Resolution: Fixed Fix Version/s: 1.10.4 > execution_date in macro is not a pendulum

[jira] [Commented] (AIRFLOW-4981) execution_date in macro is not a pendulum DateTime for fixed cron schedules

[ https://issues.apache.org/jira/browse/AIRFLOW-4981?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894771#comment-16894771 ] ASF subversion and git services commented on AIRFLOW-4981: -- Co

[jira] [Commented] (AIRFLOW-5061) test_pod_resources in KubernetesPodOperatorTest does not have resources specified

[ https://issues.apache.org/jira/browse/AIRFLOW-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894759#comment-16894759 ] ASF GitHub Bot commented on AIRFLOW-5061: - potiuk commented on pull request #56

[jira] [Closed] (AIRFLOW-5061) test_pod_resources in KubernetesPodOperatorTest does not have resources specified

[ https://issues.apache.org/jira/browse/AIRFLOW-5061?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk closed AIRFLOW-5061. - Resolution: Invalid Not needed. It was a mistake. > test_pod_resources in KubernetesPodOperato

[jira] [Updated] (AIRFLOW-5060) Add support of CatalogId to AwsGlueCatalogHook

[ https://issues.apache.org/jira/browse/AIRFLOW-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Kisil updated AIRFLOW-5060: Description: h2. Use Case Imagine that you stream data into S3 bucket of an *account A* and upda

[GitHub] [airflow] potiuk commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE]

potiuk commented on issue #5659: [AIRFLOW-5033] Switched to snakebite-py3 [DO NOT MERGE] URL: https://github.com/apache/airflow/pull/5659#issuecomment-515789075 @bolkedebruin :)? Can you help with testing that? That would be a super-easy fix for last remaining issue preventing full switch

[jira] [Commented] (AIRFLOW-3489) PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL json properly

[ https://issues.apache.org/jira/browse/AIRFLOW-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894796#comment-16894796 ] Jarek Potiuk commented on AIRFLOW-3489: --- @jack  - I think the change from [~jmcar

[GitHub] [airflow] LesterKim opened a new pull request #5676: [AIRFLOW-5062] Add ACL and get object permission

LesterKim opened a new pull request #5676: [AIRFLOW-5062] Add ACL and get object permission URL: https://github.com/apache/airflow/pull/5676 ### Jira [AIRFLOW-5062](https://issues.apache.org/jira/browse/AIRFLOW-5062) Add ACL and get object permission ### Description Ad

[jira] [Created] (AIRFLOW-5062) Allow ACL header in S3 Hook

Lester kim created AIRFLOW-5062: --- Summary: Allow ACL header in S3 Hook Key: AIRFLOW-5062 URL: https://issues.apache.org/jira/browse/AIRFLOW-5062 Project: Apache Airflow Issue Type: New Feature

[jira] [Commented] (AIRFLOW-5062) Allow ACL header in S3 Hook

[ https://issues.apache.org/jira/browse/AIRFLOW-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894808#comment-16894808 ] ASF GitHub Bot commented on AIRFLOW-5062: - LesterKim commented on pull request

[GitHub] [airflow] houqp edited a comment on issue #5664: [AIRFLOW-XXX] fix all missing type annotation errors from dmypy

houqp edited a comment on issue #5664: [AIRFLOW-XXX] fix all missing type annotation errors from dmypy URL: https://github.com/apache/airflow/pull/5664#issuecomment-515657115 `dmypy` is usually 10x to 100x faster compared to `mypy` on subseqent runs. But like @mik-laj mentioned, they somet

[jira] [Commented] (AIRFLOW-4515) KubernetesExecutor hangs in the subdag context

[ https://issues.apache.org/jira/browse/AIRFLOW-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894822#comment-16894822 ] Steven Locke commented on AIRFLOW-4515: --- [~davlum] I definitely believe you, howe

[GitHub] [airflow] AetherUnbound commented on issue #5673: [AIRFLOW-4451] Allow templated named tuples

AetherUnbound commented on issue #5673: [AIRFLOW-4451] Allow templated named tuples URL: https://github.com/apache/airflow/pull/5673#issuecomment-515803313 @potiuk I can definitely move those test cases into a separate test, as well as ensure that the named tuple values are actually render

[GitHub] [airflow] AetherUnbound commented on issue #5673: [AIRFLOW-4451] Allow templated named tuples

AetherUnbound commented on issue #5673: [AIRFLOW-4451] Allow templated named tuples URL: https://github.com/apache/airflow/pull/5673#issuecomment-515803418 https://github.com/apache/airflow/blob/b5fb370446dab076713a7de3bc2cd0f8221d30df/tests/models/test_dag.py#L391 Ha, answered my own q

[jira] [Updated] (AIRFLOW-5060) Add support of CatalogId to AwsGlueCatalogHook

[ https://issues.apache.org/jira/browse/AIRFLOW-5060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ilya Kisil updated AIRFLOW-5060: Description: h2. Use Case Imagine that you stream data into S3 bucket of an *account A* and upda

[GitHub] [airflow] LesterKim commented on issue #5676: [AIRFLOW-5062] Add ACL and get object permission

LesterKim commented on issue #5676: [AIRFLOW-5062] Add ACL and get object permission URL: https://github.com/apache/airflow/pull/5676#issuecomment-515821026 #continuous-integration/travis-ci/pr This is an automated message fr

[GitHub] [airflow] LesterKim removed a comment on issue #5676: [AIRFLOW-5062] Add ACL and get object permission

LesterKim removed a comment on issue #5676: [AIRFLOW-5062] Add ACL and get object permission URL: https://github.com/apache/airflow/pull/5676#issuecomment-515821026 #continuous-integration/travis-ci/pr This is an automated me

[GitHub] [airflow] LesterKim closed pull request #5676: [AIRFLOW-5062] Add ACL and get object permission

LesterKim closed pull request #5676: [AIRFLOW-5062] Add ACL and get object permission URL: https://github.com/apache/airflow/pull/5676 This is an automated message from the Apache Git Service. To respond to the message, plea

[jira] [Commented] (AIRFLOW-5062) Allow ACL header in S3 Hook

[ https://issues.apache.org/jira/browse/AIRFLOW-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894870#comment-16894870 ] ASF GitHub Bot commented on AIRFLOW-5062: - LesterKim commented on pull request

[GitHub] [airflow] LesterKim opened a new pull request #5676: [AIRFLOW-5062] Add ACL and get object permission

LesterKim opened a new pull request #5676: [AIRFLOW-5062] Add ACL and get object permission URL: https://github.com/apache/airflow/pull/5676 ### Jira [AIRFLOW-5062](https://issues.apache.org/jira/browse/AIRFLOW-5062) Add ACL and get object permission ### Description Ad

[jira] [Commented] (AIRFLOW-5062) Allow ACL header in S3 Hook

[ https://issues.apache.org/jira/browse/AIRFLOW-5062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894871#comment-16894871 ] ASF GitHub Bot commented on AIRFLOW-5062: - LesterKim commented on pull request

[jira] [Commented] (AIRFLOW-5053) Add support for configuring under-the-hood csv writer in MySqlToHiveTransfer Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894683#comment-16894683 ] ASF subversion and git services commented on AIRFLOW-5053: -- Co

[GitHub] [airflow] potiuk commented on a change in pull request #5676: [AIRFLOW-5062] Add ACL and get object permission

potiuk commented on a change in pull request #5676: [AIRFLOW-5062] Add ACL and get object permission URL: https://github.com/apache/airflow/pull/5676#discussion_r308057163 ## File path: airflow/hooks/S3_hook.py ## @@ -318,7 +318,8 @@ def load_file(self,

[jira] [Commented] (AIRFLOW-5053) Add support for configuring under-the-hood csv writer in MySqlToHiveTransfer Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894681#comment-16894681 ] ASF GitHub Bot commented on AIRFLOW-5053: - potiuk commented on pull request #56

[jira] [Commented] (AIRFLOW-5053) Add support for configuring under-the-hood csv writer in MySqlToHiveTransfer Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894682#comment-16894682 ] ASF subversion and git services commented on AIRFLOW-5053: -- Co

[jira] [Resolved] (AIRFLOW-5053) Add support for configuring under-the-hood csv writer in MySqlToHiveTransfer Operator

[ https://issues.apache.org/jira/browse/AIRFLOW-5053?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarek Potiuk resolved AIRFLOW-5053. --- Resolution: Fixed Fix Version/s: 1.10.4 > Add support for configuring under-the-hood

[jira] [Commented] (AIRFLOW-3489) PostgresToGoogleCloudStorageOperator doesn't handle PostgreSQL json properly

[ https://issues.apache.org/jira/browse/AIRFLOW-3489?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894971#comment-16894971 ] jack commented on AIRFLOW-3489: --- [~higrys] mmm I don't have time to test it fully but if

[jira] [Created] (AIRFLOW-5063) When switching master <> v1-10-test performance of CI scripts drops dramatically

Jarek Potiuk created AIRFLOW-5063: - Summary: When switching master <> v1-10-test performance of CI scripts drops dramatically Key: AIRFLOW-5063 URL: https://issues.apache.org/jira/browse/AIRFLOW-5063

[GitHub] [airflow] potiuk opened a new pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10

potiuk opened a new pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10 URL: https://github.com/apache/airflow/pull/5677 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues

[jira] [Commented] (AIRFLOW-5063) When switching master <> v1-10-test performance of CI scripts drops dramatically

[ https://issues.apache.org/jira/browse/AIRFLOW-5063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894973#comment-16894973 ] ASF GitHub Bot commented on AIRFLOW-5063: - potiuk commented on pull request #56

[jira] [Commented] (AIRFLOW-4165) Add CSV file support to PostgresToGoogleCloudStorageOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894974#comment-16894974 ] jack commented on AIRFLOW-4165: --- Will be fixed in https://issues.apache.org/jira/browse/A

[jira] [Closed] (AIRFLOW-4165) Add CSV file support to PostgresToGoogleCloudStorageOperator

[ https://issues.apache.org/jira/browse/AIRFLOW-4165?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-4165. - Resolution: Duplicate > Add CSV file support to PostgresToGoogleCloudStorageOperator > ---

[jira] [Updated] (AIRFLOW-3614) CSV file suupport for DB Operators loading to GCS

[ https://issues.apache.org/jira/browse/AIRFLOW-3614?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3614: -- Description:   Currently operators loading from DBs to GCS support only Json format. I would be great if a

[jira] [Updated] (AIRFLOW-3278) GZIP support for Operators loading to GCS

[ https://issues.apache.org/jira/browse/AIRFLOW-3278?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3278: -- Description: gzip flag was added to GoogleCloudStorageHook by PR: [https://issues.apache.org/jira/browse/AIR

[jira] [Commented] (AIRFLOW-5063) When switching master <> v1-10-test performance of CI scripts drops dramatically

[ https://issues.apache.org/jira/browse/AIRFLOW-5063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894978#comment-16894978 ] ASF subversion and git services commented on AIRFLOW-5063: -- Co

[GitHub] [airflow] mik-laj merged pull request #5567: [AIRFLOW-4931] Add KMS Encryption Configuration to BigQuery Hook and Operators

mik-laj merged pull request #5567: [AIRFLOW-4931] Add KMS Encryption Configuration to BigQuery Hook and Operators URL: https://github.com/apache/airflow/pull/5567 This is an automated message from the Apache Git Service. To

[jira] [Commented] (AIRFLOW-4931) Add KMS Encryption Configuration to BigQuery Hook and Operators

[ https://issues.apache.org/jira/browse/AIRFLOW-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894981#comment-16894981 ] ASF GitHub Bot commented on AIRFLOW-4931: - mik-laj commented on pull request #5

[jira] [Commented] (AIRFLOW-4931) Add KMS Encryption Configuration to BigQuery Hook and Operators

[ https://issues.apache.org/jira/browse/AIRFLOW-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16894982#comment-16894982 ] ASF subversion and git services commented on AIRFLOW-4931: -- Co

[GitHub] [airflow] mik-laj commented on a change in pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10

mik-laj commented on a change in pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10 URL: https://github.com/apache/airflow/pull/5677#discussion_r308075165 ## File path: scripts/ci/in_container/_in_container_utils.sh ## @@ -74,6 +75,7 @@

[GitHub] [airflow] potiuk commented on a change in pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10

potiuk commented on a change in pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10 URL: https://github.com/apache/airflow/pull/5677#discussion_r308076694 ## File path: scripts/ci/in_container/_in_container_utils.sh ## @@ -74,6 +75,7 @@ f

[GitHub] [airflow] potiuk commented on a change in pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10

potiuk commented on a change in pull request #5677: [AIRFLOW-5063] Fix performance when switching between master/v1-10 URL: https://github.com/apache/airflow/pull/5677#discussion_r308076889 ## File path: scripts/ci/in_container/_in_container_utils.sh ## @@ -74,6 +75,7 @@ f

[jira] [Updated] (AIRFLOW-4931) Add KMS Encryption Configuration to BigQuery Hook and Operators

[ https://issues.apache.org/jira/browse/AIRFLOW-4931?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-4931: --- Fix Version/s: 1.10.4 > Add KMS Encryption Configuration to BigQuery Hook and Operators > -