[GitHub] [airflow] is2co opened a new pull request #5772: [AIRFLOW-XXX] Add iS2.co to list of airflow users

2019-08-09 Thread GitBox
is2co opened a new pull request #5772: [AIRFLOW-XXX] Add iS2.co to list of airflow users URL: https://github.com/apache/airflow/pull/5772 [AIRFLOW-XXX] Add iS2.co to list of airflow users Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the

[GitHub] [airflow] nuclearpinguin commented on issue #5764: [AIRFLOW-5152]Change autodetect default value to be True

2019-08-09 Thread GitBox
nuclearpinguin commented on issue #5764: [AIRFLOW-5152]Change autodetect default value to be True URL: https://github.com/apache/airflow/pull/5764#issuecomment-520117254 In such cases `git commit --amend` may help, it's quite useful:

[jira] [Assigned] (AIRFLOW-4013) Mark success/failed is picking all execution date

2019-08-09 Thread Qian Yu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4013?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Yu reassigned AIRFLOW-4013: Assignee: Qian Yu > Mark success/failed is picking all execution date >

[jira] [Commented] (AIRFLOW-5152) Fix autodetect default value

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904275#comment-16904275 ] ASF GitHub Bot commented on AIRFLOW-5152: - bingqinzhou commented on pull request #5764:

[GitHub] [airflow] bingqinzhou closed pull request #5764: [AIRFLOW-5152]Change autodetect default value to be True

2019-08-09 Thread GitBox
bingqinzhou closed pull request #5764: [AIRFLOW-5152]Change autodetect default value to be True URL: https://github.com/apache/airflow/pull/5764 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] bingqinzhou commented on issue #5764: [AIRFLOW-5152]Change autodetect default value to be True

2019-08-09 Thread GitBox
bingqinzhou commented on issue #5764: [AIRFLOW-5152]Change autodetect default value to be True URL: https://github.com/apache/airflow/pull/5764#issuecomment-520103388 Declining this PR and created https://github.com/apache/airflow/pull/5771 since I messed up the commit messages.

[GitHub] [airflow] bingqinzhou commented on issue #5771: [AIRFLOW-5152] Fix autodetect default value from False to be True

2019-08-09 Thread GitBox
bingqinzhou commented on issue #5771: [AIRFLOW-5152] Fix autodetect default value from False to be True URL: https://github.com/apache/airflow/pull/5771#issuecomment-520103362 Had to decline https://github.com/apache/airflow/pull/5764 and open a new one since I messed up the commit

[GitHub] [airflow] steven-freed commented on a change in pull request #5770: GCS Hook Upload Method(s)

2019-08-09 Thread GitBox
steven-freed commented on a change in pull request #5770: GCS Hook Upload Method(s) URL: https://github.com/apache/airflow/pull/5770#discussion_r312680039 ## File path: airflow/contrib/hooks/gcs_hook.py ## @@ -175,7 +175,30 @@ def download(self, bucket_name, object_name,

[GitHub] [airflow] kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on issue #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#issuecomment-520101071 Pending Issues: - ~Add Timezone support to `serialized_dag` table~ - We still have the issue of

[jira] [Commented] (AIRFLOW-5152) Fix autodetect default value

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5152?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904260#comment-16904260 ] ASF GitHub Bot commented on AIRFLOW-5152: - bingqinzhou commented on pull request #5771:

[GitHub] [airflow] bingqinzhou opened a new pull request #5771: [AIRFLOW-5152] Fix autodetect default value from False to True in Goo…

2019-08-09 Thread GitBox
bingqinzhou opened a new pull request #5771: [AIRFLOW-5152] Fix autodetect default value from False to True in Goo… URL: https://github.com/apache/airflow/pull/5771 …gleCloudStorageToBigQueryOperator. Make sure you have checked _all_ steps below. ### Jira - [ ] My PR

[GitHub] [airflow] steven-freed commented on a change in pull request #5770: GCS Hook Upload Method(s)

2019-08-09 Thread GitBox
steven-freed commented on a change in pull request #5770: GCS Hook Upload Method(s) URL: https://github.com/apache/airflow/pull/5770#discussion_r312680039 ## File path: airflow/contrib/hooks/gcs_hook.py ## @@ -175,7 +175,30 @@ def download(self, bucket_name, object_name,

[GitHub] [airflow] ryanyuan commented on a change in pull request #5770: GCS Hook Upload Method(s)

2019-08-09 Thread GitBox
ryanyuan commented on a change in pull request #5770: GCS Hook Upload Method(s) URL: https://github.com/apache/airflow/pull/5770#discussion_r312678518 ## File path: airflow/contrib/hooks/gcs_hook.py ## @@ -175,7 +175,30 @@ def download(self, bucket_name, object_name,

[GitHub] [airflow] ryanyuan commented on a change in pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets

2019-08-09 Thread GitBox
ryanyuan commented on a change in pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets URL: https://github.com/apache/airflow/pull/5768#discussion_r312676623 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -1683,13 +1683,17 @@ def

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312676265 ## File path:

[GitHub] [airflow] coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312668060 ## File path:

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312667040 ## File path:

[GitHub] [airflow] bingqinzhou edited a comment on issue #5764: Change default value of autodetect to be True.

2019-08-09 Thread GitBox
bingqinzhou edited a comment on issue #5764: Change default value of autodetect to be True. URL: https://github.com/apache/airflow/pull/5764#issuecomment-520076369 > This seems to be reasonable change but is it backward compatible? If user passes a schema definition and autodetect is set

[GitHub] [airflow] bingqinzhou edited a comment on issue #5764: Change default value of autodetect to be True.

2019-08-09 Thread GitBox
bingqinzhou edited a comment on issue #5764: Change default value of autodetect to be True. URL: https://github.com/apache/airflow/pull/5764#issuecomment-520076369 > This seems to be reasonable change but is it backward compatible? If user passes a schema definition and autodetect is set

[GitHub] [airflow] bingqinzhou commented on issue #5764: Change default value of autodetect to be True.

2019-08-09 Thread GitBox
bingqinzhou commented on issue #5764: Change default value of autodetect to be True. URL: https://github.com/apache/airflow/pull/5764#issuecomment-520076369 > This seems to be reasonable change but is it backward compatible? If user passes a schema definition and autodetect is set to True

[GitHub] [airflow] steven-freed opened a new pull request #5770: GCS Hook Upload Method(s)

2019-08-09 Thread GitBox
steven-freed opened a new pull request #5770: GCS Hook Upload Method(s) URL: https://github.com/apache/airflow/pull/5770 My change allows developers to upload objects to a GCS bucket by either a local file's file name or by a file's data (string or bytes). This may help prevent issues

[jira] [Commented] (AIRFLOW-5139) ElasticSearchTaskRunner does not allow for custom ES configurations

2019-08-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904207#comment-16904207 ] ASF subversion and git services commented on AIRFLOW-5139: -- Commit

[jira] [Commented] (AIRFLOW-5139) ElasticSearchTaskRunner does not allow for custom ES configurations

2019-08-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904206#comment-16904206 ] ASF subversion and git services commented on AIRFLOW-5139: -- Commit

[jira] [Commented] (AIRFLOW-5139) ElasticSearchTaskRunner does not allow for custom ES configurations

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5139?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904205#comment-16904205 ] ASF GitHub Bot commented on AIRFLOW-5139: - dimberman commented on pull request #5760:

[GitHub] [airflow] dimberman merged pull request #5760: [AIRFLOW-5139] Allow custom ES configs

2019-08-09 Thread GitBox
dimberman merged pull request #5760: [AIRFLOW-5139] Allow custom ES configs URL: https://github.com/apache/airflow/pull/5760 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] coufon closed pull request #5594: [AIRFLOW-4924] Loading DAGs asynchronously in Airflow webserver

2019-08-09 Thread GitBox
coufon closed pull request #5594: [AIRFLOW-4924] Loading DAGs asynchronously in Airflow webserver URL: https://github.com/apache/airflow/pull/5594 This is an automated message from the Apache Git Service. To respond to the

[jira] [Commented] (AIRFLOW-4924) Loading DAGs asynchronously in Airflow webserver

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4924?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904187#comment-16904187 ] ASF GitHub Bot commented on AIRFLOW-4924: - coufon commented on pull request #5594:

[jira] [Created] (AIRFLOW-5158) Google Sheet Operator

2019-08-09 Thread Omar Al-Jadda (JIRA)
Omar Al-Jadda created AIRFLOW-5158: -- Summary: Google Sheet Operator Key: AIRFLOW-5158 URL: https://issues.apache.org/jira/browse/AIRFLOW-5158 Project: Apache Airflow Issue Type: New Feature

[jira] [Updated] (AIRFLOW-5153) Add option to force delete a non-empty Google BQ dataset

2019-08-09 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kamil Bregula updated AIRFLOW-5153: --- Component/s: gcp > Add option to force delete a non-empty Google BQ dataset >

[jira] [Comment Edited] (AIRFLOW-5154) Add ability to generate graph alerts to email

2019-08-09 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904181#comment-16904181 ] Kamil Bregula edited comment on AIRFLOW-5154 at 8/9/19 8:54 PM: I think

[jira] [Commented] (AIRFLOW-5154) Add ability to generate graph alerts to email

2019-08-09 Thread Kamil Bregula (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5154?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904181#comment-16904181 ] Kamil Bregula commented on AIRFLOW-5154: I think we should develop instructions for integration

[jira] [Commented] (AIRFLOW-5150) Implement POC of GitLab CI + GKE integration

2019-08-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5150?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904180#comment-16904180 ] ASF subversion and git services commented on AIRFLOW-5150: -- Commit

[jira] [Created] (AIRFLOW-5157) S3ToRedshiftTransfer hard codes aws credentials gets logged

2019-08-09 Thread Omar Al-Jadda (JIRA)
Omar Al-Jadda created AIRFLOW-5157: -- Summary: S3ToRedshiftTransfer hard codes aws credentials gets logged Key: AIRFLOW-5157 URL: https://issues.apache.org/jira/browse/AIRFLOW-5157 Project: Apache

[GitHub] [airflow] wmorris75 commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query

2019-08-09 Thread GitBox
wmorris75 commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query URL: https://github.com/apache/airflow/pull/5717#discussion_r312640035 ## File path: airflow/contrib/hooks/salesforce_hook.py ## @@ -73,19

[GitHub] [airflow] nuclearpinguin commented on issue #5764: Change default value of autodetect to be True.

2019-08-09 Thread GitBox
nuclearpinguin commented on issue #5764: Change default value of autodetect to be True. URL: https://github.com/apache/airflow/pull/5764#issuecomment-520055431 @criccomini thank you for the insight! This is an automated

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query

2019-08-09 Thread GitBox
nuclearpinguin commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query URL: https://github.com/apache/airflow/pull/5717#discussion_r312638543 ## File path: airflow/contrib/hooks/salesforce_hook.py ## @@ -73,19

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query

2019-08-09 Thread GitBox
nuclearpinguin commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query URL: https://github.com/apache/airflow/pull/5717#discussion_r312638362 ## File path: airflow/contrib/hooks/salesforce_hook.py ## @@ -73,19

[GitHub] [airflow] coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312625225 ## File path: tests/dags/test_dag_serialization.py ## @@ -244,7

[GitHub] [airflow] coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312620497 ## File path: tests/dags/test_dag_serialization.py ## @@ -244,7

[GitHub] [airflow] coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312620352 ## File path: airflow/models/dagbag.py ## @@ -352,7 +376,8 @@ def

[GitHub] [airflow] coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
coufon commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312620158 ## File path: airflow/settings.py ## @@ -310,3 +310,12 @@ def

[GitHub] [airflow] criccomini commented on issue #5764: Change default value of autodetect to be True.

2019-08-09 Thread GitBox
criccomini commented on issue #5764: Change default value of autodetect to be True. URL: https://github.com/apache/airflow/pull/5764#issuecomment-520025246 I would argue that the change, itself, was backwards incompatible, and this is restoring the compatibility. We had DAGs that were

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312604975 ## File path: airflow/settings.py ## @@ -310,3 +310,12 @@ def

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312600459 ## File path: airflow/models/dagbag.py ## @@ -352,7 +376,8 @@ def

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312570455 ## File path: tests/models/test_serialized_dag.py ## @@ -0,0 +1,124

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312569958 ## File path: tests/dags/test_dag_serialization.py ## @@ -244,7

[GitHub] [airflow] dimberman commented on a change in pull request #5760: [AIRFLOW-5139] Allow custom ES configs

2019-08-09 Thread GitBox
dimberman commented on a change in pull request #5760: [AIRFLOW-5139] Allow custom ES configs URL: https://github.com/apache/airflow/pull/5760#discussion_r312576569 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -591,6 +591,11 @@ json_format = False #

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312570455 ## File path: tests/models/test_serialized_dag.py ## @@ -0,0 +1,124

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312569958 ## File path: tests/dags/test_dag_serialization.py ## @@ -244,7

[GitHub] [airflow] kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5743: [AIRFLOW-5088][AIP-24] Persisting serialized DAG in DB for webserver scalability URL: https://github.com/apache/airflow/pull/5743#discussion_r312569958 ## File path: tests/dags/test_dag_serialization.py ## @@ -244,7

[GitHub] [airflow] kaxil edited a comment on issue #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON

2019-08-09 Thread GitBox
kaxil edited a comment on issue #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON URL: https://github.com/apache/airflow/pull/5701#issuecomment-519989967 Follow Up PR: https://github.com/apache/airflow/pull/5743 which would actually use this Serialized DAG and persist in DB.

[GitHub] [airflow] kaxil commented on issue #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON

2019-08-09 Thread GitBox
kaxil commented on issue #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON URL: https://github.com/apache/airflow/pull/5701#issuecomment-519989967 Follow Up PR: https://github.com/apache/airflow/pull/5743 which would actually use this Serialized DAG and persist in DB.

[jira] [Commented] (AIRFLOW-5088) To implement DAG JSON serialization and DB persistence for webserver scalability improvement

2019-08-09 Thread ASF subversion and git services (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904034#comment-16904034 ] ASF subversion and git services commented on AIRFLOW-5088: -- Commit

[GitHub] [airflow] kaxil commented on issue #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON

2019-08-09 Thread GitBox
kaxil commented on issue #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON URL: https://github.com/apache/airflow/pull/5701#issuecomment-519989538 Thanks @coufon . This is an automated message from the

[jira] [Commented] (AIRFLOW-5088) To implement DAG JSON serialization and DB persistence for webserver scalability improvement

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5088?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16904032#comment-16904032 ] ASF GitHub Bot commented on AIRFLOW-5088: - kaxil commented on pull request #5701:

[GitHub] [airflow] kaxil merged pull request #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON

2019-08-09 Thread GitBox
kaxil merged pull request #5701: [AIRFLOW-5088][AIP-24] Add DAG serialization using JSON URL: https://github.com/apache/airflow/pull/5701 This is an automated message from the Apache Git Service. To respond to the message,

[GitHub] [airflow] houqp commented on issue #5668: [AIRFLOW-4316] support setting kubernetes_environment_variables config section from env var

2019-08-09 Thread GitBox
houqp commented on issue #5668: [AIRFLOW-4316] support setting kubernetes_environment_variables config section from env var URL: https://github.com/apache/airflow/pull/5668#issuecomment-519974778 I decided to leave `kubernetes_environment_variables` as a special case to avoid breaking all

[GitHub] [airflow] kaxil commented on a change in pull request #5760: [AIRFLOW-5139] Allow custom ES configs

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5760: [AIRFLOW-5139] Allow custom ES configs URL: https://github.com/apache/airflow/pull/5760#discussion_r312545425 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -591,6 +591,11 @@ json_format = False # Log

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #5727: [AIRFLOW-5114] Fix gcp_transfer_hook behavior with default operator arguments

2019-08-09 Thread GitBox
nuclearpinguin commented on a change in pull request #5727: [AIRFLOW-5114] Fix gcp_transfer_hook behavior with default operator arguments URL: https://github.com/apache/airflow/pull/5727#discussion_r312521516 ## File path: airflow/contrib/hooks/gcp_transfer_hook.py ## @@

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #5727: [AIRFLOW-5114] Fix gcp_transfer_hook behavior with default operator arguments

2019-08-09 Thread GitBox
nuclearpinguin commented on a change in pull request #5727: [AIRFLOW-5114] Fix gcp_transfer_hook behavior with default operator arguments URL: https://github.com/apache/airflow/pull/5727#discussion_r312517629 ## File path: airflow/contrib/hooks/gcp_transfer_hook.py ## @@

[jira] [Updated] (AIRFLOW-5156) Add other authentication mechanisms to HttpHook

2019-08-09 Thread Joshua Kornblum (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5156?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua Kornblum updated AIRFLOW-5156: - Description: It looks like the only supported authentication for HttpHooks is basic

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query

2019-08-09 Thread GitBox
nuclearpinguin commented on a change in pull request #5717: [AIRFLOW-5052] Added the include_deleted params to salesforce make_query URL: https://github.com/apache/airflow/pull/5717#discussion_r312516709 ## File path: airflow/contrib/hooks/salesforce_hook.py ## @@ -73,19

[jira] [Updated] (AIRFLOW-4538) Add support for FAB API with plugins

2019-08-09 Thread Joshua Kornblum (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4538?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua Kornblum updated AIRFLOW-4538: - Affects Version/s: 1.10.4 > Add support for FAB API with plugins >

[jira] [Updated] (AIRFLOW-4413) Expose making flask sessions permanent via webserver_config or airflow.cfg

2019-08-09 Thread Joshua Kornblum (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4413?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Joshua Kornblum updated AIRFLOW-4413: - Affects Version/s: 1.10.4 > Expose making flask sessions permanent via

[jira] [Created] (AIRFLOW-5156) Add other authentication mechanisms to HttpHook

2019-08-09 Thread Joshua Kornblum (JIRA)
Joshua Kornblum created AIRFLOW-5156: Summary: Add other authentication mechanisms to HttpHook Key: AIRFLOW-5156 URL: https://issues.apache.org/jira/browse/AIRFLOW-5156 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-4515) KubernetesExecutor hangs in the subdag context

2019-08-09 Thread Steven Locke (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903934#comment-16903934 ] Steven Locke commented on AIRFLOW-4515: --- Also, in what world would this not be a bug if every

[GitHub] [airflow] jstern opened a new pull request #5761: take false is_encrypted choice away from user

2019-08-09 Thread GitBox
jstern opened a new pull request #5761: take false is_encrypted choice away from user URL: https://github.com/apache/airflow/pull/5761 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] jstern closed pull request #5761: take false is_encrypted choice away from user

2019-08-09 Thread GitBox
jstern closed pull request #5761: take false is_encrypted choice away from user URL: https://github.com/apache/airflow/pull/5761 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] jstern commented on issue #5761: take false is_encrypted choice away from user

2019-08-09 Thread GitBox
jstern commented on issue #5761: take false is_encrypted choice away from user URL: https://github.com/apache/airflow/pull/5761#issuecomment-519938321 Going to close and re-open to re-trigger travis (failure appeared unrelated to change).

[jira] [Commented] (AIRFLOW-4515) KubernetesExecutor hangs in the subdag context

2019-08-09 Thread Steven Locke (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903933#comment-16903933 ] Steven Locke commented on AIRFLOW-4515: --- Please add comments/documentation accordingly. I'm not

[jira] [Created] (AIRFLOW-5155) Add OracleToGoogleStorageOperator

2019-08-09 Thread lovk korm (JIRA)
lovk korm created AIRFLOW-5155: -- Summary: Add OracleToGoogleStorageOperator Key: AIRFLOW-5155 URL: https://issues.apache.org/jira/browse/AIRFLOW-5155 Project: Apache Airflow Issue Type: Wish

[jira] [Created] (AIRFLOW-5154) Add ability to generate graph alerts to email

2019-08-09 Thread lovk korm (JIRA)
lovk korm created AIRFLOW-5154: -- Summary: Add ability to generate graph alerts to email Key: AIRFLOW-5154 URL: https://issues.apache.org/jira/browse/AIRFLOW-5154 Project: Apache Airflow Issue

[jira] [Commented] (AIRFLOW-4515) KubernetesExecutor hangs in the subdag context

2019-08-09 Thread David Lum (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903920#comment-16903920 ] David Lum commented on AIRFLOW-4515: Yeah unfortunately this looks like an inconsistency in the the

[jira] [Commented] (AIRFLOW-4964) Add BigQuery Data Transfer Hook and Operator

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4964?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903913#comment-16903913 ] ASF GitHub Bot commented on AIRFLOW-4964: - nuclearpinguin commented on pull request #5769:

[GitHub] [airflow] nuclearpinguin opened a new pull request #5769: [AIRFLOW-4964] Add BigQuery Data Transfer Hook and Operator

2019-08-09 Thread GitBox
nuclearpinguin opened a new pull request #5769: [AIRFLOW-4964] Add BigQuery Data Transfer Hook and Operator URL: https://github.com/apache/airflow/pull/5769 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] mik-laj commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list

2019-08-09 Thread GitBox
mik-laj commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list URL: https://github.com/apache/airflow/pull/5766#discussion_r312489986 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -761,6 +761,12 @@ def

[jira] [Commented] (AIRFLOW-4309) Delete dag doesn't delete everything

2019-08-09 Thread lovk korm (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4309?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903910#comment-16903910 ] lovk korm commented on AIRFLOW-4309: [~kaxilnaik] yes > Delete dag doesn't delete everything >

[jira] [Commented] (AIRFLOW-4816) add MySQLToS3Operator

2019-08-09 Thread lovk korm (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4816?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903908#comment-16903908 ] lovk korm commented on AIRFLOW-4816: [~wkhudgins] looking forward for adding this support! > add

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list

2019-08-09 Thread GitBox
nuclearpinguin commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list URL: https://github.com/apache/airflow/pull/5766#discussion_r312488838 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -761,6 +761,12 @@

[GitHub] [airflow] mohannadbanayosi commented on a change in pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets

2019-08-09 Thread GitBox
mohannadbanayosi commented on a change in pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets URL: https://github.com/apache/airflow/pull/5768#discussion_r312488539 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -1683,13 +1683,17 @@

[GitHub] [airflow] ryanyuan commented on a change in pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets

2019-08-09 Thread GitBox
ryanyuan commented on a change in pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets URL: https://github.com/apache/airflow/pull/5768#discussion_r312478577 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -1683,13 +1683,17 @@ def

[jira] [Commented] (AIRFLOW-5153) Add option to force delete a non-empty Google BQ dataset

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903872#comment-16903872 ] ASF GitHub Bot commented on AIRFLOW-5153: - mohannadbanayosi commented on pull request #5768:

[GitHub] [airflow] mohannadbanayosi opened a new pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets

2019-08-09 Thread GitBox
mohannadbanayosi opened a new pull request #5768: [AIRFLOW-5153] Option to force delete non-empty BQ datasets URL: https://github.com/apache/airflow/pull/5768 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] jml commented on a change in pull request #5757: [AIRFLOW-5100] Use safe_mode configuration setting by default

2019-08-09 Thread GitBox
jml commented on a change in pull request #5757: [AIRFLOW-5100] Use safe_mode configuration setting by default URL: https://github.com/apache/airflow/pull/5757#discussion_r312468051 ## File path: airflow/utils/dag_processing.py ## @@ -288,18 +288,21 @@ def

[GitHub] [airflow] jml commented on a change in pull request #5757: [AIRFLOW-5100] Use safe_mode configuration setting by default

2019-08-09 Thread GitBox
jml commented on a change in pull request #5757: [AIRFLOW-5100] Use safe_mode configuration setting by default URL: https://github.com/apache/airflow/pull/5757#discussion_r312461672 ## File path: airflow/utils/dag_processing.py ## @@ -288,18 +288,21 @@ def

[jira] [Updated] (AIRFLOW-5153) Add option to force delete a non-empty Google BQ dataset

2019-08-09 Thread Mohannad Albanayosy (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Mohannad Albanayosy updated AIRFLOW-5153: - Description: h2. Problem There is currently no option to force delete a

[GitHub] [airflow] nuclearpinguin opened a new pull request #5767: [AIRFLOW-4774] MLEngineHook should use the built-in Google Discovery API method for retry requests

2019-08-09 Thread GitBox
nuclearpinguin opened a new pull request #5767: [AIRFLOW-4774] MLEngineHook should use the built-in Google Discovery API method for retry requests URL: https://github.com/apache/airflow/pull/5767 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the

[jira] [Commented] (AIRFLOW-4774) MLEngineHook should use the built-in Google Discovery API method for retry requests

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903846#comment-16903846 ] ASF GitHub Bot commented on AIRFLOW-4774: - nuclearpinguin commented on pull request #5767:

[jira] [Commented] (AIRFLOW-4774) MLEngineHook should use the built-in Google Discovery API method for retry requests

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903847#comment-16903847 ] ASF GitHub Bot commented on AIRFLOW-4774: - nuclearpinguin commented on pull request #5767:

[jira] [Work started] (AIRFLOW-5153) Add option to force delete a non-empty Google BQ dataset

2019-08-09 Thread Mohannad Albanayosy (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-5153?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-5153 started by Mohannad Albanayosy. > Add option to force delete a non-empty Google BQ dataset >

[jira] [Created] (AIRFLOW-5153) Add option to force delete a non-empty Google BQ dataset

2019-08-09 Thread Mohannad Albanayosy (JIRA)
Mohannad Albanayosy created AIRFLOW-5153: Summary: Add option to force delete a non-empty Google BQ dataset Key: AIRFLOW-5153 URL: https://issues.apache.org/jira/browse/AIRFLOW-5153 Project:

[GitHub] [airflow] de-code commented on issue #5616: [AIRFLOW-4013] Fix Mark Success/Failed picking all execution_date bug

2019-08-09 Thread GitBox
de-code commented on issue #5616: [AIRFLOW-4013] Fix Mark Success/Failed picking all execution_date bug URL: https://github.com/apache/airflow/pull/5616#issuecomment-519893584 This seems to work. I can finally marking individual tasks as failed.

[GitHub] [airflow] marengaz commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list

2019-08-09 Thread GitBox
marengaz commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list URL: https://github.com/apache/airflow/pull/5766#discussion_r312447223 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -761,6 +761,12 @@ def

[jira] [Assigned] (AIRFLOW-4774) MLEngineHook should use the built-in Google Discovery API method for retry requests

2019-08-09 Thread Tomasz Urbaszek (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4774?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Urbaszek reassigned AIRFLOW-4774: Assignee: Tomasz Urbaszek > MLEngineHook should use the built-in Google

[jira] [Commented] (AIRFLOW-3804) MySqlToGoogleCloudStorageOperator success when it should fail

2019-08-09 Thread Tomasz Urbaszek (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3804?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903808#comment-16903808 ] Tomasz Urbaszek commented on AIRFLOW-3804: -- Hey [~jackjack10] do you still experience this

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list

2019-08-09 Thread GitBox
nuclearpinguin commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list URL: https://github.com/apache/airflow/pull/5766#discussion_r312427302 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -737,7 +737,7 @@

[GitHub] [airflow] mik-laj commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list

2019-08-09 Thread GitBox
mik-laj commented on a change in pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list URL: https://github.com/apache/airflow/pull/5766#discussion_r312423085 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@ -737,7 +737,7 @@ def

[jira] [Commented] (AIRFLOW-4230) bigquery schema update options should be a list

2019-08-09 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-4230?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16903797#comment-16903797 ] ASF GitHub Bot commented on AIRFLOW-4230: - nuclearpinguin commented on pull request #5766:

[GitHub] [airflow] nuclearpinguin opened a new pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list

2019-08-09 Thread GitBox
nuclearpinguin opened a new pull request #5766: [AIRFLOW-4230] BigQuery schema update options should be a list URL: https://github.com/apache/airflow/pull/5766 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] kaxil commented on a change in pull request #5757: [AIRFLOW-5100] Use safe_mode configuration setting by default

2019-08-09 Thread GitBox
kaxil commented on a change in pull request #5757: [AIRFLOW-5100] Use safe_mode configuration setting by default URL: https://github.com/apache/airflow/pull/5757#discussion_r312420059 ## File path: airflow/utils/dag_processing.py ## @@ -288,18 +288,21 @@ def

  1   2   >