[jira] [Commented] (AIRFLOW-3132) Allow to specify auto_remove option for DockerOperator

2018-10-07 Thread Guoqiang Ding (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3132?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641283#comment-16641283 ] Guoqiang Ding commented on AIRFLOW-3132: Github pullrequest:

[GitHub] gerardo commented on issue #3805: [AIRFLOW-2062] Add per-connection KMS encryption.

2018-10-07 Thread GitBox
gerardo commented on issue #3805: [AIRFLOW-2062] Add per-connection KMS encryption. URL: https://github.com/apache/incubator-airflow/pull/3805#issuecomment-427702362 @Fokko @jakahn I feel like this PR should be presented as an [Airflow Improvement

[jira] [Commented] (AIRFLOW-3141) Fix 500 on duration view when dag doesn't exist

2018-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3141?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641239#comment-16641239 ] ASF GitHub Bot commented on AIRFLOW-3141: - feng-tao closed pull request #3991: [AIRFLOW-3141]

[GitHub] feng-tao closed pull request #3991: [AIRFLOW-3141] Backfill missing sensor tests.

2018-10-07 Thread GitBox
feng-tao closed pull request #3991: [AIRFLOW-3141] Backfill missing sensor tests. URL: https://github.com/apache/incubator-airflow/pull/3991 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[GitHub] codecov-io commented on issue #4016: [AIRFLOW-XXX] Fix Typo in SFTPOperator docstring

2018-10-07 Thread GitBox
codecov-io commented on issue #4016: [AIRFLOW-XXX] Fix Typo in SFTPOperator docstring URL: https://github.com/apache/incubator-airflow/pull/4016#issuecomment-427689430 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4016?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #4016: [AIRFLOW-XXX] Fix Typo in SFTPOperator docstring

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #4016: [AIRFLOW-XXX] Fix Typo in SFTPOperator docstring URL: https://github.com/apache/incubator-airflow/pull/4016#issuecomment-427689430 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4016?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3893: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #3893: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file URL: https://github.com/apache/incubator-airflow/pull/3893#issuecomment-424189836 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3893?src=pr=h1) Report >

[GitHub] kaxil opened a new pull request #4016: [AIRFLOW-XXX] Fix Typo in SFTPOperator docstring

2018-10-07 Thread GitBox
kaxil opened a new pull request #4016: [AIRFLOW-XXX] Fix Typo in SFTPOperator docstring URL: https://github.com/apache/incubator-airflow/pull/4016 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] neil90 commented on issue #3893: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file

2018-10-07 Thread GitBox
neil90 commented on issue #3893: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file URL: https://github.com/apache/incubator-airflow/pull/3893#issuecomment-427686729 @kaxil and @xnuinside I have updated the operator and added test case, I used the

[GitHub] codecov-io edited a comment on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #3989: [AIRFLOW-1945] Autoscale celery workers for airflow added URL: https://github.com/apache/incubator-airflow/pull/3989#issuecomment-426543786 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3989?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log URL: https://github.com/apache/incubator-airflow/pull/3992#issuecomment-426519197 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3992?src=pr=h1)

[GitHub] codecov-io edited a comment on issue #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log URL: https://github.com/apache/incubator-airflow/pull/3992#issuecomment-426519197 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3992?src=pr=h1)

[GitHub] phani8996 commented on a change in pull request #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log

2018-10-07 Thread GitBox
phani8996 commented on a change in pull request #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log URL: https://github.com/apache/incubator-airflow/pull/3992#discussion_r223224920 ## File path: airflow/bin/cli.py ## @@ -1023,17

[jira] [Resolved] (AIRFLOW-3055) add get_dataset and get_datasets_list to bigquery_hook

2018-10-07 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3055. - Resolution: Fixed Fix Version/s: (was: 1.10.1) 2.0.0 Resolved by

[jira] [Updated] (AIRFLOW-3055) add get_dataset and get_datasets_list to bigquery_hook

2018-10-07 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3055: Affects Version/s: (was: 1.10.1) > add get_dataset and get_datasets_list to bigquery_hook >

[jira] [Commented] (AIRFLOW-3055) add get_dataset and get_datasets_list to bigquery_hook

2018-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3055?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641169#comment-16641169 ] ASF GitHub Bot commented on AIRFLOW-3055: - kaxil closed pull request #3894: [AIRFLOW-3055] add

[GitHub] kaxil closed pull request #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook

2018-10-07 Thread GitBox
kaxil closed pull request #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook URL: https://github.com/apache/incubator-airflow/pull/3894 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake

[jira] [Commented] (AIRFLOW-820) Standardize GCP related connection id names and default values

2018-10-07 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641164#comment-16641164 ] Kaxil Naik commented on AIRFLOW-820: At this point of writing, `DataProcClusterCreateOperator` has

[GitHub] xnuinside commented on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook

2018-10-07 Thread GitBox
xnuinside commented on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook URL: https://github.com/apache/incubator-airflow/pull/3894#issuecomment-427675981 @kaxil , thanks, as I see - all okay with CI

[GitHub] jeffkpayne commented on a change in pull request #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log

2018-10-07 Thread GitBox
jeffkpayne commented on a change in pull request #3992: [AIRFLOW-620] Feature to tail custom number of logs instead of rendering whole log URL: https://github.com/apache/incubator-airflow/pull/3992#discussion_r223222849 ## File path: airflow/bin/cli.py ## @@ -1023,17

[jira] [Commented] (AIRFLOW-820) Standardize GCP related connection id names and default values

2018-10-07 Thread Daniel Lamblin (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-820?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641137#comment-16641137 ] Daniel Lamblin commented on AIRFLOW-820: I think any operator that takes only 1 connection id

[GitHub] antxxxx commented on issue #4003: [AIRFLOW-3163] add operator to enable setting table description in BigQuery table

2018-10-07 Thread GitBox
ant commented on issue #4003: [AIRFLOW-3163] add operator to enable setting table description in BigQuery table URL: https://github.com/apache/incubator-airflow/pull/4003#issuecomment-427662813 There is not a bigquery api exposed to set the description when you want to run a query

[GitHub] codecov-io edited a comment on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook URL: https://github.com/apache/incubator-airflow/pull/3894#issuecomment-423291432 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3894?src=pr=h1) Report >

[GitHub] kaxil commented on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook

2018-10-07 Thread GitBox
kaxil commented on issue #3894: [AIRFLOW-3055] add get_dataset and get_datasets_list to bigquery_hook URL: https://github.com/apache/incubator-airflow/pull/3894#issuecomment-427659777 I have updated a few minor changes. Let's wait for the CI to pass. If it passes, I will squash commit

[jira] [Updated] (AIRFLOW-3162) HttpHook fails to parse URL when port is specified

2018-10-07 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3162: Fix Version/s: 1.10.1 > HttpHook fails to parse URL when port is specified >

[jira] [Updated] (AIRFLOW-3162) HttpHook fails to parse URL when port is specified

2018-10-07 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-3162: Affects Version/s: 1.10.0 > HttpHook fails to parse URL when port is specified >

[GitHub] kaxil closed pull request #4001: [AIRFLOW-3162] Fix HttpHook URL parse error when port is specified

2018-10-07 Thread GitBox
kaxil closed pull request #4001: [AIRFLOW-3162] Fix HttpHook URL parse error when port is specified URL: https://github.com/apache/incubator-airflow/pull/4001 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-3162) HttpHook fails to parse URL when port is specified

2018-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641081#comment-16641081 ] ASF GitHub Bot commented on AIRFLOW-3162: - kaxil closed pull request #4001: [AIRFLOW-3162] Fix

[jira] [Resolved] (AIRFLOW-3162) HttpHook fails to parse URL when port is specified

2018-10-07 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3162?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3162. - Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/4001 >

[GitHub] kaxil commented on issue #4003: [AIRFLOW-3163] add operator to enable setting table description in BigQuery table

2018-10-07 Thread GitBox
kaxil commented on issue #4003: [AIRFLOW-3163] add operator to enable setting table description in BigQuery table URL: https://github.com/apache/incubator-airflow/pull/4003#issuecomment-427658486 A different operator for setting table description? I don't think it is worth it. I am ok

[GitHub] kaxil closed pull request #4002: [AIRFLOW-3099] Complete list of optional airflow.cfg sections

2018-10-07 Thread GitBox
kaxil closed pull request #4002: [AIRFLOW-3099] Complete list of optional airflow.cfg sections URL: https://github.com/apache/incubator-airflow/pull/4002 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[jira] [Commented] (AIRFLOW-3099) Errors raised when some blocs are missing in airflow.cfg

2018-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3099?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641076#comment-16641076 ] ASF GitHub Bot commented on AIRFLOW-3099: - kaxil closed pull request #4002: [AIRFLOW-3099]

[GitHub] codecov-io edited a comment on issue #4015: [AIRFLOW-2789] Create single node cluster

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #4015: [AIRFLOW-2789] Create single node cluster URL: https://github.com/apache/incubator-airflow/pull/4015#issuecomment-427650314 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4015?src=pr=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #2551: [AIRFLOW-1543] Improve error message for incorrect fernet_key

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #2551: [AIRFLOW-1543] Improve error message for incorrect fernet_key URL: https://github.com/apache/incubator-airflow/pull/2551#issuecomment-325708902 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/2551?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-824) Allow writing to XCOM values via API

2018-10-07 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-824?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641068#comment-16641068 ] jack commented on AIRFLOW-824: -- What is this suppose to help with? When did you have the need to manually

[GitHub] exploy commented on issue #4015: [AIRFLOW-2789] Create single node cluster

2018-10-07 Thread GitBox
exploy commented on issue #4015: [AIRFLOW-2789] Create single node cluster URL: https://github.com/apache/incubator-airflow/pull/4015#issuecomment-427650912 > # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4015?src=pr=h1) Report > > Merging

[jira] [Commented] (AIRFLOW-2717) FileToGoogleCloudStorageOperator not shown in the Documentation.

2018-10-07 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2717?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641046#comment-16641046 ] jack commented on AIRFLOW-2717: --- [~ashb] I think it was fixed.

[GitHub] codecov-io edited a comment on issue #4015: [AIRFLOW-2789] Create single node cluster

2018-10-07 Thread GitBox
codecov-io edited a comment on issue #4015: [AIRFLOW-2789] Create single node cluster URL: https://github.com/apache/incubator-airflow/pull/4015#issuecomment-427650314 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4015?src=pr=h1) Report > Merging

[GitHub] codecov-io commented on issue #4015: [AIRFLOW-2789] Create single node cluster

2018-10-07 Thread GitBox
codecov-io commented on issue #4015: [AIRFLOW-2789] Create single node cluster URL: https://github.com/apache/incubator-airflow/pull/4015#issuecomment-427650314 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4015?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-2789) Add ability to create single node cluster to DataprocClusterCreateOperator

2018-10-07 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jarosław Śmietanka updated AIRFLOW-2789: Affects Version/s: 1.10.0 > Add ability to create single node cluster to

[jira] [Work started] (AIRFLOW-2789) Add ability to create single node cluster to DataprocClusterCreateOperator

2018-10-07 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-2789 started by Jarosław Śmietanka. --- > Add ability to create single node cluster to

[jira] [Commented] (AIRFLOW-2789) Add ability to create single node cluster to DataprocClusterCreateOperator

2018-10-07 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2789?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16641039#comment-16641039 ] ASF GitHub Bot commented on AIRFLOW-2789: - exploy opened a new pull request #4015:

[GitHub] exploy opened a new pull request #4015: [AIRFLOW-2789] Create single node cluster

2018-10-07 Thread GitBox
exploy opened a new pull request #4015: [AIRFLOW-2789] Create single node cluster URL: https://github.com/apache/incubator-airflow/pull/4015 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Updated] (AIRFLOW-3169) Indicate in the main UI if the scheduler is NOT working.

2018-10-07 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3169: -- Description: I came to work today and took a look at Airflow UI. Everything was green (success) - it took

[jira] [Created] (AIRFLOW-3169) Indicate in the main UI if the scheduler is working.

2018-10-07 Thread jack (JIRA)
jack created AIRFLOW-3169: - Summary: Indicate in the main UI if the scheduler is working. Key: AIRFLOW-3169 URL: https://issues.apache.org/jira/browse/AIRFLOW-3169 Project: Apache Airflow Issue

[jira] [Updated] (AIRFLOW-3169) Indicate in the main UI if the scheduler is NOT working.

2018-10-07 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3169?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3169: -- Summary: Indicate in the main UI if the scheduler is NOT working. (was: Indicate in the main UI if the