[jira] [Commented] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613081#comment-16613081 ] Iuliia Volkova commented on AIRFLOW-2772: - [~kaxilnaik], yes, of course, I will

[jira] [Assigned] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova reassigned AIRFLOW-2772: --- Assignee: Iuliia Volkova > BigQuery hook does not allow specifying both the partit

[GitHub] xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217272463 ## File path: airflow/contrib/operators/bigquery_operator.py ##

[GitHub] xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217271767 ## File path: docs/integration.rst ## @@ -349,6 +349,7

[jira] [Commented] (AIRFLOW-3034) Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16613042#comment-16613042 ] ASF GitHub Bot commented on AIRFLOW-3034: - r39132 closed pull request #3878: [A

[jira] [Closed] (AIRFLOW-3034) Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand closed AIRFLOW-3034. Resolution: Fixed > Readme updates : Add Slack & Twitter, remove Gitter > --

[GitHub] r39132 closed pull request #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread GitBox
r39132 closed pull request #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] r39132 edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread GitBox
r39132 edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420816917 @tedmiston What plan would you recommend for transitioning off Gitter? I can't imagine it would be

[jira] [Commented] (AIRFLOW-2229) Scheduler cannot retry abrupt task failures within factory-generated DAGs

2018-09-12 Thread Pramiti (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2229?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612982#comment-16612982 ] Pramiti commented on AIRFLOW-2229: -- We are also facing the same issue. If we change th

[GitHub] xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
xnuinside commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217244436 ## File path: airflow/contrib/hooks/bigquery_hook.py ##

[GitHub] codecov-io commented on issue #3886: [AIRFLOW-1298] Fix 'clear only_failed'

2018-09-12 Thread GitBox
codecov-io commented on issue #3886: [AIRFLOW-1298] Fix 'clear only_failed' URL: https://github.com/apache/incubator-airflow/pull/3886#issuecomment-420853555 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3886?src=pr&el=h1) Report > Merging [#3886](https://codecov.io/

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr&el=h1) Report

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr&el=h1) Report

[GitHub] codecov-io commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
codecov-io commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#issuecomment-420833798 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3887?src=pr&el=h1) Report > Merging

[GitHub] codecov-io edited a comment on issue #3767: [AIRFLOW-2524]Add SageMaker Batch Inference

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3767: [AIRFLOW-2524]Add SageMaker Batch Inference URL: https://github.com/apache/incubator-airflow/pull/3767#issuecomment-414106256 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3767?src=pr&el=h1) Report > Merging [#3767](https:

[jira] [Updated] (AIRFLOW-3052) Add logo options to Airflow

2018-09-12 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand updated AIRFLOW-3052: - External issue URL: https://github.com/apache/incubator-airflow/pull/3892 > Add logo op

[jira] [Commented] (AIRFLOW-3052) Add logo options to Airflow

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612855#comment-16612855 ] ASF GitHub Bot commented on AIRFLOW-3052: - r39132 opened a new pull request #38

[GitHub] r39132 opened a new pull request #3892: [AIRFLOW-3052] Add logo options to Airflow

2018-09-12 Thread GitBox
r39132 opened a new pull request #3892: [AIRFLOW-3052] Add logo options to Airflow URL: https://github.com/apache/incubator-airflow/pull/3892 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira](https://issues.apache.org/ji

[jira] [Created] (AIRFLOW-3052) Add new logos to Airflow

2018-09-12 Thread Siddharth Anand (JIRA)
Siddharth Anand created AIRFLOW-3052: Summary: Add new logos to Airflow Key: AIRFLOW-3052 URL: https://issues.apache.org/jira/browse/AIRFLOW-3052 Project: Apache Airflow Issue Type: New F

[jira] [Updated] (AIRFLOW-3052) Add logo options to Airflow

2018-09-12 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3052?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand updated AIRFLOW-3052: - Summary: Add logo options to Airflow (was: Add new logos to Airflow) > Add logo option

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Readme updates : Add Slack & Twitter, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr&el=h1) Report

[GitHub] XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420828802 I was wrong: **userinfoedit** and **resermypassword** don’t have to be applicalble, for example LDAP. ---

[GitHub] XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420827063 Thanks @feng-tao for pointing this out. I’ll check another four authentication models then. Regardi

[GitHub] jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#issuecomment-420818546 Fixing conflicts now... This is an auto

[GitHub] jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217208712 ## File path: tests/contrib/hooks/test_gcp_dataflow_hook.py ## @@ -178

[jira] [Updated] (AIRFLOW-3034) Readme updates : Add Slack & Twitter, remove Gitter

2018-09-12 Thread Siddharth Anand (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3034?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Siddharth Anand updated AIRFLOW-3034: - Summary: Readme updates : Add Slack & Twitter, remove Gitter (was: Update Readme : Ad

[GitHub] r39132 commented on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter

2018-09-12 Thread GitBox
r39132 commented on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420816917 @tedmiston What plan would you recommend for transitioning off Gitter? I can't imagine it would be a good idea t

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204000 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204755 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204607 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217204960 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217205266 ## File path: airflow/contrib/operators/bigquery_operator.py ##

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217206007 ## File path: airflow/contrib/operators/bigquery_operator.py ##

[GitHub] jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217206882 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -208,56

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217205897 ## File path: airflow/contrib/hooks/bigquery_hook.py ## @@

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217206388 ## File path: airflow/contrib/operators/bigquery_operator.py ##

[GitHub] kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3876: [AIRFLOW-2887] Add to BigQueryBaseCursor methods for insert (create empty) dataset URL: https://github.com/apache/incubator-airflow/pull/3876#discussion_r217206794 ## File path: docs/integration.rst ## @@ -349,6 +349,7 @@

[GitHub] jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217206446 ## File path: tests/contrib/hooks/test_gcp_dataflow_hook.py ## @@ -178

[jira] [Commented] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612790#comment-16612790 ] Kaxil Naik commented on AIRFLOW-2772: - [~xnuinside] Looks the this was a mistake. C

[jira] [Resolved] (AIRFLOW-638) Added schema_update_options to BigQueryBaseCursor and GoogleCloudStorageToBigQueryOperator

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-638?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-638. Resolution: Fixed Resolved by https://github.com/apache/incubator-airflow/pull/1891 > Added sche

[jira] [Closed] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-2469. --- Resolution: Fixed This has already been fixed > example task in documentation causes dataflow oper

[jira] [Commented] (AIRFLOW-3035) gcp_dataproc_hook should treat CANCELLED job state consistently

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612774#comment-16612774 ] ASF GitHub Bot commented on AIRFLOW-3035: - kaxil closed pull request #3884: [AI

[jira] [Resolved] (AIRFLOW-3035) gcp_dataproc_hook should treat CANCELLED job state consistently

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-3035. - Resolution: Fixed Fix Version/s: (was: 1.10.1) 2.0.0 Resolved by

[GitHub] kaxil closed pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
kaxil closed pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of proven

[jira] [Commented] (AIRFLOW-2988) GCP Dataflow hook should specifically run python2

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612769#comment-16612769 ] ASF GitHub Bot commented on AIRFLOW-2988: - kaxil closed pull request #3826: [AI

[jira] [Resolved] (AIRFLOW-2988) GCP Dataflow hook should specifically run python2

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2988?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2988. - Resolution: Fixed Fix Version/s: 2.0.0 Resolved by https://github.com/apache/incubator-a

[GitHub] kaxil closed pull request #3826: [AIRFLOW-2988] Run specifically python2 for dataflow

2018-09-12 Thread GitBox
kaxil closed pull request #3826: [AIRFLOW-2988] Run specifically python2 for dataflow URL: https://github.com/apache/incubator-airflow/pull/3826 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: As

[jira] [Closed] (AIRFLOW-2953) Installing postgres and gcp_api doesn't install PostgresToGoogleCloudStorageOperator

2018-09-12 Thread Kaxil Naik (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-2953. --- Resolution: Not A Problem > Installing postgres and gcp_api doesn't install > PostgresToGoogleClou

[GitHub] ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow

2018-09-12 Thread GitBox
ndmar commented on issue #2708: [AIRFLOW-1746] Add a Nomad operator to trigger job from Airflow URL: https://github.com/apache/incubator-airflow/pull/2708#issuecomment-420805366 @Fokko Just wanted to follow up and see if there was anything else I should tackle. Seems like most of your mor

[GitHub] kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217194071 ## File path: tests/contrib/hooks/test_gcp_dataflow_hook.py ## @@ -178,18 +

[GitHub] kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
kaxil commented on a change in pull request #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#discussion_r217195863 ## File path: airflow/contrib/hooks/gcp_dataflow_hook.py ## @@ -208,56 +206

[GitHub] gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
gerardo commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-420799103 If it's becoming too hard, I agree with reverting the docker-compose CI changes. I could go back and create a new branch w

[jira] [Created] (AIRFLOW-3051) The cli tools for manipulating users should be symmetric with connections

2018-09-12 Thread William Pursell (JIRA)
William Pursell created AIRFLOW-3051: Summary: The cli tools for manipulating users should be symmetric with connections Key: AIRFLOW-3051 URL: https://issues.apache.org/jira/browse/AIRFLOW-3051 P

[GitHub] dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on issue #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#issuecomment-420793289 @Fokko @bolkedebruin @ashb I am seeing multiple errors with the kubernetes executor once running: 1. The API call

[jira] [Commented] (AIRFLOW-1009) Remove SQLOperator from Concepts page

2018-09-12 Thread Josh Bacon (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-1009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612694#comment-16612694 ] Josh Bacon commented on AIRFLOW-1009: - Hello,  Just for the record here: I just s

[jira] [Commented] (AIRFLOW-3029) New Operator - SqlOperator

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3029?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612686#comment-16612686 ] ASF GitHub Bot commented on AIRFLOW-3029: - jbacon opened a new pull request #38

[GitHub] jbacon opened a new pull request #3891: [AIRFLOW-3029] New Operator - SqlOperator

2018-09-12 Thread GitBox
jbacon opened a new pull request #3891: [AIRFLOW-3029] New Operator - SqlOperator URL: https://github.com/apache/incubator-airflow/pull/3891 Introduces a new `SqlOperator` that executes sql code in a database. Surprisingly this operator doesn't already exist. It is not always necessary to

[jira] [Commented] (AIRFLOW-3050) Deactivate Stale DAGs in the Main Scheduler Loop

2018-09-12 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612658#comment-16612658 ] Ash Berlin-Taylor commented on AIRFLOW-3050: I would probably say at schedu

[GitHub] jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param

2018-09-12 Thread GitBox
jeffkpayne commented on issue #3887: [AIRFLOW-3044] Dataflow operators accept templated job_name param URL: https://github.com/apache/incubator-airflow/pull/3887#issuecomment-420768848 Fixing now... This is an automated mess

[jira] [Commented] (AIRFLOW-2953) Installing postgres and gcp_api doesn't install PostgresToGoogleCloudStorageOperator

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2953?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612621#comment-16612621 ] Iuliia Volkova commented on AIRFLOW-2953: - [~robert.l.kelly3] , do you fix the

[GitHub] feng-tao commented on issue #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop

2018-09-12 Thread GitBox
feng-tao commented on issue #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop URL: https://github.com/apache/incubator-airflow/pull/3873#issuecomment-420764932 will take a look later this week. This is an a

[jira] [Commented] (AIRFLOW-2928) Use uuid.uuid4 to create unique job name

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2928?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612619#comment-16612619 ] Iuliia Volkova commented on AIRFLOW-2928: - [~ashb], [~Fokko] , please close the

[GitHub] xnuinside edited a comment on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow

2018-09-12 Thread GitBox
xnuinside edited a comment on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow URL: https://github.com/apache/incubator-airflow/pull/3826#issuecomment-420762430 @kaxil , please review This is an automated me

[GitHub] xnuinside commented on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow

2018-09-12 Thread GitBox
xnuinside commented on issue #3826: [AIRFLOW-2988] Run specifically python2 for dataflow URL: https://github.com/apache/incubator-airflow/pull/3826#issuecomment-420762430 @kaxil , @tswast , please review This is an automated

[GitHub] jeffkpayne commented on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
jeffkpayne commented on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#issuecomment-420762458 @kaxil Made the requested changes to the docstrings. --

[GitHub] danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE

2018-09-12 Thread GitBox
danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE URL: https://github.com/apache/incubator-airflow/pull/3435#discussion_r217152739 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -

[GitHub] danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE

2018-09-12 Thread GitBox
danmactough commented on a change in pull request #3435: [AIRFLOW-2539] OS Environment variable for logging FILENAME_TEMPLATE URL: https://github.com/apache/incubator-airflow/pull/3435#discussion_r217152739 ## File path: airflow/config_templates/default_airflow.cfg ## @@ -

[jira] [Comment Edited] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612593#comment-16612593 ] Iuliia Volkova edited comment on AIRFLOW-2469 at 9/12/18 7:02 PM: ---

[jira] [Commented] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612593#comment-16612593 ] Iuliia Volkova commented on AIRFLOW-2469: - link to the doc with pattern matchin

[jira] [Issue Comment Deleted] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova updated AIRFLOW-2469: Comment: was deleted (was: link to the doc with pattern matching condition: [https://bea

[jira] [Commented] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612566#comment-16612566 ] Iuliia Volkova commented on AIRFLOW-2469: - link to the doc with pattern matchin

[jira] [Assigned] (AIRFLOW-2469) example task in documentation causes dataflow operator to fail

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Iuliia Volkova reassigned AIRFLOW-2469: --- Assignee: Iuliia Volkova > example task in documentation causes dataflow operator

[jira] [Created] (AIRFLOW-3050) Deactivate Stale DAGs in the Main Scheduler Loop

2018-09-12 Thread Dan Davydov (JIRA)
Dan Davydov created AIRFLOW-3050: Summary: Deactivate Stale DAGs in the Main Scheduler Loop Key: AIRFLOW-3050 URL: https://issues.apache.org/jira/browse/AIRFLOW-3050 Project: Apache Airflow I

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr&el=h1) Report > Mergi

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr&el=h1) Report > Mergi

[GitHub] codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3878: [AIRFLOW-3034]: Update Readme : Add slack link, remove Gitter URL: https://github.com/apache/incubator-airflow/pull/3878#issuecomment-420078393 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3878?src=pr&el=h1) Report > Mergi

[GitHub] dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r217129158 ## File path: tests/operators/__init__.py ## @@ -7,21 +7,26 @@ # to you under the Apa

[GitHub] codecov-io edited a comment on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
codecov-io edited a comment on issue #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#issuecomment-420458359 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/3884?src=pr&el=h1) Report > Merg

[GitHub] dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r217119304 ## File path: tox.ini ## @@ -57,10 +58,12 @@ passenv = * commands = pip wheel --pr

[GitHub] dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose

2018-09-12 Thread GitBox
dimberman commented on a change in pull request #3797: [AIRFLOW-2952] Splits CI into k8s + docker-compose URL: https://github.com/apache/incubator-airflow/pull/3797#discussion_r217119163 ## File path: tests/operators/__init__.py ## @@ -7,21 +7,26 @@ # to you under the Apa

[jira] [Commented] (AIRFLOW-3049) Add update, replace, delete commands for Mongo hook

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612480#comment-16612480 ] ASF GitHub Bot commented on AIRFLOW-3049: - dlebech opened a new pull request #3

[GitHub] dlebech opened a new pull request #3890: [AIRFLOW-3049] Add extra operations for Mongo hook

2018-09-12 Thread GitBox
dlebech opened a new pull request #3890: [AIRFLOW-3049] Add extra operations for Mongo hook URL: https://github.com/apache/incubator-airflow/pull/3890 Make sure you have checked _all_ steps below. ### Jira - [X] My PR addresses the following [Airflow Jira](https://issues.apac

[GitHub] jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#discussion_r217110985 ## File path: airflow/contrib/operators/dataproc_operator.py ## @@ -688,6

[jira] [Commented] (AIRFLOW-638) Added schema_update_options to BigQueryBaseCursor and GoogleCloudStorageToBigQueryOperator

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-638?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612452#comment-16612452 ] Iuliia Volkova commented on AIRFLOW-638: [~ashb] , [~kaxilnaik] , please close t

[GitHub] jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops

2018-09-12 Thread GitBox
jeffkpayne commented on a change in pull request #3884: [AIRFLOW-3035] Allow custom 'job_error_states' in dataproc ops URL: https://github.com/apache/incubator-airflow/pull/3884#discussion_r217107487 ## File path: airflow/contrib/operators/dataproc_operator.py ## @@ -688,6

[jira] [Created] (AIRFLOW-3049) Add update, replace, delete commands for Mongo hook

2018-09-12 Thread David Volquartz Lebech (JIRA)
David Volquartz Lebech created AIRFLOW-3049: --- Summary: Add update, replace, delete commands for Mongo hook Key: AIRFLOW-3049 URL: https://issues.apache.org/jira/browse/AIRFLOW-3049 Project: A

[jira] [Commented] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612438#comment-16612438 ] Iuliia Volkova commented on AIRFLOW-2772: - [~kaxilnaik] , [~fenglu] , please wr

[jira] [Comment Edited] (AIRFLOW-2772) BigQuery hook does not allow specifying both the partition field name and table name at the same time

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2772?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612438#comment-16612438 ] Iuliia Volkova edited comment on AIRFLOW-2772 at 9/12/18 4:38 PM: ---

[jira] [Commented] (AIRFLOW-2889) Fix typos detected by github.com/client9/misspell

2018-09-12 Thread Iuliia Volkova (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2889?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612432#comment-16612432 ] Iuliia Volkova commented on AIRFLOW-2889: - [~ashb], [~seratch] , please close t

[GitHub] xnuinside commented on issue #3870: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file

2018-09-12 Thread GitBox
xnuinside commented on issue #3870: [AIRFLOW-2932] GoogleCloudStorageHook - allow compression of file URL: https://github.com/apache/incubator-airflow/pull/3870#issuecomment-420712325 @neil90, Hi and thank you for PR! Could you fix your flake8 issues? Your travis build failed in flake8 en

[GitHub] feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420692913 FYI, this fix won't work as there are five types of authentication model. This change only intends for DB

[GitHub] feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
feng-tao commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420690835 I worked on this code. I will take a look. --

[jira] [Commented] (AIRFLOW-3048) (www_rbac) Non-Admin Roles' Access to Pages "Profile", "Edit User", and "Reset my password"

2018-09-12 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3048?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16612332#comment-16612332 ] ASF GitHub Bot commented on AIRFLOW-3048: - XD-DENG closed pull request #3889: [

[GitHub] XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420690342 CI fails. Will re-open after I fix the CI. ---

[GitHub] XD-DENG closed pull request #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG closed pull request #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of

[GitHub] XD-DENG removed a comment on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG removed a comment on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420676042 Hi @r39132, may you kindly refer committers or contributors who's working on the `www_rbac` to hav

[GitHub] feluelle commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server

2018-09-12 Thread GitBox
feluelle commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server URL: https://github.com/apache/incubator-airflow/pull/3661#discussion_r217070936 ## File path: airflow/contrib/hooks/imap_hook.py ## @@ -0,0 +1,262 @@ +# -*-

[GitHub] ashb commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server

2018-09-12 Thread GitBox
ashb commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server URL: https://github.com/apache/incubator-airflow/pull/3661#discussion_r217064162 ## File path: airflow/contrib/hooks/imap_hook.py ## @@ -0,0 +1,262 @@ +# -*- codi

[GitHub] feluelle commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server

2018-09-12 Thread GitBox
feluelle commented on a change in pull request #3661: [AIRFLOW-2780] Adds IMAP Hook to interact with a mail server URL: https://github.com/apache/incubator-airflow/pull/3661#discussion_r217063527 ## File path: airflow/contrib/hooks/imap_hook.py ## @@ -0,0 +1,262 @@ +# -*-

[GitHub] XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles

2018-09-12 Thread GitBox
XD-DENG commented on issue #3889: [AIRFLOW-3048] Add access to self-manage pages for non-Admin roles URL: https://github.com/apache/incubator-airflow/pull/3889#issuecomment-420676042 Hi @r39132, may you kindly refer committers or contributors who's working on the `www_rbac` to have a look

  1   2   >