[GitHub] oelesinsc24 commented on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-18 Thread GitBox
oelesinsc24 commented on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#issuecomment-431251857 Everyone, I have moved this PR to: https://github.com/apache/incubator-airflow/pull/4068. I will close this lat

[GitHub] oelesinsc24 opened a new pull request #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-18 Thread GitBox
oelesinsc24 opened a new pull request #4068: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/4068 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow Jira](https://

[jira] [Commented] (AIRFLOW-2310) Enable AWS Glue Job Integration

2018-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-2310?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656307#comment-16656307 ] ASF GitHub Bot commented on AIRFLOW-2310: - oelesinsc24 opened a new pull reques

[jira] [Commented] (AIRFLOW-3172) AttributeError: 'DagModel' object has no attribute 'execution_date'

2018-10-18 Thread Pat Christopher (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656293#comment-16656293 ] Pat Christopher commented on AIRFLOW-3172: -- [~vinnson] do you mind dumping the

[jira] [Commented] (AIRFLOW-3172) AttributeError: 'DagModel' object has no attribute 'execution_date'

2018-10-18 Thread Pat Christopher (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656289#comment-16656289 ] Pat Christopher commented on AIRFLOW-3172: -- This is the PR that introduced the

[jira] [Commented] (AIRFLOW-3172) AttributeError: 'DagModel' object has no attribute 'execution_date'

2018-10-18 Thread Pat Christopher (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16656284#comment-16656284 ] Pat Christopher commented on AIRFLOW-3172: -- No idea!ย  I was hoping an airflow

[GitHub] oelesinsc24 commented on a change in pull request #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-18 Thread GitBox
oelesinsc24 commented on a change in pull request #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#discussion_r226533475 ## File path: airflow/contrib/aws_glue_job_hook.py ## @@ -0,0 +1,212 @@ +# -*

[GitHub] oelesinsc24 commented on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow

2018-10-18 Thread GitBox
oelesinsc24 commented on issue #3504: [AIRFLOW-2310]: Add AWS Glue Job Compatibility to Airflow URL: https://github.com/apache/incubator-airflow/pull/3504#issuecomment-431243451 > @OElesin Have you been able to make any progress on this? > There's one duplicate file in there `airflow/co

[GitHub] KevinYang21 commented on issue #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop

2018-10-18 Thread GitBox
KevinYang21 commented on issue #3873: [Airflow-2760] Decouple DAG parsing loop from scheduler loop URL: https://github.com/apache/incubator-airflow/pull/3873#issuecomment-431199074 Is there more I can do to have this PR merged? -

[jira] [Commented] (AIRFLOW-3215) Creating EMR using python from airflow

2018-10-18 Thread Pandu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655958#comment-16655958 ] Pandu commented on AIRFLOW-3215: Hi there, I am using yaml file to lanch EC

[jira] [Commented] (AIRFLOW-3215) Creating EMR using python from airflow

2018-10-18 Thread Pandu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655961#comment-16655961 ] Pandu commented on AIRFLOW-3215: AWSTemplateFormatVersion: '2010-09-09' Description: A

[jira] [Commented] (AIRFLOW-3215) Creating EMR using python from airflow

2018-10-18 Thread Pandu (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3215?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655960#comment-16655960 ] Pandu commented on AIRFLOW-3215: here is the attachment of yaml file > Creating EMR us

[GitHub] Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism

2018-10-18 Thread GitBox
Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism URL: https://github.com/apache/incubator-airflow/pull/3584#issuecomment-431128640 It looks like the test is now passing, though that's not clear whether it was an intermittent failure or if it was indeed having issu

[GitHub] Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism

2018-10-18 Thread GitBox
Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism URL: https://github.com/apache/incubator-airflow/pull/3584#issuecomment-431095134 In the off chance that this is due to a Kubernetes-only exception that is blocking scheduling that the other scheduler tests don't ca

[GitHub] mavarek commented on issue #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator

2018-10-18 Thread GitBox
mavarek commented on issue #3741: [AIRFLOW-1368] Add auto_remove for DockerOperator URL: https://github.com/apache/incubator-airflow/pull/3741#issuecomment-431087472 Just a comment, we ran into an issue when using this where docker would remove the container before airflow could get the e

[jira] [Commented] (AIRFLOW-3232) Make documentation for GCF Functions operator more readable

2018-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655570#comment-16655570 ] ASF GitHub Bot commented on AIRFLOW-3232: - ashb closed pull request #4067: [AIR

[GitHub] ashb closed pull request #4067: [AIRFLOW-3232] More readable GCF operator documentation

2018-10-18 Thread GitBox
ashb closed pull request #4067: [AIRFLOW-3232] More readable GCF operator documentation URL: https://github.com/apache/incubator-airflow/pull/4067 This is a PR merged from a forked repository. As GitHub hides the original diff on merge, it is displayed below for the sake of provenance: A

[GitHub] ashb commented on issue #4067: [AIRFLOW-3232] More readable GCF operator documentation

2018-10-18 Thread GitBox
ashb commented on issue #4067: [AIRFLOW-3232] More readable GCF operator documentation URL: https://github.com/apache/incubator-airflow/pull/4067#issuecomment-431081464 ๐Ÿ˜ ๐Ÿ’ฏ ๐ŸŽ‰ ๐Ÿ˜ฒ This is an automated message from the Apache G

[GitHub] codecov-io commented on issue #4067: [AIRFLOW-3232] More readable GCF operator documentation

2018-10-18 Thread GitBox
codecov-io commented on issue #4067: [AIRFLOW-3232] More readable GCF operator documentation URL: https://github.com/apache/incubator-airflow/pull/4067#issuecomment-431073819 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4067?src=pr&el=h1) Report > Merging [#4067](h

[GitHub] ashb commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism

2018-10-18 Thread GitBox
ashb commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism URL: https://github.com/apache/incubator-airflow/pull/3584#issuecomment-431073238 The kube builds just passed on another PR opened just now (https://travis-ci.org/apache/incubator-airflow/builds/443257829) so it's unl

[GitHub] Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism

2018-10-18 Thread GitBox
Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism URL: https://github.com/apache/incubator-airflow/pull/3584#issuecomment-431071951 From my perspective, the Travis failures above are spurious minikube test failures - maybe related to the ongoing pinning issues? Wou

[jira] [Commented] (AIRFLOW-3232) Make documentation for GCF Functions operator more readable

2018-10-18 Thread ASF GitHub Bot (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3232?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16655469#comment-16655469 ] ASF GitHub Bot commented on AIRFLOW-3232: - potiuk opened a new pull request #40

[GitHub] potiuk opened a new pull request #4067: [AIRFLOW-3232] More readable GCF operator documentation

2018-10-18 Thread GitBox
potiuk opened a new pull request #4067: [AIRFLOW-3232] More readable GCF operator documentation URL: https://github.com/apache/incubator-airflow/pull/4067 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow Jira - Make documentat

[GitHub] ashb commented on issue #4061: [AIRFLOW-2799] Fix filtering UI objects by datetime

2018-10-18 Thread GitBox
ashb commented on issue #4061: [AIRFLOW-2799] Fix filtering UI objects by datetime URL: https://github.com/apache/incubator-airflow/pull/4061#issuecomment-431060272 @ebrard Tests are green now (helps if I actually hit enter on the terminal where I wrote `git push` :) ) if you could give i

[GitHub] codecov-io edited a comment on issue #4061: [AIRFLOW-2799] Fix filtering UI objects by datetime

2018-10-18 Thread GitBox
codecov-io edited a comment on issue #4061: [AIRFLOW-2799] Fix filtering UI objects by datetime URL: https://github.com/apache/incubator-airflow/pull/4061#issuecomment-430756389 # [Codecov](https://codecov.io/gh/apache/incubator-airflow/pull/4061?src=pr&el=h1) Report > Merging [#4061

[jira] [Created] (AIRFLOW-3232) Make documentation for GCF Functions operator more readable

2018-10-18 Thread Jarek Potiuk (JIRA)
Jarek Potiuk created AIRFLOW-3232: - Summary: Make documentation for GCF Functions operator more readable Key: AIRFLOW-3232 URL: https://issues.apache.org/jira/browse/AIRFLOW-3232 Project: Apache Airfl

[GitHub] Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism

2018-10-18 Thread GitBox
Eronarn commented on issue #3584: [AIRFLOW-249] Refactor the SLA mechanism URL: https://github.com/apache/incubator-airflow/pull/3584#issuecomment-431050903 I sent in the final test I was intending to write and fixed the remaining flake8 errors. If Travis passes this is ready for re-review

[jira] [Created] (AIRFLOW-3231) Basic operators for Google Cloud SQL (deploy / patch / delete)

2018-10-18 Thread Szymon Przedwojski (JIRA)
Szymon Przedwojski created AIRFLOW-3231: --- Summary: Basic operators for Google Cloud SQL (deploy / patch / delete) Key: AIRFLOW-3231 URL: https://issues.apache.org/jira/browse/AIRFLOW-3231 Projec

[jira] [Created] (AIRFLOW-3230) Add an Airflow CLI command for rendering graphs

2018-10-18 Thread James Meickle (JIRA)
James Meickle created AIRFLOW-3230: -- Summary: Add an Airflow CLI command for rendering graphs Key: AIRFLOW-3230 URL: https://issues.apache.org/jira/browse/AIRFLOW-3230 Project: Apache Airflow

[jira] [Created] (AIRFLOW-3229) New install with python3.7 fail - Need to bump tenacity version

2018-10-18 Thread Qj Chv (JIRA)
Qj Chv created AIRFLOW-3229: --- Summary: New install with python3.7 fail - Need to bump tenacity version Key: AIRFLOW-3229 URL: https://issues.apache.org/jira/browse/AIRFLOW-3229 Project: Apache Airflow

[jira] [Created] (AIRFLOW-3228) Airflow leaks Kubernetes credentials on exceptions

2018-10-18 Thread James Meickle (JIRA)
James Meickle created AIRFLOW-3228: -- Summary: Airflow leaks Kubernetes credentials on exceptions Key: AIRFLOW-3228 URL: https://issues.apache.org/jira/browse/AIRFLOW-3228 Project: Apache Airflow

[GitHub] dossett commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR

2018-10-18 Thread GitBox
dossett commented on issue #4064: AIRFLOW-3149 Support dataproc cluster deletion on ERROR URL: https://github.com/apache/incubator-airflow/pull/4064#issuecomment-431002257 Hi @fenglu-g thanks for your comment. My goal wasn't just to make sure the ERROR cluster gets deleted but to give th

[GitHub] michaelDovgal removed a comment on issue #3356: [AIRFLOW-2460] Users can acces PersistentVolumeClaims and Configmaps using KubernetesPodOperator

2018-10-18 Thread GitBox
michaelDovgal removed a comment on issue #3356: [AIRFLOW-2460] Users can acces PersistentVolumeClaims and Configmaps using KubernetesPodOperator URL: https://github.com/apache/incubator-airflow/pull/3356#issuecomment-428269287 @dimberman maybe I misunderstand something, but where is in thi

[jira] [Updated] (AIRFLOW-3183) Potential Bug in utils/dag_processing/DagFileProcessorManager.max_runs_reached()

2018-10-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3183?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor updated AIRFLOW-3183: --- Fix Version/s: 1.10.1 > Potential Bug in > utils/dag_processing/DagFileProcessorMa

[jira] [Closed] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack closed AIRFLOW-3227. - Resolution: Done > Airflow is broken when deleting a Variable > -- > >

[jira] [Commented] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654964#comment-16654964 ] jack commented on AIRFLOW-3227: --- Well I have no such file nor it has logs folder.. I dele

[jira] [Commented] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654934#comment-16654934 ] Ash Berlin-Taylor commented on AIRFLOW-3227: The path is {{/home/ubuntu/air

[jira] [Commented] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654930#comment-16654930 ] jack commented on AIRFLOW-3227: --- [~ashb] I have not DAG file with that name. > Airflow i

[jira] [Commented] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread Ash Berlin-Taylor (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654899#comment-16654899 ] Ash Berlin-Taylor commented on AIRFLOW-3227: {{loadairflow.py}} is in your

[jira] [Commented] (AIRFLOW-2508) Handle non string types in render_template_from_field

2018-10-18 Thread JIRA
[ https://issues.apache.org/jira/browse/AIRFLOW-2508?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654887#comment-16654887 ] Bjรถrn Pollex commented on AIRFLOW-2508: --- I'd propose to extend this to check if t

[jira] [Commented] (AIRFLOW-3172) AttributeError: 'DagModel' object has no attribute 'execution_date'

2018-10-18 Thread Vinnson Lee (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3172?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16654746#comment-16654746 ] Vinnson Lee commented on AIRFLOW-3172: -- Sure, but is there any reason behind to ac

[jira] [Updated] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
[ https://issues.apache.org/jira/browse/AIRFLOW-3227?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] jack updated AIRFLOW-3227: -- Priority: Critical (was: Major) Issue Type: Bug (was: Improvement) > Airflow is broken when deleting

[jira] [Created] (AIRFLOW-3227) Airflow is broken when deleting a Variable

2018-10-18 Thread jack (JIRA)
jack created AIRFLOW-3227: - Summary: Airflow is broken when deleting a Variable Key: AIRFLOW-3227 URL: https://issues.apache.org/jira/browse/AIRFLOW-3227 Project: Apache Airflow Issue Type: Improveme