[jira] [Created] (AIRFLOW-5871) Stopping/Clearing a running airflow instance doesnt't terminate the job actually.

2019-11-07 Thread Vasudha Putta (Jira)
Vasudha Putta created AIRFLOW-5871: -- Summary: Stopping/Clearing a running airflow instance doesnt't terminate the job actually. Key: AIRFLOW-5871 URL: https://issues.apache.org/jira/browse/AIRFLOW-5871

[jira] [Comment Edited] (AIRFLOW-5860) Add the field `dagrun_id` to the response of experimental API on trigger.

2019-11-07 Thread Anton Kumpan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969784#comment-16969784 ] Anton Kumpan edited comment on AIRFLOW-5860 at 11/8/19 3:17 AM: I

[jira] [Comment Edited] (AIRFLOW-5860) Add the field `dagrun_id` to the response of experimental API on trigger.

2019-11-07 Thread Anton Kumpan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969784#comment-16969784 ] Anton Kumpan edited comment on AIRFLOW-5860 at 11/8/19 3:16 AM: I

[GitHub] [airflow-site] mik-laj opened a new pull request #143: Add version selector

2019-11-07 Thread GitBox
mik-laj opened a new pull request #143: Add version selector URL: https://github.com/apache/airflow-site/pull/143 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] aKumpan commented on issue #6256: [AIRFLOW-5590] Add run_id to trigger DAG run API response

2019-11-07 Thread GitBox
aKumpan commented on issue #6256: [AIRFLOW-5590] Add run_id to trigger DAG run API response URL: https://github.com/apache/airflow/pull/6256#issuecomment-551365641 @XD-DENG hi, could you please merge this? This is an

[jira] [Updated] (AIRFLOW-5590) Add 'run_id' to trigger DAG run API response as a field

2019-11-07 Thread Anton Kumpan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5590?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Anton Kumpan updated AIRFLOW-5590: -- External issue URL: https://github.com/apache/airflow/pull/6256 > Add 'run_id' to trigger

[jira] [Commented] (AIRFLOW-5860) Add the field `dagrun_id` to the response of experimental API on trigger.

2019-11-07 Thread Anton Kumpan (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5860?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969784#comment-16969784 ] Anton Kumpan commented on AIRFLOW-5860: --- I believe this is duplicate of 

[GitHub] [airflow] aKumpan commented on issue #6514: AIRFLOW-5590: Add dagrun_id to the response of experimental API on trigger.

2019-11-07 Thread GitBox
aKumpan commented on issue #6514: AIRFLOW-5590: Add dagrun_id to the response of experimental API on trigger. URL: https://github.com/apache/airflow/pull/6514#issuecomment-551365190 I believe you are duplicating: https://github.com/apache/airflow/pull/6256

[GitHub] [airflow] codecov-io commented on issue #6519: [AIRFLOW-5869] BugFix: Creating DagRuns fails for Deserialized tasks …

2019-11-07 Thread GitBox
codecov-io commented on issue #6519: [AIRFLOW-5869] BugFix: Creating DagRuns fails for Deserialized tasks … URL: https://github.com/apache/airflow/pull/6519#issuecomment-551353595 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6519?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-5870) Allow infinite pool for tasks

2019-11-07 Thread Alex Guziel (Jira)
Alex Guziel created AIRFLOW-5870: Summary: Allow infinite pool for tasks Key: AIRFLOW-5870 URL: https://issues.apache.org/jira/browse/AIRFLOW-5870 Project: Apache Airflow Issue Type:

[GitHub] [airflow] saguziel opened a new pull request #6520: [AIRFLOW-5870] Allow -1 for infinite pool size

2019-11-07 Thread GitBox
saguziel opened a new pull request #6520: [AIRFLOW-5870] Allow -1 for infinite pool size URL: https://github.com/apache/airflow/pull/6520 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[jira] [Commented] (AIRFLOW-5870) Allow infinite pool for tasks

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5870?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969728#comment-16969728 ] ASF GitHub Bot commented on AIRFLOW-5870: - saguziel commented on pull request #6520:

[GitHub] [airflow-site] mik-laj opened a new pull request #142: Create indexes in an automagical way

2019-11-07 Thread GitBox
mik-laj opened a new pull request #142: Create indexes in an automagical way URL: https://github.com/apache/airflow-site/pull/142 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow-site] mik-laj opened a new pull request #141: Add cleanup command

2019-11-07 Thread GitBox
mik-laj opened a new pull request #141: Add cleanup command URL: https://github.com/apache/airflow-site/pull/141 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow-site] mik-laj opened a new pull request #140: Fix process killing by CTRL + C

2019-11-07 Thread GitBox
mik-laj opened a new pull request #140: Fix process killing by CTRL + C URL: https://github.com/apache/airflow-site/pull/140 This is an automated message from the Apache Git Service. To respond to the message, please log on

[jira] [Updated] (AIRFLOW-5869) Creating DagRuns fails for Deserialized tasks with no start_date

2019-11-07 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-5869: Fix Version/s: 1.10.7 > Creating DagRuns fails for Deserialized tasks with no start_date >

[GitHub] [airflow] codecov-io commented on issue #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21]

2019-11-07 Thread GitBox
codecov-io commented on issue #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6518#issuecomment-551332733 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6518?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21]

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6518#issuecomment-551332733 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6518?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21]

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6518#issuecomment-551332733 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6518?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5869) Creating DagRuns fails for Deserialized tasks with no start_date

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969678#comment-16969678 ] ASF GitHub Bot commented on AIRFLOW-5869: - kaxil commented on pull request #6519:

[GitHub] [airflow] kaxil opened a new pull request #6519: [AIRFLOW-5869] BugFix: Creating DagRuns fails for Deserialized tasks …

2019-11-07 Thread GitBox
kaxil opened a new pull request #6519: [AIRFLOW-5869] BugFix: Creating DagRuns fails for Deserialized tasks … URL: https://github.com/apache/airflow/pull/6519 …with no start_date Make sure you have checked _all_ steps below. ### Jira -

[jira] [Updated] (AIRFLOW-5869) Creating DagRuns fails for Deserialized tasks with no start_date

2019-11-07 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5869?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-5869: Summary: Creating DagRuns fails for Deserialized tasks with no start_date (was: Deserialized

[jira] [Created] (AIRFLOW-5869) Deserialized Operators have no start_date

2019-11-07 Thread Kaxil Naik (Jira)
Kaxil Naik created AIRFLOW-5869: --- Summary: Deserialized Operators have no start_date Key: AIRFLOW-5869 URL: https://issues.apache.org/jira/browse/AIRFLOW-5869 Project: Apache Airflow Issue

[GitHub] [airflow] ratb3rt commented on issue #6502: [AIRFLOW-5786] Migrate AWS SNS to /providers/aws

2019-11-07 Thread GitBox
ratb3rt commented on issue #6502: [AIRFLOW-5786] Migrate AWS SNS to /providers/aws URL: https://github.com/apache/airflow/pull/6502#issuecomment-551319400 Migrated to new paths This is an automated message from the Apache

[jira] [Commented] (AIRFLOW-5867) [--debug] unit_test_mode configuration interpreted as str instead of bool

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969636#comment-16969636 ] ASF GitHub Bot commented on AIRFLOW-5867: - rvanasa commented on pull request #6517:

[jira] [Commented] (AIRFLOW-5867) [--debug] unit_test_mode configuration interpreted as str instead of bool

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969637#comment-16969637 ] ASF GitHub Bot commented on AIRFLOW-5867: - rvanasa commented on pull request #6517:

[GitHub] [airflow] rvanasa opened a new pull request #6517: [AIRFLOW-5867] Fix reloading when using webserver --debug command

2019-11-07 Thread GitBox
rvanasa opened a new pull request #6517: [AIRFLOW-5867] Fix reloading when using webserver --debug command URL: https://github.com/apache/airflow/pull/6517 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[GitHub] [airflow] rvanasa closed pull request #6517: [AIRFLOW-5867] Fix reloading when using webserver --debug command

2019-11-07 Thread GitBox
rvanasa closed pull request #6517: [AIRFLOW-5867] Fix reloading when using webserver --debug command URL: https://github.com/apache/airflow/pull/6517 This is an automated message from the Apache Git Service. To respond to

[jira] [Commented] (AIRFLOW-5782) Migrate AWS Lambda to /providers/aws [AIP-21]

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969627#comment-16969627 ] ASF GitHub Bot commented on AIRFLOW-5782: - shcherbin commented on pull request #6518:

[GitHub] [airflow] shcherbin opened a new pull request #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21]

2019-11-07 Thread GitBox
shcherbin opened a new pull request #6518: [AIRFLOW-5782] Migrate AWS Lambda to /providers/aws [AIP-21] URL: https://github.com/apache/airflow/pull/6518 Make sure you have checked _all_ steps below. ### Jira - [x] My PR addresses the following [Airflow

[jira] [Created] (AIRFLOW-5868) Should not deepcopy shallow_copy attributes

2019-11-07 Thread Ping Zhang (Jira)
Ping Zhang created AIRFLOW-5868: --- Summary: Should not deepcopy shallow_copy attributes Key: AIRFLOW-5868 URL: https://issues.apache.org/jira/browse/AIRFLOW-5868 Project: Apache Airflow Issue

[jira] [Assigned] (AIRFLOW-5782) Migrate AWS Lambda to /providers/aws [AIP-21]

2019-11-07 Thread Cyril Shcherbin (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5782?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Cyril Shcherbin reassigned AIRFLOW-5782: Assignee: Cyril Shcherbin > Migrate AWS Lambda to /providers/aws [AIP-21] >

[jira] [Commented] (AIRFLOW-4547) Negative priority_weight should not be permitted

2019-11-07 Thread Alex Abraham (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-4547?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969606#comment-16969606 ] Alex Abraham commented on AIRFLOW-4547: --- I actually have a use case where this is the desired

[jira] [Commented] (AIRFLOW-5817) Improve BigQuery operators idempotency

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969523#comment-16969523 ] ASF GitHub Bot commented on AIRFLOW-5817: - kaxil commented on pull request #6470:

[GitHub] [airflow] kaxil merged pull request #6470: [AIRFLOW-5817] Improve BigQuery operators idempotency

2019-11-07 Thread GitBox
kaxil merged pull request #6470: [AIRFLOW-5817] Improve BigQuery operators idempotency URL: https://github.com/apache/airflow/pull/6470 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Commented] (AIRFLOW-5817) Improve BigQuery operators idempotency

2019-11-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969524#comment-16969524 ] ASF subversion and git services commented on AIRFLOW-5817: -- Commit

[jira] [Resolved] (AIRFLOW-5817) Improve BigQuery operators idempotency

2019-11-07 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5817?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5817. - Fix Version/s: 2.0.0 Resolution: Fixed > Improve BigQuery operators idempotency >

[jira] [Updated] (AIRFLOW-5867) [--debug] unit_test_mode configuration interpreted as str instead of bool

2019-11-07 Thread Ryan Vandersmith (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ryan Vandersmith updated AIRFLOW-5867: -- Description: Relevant StackOverflow question:

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343833274 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[jira] [Commented] (AIRFLOW-5867) [--debug] unit_test_mode configuration interpreted as str instead of bool

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5867?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969521#comment-16969521 ] ASF GitHub Bot commented on AIRFLOW-5867: - rvanasa commented on pull request #6517:

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343831995 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] rvanasa opened a new pull request #6517: [AIRFLOW-5867] Fix webserver unit_test_mode data type

2019-11-07 Thread GitBox
rvanasa opened a new pull request #6517: [AIRFLOW-5867] Fix webserver unit_test_mode data type URL: https://github.com/apache/airflow/pull/6517 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343830368 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[jira] [Created] (AIRFLOW-5867) [--debug] unit_test_mode configuration interpreted as str instead of bool

2019-11-07 Thread Ryan Vandersmith (Jira)
Ryan Vandersmith created AIRFLOW-5867: - Summary: [--debug] unit_test_mode configuration interpreted as str instead of bool Key: AIRFLOW-5867 URL: https://issues.apache.org/jira/browse/AIRFLOW-5867

[GitHub] [airflow] codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-537654940 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6230?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-537654940 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6230?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-537654940 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6230?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-537654940 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6230?src=pr=h1) Report > Merging

[jira] [Commented] (AIRFLOW-5819) AWSBatchOperator has invalid default value for array_properties

2019-11-07 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969513#comment-16969513 ] ASF subversion and git services commented on AIRFLOW-5819: -- Commit

[GitHub] [airflow] kaxil merged pull request #6473: [AIRFLOW-5819] Update AWSBatchOperator default value

2019-11-07 Thread GitBox
kaxil merged pull request #6473: [AIRFLOW-5819] Update AWSBatchOperator default value URL: https://github.com/apache/airflow/pull/6473 This is an automated message from the Apache Git Service. To respond to the message,

[jira] [Resolved] (AIRFLOW-5819) AWSBatchOperator has invalid default value for array_properties

2019-11-07 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-5819. - Fix Version/s: 1.10.7 Resolution: Fixed > AWSBatchOperator has invalid default value

[jira] [Commented] (AIRFLOW-5819) AWSBatchOperator has invalid default value for array_properties

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5819?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969512#comment-16969512 ] ASF GitHub Bot commented on AIRFLOW-5819: - kaxil commented on pull request #6473:

[GitHub] [airflow] TobKed commented on issue #6511: [AIRFLOW-XXX] Improve the PubSub documentation

2019-11-07 Thread GitBox
TobKed commented on issue #6511: [AIRFLOW-XXX] Improve the PubSub documentation URL: https://github.com/apache/airflow/pull/6511#issuecomment-551215099 > In case you fix a typo in the documentation you can prepend your commit with [AIRFLOW-XXX], code changes always need a Jira issue. ||

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Description: mysql rds metastore - db.m5.large instance, 5.7.26 version   task_instance table has 

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Description: mysql rds metastore - db.m5.large instance, 5.7.26 version   task_instance table has 

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Description: mysql rds metastore - db.m5.large instance, 5.7.26 version   task_instance table has 

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Description: mysql rds metastore - db.m5.large instance, 5.7.26 version   task_instance table has 

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Attachment: EC2's `ps -ef pipe wc -l` count.png > Task_instance table too large causing issues? >

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Attachment: mysql cpu_util.png > Task_instance table too large causing issues? >

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Attachment: mysql write latency.png > Task_instance table too large causing issues? >

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Attachment: mysql read latency.png > Task_instance table too large causing issues? >

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Description: mysql rds metastore - db.m5.large instance, 5.7.26 version   task_instance table has 

[GitHub] [airflow] TobKed commented on a change in pull request #6393: [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator

2019-11-07 Thread GitBox
TobKed commented on a change in pull request #6393: [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/6393#discussion_r343803655 ## File path: airflow/operators/sftp_to_gcs.py ## @@ -0,0 +1,178 @@ +# Review comment: I've

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Attachment: mysql dbconnections.png > Task_instance table too large causing issues? >

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Attachment: mysql write IOPS.png > Task_instance table too large causing issues? >

[GitHub] [airflow] codecov-io edited a comment on issue #6473: [AIRFLOW-5819] Update AWSBatchOperator default value

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6473: [AIRFLOW-5819] Update AWSBatchOperator default value URL: https://github.com/apache/airflow/pull/6473#issuecomment-548057865 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6473?src=pr=h1) Report > Merging

[jira] [Updated] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5866?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-5866: -- Attachment: Mysql queuedepth.png > Task_instance table too large causing issues? >

[GitHub] [airflow] codecov-io edited a comment on issue #6473: [AIRFLOW-5819] Update AWSBatchOperator default value

2019-11-07 Thread GitBox
codecov-io edited a comment on issue #6473: [AIRFLOW-5819] Update AWSBatchOperator default value URL: https://github.com/apache/airflow/pull/6473#issuecomment-548057865 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6473?src=pr=h1) Report > Merging

[jira] [Created] (AIRFLOW-5866) Task_instance table too large causing issues?

2019-11-07 Thread t oo (Jira)
t oo created AIRFLOW-5866: - Summary: Task_instance table too large causing issues? Key: AIRFLOW-5866 URL: https://issues.apache.org/jira/browse/AIRFLOW-5866 Project: Apache Airflow Issue Type: Bug

[GitHub] [airflow] TobKed commented on a change in pull request #6393: [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator

2019-11-07 Thread GitBox
TobKed commented on a change in pull request #6393: [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/6393#discussion_r343784244 ## File path: docs/howto/operator/gcp/sftp_to_gcs.rst ## @@ -0,0 +1,105 @@ + .. Licensed to the

[GitHub] [airflow] TobKed commented on a change in pull request #6393: [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator

2019-11-07 Thread GitBox
TobKed commented on a change in pull request #6393: [AIRFLOW-5718] Add SFTPToGoogleCloudStorageOperator URL: https://github.com/apache/airflow/pull/6393#discussion_r343782483 ## File path: tests/operators/test_sftp_to_gcs.py ## @@ -0,0 +1,213 @@ +#!/usr/bin/env python +#

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343755387 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343755456 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343754810 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343753269 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343755288 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343753683 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343734138 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[GitHub] [airflow] kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
kaxil commented on a change in pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#discussion_r343733936 ## File path: docs/howto/dags-in-production.rst ## @@ -0,0 +1,247 @@ + .. Licensed to the Apache

[jira] [Commented] (AIRFLOW-5704) Docker scripts for kind kubernetes tests can be improved

2019-11-07 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969396#comment-16969396 ] ASF GitHub Bot commented on AIRFLOW-5704: - potiuk commented on pull request #6516:

[GitHub] [airflow] potiuk opened a new pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2019-11-07 Thread GitBox
potiuk opened a new pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516 * Fixed problem that Kubernetes tests were testing latest master rather than what came from the local sources. * Moved

[jira] [Comment Edited] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread Jon Hanson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969391#comment-16969391 ] Jon Hanson edited comment on AIRFLOW-1753 at 11/7/19 4:28 PM: -- Even if you

[jira] [Commented] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread Jon Hanson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969391#comment-16969391 ] Jon Hanson commented on AIRFLOW-1753: - Even if you get past that, the same script (daemon.py) fails

[jira] [Commented] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread jack (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969386#comment-16969386 ] jack commented on AIRFLOW-1753: --- pwd is a built-in module(come with python installation) for unix like

[jira] [Comment Edited] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread Jon Hanson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969376#comment-16969376 ] Jon Hanson edited comment on AIRFLOW-1753 at 11/7/19 4:12 PM: -- [~ash] If

[jira] [Comment Edited] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread Jon Hanson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969376#comment-16969376 ] Jon Hanson edited comment on AIRFLOW-1753 at 11/7/19 4:12 PM: -- @[~ash] If

[jira] [Comment Edited] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread Jon Hanson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969376#comment-16969376 ] Jon Hanson edited comment on AIRFLOW-1753 at 11/7/19 4:11 PM: -- If you get

[jira] [Commented] (AIRFLOW-1753) Can't install on windows 10

2019-11-07 Thread Jon Hanson (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-1753?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16969376#comment-16969376 ] Jon Hanson commented on AIRFLOW-1753: - If you get it to build, and then run {{airflow initdb}}, it

[GitHub] [airflow] KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
KKcorps commented on issue #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515#issuecomment-551142274 Surge UI - http://airflow.kharekartik-prod-dag.surge.sh/howto/dags-in-production.html

[GitHub] [airflow] KKcorps opened a new pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready

2019-11-07 Thread GitBox
KKcorps opened a new pull request #6515: [AIRFLOW-XXX] GSoD: How to make DAGs production ready URL: https://github.com/apache/airflow/pull/6515 Make sure you have checked _all_ steps below. ### Jira - [ ] My PR addresses the following [Airflow

[GitHub] [airflow] baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator

2019-11-07 Thread GitBox
baolsen commented on issue #6512: [AIRFLOW-5824] Added AWS DataSync Hook and Operator URL: https://github.com/apache/airflow/pull/6512#issuecomment-551119608 I split up the monolithic DataSync operator into different operators for Create, Get, Update, Delete and execute. This provides

[GitHub] [airflow-site] mik-laj closed pull request #124: Suggest a change button

2019-11-07 Thread GitBox
mik-laj closed pull request #124: Suggest a change button URL: https://github.com/apache/airflow-site/pull/124 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow-site] mik-laj commented on issue #106: [depends on #124] Roadmap

2019-11-07 Thread GitBox
mik-laj commented on issue #106: [depends on #124] Roadmap URL: https://github.com/apache/airflow-site/pull/106#issuecomment-551118740 Superseded by: https://github.com/apache/airflow-site/pull/138 This is an automated

[GitHub] [airflow-site] mik-laj closed pull request #100: [depends on #91] Docs

2019-11-07 Thread GitBox
mik-laj closed pull request #100: [depends on #91] Docs URL: https://github.com/apache/airflow-site/pull/100 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[GitHub] [airflow-site] mik-laj commented on issue #125: [depends on #106] Feature/tracking progress

2019-11-07 Thread GitBox
mik-laj commented on issue #125: [depends on #106] Feature/tracking progress URL: https://github.com/apache/airflow-site/pull/125#issuecomment-551118782 Superseded by: https://github.com/apache/airflow-site/pull/138 This is

[GitHub] [airflow-site] mik-laj edited a comment on issue #100: [depends on #91] Docs

2019-11-07 Thread GitBox
mik-laj edited a comment on issue #100: [depends on #91] Docs URL: https://github.com/apache/airflow-site/pull/100#issuecomment-551118349 Superseded by: https://github.com/apache/airflow-site/pull/138 This is an automated

[GitHub] [airflow-site] mik-laj closed pull request #106: [depends on #124] Roadmap

2019-11-07 Thread GitBox
mik-laj closed pull request #106: [depends on #124] Roadmap URL: https://github.com/apache/airflow-site/pull/106 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow-site] mik-laj commented on issue #124: Suggest a change button

2019-11-07 Thread GitBox
mik-laj commented on issue #124: Suggest a change button URL: https://github.com/apache/airflow-site/pull/124#issuecomment-551119041 Superseded by: https://github.com/apache/airflow-site/pull/138 This is an automated message

[GitHub] [airflow-site] mik-laj closed pull request #125: [depends on #106] Feature/tracking progress

2019-11-07 Thread GitBox
mik-laj closed pull request #125: [depends on #106] Feature/tracking progress URL: https://github.com/apache/airflow-site/pull/125 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow-site] mik-laj commented on issue #100: [depends on #91] Docs

2019-11-07 Thread GitBox
mik-laj commented on issue #100: [depends on #91] Docs URL: https://github.com/apache/airflow-site/pull/100#issuecomment-551118349 Suspensed by: https://github.com/apache/airflow-site/pull/138 This is an automated message

  1   2   >