[GitHub] [airflow] zhongjiajie commented on issue #7835: Remove JIRA ticket insert by bot in PR template

2020-04-04 Thread GitBox
zhongjiajie commented on issue #7835: Remove JIRA ticket insert by bot in PR template URL: https://github.com/apache/airflow/pull/7835#issuecomment-609359658 Thanks for merging This is an automated message from the Apache Git

[GitHub] [airflow] zhongjiajie commented on issue #8094: Fix enter Breeze with multiple container name include mysql

2020-04-04 Thread GitBox
zhongjiajie commented on issue #8094: Fix enter Breeze with multiple container name include mysql URL: https://github.com/apache/airflow/pull/8094#issuecomment-609359609 Thanks for merging This is an automated message from th

[GitHub] [airflow] codecov-io commented on issue #8153: Make the default TI pool slots '1'

2020-04-04 Thread GitBox
codecov-io commented on issue #8153: Make the default TI pool slots '1' URL: https://github.com/apache/airflow/pull/8153#issuecomment-609244206 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8153?src=pr&el=h1) Report > Merging [#8153](https://codecov.io/gh/apache/airflow/pull/815

[GitHub] [airflow] codecov-io edited a comment on issue #8153: Make the default TI pool slots '1'

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8153: Make the default TI pool slots '1' URL: https://github.com/apache/airflow/pull/8153#issuecomment-609244206 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8153?src=pr&el=h1) Report > Merging [#8153](https://codecov.io/gh/apache/airflow/p

[GitHub] [airflow] kaxil edited a comment on issue #8153: Make the default TI pool slots '1'

2020-04-04 Thread GitBox
kaxil edited a comment on issue #8153: Make the default TI pool slots '1' URL: https://github.com/apache/airflow/pull/8153#issuecomment-609186914 I have tested this manually on my machine. I installed 1.10.9 ran a few examples DAGs, upgraded to 1.10.10rc2, Visited old Task Instance details

[GitHub] [airflow] codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/ai

[GitHub] [airflow] kaxil commented on issue #8151: BugFix: Fix writing Dag Code for Serialized DAGs

2020-04-04 Thread GitBox
kaxil commented on issue #8151: BugFix: Fix writing Dag Code for Serialized DAGs URL: https://github.com/apache/airflow/pull/8151#issuecomment-609194353 Tests have passed, failing tests is for Generating requirements.txt and is unrelated

[GitHub] [airflow] codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/ai

[GitHub] [airflow] codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/ai

[GitHub] [airflow] kaxil commented on issue #8153: Make the default TI pool slots '1'

2020-04-04 Thread GitBox
kaxil commented on issue #8153: Make the default TI pool slots '1' URL: https://github.com/apache/airflow/pull/8153#issuecomment-609186914 I have tested this manually on my machine. I installed 1.10.9 ran a few examples DAGs, upgraded to 1.10.10rc2, Visited old Task Instance details of old

[GitHub] [airflow] codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/ai

[GitHub] [airflow] kaxil opened a new pull request #8153: Make the default TI pool slots '1'

2020-04-04 Thread GitBox
kaxil opened a new pull request #8153: Make the default TI pool slots '1' URL: https://github.com/apache/airflow/pull/8153 This is caused by the new `add pool_slots field to task_instance` database migration, which adds a new `pool_slots` database column, which is nullable (hence it is

[GitHub] [airflow] codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/ai

[GitHub] [airflow] codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/ai

[GitHub] [airflow] codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/ai

[GitHub] [airflow] codecov-io commented on issue #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
codecov-io commented on issue #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152#issuecomment-609172760 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8152?src=pr&el=h1) Report > Merging [#8152](https://codecov.io/gh/apache/airflow/pu

[GitHub] [airflow] codecov-io commented on issue #8151: BugFix: Fix writing Dag Code for Serialized DAGs

2020-04-04 Thread GitBox
codecov-io commented on issue #8151: BugFix: Fix writing Dag Code for Serialized DAGs URL: https://github.com/apache/airflow/pull/8151#issuecomment-609136696 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8151?src=pr&el=h1) Report > Merging [#8151](https://codecov.io/gh/apache/a

[GitHub] [airflow] kaxil opened a new pull request #8152: Improve tests for Storing Dag Code in DB

2020-04-04 Thread GitBox
kaxil opened a new pull request #8152: Improve tests for Storing Dag Code in DB URL: https://github.com/apache/airflow/pull/8152 The original test does not cover the real case where DAG model actually calls `dag.sync_to_db()`. This is where the subdag fileloc is set to parent dag's fileloc

[GitHub] [airflow] kaxil opened a new pull request #8151: BugFix: Fix writing Dag Code for Serialized DAGs

2020-04-04 Thread GitBox
kaxil opened a new pull request #8151: BugFix: Fix writing Dag Code for Serialized DAGs URL: https://github.com/apache/airflow/pull/8151 With `store_dag_code` enabled scheduler throws the following error: ``` Traceback (most recent call last): File "/usr/local/lib/python3.7/m

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://code

[GitHub] [airflow] codecov-io commented on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
codecov-io commented on issue #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150#issuecomment-609113012 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8150?src=pr&el=h1) Report > Merging [#8150](https://codecov.io/

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](

[GitHub] [airflow] codecov-io commented on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
codecov-io commented on issue #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147#issuecomment-609112565 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8147?src=pr&el=h1) Report > Merging [#8147](https:/

[jira] [Commented] (AIRFLOW-3126) kubernetes executor not allowing new PV

2020-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075572#comment-17075572 ] ASF GitHub Bot commented on AIRFLOW-3126: - brandonwillard commented on pull req

[GitHub] [airflow] brandonwillard commented on issue #7423: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
brandonwillard commented on issue #7423: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/7423#issuecomment-609109273 Sorry, I have to move this to my personal fork: #8150. --

[GitHub] [airflow] brandonwillard closed pull request #7423: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
brandonwillard closed pull request #7423: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/7423 This is an automated message from the Apache Git Service. To respond to t

[jira] [Commented] (AIRFLOW-3126) kubernetes executor not allowing new PV

2020-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3126?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075571#comment-17075571 ] ASF GitHub Bot commented on AIRFLOW-3126: - brandonwillard commented on pull req

[GitHub] [airflow] mik-laj opened a new pull request #8149: Add fudament for API based on cconnexion

2020-04-04 Thread GitBox
mik-laj opened a new pull request #8149: Add fudament for API based on cconnexion URL: https://github.com/apache/airflow/pull/8149 Close: https://github.com/apache/airflow/issues/8109 --- Make sure to mark the boxes below before creating PR: [x] - [X] Description above provides

[GitHub] [airflow] brandonwillard opened a new pull request #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes

2020-04-04 Thread GitBox
brandonwillard opened a new pull request #8150: [AIRFLOW-3126] Add option to specify additional K8s volumes URL: https://github.com/apache/airflow/pull/8150 This PR introduces a new config option, `kubernetes.extra_volume_mounts`, that allows users to specify multiple Kubernetes volumes to

[jira] [Commented] (AIRFLOW-6778) Add a DAGs PVC Mount Point Option for Workers under Kubernetes Executor

2020-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075570#comment-17075570 ] ASF GitHub Bot commented on AIRFLOW-6778: - brandonwillard commented on pull req

[GitHub] [airflow] kaxil commented on a change in pull request #7899: Move out get_python_source from www, Move get_dag to www.utils

2020-04-04 Thread GitBox
kaxil commented on a change in pull request #7899: Move out get_python_source from www, Move get_dag to www.utils URL: https://github.com/apache/airflow/pull/7899#discussion_r403595864 ## File path: airflow/models/dag.py ## @@ -1797,20 +1797,6 @@ def get_paused_dag_ids(dag

[GitHub] [airflow] brandonwillard commented on issue #7401: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
brandonwillard commented on issue #7401: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/7401#issuecomment-609108927 Sorry, I have to move this to my personal fork: #8147. --

[GitHub] [airflow] brandonwillard closed pull request #7401: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
brandonwillard closed pull request #7401: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/7401 This is an automated message from the Apache Git Service. To

[jira] [Commented] (AIRFLOW-6778) Add a DAGs PVC Mount Point Option for Workers under Kubernetes Executor

2020-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6778?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075569#comment-17075569 ] ASF GitHub Bot commented on AIRFLOW-6778: - brandonwillard commented on pull req

[GitHub] [airflow] kaxil opened a new pull request #8148: Fix broken TriggerDag UI

2020-04-04 Thread GitBox
kaxil opened a new pull request #8148: Fix broken TriggerDag UI URL: https://github.com/apache/airflow/pull/8148 https://github.com/apache/airflow/pull/7899 broke Triggering DAG from UI ``` > return self.get_dag().create_dagrun(run_id=run_id,

[GitHub] [airflow] brandonwillard opened a new pull request #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes

2020-04-04 Thread GitBox
brandonwillard opened a new pull request #8147: [AIRFLOW-6778] Add a configurable DAGs volume mount path for Kubernetes URL: https://github.com/apache/airflow/pull/8147 This PR introduces a new config option, `kubernetes.extra_volume_mounts`, that allows users to specify multiple Kubernete

[GitHub] [airflow] brandonwillard closed pull request #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec

2020-04-04 Thread GitBox
brandonwillard closed pull request #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec URL: https://github.com/apache/airflow/pull/7405 This is an automated message from the Apache Git Service. To

[jira] [Commented] (AIRFLOW-6780) Use args Instead of command in Kubernetes Executor Worker Pods

2020-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075568#comment-17075568 ] ASF GitHub Bot commented on AIRFLOW-6780: - brandonwillard commented on pull req

[GitHub] [airflow] brandonwillard commented on issue #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec

2020-04-04 Thread GitBox
brandonwillard commented on issue #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec URL: https://github.com/apache/airflow/pull/7405#issuecomment-609108556 Sorry, I have to move this to my personal fork: #8146 -

[GitHub] [airflow] brandonwillard opened a new pull request #8146: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec

2020-04-04 Thread GitBox
brandonwillard opened a new pull request #8146: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec URL: https://github.com/apache/airflow/pull/8146 This PR adds a config option, `kubernetes.worker_pod_uses_args`, that is passed to `PodGenerator.construct_pod` in order

[jira] [Commented] (AIRFLOW-6780) Use args Instead of command in Kubernetes Executor Worker Pods

2020-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6780?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075567#comment-17075567 ] ASF GitHub Bot commented on AIRFLOW-6780: - brandonwillard commented on pull req

[GitHub] [airflow] brandonwillard commented on a change in pull request #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec

2020-04-04 Thread GitBox
brandonwillard commented on a change in pull request #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec URL: https://github.com/apache/airflow/pull/7405#discussion_r403589325 ## File path: airflow/kubernetes/pod_generator.py ## @@ -397,24 +397,

[GitHub] [airflow] brandonwillard commented on a change in pull request #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec

2020-04-04 Thread GitBox
brandonwillard commented on a change in pull request #7405: [AIRFLOW-6780] Add option to use args instead of command in K8s pod spec URL: https://github.com/apache/airflow/pull/7405#discussion_r403589325 ## File path: airflow/kubernetes/pod_generator.py ## @@ -397,24 +397,

[GitHub] [airflow] jmcarp opened a new pull request #8145: Drop redundant project id null checks.

2020-04-04 Thread GitBox
jmcarp opened a new pull request #8145: Drop redundant project id null checks. URL: https://github.com/apache/airflow/pull/8145 The `fallback_to_default_project_id` method already raises an exception if both `self.project_id` and `kwargs["project_id"]` are missing, so skip redundant nu

[GitHub] [airflow] mik-laj opened a new issue #8144: API Endpoint - Health - Spec and impelementataion

2020-04-04 Thread GitBox
mik-laj opened a new issue #8144: API Endpoint - Health - Spec and impelementataion URL: https://github.com/apache/airflow/issues/8144 **Description** There is no endpoint to check if the instance is in good condition We need to prepare the change to the API specification and

[jira] [Commented] (AIRFLOW-6822) AWS hooks dont always cache the boto3 client

2020-04-04 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075299#comment-17075299 ] ASF subversion and git services commented on AIRFLOW-6822: -- Co

[jira] [Resolved] (AIRFLOW-6822) AWS hooks dont always cache the boto3 client

2020-04-04 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6822. - Fix Version/s: 2.0.0 Resolution: Fixed > AWS hooks dont always cache the boto3 client >

[jira] [Commented] (AIRFLOW-6822) AWS hooks dont always cache the boto3 client

2020-04-04 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17075298#comment-17075298 ] ASF GitHub Bot commented on AIRFLOW-6822: - kaxil commented on pull request #754

[GitHub] [airflow] kaxil merged pull request #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client

2020-04-04 Thread GitBox
kaxil merged pull request #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client URL: https://github.com/apache/airflow/pull/7541 This is an automated message from the Apache Git Service. To respond to the message, please

[GitHub] [airflow] codecov-io edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client URL: https://github.com/apache/airflow/pull/7541#issuecomment-591909170 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7541?src=pr&el=h1) Report > Merging [#7541](https://codecov.io/gh

[GitHub] [airflow] codecov-io edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client URL: https://github.com/apache/airflow/pull/7541#issuecomment-591909170 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7541?src=pr&el=h1) Report > Merging [#7541](https://codecov.io/gh

[GitHub] [airflow] codecov-io edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client URL: https://github.com/apache/airflow/pull/7541#issuecomment-591909170 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7541?src=pr&el=h1) Report > Merging [#7541](https://codecov.io/gh

[GitHub] [airflow] kaxil edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client

2020-04-04 Thread GitBox
kaxil edited a comment on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client URL: https://github.com/apache/airflow/pull/7541#issuecomment-609081689 I have Fixed conflicts. @feluelle Do you have any other pending issues/comments. If not I will merge this once if CI passes. --

[GitHub] [airflow] kaxil commented on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client

2020-04-04 Thread GitBox
kaxil commented on issue #7541: [AIRFLOW-6822] AWS hooks should cache boto3 client URL: https://github.com/apache/airflow/pull/7541#issuecomment-609081689 Fixed conflicts This is an automated message from the Apache Git Servi

[GitHub] [airflow] mik-laj opened a new issue #8143: Docs for REST API

2020-04-04 Thread GitBox
mik-laj opened a new issue #8143: Docs for REST API URL: https://github.com/apache/airflow/issues/8143 **Description** We should prepare documentation for the REST API: - [Guide about API authentication (including custom)](https://github.com/apache/airflow/issues/8123) - [G

[GitHub] [airflow] mik-laj closed issue #8067: Allow Custom Task Runner via plugins

2020-04-04 Thread GitBox
mik-laj closed issue #8067: Allow Custom Task Runner via plugins URL: https://github.com/apache/airflow/issues/8067 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

[GitHub] [airflow] kaxil merged pull request #8141: Fix minor issues with Announcements Dev Scripts

2020-04-04 Thread GitBox
kaxil merged pull request #8141: Fix minor issues with Announcements Dev Scripts URL: https://github.com/apache/airflow/pull/8141 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] mik-laj opened a new issue #8142: API Endpoints - XCOM/Variables lookup

2020-04-04 Thread GitBox
mik-laj opened a new issue #8142: API Endpoints - XCOM/Variables lookup URL: https://github.com/apache/airflow/issues/8142 **Description** We need endpoints that allow you to retrieve an element based on the object key - `lookup`. - GET /variables/lookup More details ab

[GitHub] [airflow] kaxil opened a new pull request #8141: Fix minor issues with Announcements Dev Scripts

2020-04-04 Thread GitBox
kaxil opened a new pull request #8141: Fix minor issues with Announcements Dev Scripts URL: https://github.com/apache/airflow/pull/8141 Fixes following Minor issues: - Adds **wheel** package name in Voting email - Fixes pip package name (`apache-airflow instead of `airflow`) -

[GitHub] [airflow] mik-laj opened a new issue #8140: API Enddpoint - Links

2020-04-04 Thread GitBox
mik-laj opened a new issue #8140: API Enddpoint - Links URL: https://github.com/apache/airflow/issues/8140 **Description** We need endpoints that allow you to read [extra links](https://airflow.readthedocs.io/en/latest/howto/define_extra_link.html). GET /dags/{dag_id}/taskInst

[GitHub] [airflow] kaxil closed pull request #8139: Fix minor issues with Announcements Dev Scripts

2020-04-04 Thread GitBox
kaxil closed pull request #8139: Fix minor issues with Announcements Dev Scripts URL: https://github.com/apache/airflow/pull/8139 This is an automated message from the Apache Git Service. To respond to the message, please log

[GitHub] [airflow] kaxil commented on issue #8139: Fix minor issues with Announcements Dev Scripts

2020-04-04 Thread GitBox
kaxil commented on issue #8139: Fix minor issues with Announcements Dev Scripts URL: https://github.com/apache/airflow/pull/8139#issuecomment-609074647 closing it. Will create from my fork This is an automated message from the

[GitHub] [airflow] kaxil opened a new pull request #8139: Fix minor issues with Announcements Dev Scripts

2020-04-04 Thread GitBox
kaxil opened a new pull request #8139: Fix minor issues with Announcements Dev Scripts URL: https://github.com/apache/airflow/pull/8139 Fixes following Minor issues; - Adds **wheel** package name in Voting email - Fixes pip package name (`apache-airflow instead of `airflow`) -

[GitHub] [airflow] mik-laj opened a new issue #8138: API Endpoint - Dags structure/Task

2020-04-04 Thread GitBox
mik-laj opened a new issue #8138: API Endpoint - Dags structure/Task URL: https://github.com/apache/airflow/issues/8138 **Description** We need to have endpoints that allow us to read information about workflow - DAG, Task. Endpoints should properly support serialization. - GE

[GitHub] [airflow] mik-laj opened a new issue #8137: API Endpoint - Dag source

2020-04-04 Thread GitBox
mik-laj opened a new issue #8137: API Endpoint - Dag source URL: https://github.com/apache/airflow/issues/8137 **Description** Hello, We need an endpoint that allows you to read the DAG File source code. When ``store_dag_code`` = True, then the code should be read from the

[GitHub] [airflow] mik-laj opened a new issue #8136: API Enddpoint - Config

2020-04-04 Thread GitBox
mik-laj opened a new issue #8136: API Enddpoint - Config URL: https://github.com/apache/airflow/issues/8136 **Description** Hello, We need an endpoint that allows us to **read** the current Airflow configuration. - GET /config More details about API Endpoints:

[GitHub] [airflow] mik-laj commented on issue #8135: API Enddpoint - Logs

2020-04-04 Thread GitBox
mik-laj commented on issue #8135: API Enddpoint - Logs URL: https://github.com/apache/airflow/issues/8135#issuecomment-609072285 @kaxil Do you want to help with this ticket? This is an automated message from the Apache Git Ser

[GitHub] [airflow] mik-laj opened a new issue #8135: API Enddpoint - Logs

2020-04-04 Thread GitBox
mik-laj opened a new issue #8135: API Enddpoint - Logs URL: https://github.com/apache/airflow/issues/8135 **Description** Hello, We need to prepare an endpoint that will read the logs for the task. Logs are already available in Web UI, so abstractions should be created and used in

[GitHub] [airflow] codecov-io edited a comment on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status URL: https://github.com/apache/airflow/pull/8106#issuecomment-609070896 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8106?src=pr&el=h1) Report > Merging [#8106](https://codeco

[GitHub] [airflow] codecov-io commented on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status

2020-04-04 Thread GitBox
codecov-io commented on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status URL: https://github.com/apache/airflow/pull/8106#issuecomment-609070896 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8106?src=pr&el=h1) Report > Merging [#8106](https://codecov.io/gh

[GitHub] [airflow] codecov-io edited a comment on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status URL: https://github.com/apache/airflow/pull/8106#issuecomment-609070896 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8106?src=pr&el=h1) Report > Merging [#8106](https://codeco

[GitHub] [airflow] codecov-io edited a comment on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status

2020-04-04 Thread GitBox
codecov-io edited a comment on issue #8106: [AIRFLOW-7049] Persistent display/filtering of DAG status URL: https://github.com/apache/airflow/pull/8106#issuecomment-609070896 # [Codecov](https://codecov.io/gh/apache/airflow/pull/8106?src=pr&el=h1) Report > Merging [#8106](https://codeco

[GitHub] [airflow] mik-laj opened a new issue #8134: API Endpoint - CRUD - XCOM

2020-04-04 Thread GitBox
mik-laj opened a new issue #8134: API Endpoint - CRUD - XCOM URL: https://github.com/apache/airflow/issues/8134 **Description** Hello We need to create several endpoints that perform basic CRUD operations on **XCOM** . We need the following endpoints: - GET /dags/{dag_

[GitHub] [airflow] mik-laj opened a new issue #8132: API Endpoint - CRUD - Task Instance

2020-04-04 Thread GitBox
mik-laj opened a new issue #8132: API Endpoint - CRUD - Task Instance URL: https://github.com/apache/airflow/issues/8132 **Description** Hello We need to create several endpoints that perform basic CRUD operations on **Task instance** . We need the following endpoints: - G

[GitHub] [airflow] mik-laj opened a new issue #8133: API Endpoint - CRUD - Variable

2020-04-04 Thread GitBox
mik-laj opened a new issue #8133: API Endpoint - CRUD - Variable URL: https://github.com/apache/airflow/issues/8133 **Description** Hello We need to create several endpoints that perform basic CRUD operations on **Variable** . We need the following endpoints: - GET /va

[jira] [Assigned] (AIRFLOW-7049) Make show_paused persistent across navigation

2020-04-04 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-7049: --- Assignee: (was: Ryan McKinley) > Make show_paused persistent across navigation > -

[jira] [Work stopped] (AIRFLOW-7049) Make show_paused persistent across navigation

2020-04-04 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-7049 stopped by Kaxil Naik. --- > Make show_paused persistent across navigation > --

[jira] [Assigned] (AIRFLOW-7049) Make show_paused persistent across navigation

2020-04-04 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-7049: --- Assignee: Ryan McKinley (was: Kaxil Naik) > Make show_paused persistent across navigation

[jira] [Work started] (AIRFLOW-7049) Make show_paused persistent across navigation

2020-04-04 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-7049?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-7049 started by Kaxil Naik. --- > Make show_paused persistent across navigation > --

[GitHub] [airflow] mik-laj opened a new issue #8131: API Enddpoint - CRUD - Pools

2020-04-04 Thread GitBox
mik-laj opened a new issue #8131: API Enddpoint - CRUD - Pools URL: https://github.com/apache/airflow/issues/8131 **Description** Hello We need to create several endpoints that perform basic CRUD operations on **Pools** . We need the following endpoints: - GET /pools -

  1   2   >