[GitHub] [airflow] dstandish opened a new pull request #7124: [AIRFLOW-6528] disable flake8 W503 line break before binary operator

2020-01-09 Thread GitBox
dstandish opened a new pull request #7124: [AIRFLOW-6528] disable flake8 W503 line break before binary operator URL: https://github.com/apache/airflow/pull/7124 Flake8's W503 rule says there should be no line break before binary operator. This rule is incompatible with black

[jira] [Commented] (AIRFLOW-6528) disable W503 flake8 check (line break before binary operator)

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6528?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012525#comment-17012525 ] ASF GitHub Bot commented on AIRFLOW-6528: - dstandish commented on pull request #7124:

[jira] [Created] (AIRFLOW-6528) disable W503 flake8 check (line break before binary operator)

2020-01-09 Thread Daniel Standish (Jira)
Daniel Standish created AIRFLOW-6528: Summary: disable W503 flake8 check (line break before binary operator) Key: AIRFLOW-6528 URL: https://issues.apache.org/jira/browse/AIRFLOW-6528 Project:

[GitHub] [airflow] sarutak commented on a change in pull request #7099: [AIRFLOW-6507] Replace the use of imp.load_source with another solution.

2020-01-09 Thread GitBox
sarutak commented on a change in pull request #7099: [AIRFLOW-6507] Replace the use of imp.load_source with another solution. URL: https://github.com/apache/airflow/pull/7099#discussion_r365094489 ## File path: airflow/models/dagbag.py ## @@ -248,7 +247,11 @@ def

[GitHub] [airflow] codecov-io edited a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True URL: https://github.com/apache/airflow/pull/7122#issuecomment-572890272 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7122?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True URL: https://github.com/apache/airflow/pull/7122#issuecomment-572890272 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7122?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True URL: https://github.com/apache/airflow/pull/7122#issuecomment-572890272 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7122?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True

2020-01-09 Thread GitBox
codecov-io commented on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True URL: https://github.com/apache/airflow/pull/7122#issuecomment-572890272 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7122?src=pr=h1) Report > Merging

[GitHub] [airflow] potiuk commented on a change in pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk commented on a change in pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#discussion_r365083603 ## File path: BREEZE.rst ## @@ -528,6 +509,65 @@ As soon as you enter the Breeze

[GitHub] [airflow] potiuk commented on a change in pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk commented on a change in pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#discussion_r365083603 ## File path: BREEZE.rst ## @@ -528,6 +509,65 @@ As soon as you enter the Breeze

[GitHub] [airflow] potiuk commented on a change in pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk commented on a change in pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#discussion_r365083603 ## File path: BREEZE.rst ## @@ -528,6 +509,65 @@ As soon as you enter the Breeze

[GitHub] [airflow] dimberman commented on issue #7123: [AIRFLOW-6062] Executor would only delete workers in its own namespace

2020-01-09 Thread GitBox
dimberman commented on issue #7123: [AIRFLOW-6062] Executor would only delete workers in its own namespace URL: https://github.com/apache/airflow/pull/7123#issuecomment-572887183 Also I honestly forgot what an absolute pleasure typing systems are :). Being able to have highlights of

[GitHub] [airflow] dimberman commented on issue #7123: [AIRFLOW-6062] Executor would only delete workers in its own namespace

2020-01-09 Thread GitBox
dimberman commented on issue #7123: [AIRFLOW-6062] Executor would only delete workers in its own namespace URL: https://github.com/apache/airflow/pull/7123#issuecomment-572886583 So I'm thinking for testing we create a second namespace in the k8s cluster and put a worker in it. @potiuk

[GitHub] [airflow] potiuk commented on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk commented on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572886649 Yep. It's Green now. All test working -> I can finish now the change to separate out integration tests based on this.

[jira] [Commented] (AIRFLOW-6062) Scheduler doesn't delete worker pods from namespaces different than the scheduler's namespace

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6062?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012487#comment-17012487 ] ASF GitHub Bot commented on AIRFLOW-6062: - dimberman commented on pull request #7123:

[GitHub] [airflow] dimberman opened a new pull request #7123: [AIRFLOW-6062] Executor would only delete workers in its own namespace

2020-01-09 Thread GitBox
dimberman opened a new pull request #7123: [AIRFLOW-6062] Executor would only delete workers in its own namespace URL: https://github.com/apache/airflow/pull/7123 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) The KubernetesExecutor was

[jira] [Resolved] (AIRFLOW-6414) Create a configurations page in airflow documentation

2020-01-09 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman resolved AIRFLOW-6414. -- Resolution: Fixed > Create a configurations page in airflow documentation >

[jira] [Work started] (AIRFLOW-6506) KubernetesPodOperator defaulting do_xcom_push to True after 1.10.7 release

2020-01-09 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6506 started by Daniel Imberman. > KubernetesPodOperator defaulting do_xcom_push to True after 1.10.7

[jira] [Updated] (AIRFLOW-6414) Create a configurations page in airflow documentation

2020-01-09 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6414?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Daniel Imberman updated AIRFLOW-6414: - Fix Version/s: 1.10.8 > Create a configurations page in airflow documentation >

[jira] [Work started] (AIRFLOW-6166) KubernetesPodOperator resolve default xcom read behavior or improve associated documentation

2020-01-09 Thread Daniel Imberman (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on AIRFLOW-6166 started by Daniel Imberman. > KubernetesPodOperator resolve default xcom read behavior or improve

[GitHub] [airflow] dimberman removed a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True

2020-01-09 Thread GitBox
dimberman removed a comment on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True URL: https://github.com/apache/airflow/pull/7122#issuecomment-572880471 I need to figure out a test for this, but I figure this is a good start.

[jira] [Commented] (AIRFLOW-6506) KubernetesPodOperator defaulting do_xcom_push to True after 1.10.7 release

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012476#comment-17012476 ] ASF GitHub Bot commented on AIRFLOW-6506: - dimberman commented on pull request #7122:

[GitHub] [airflow] dimberman commented on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True

2020-01-09 Thread GitBox
dimberman commented on issue #7122: [AIRFLOW-6506] do_xcom_push defaulting to True URL: https://github.com/apache/airflow/pull/7122#issuecomment-572880471 I need to figure out a test for this, but I figure this is a good start.

[GitHub] [airflow] dimberman opened a new pull request #7122: [AIRFLOW-6506] do_xcom_push defaulting to True

2020-01-09 Thread GitBox
dimberman opened a new pull request #7122: [AIRFLOW-6506] do_xcom_push defaulting to True URL: https://github.com/apache/airflow/pull/7122 --- Issue link: WILL BE INSERTED BY [boring-cyborg](https://github.com/kaxil/boring-cyborg) - [ ] Description above provides context of the

[jira] [Commented] (AIRFLOW-6527) Error sending Celery task:Timeout in send_task_to_executor

2020-01-09 Thread Qian Yu (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012447#comment-17012447 ] Qian Yu commented on AIRFLOW-6527: -- Tagging some people who might know:

[jira] [Updated] (AIRFLOW-6527) Error sending Celery task:Timeout in send_task_to_executor

2020-01-09 Thread Qian Yu (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6527?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Qian Yu updated AIRFLOW-6527: - Description: We use Airflow with CeleryExecutor and redis broker. Our airflow scheduler often

[jira] [Created] (AIRFLOW-6527) Error sending Celery task:Timeout in send_task_to_executor

2020-01-09 Thread Qian Yu (Jira)
Qian Yu created AIRFLOW-6527: Summary: Error sending Celery task:Timeout in send_task_to_executor Key: AIRFLOW-6527 URL: https://issues.apache.org/jira/browse/AIRFLOW-6527 Project: Apache Airflow

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7117: [AIRFLOW-6520] Simplify `airflow config` command

2020-01-09 Thread GitBox
zhongjiajie commented on a change in pull request #7117: [AIRFLOW-6520] Simplify `airflow config` command URL: https://github.com/apache/airflow/pull/7117#discussion_r365059091 ## File path: airflow/cli/commands/config_command.py ## @@ -15,15 +15,13 @@ # specific

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io commented on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572851732 # [Codecov](https://codecov.io/gh/apache/airflow/pull/6516?src=pr=h1) Report > Merging

[GitHub] [airflow] rayrrr commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP

2020-01-09 Thread GitBox
rayrrr commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP URL: https://github.com/apache/airflow/pull/7116#discussion_r365047837 ## File path: setup.py ## @@ -218,24 +218,24 @@ def write_version(filename: str =

[GitHub] [airflow] codecov-io edited a comment on issue #7121: [AIRFLOW-6526] Remove unused line in k8s worker_configuration.py

2020-01-09 Thread GitBox
codecov-io edited a comment on issue #7121: [AIRFLOW-6526] Remove unused line in k8s worker_configuration.py URL: https://github.com/apache/airflow/pull/7121#issuecomment-572843916 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7121?src=pr=h1) Report > Merging

[GitHub] [airflow] codecov-io commented on issue #7121: [AIRFLOW-6526] Remove unused line in k8s worker_configuration.py

2020-01-09 Thread GitBox
codecov-io commented on issue #7121: [AIRFLOW-6526] Remove unused line in k8s worker_configuration.py URL: https://github.com/apache/airflow/pull/7121#issuecomment-572843916 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7121?src=pr=h1) Report > Merging

[GitHub] [airflow] rayrrr commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP

2020-01-09 Thread GitBox
rayrrr commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP URL: https://github.com/apache/airflow/pull/7116#discussion_r365047837 ## File path: setup.py ## @@ -218,24 +218,24 @@ def write_version(filename: str =

[jira] [Commented] (AIRFLOW-5704) Docker scripts for kind kubernetes tests can be improved

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012388#comment-17012388 ] ASF GitHub Bot commented on AIRFLOW-5704: - potiuk commented on pull request #6516:

[jira] [Commented] (AIRFLOW-5704) Docker scripts for kind kubernetes tests can be improved

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012389#comment-17012389 ] ASF GitHub Bot commented on AIRFLOW-5704: - potiuk commented on pull request #6516:

[GitHub] [airflow] yuqian90 commented on issue #6633: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker

2020-01-09 Thread GitBox
yuqian90 commented on issue #6633: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker URL: https://github.com/apache/airflow/pull/6633#issuecomment-572839558 > Thanks @yuqian90 - Good Work  Thank you @kaxil ! When I tested this patch in our own

[GitHub] [airflow] potiuk opened a new pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk opened a new pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516 * Fixed problem that Kubernetes tests were testing latest master rather than what came from the local sources. * Kind

[GitHub] [airflow] potiuk closed pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk closed pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516 This is an automated message from the Apache Git Service. To respond to the

[GitHub] [airflow] kaxil commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP

2020-01-09 Thread GitBox
kaxil commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP URL: https://github.com/apache/airflow/pull/7116#discussion_r365042953 ## File path: setup.py ## @@ -218,24 +218,24 @@ def write_version(filename: str =

[GitHub] [airflow] kaxil commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP

2020-01-09 Thread GitBox
kaxil commented on a change in pull request #7116: [AIRFLOW-5167] Rolling dependencies for GCP URL: https://github.com/apache/airflow/pull/7116#discussion_r365042953 ## File path: setup.py ## @@ -218,24 +218,24 @@ def write_version(filename: str =

[GitHub] [airflow] kaxil merged pull request #7094: Update start.rst to reference specific DAG

2020-01-09 Thread GitBox
kaxil merged pull request #7094: Update start.rst to reference specific DAG URL: https://github.com/apache/airflow/pull/7094 This is an automated message from the Apache Git Service. To respond to the message, please log on

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7094: Update start.rst to reference specific DAG

2020-01-09 Thread GitBox
boring-cyborg[bot] commented on issue #7094: Update start.rst to reference specific DAG URL: https://github.com/apache/airflow/pull/7094#issuecomment-572837837 Awesome work, congrats on your first merged pull request!

[jira] [Resolved] (AIRFLOW-2279) Clearing Tasks Across DAGs

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-2279. - Fix Version/s: 2.0.0 Resolution: Fixed > Clearing Tasks Across DAGs >

[jira] [Updated] (AIRFLOW-6526) Remove unused line in k8s worker_configuration.py

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6526: Fix Version/s: 2.0.0 > Remove unused line in k8s worker_configuration.py >

[jira] [Commented] (AIRFLOW-2279) Clearing Tasks Across DAGs

2020-01-09 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012376#comment-17012376 ] ASF subversion and git services commented on AIRFLOW-2279: -- Commit

[GitHub] [airflow] kaxil commented on issue #6633: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker

2020-01-09 Thread GitBox
kaxil commented on issue #6633: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker URL: https://github.com/apache/airflow/pull/6633#issuecomment-572835875 Thanks @yuqian90 - Good Work  This is an

[jira] [Commented] (AIRFLOW-2279) Clearing Tasks Across DAGs

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2279?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012375#comment-17012375 ] ASF GitHub Bot commented on AIRFLOW-2279: - kaxil commented on pull request #6633:

[GitHub] [airflow] kaxil merged pull request #6633: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker

2020-01-09 Thread GitBox
kaxil merged pull request #6633: [AIRFLOW-2279] Clear tasks across DAGs if marked by ExternalTaskMarker URL: https://github.com/apache/airflow/pull/6633 This is an automated message from the Apache Git Service. To respond

[jira] [Commented] (AIRFLOW-6526) Remove unused line in k8s worker_configuration.py

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012373#comment-17012373 ] ASF GitHub Bot commented on AIRFLOW-6526: - kaxil commented on pull request #7121:

[jira] [Created] (AIRFLOW-6526) Remove unused line in k8s worker_configuration.py

2020-01-09 Thread Kaxil Naik (Jira)
Kaxil Naik created AIRFLOW-6526: --- Summary: Remove unused line in k8s worker_configuration.py Key: AIRFLOW-6526 URL: https://issues.apache.org/jira/browse/AIRFLOW-6526 Project: Apache Airflow

[GitHub] [airflow] kaxil opened a new pull request #7121: [AIRFLOW-6526] Remove unused line in k8s worker_configuration.py

2020-01-09 Thread GitBox
kaxil opened a new pull request #7121: [AIRFLOW-6526] Remove unused line in k8s worker_configuration.py URL: https://github.com/apache/airflow/pull/7121 This line is not used anywhere. Let me know if we want to add a --- Issue link: WILL BE INSERTED BY

[GitHub] [airflow] zhongjiajie commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator

2020-01-09 Thread GitBox
zhongjiajie commented on a change in pull request #6090: [AIRFLOW-5470] Add Apache Livy REST operator URL: https://github.com/apache/airflow/pull/6090#discussion_r365039548 ## File path: airflow/providers/apache/livy/example_dags/livy_example.py ## @@ -0,0 +1,65 @@ +# -*-

[jira] [Commented] (AIRFLOW-6454) add test for time taken by scheduler to run dag of diff num of tasks (2 vs 20 vs 200 vs 2000 vs 20000 simple 1 line print tasks)

2020-01-09 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012370#comment-17012370 ] Kamil Bregula commented on AIRFLOW-6454: My team wants to start working on improving

[jira] [Updated] (AIRFLOW-6525) subdag do not fail fast for missing pool name

2020-01-09 Thread Akshay Y Dange (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akshay Y Dange updated AIRFLOW-6525: Description: The dag was scheduled but not running.  Logs indicates sub dag is using

[jira] [Updated] (AIRFLOW-6525) subdag do not fail fast for missing pool name

2020-01-09 Thread Akshay Y Dange (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Akshay Y Dange updated AIRFLOW-6525: Description: The dag was scheduled but not running.  Logs indicates sub dag is using

[jira] [Commented] (AIRFLOW-6347) Can't get task logs in webUI when DAG serialization is enabled

2020-01-09 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012364#comment-17012364 ] ASF subversion and git services commented on AIRFLOW-6347: -- Commit

[jira] [Created] (AIRFLOW-6525) subdag do not fail fast for missing pool name

2020-01-09 Thread Akshay Y Dange (Jira)
Akshay Y Dange created AIRFLOW-6525: --- Summary: subdag do not fail fast for missing pool name Key: AIRFLOW-6525 URL: https://issues.apache.org/jira/browse/AIRFLOW-6525 Project: Apache Airflow

[GitHub] [airflow] mik-laj commented on a change in pull request #7117: [AIRFLOW-6520] Simplify `airflow config` command

2020-01-09 Thread GitBox
mik-laj commented on a change in pull request #7117: [AIRFLOW-6520] Simplify `airflow config` command URL: https://github.com/apache/airflow/pull/7117#discussion_r365037217 ## File path: airflow/cli/commands/config_command.py ## @@ -15,15 +15,13 @@ # specific language

[GitHub] [airflow] potiuk commented on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk commented on issue #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516#issuecomment-572831619 I think I solved all the problems and hopefully it will go green now. There were a few problems with kind on docker

[jira] [Updated] (AIRFLOW-6454) add test for time taken by scheduler to run dag of diff num of tasks (2 vs 20 vs 200 vs 2000 vs 20000 simple 1 line print tasks)

2020-01-09 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6454: -- Description: *LUIGI* vs *AIRFLOW*   200 sequential tasks (so no parallelism):   +LUIGI:+ mkdir -p

[jira] [Commented] (AIRFLOW-5704) Docker scripts for kind kubernetes tests can be improved

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012352#comment-17012352 ] ASF GitHub Bot commented on AIRFLOW-5704: - potiuk commented on pull request #6516:

[jira] [Commented] (AIRFLOW-5704) Docker scripts for kind kubernetes tests can be improved

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-5704?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012353#comment-17012353 ] ASF GitHub Bot commented on AIRFLOW-5704: - potiuk commented on pull request #6516:

[GitHub] [airflow] potiuk opened a new pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk opened a new pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516 * Fixed problem that Kubernetes tests were testing latest master rather than what came from the local sources. * Kind

[GitHub] [airflow] potiuk closed pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing

2020-01-09 Thread GitBox
potiuk closed pull request #6516: [AIRFLOW-5704] Improve Kind Kubernetes scripts for local testing URL: https://github.com/apache/airflow/pull/6516 This is an automated message from the Apache Git Service. To respond to the

[jira] [Updated] (AIRFLOW-6454) add test for time taken by scheduler to run dag of diff num of tasks (2 vs 20 vs 200 vs 2000 vs 20000 simple 1 line print tasks)

2020-01-09 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6454: -- Description: *LUIGI* vs *AIRFLOW*   200 sequential tasks (so no parallelism):   +LUIGI:+ mkdir -p

[jira] [Updated] (AIRFLOW-6454) add test for time taken by scheduler to run dag of diff num of tasks (2 vs 20 vs 200 vs 2000 vs 20000 simple 1 line print tasks)

2020-01-09 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6454: -- Description: *LUIGI* vs *AIRFLOW*   200 sequential tasks (so no parallelism):   +LUIGI:+ mkdir -p

[jira] [Updated] (AIRFLOW-6454) add test for time taken by scheduler to run dag of diff num of tasks (2 vs 20 vs 200 vs 2000 vs 20000 simple 1 line print tasks)

2020-01-09 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6454: -- Description: *LUIGI* vs *AIRFLOW*   200 sequential tasks (so no parallelism):   +LUIGI:+ mkdir -p

[jira] [Closed] (AIRFLOW-6523) Broken airflow-worker.service with latest commit

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-6523. --- Resolution: Not A Problem > Broken airflow-worker.service with latest commit >

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7117: [AIRFLOW-6520] Simplify `airflow config` command

2020-01-09 Thread GitBox
zhongjiajie commented on a change in pull request #7117: [AIRFLOW-6520] Simplify `airflow config` command URL: https://github.com/apache/airflow/pull/7117#discussion_r365034179 ## File path: airflow/cli/commands/config_command.py ## @@ -15,15 +15,13 @@ # specific

[jira] [Updated] (AIRFLOW-6454) add test for time taken by scheduler to run dag of diff num of tasks (2 vs 20 vs 200 vs 2000 vs 20000 simple 1 line print tasks)

2020-01-09 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6454: -- Description: *LUIGI* vs *AIRFLOW*   200 sequential tasks (so no parallelism):   +LUIGI:+ mkdir -p

[jira] [Updated] (AIRFLOW-6454) add test for time taken by scheduler to run dag of diff num of tasks (2 vs 20 vs 200 vs 2000 vs 20000 simple 1 line print tasks)

2020-01-09 Thread t oo (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6454?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] t oo updated AIRFLOW-6454: -- Description: *LUIGI* vs *AIRFLOW* 200 sequential tasks: LUIGI: mkdir -p test_output8 #*8.3secs* total time

[jira] [Assigned] (AIRFLOW-6523) Broken airflow-worker.service with latest commit

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-6523: --- Assignee: (was: Kaxil Naik) > Broken airflow-worker.service with latest commit >

[jira] [Commented] (AIRFLOW-6523) Broken airflow-worker.service with latest commit

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012331#comment-17012331 ] Kaxil Naik commented on AIRFLOW-6523: - That is only for master. For 1.10.7 use

[jira] [Closed] (AIRFLOW-2973) Use Python 3.6.x everywhere possible

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik closed AIRFLOW-2973. --- Resolution: Fixed > Use Python 3.6.x everywhere possible > >

[GitHub] [airflow] kaxil commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-09 Thread GitBox
kaxil commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r365025752 ## File path: airflow/sensors/external_task_sensor.py ## @@ -21,14 +21,31 @@ from

[GitHub] [airflow] kaxil commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-09 Thread GitBox
kaxil commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r365025063 ## File path: airflow/sensors/external_task_sensor.py ## @@ -21,14 +21,31 @@ from

[GitHub] [airflow] kaxil commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-09 Thread GitBox
kaxil commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r365025063 ## File path: airflow/sensors/external_task_sensor.py ## @@ -21,14 +21,31 @@ from

[jira] [Commented] (AIRFLOW-6522) Sensors in reschedule mode with S3TaskHandler can cause log duplication

2020-01-09 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6522?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012324#comment-17012324 ] ASF GitHub Bot commented on AIRFLOW-6522: - rconroy293 commented on pull request #7120:

[GitHub] [airflow] rconroy293 opened a new pull request #7120: [AIRFLOW-6522] Clear log file to fix duplication in S3TaskHandler

2020-01-09 Thread GitBox
rconroy293 opened a new pull request #7120: [AIRFLOW-6522] Clear log file to fix duplication in S3TaskHandler URL: https://github.com/apache/airflow/pull/7120 The same task instance (including try number) can be run on a worker when using a sensor in "reschedule" mode. Accordingly, this

[jira] [Updated] (AIRFLOW-6506) KubernetesPodOperator defaulting do_xcom_push to True after 1.10.7 release

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6506?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6506: Fix Version/s: 1.10.8 > KubernetesPodOperator defaulting do_xcom_push to True after 1.10.7

[jira] [Updated] (AIRFLOW-6514) AIRFLOW-5695 didn't make it into release

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6514?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik updated AIRFLOW-6514: Fix Version/s: 1.10.8 > AIRFLOW-5695 didn't make it into release >

[jira] [Assigned] (AIRFLOW-6523) Broken airflow-worker.service with latest commit

2020-01-09 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6523?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik reassigned AIRFLOW-6523: --- Assignee: Kaxil Naik > Broken airflow-worker.service with latest commit >

[GitHub] [airflow] dimberman commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2020-01-09 Thread GitBox
dimberman commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-572807836 Looks like the current failures are in `test_pod_generator`. Once the CI/CD is passing @ashb and I will look

[GitHub] [airflow] mik-laj commented on issue #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-09 Thread GitBox
mik-laj commented on issue #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#issuecomment-572804536 @ashb @kaxil Will it work with DAG serialization enabled? Do you have another idea for implementing this?

[jira] [Commented] (AIRFLOW-6201) How can I manually trigger a future dag?

2020-01-09 Thread Sergio Kef (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6201?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17012281#comment-17012281 ] Sergio Kef commented on AIRFLOW-6201: - Not AFAIK. You can manually trigger the DAG, but this is

[GitHub] [airflow] tooptoop4 commented on issue #7096: [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable

2020-01-09 Thread GitBox
tooptoop4 commented on issue #7096: [AIRFLOW-6451] self._print_stat() in dag_processing.py should be skippable URL: https://github.com/apache/airflow/pull/7096#issuecomment-572781356 > Instead of a new config option what do you think of using the existing `print_stats_interval` config

  1   2   3   4   >