[GitHub] [airflow] nuclearpinguin closed pull request #6750: [WIP] [AIRFLOW-6329] Add AirflowExecutor and native worker

2020-01-16 Thread GitBox
nuclearpinguin closed pull request #6750: [WIP] [AIRFLOW-6329] Add AirflowExecutor and native worker URL: https://github.com/apache/airflow/pull/6750 This is an automated message from the Apache Git Service. To respond to th

[jira] [Commented] (AIRFLOW-6329) Add AirflowExecutor and native worker

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016661#comment-17016661 ] ASF GitHub Bot commented on AIRFLOW-6329: - nuclearpinguin commented on pull req

[GitHub] [airflow] nuclearpinguin opened a new pull request #7188: [AIRFLOW-XXXX] Add link for operators guide in first PR message

2020-01-16 Thread GitBox
nuclearpinguin opened a new pull request #7188: [AIRFLOW-] Add link for operators guide in first PR message URL: https://github.com/apache/airflow/pull/7188 Add link for operators guide in first PR message for new contributors. --- Issue link: WILL BE INSERTED BY [boring-cybo

[jira] [Created] (AIRFLOW-6578) store_serialized_dags raises fatal error for reviewing logs

2020-01-16 Thread Xiaodong Ye (Jira)
Xiaodong Ye created AIRFLOW-6578: Summary: store_serialized_dags raises fatal error for reviewing logs Key: AIRFLOW-6578 URL: https://issues.apache.org/jira/browse/AIRFLOW-6578 Project: Apache Airflow

[jira] [Commented] (AIRFLOW-6556) Improving unclear and incomplete documentation

2020-01-16 Thread Jacob Ward (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016746#comment-17016746 ] Jacob Ward commented on AIRFLOW-6556: - Absolutely! > Improving unclear and incompl

[jira] [Created] (AIRFLOW-6579) One of Celery executir tests is flaky

2020-01-16 Thread Jarek Potiuk (Jira)
Jarek Potiuk created AIRFLOW-6579: - Summary: One of Celery executir tests is flaky Key: AIRFLOW-6579 URL: https://issues.apache.org/jira/browse/AIRFLOW-6579 Project: Apache Airflow Issue Typ

[jira] [Resolved] (AIRFLOW-6329) Add AirflowExecutor and native worker

2020-01-16 Thread Tomasz Urbaszek (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6329?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Tomasz Urbaszek resolved AIRFLOW-6329. -- Resolution: Abandoned > Add AirflowExecutor and native worker > -

[jira] [Commented] (AIRFLOW-6556) Improving unclear and incomplete documentation

2020-01-16 Thread Jarek Potiuk (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016788#comment-17016788 ] Jarek Potiuk commented on AIRFLOW-6556: --- Cool. I don't promise anything super-fas

[GitHub] [airflow] Fokko commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
Fokko commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575090955 @vsoch Personally I'm very happy to include Singularity support to Airflow, but we want to do this in a way that we enforce some qu

[GitHub] [airflow] potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367360266 ## File path: tests/bin/test_cli.py ## @@ -0,0 +1,139 @@ +#!/usr/bin/env python +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367359969 ## File path: UPDATING.md ## @@ -57,6 +57,26 @@ https://developers.google.com/style/inclusive-documentation

[GitHub] [airflow] potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367359682 ## File path: UPDATING.md ## @@ -59,6 +59,26 @@ https://developers.google.com/style/inclusive-documentation

[GitHub] [airflow] potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367359489 ## File path: UPDATING.md ## @@ -59,6 +59,26 @@ https://developers.google.com/style/inclusive-documentation

[GitHub] [airflow] potiuk commented on a change in pull request #7187: [AIRFLOW-6576] fix scheduler crash caused by deleted task with sla misses

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7187: [AIRFLOW-6576] fix scheduler crash caused by deleted task with sla misses URL: https://github.com/apache/airflow/pull/7187#discussion_r367362316 ## File path: airflow/jobs/scheduler_job.py ## @@ -429,7 +429,15 @@ def mana

[jira] [Resolved] (AIRFLOW-6578) store_serialized_dags raises fatal error for reviewing logs

2020-01-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6578?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-6578. Resolution: Duplicate Fix has already been committed, will be included in 1.10.8

[GitHub] [airflow] vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
vsoch commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575113703 The PR has been open for so long (and a few of your maintainers updated it after the initial submission) and this has led to the co

[GitHub] [airflow] ashb commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r367373865 ## File path: .gitignore ## @@ -129,6 +129,16 @@ ENV/ # vim *.

[GitHub] [airflow] ashb commented on issue #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore

2020-01-16 Thread GitBox
ashb commented on issue #7175: [AIRFLOW-6568] Add some more entries (Emacs related files and yarn.lock) to .gitignore URL: https://github.com/apache/airflow/pull/7175#issuecomment-575115084 Please update the PR title/commit message -

[GitHub] [airflow] ashb merged pull request #7159: [AIRFLOW-6553] [UI] Add upstream_failed in instance state filter

2020-01-16 Thread GitBox
ashb merged pull request #7159: [AIRFLOW-6553] [UI] Add upstream_failed in instance state filter URL: https://github.com/apache/airflow/pull/7159 This is an automated message from the Apache Git Service. To respond to the me

[jira] [Resolved] (AIRFLOW-6553) Add upstream_failed filter in Airflow web UI

2020-01-16 Thread Ash Berlin-Taylor (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ash Berlin-Taylor resolved AIRFLOW-6553. Fix Version/s: 1.10.8 Resolution: Fixed > Add upstream_failed filter in Ai

[jira] [Commented] (AIRFLOW-6553) Add upstream_failed filter in Airflow web UI

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016829#comment-17016829 ] ASF GitHub Bot commented on AIRFLOW-6553: - ashb commented on pull request #7159

[GitHub] [airflow] boring-cyborg[bot] commented on issue #7159: [AIRFLOW-6553] [UI] Add upstream_failed in instance state filter

2020-01-16 Thread GitBox
boring-cyborg[bot] commented on issue #7159: [AIRFLOW-6553] [UI] Add upstream_failed in instance state filter URL: https://github.com/apache/airflow/pull/7159#issuecomment-575115306 Awesome work, congrats on your first merged pull request! --

[jira] [Commented] (AIRFLOW-6553) Add upstream_failed filter in Airflow web UI

2020-01-16 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6553?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016830#comment-17016830 ] ASF subversion and git services commented on AIRFLOW-6553: -- Co

[GitHub] [airflow] ashb commented on a change in pull request #7184: [AIRFLOW-6574] Adding private_environment to docker operator.

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7184: [AIRFLOW-6574] Adding private_environment to docker operator. URL: https://github.com/apache/airflow/pull/7184#discussion_r367375648 ## File path: airflow/operators/docker_operator.py ## @@ -66,6 +66,9 @@ class DockerOperat

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367375676 ## File path: tests/bin/test_cli.py ## @@ -0,0 +1,139 @@ +#!/usr/bin/env python +# -*- coding: utf-8 -

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367377698 ## File path: UPDATING.md ## @@ -59,6 +59,26 @@ https://developers.google.com/style/inclusive-document

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367377595 ## File path: UPDATING.md ## @@ -59,6 +59,26 @@ https://developers.google.com/style/inclusive-document

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367378897 ## File path: UPDATING.md ## @@ -57,6 +57,26 @@ https://developers.google.com/style/inclusive-document

[jira] [Commented] (AIRFLOW-6556) Improving unclear and incomplete documentation

2020-01-16 Thread Kamil Bregula (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016838#comment-17016838 ] Kamil Bregula commented on AIRFLOW-6556: I would be happy if they were added to

[GitHub] [airflow] ashb commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367384009 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,68 @@ def t

[jira] [Created] (AIRFLOW-6580) Killing or marking a task does not kill the Pod in the backend

2020-01-16 Thread Ram (Jira)
Ram created AIRFLOW-6580: Summary: Killing or marking a task does not kill the Pod in the backend Key: AIRFLOW-6580 URL: https://issues.apache.org/jira/browse/AIRFLOW-6580 Project: Apache Airflow Is

[jira] [Updated] (AIRFLOW-6580) Killing or marking a task as failed does not kill the Pod in the backend

2020-01-16 Thread Ram (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ram updated AIRFLOW-6580: - Summary: Killing or marking a task as failed does not kill the Pod in the backend (was: Killing or marking a t

[GitHub] [airflow] ashb commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7119: [AIRFLOW-5840] Add operator extra link to external task sensor URL: https://github.com/apache/airflow/pull/7119#discussion_r367386381 ## File path: airflow/sensors/external_task_sensor.py ## @@ -16,22 +16,71 @@ # KIND, eit

[jira] [Created] (AIRFLOW-6581) Capture Pod details when using KubernetesPodOperator

2020-01-16 Thread Ram (Jira)
Ram created AIRFLOW-6581: Summary: Capture Pod details when using KubernetesPodOperator Key: AIRFLOW-6581 URL: https://issues.apache.org/jira/browse/AIRFLOW-6581 Project: Apache Airflow Issue Type: I

[jira] [Updated] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated AIRFLOW-6568: Summary: Add some more entries (Emacs related files) to .gitignore (was: Add some more

[jira] [Updated] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread Kousuke Saruta (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kousuke Saruta updated AIRFLOW-6568: Description: Emacs generates some types of backup files. They should be ignored by the re

[GitHub] [airflow] sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r367396434 ## File path: .gitignore ## @@ -129,6 +129,16 @@ ENV/ # vim *.swp +# Em

[GitHub] [airflow] ashb commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r367397795 ## File path: .gitignore ## @@ -129,6 +129,16 @@ ENV/ # vim *.swp +# Emacs

[GitHub] [airflow] sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r367398585 ## File path: .gitignore ## @@ -129,6 +129,16 @@ ENV/ # vim *.swp +# Em

[GitHub] [airflow] CaptainCuddleCube commented on a change in pull request #7184: [AIRFLOW-6574] Adding private_environment to docker operator.

2020-01-16 Thread GitBox
CaptainCuddleCube commented on a change in pull request #7184: [AIRFLOW-6574] Adding private_environment to docker operator. URL: https://github.com/apache/airflow/pull/7184#discussion_r367400820 ## File path: airflow/operators/docker_operator.py ## @@ -66,6 +66,9 @@ class

[GitHub] [airflow] mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
mik-laj commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575141267 It seems to me that the problem arose because of performing merge instead of performing rebase. Merge can cause random issues in

[GitHub] [airflow] ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367406479 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367406829 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@ def

[GitHub] [airflow] ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
ashb commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367407586 ## File path: airflow/jobs/scheduler_job.py ## @@ -126,7 +127,14 @@ def _ru

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367409255 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@ d

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367410298 ## File path: airflow/jobs/scheduler_job.py ## @@ -126,7 +127,14 @@ def

[GitHub] [airflow] potiuk commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow

2020-01-16 Thread GitBox
potiuk commented on issue #4846: [AIRFLOW-4030] adding start to singularity for airflow URL: https://github.com/apache/airflow/pull/4846#issuecomment-575146487 Hello @vsoch -> I am sorry you have this extra work, but unfortunately it happens and this is part of our normal process. This is

[GitHub] [airflow] potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367412205 ## File path: tests/bin/test_cli.py ## @@ -0,0 +1,139 @@ +#!/usr/bin/env python +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367413148 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,68 @@ def

[GitHub] [airflow] potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367413700 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,68 @@ def

[GitHub] [airflow] potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#discussion_r367413700 ## File path: tests/serialization/test_dag_serialization.py ## @@ -543,6 +543,68 @@ def

[GitHub] [airflow] potiuk commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread GitBox
potiuk commented on a change in pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore URL: https://github.com/apache/airflow/pull/7175#discussion_r367415247 ## File path: .gitignore ## @@ -129,6 +129,16 @@ ENV/ # vim *.swp +# Ema

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367418143 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@ d

[GitHub] [airflow] potiuk commented on issue #7088: [WIP][AIRFLOW-6494] SSH host_proxy has to be fresh

2020-01-16 Thread GitBox
potiuk commented on issue #7088: [WIP][AIRFLOW-6494] SSH host_proxy has to be fresh URL: https://github.com/apache/airflow/pull/7088#issuecomment-575161505 Would it be too much to ask for a test covering this scenario of refresh (mocking Paramiko)?

[jira] [Commented] (AIRFLOW-3421) CSS issue on Airflow 1.10 Tree view UI

2020-01-16 Thread Court Sansom (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-3421?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17016958#comment-17016958 ] Court Sansom commented on AIRFLOW-3421: --- I can confirm the issue persists in 1.10

[jira] [Updated] (AIRFLOW-6535) add exception subclass to fail immediately without retrying

2020-01-16 Thread Jon Stern (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Jon Stern updated AIRFLOW-6535: --- Component/s: documentation > add exception subclass to fail immediately without retrying >

[GitHub] [airflow] sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
sarutak commented on a change in pull request #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#discussion_r367435592 ## File path: airflow/utils/dag_processing.py ## @@ -388,12 +415,20 @@ d

[GitHub] [airflow] potiuk commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
potiuk commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-575169715 So just update the json @lokeshlal. Here is the current message that you will

[GitHub] [airflow] lokeshlal commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
lokeshlal commented on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-575173295 Thanks @potiuk - I have already updated schema.json file with pool_slots fi

[GitHub] [airflow] codecov-io edited a comment on issue #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7162: [AIRFLOW-6557] Add test for newly added fields in BaseOperator URL: https://github.com/apache/airflow/pull/7162#issuecomment-574227743 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7162?src=pr&el=h1) Report > Merging [#7162](https://c

[GitHub] [airflow] zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli

2020-01-16 Thread GitBox
zhongjiajie commented on a change in pull request #7148: [AIRFLOW-6472] Correct short option in cli URL: https://github.com/apache/airflow/pull/7148#discussion_r367454779 ## File path: tests/bin/test_cli.py ## @@ -0,0 +1,139 @@ +#!/usr/bin/env python +# -*- coding: utf-8 -

[GitHub] [airflow] mik-laj opened a new pull request #7189: [AIRFLOW-XXXX] Move email configuration from the concept page

2020-01-16 Thread GitBox
mik-laj opened a new pull request #7189: [AIRFLOW-] Move email configuration from the concept page URL: https://github.com/apache/airflow/pull/7189 Configuration is not a concept. These are two different matters and it is worth separating them. --- Issue link: WILL BE INSERTE

[GitHub] [airflow] mik-laj opened a new pull request #7190: [AIRFLOW-XXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj opened a new pull request #7190: [AIRFLOW-XXX] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190 The `Manage connection` page contains very detailed information. However, it doesn't contain information about fernet. --- Is

[GitHub] [airflow] codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-574096290 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7160?src=pr&el

[GitHub] [airflow] codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-574096290 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7160?src=pr&el

[GitHub] [airflow] codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need)

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7160: [AIRFLOW-1467] Dynamic pooling via allowing tasks to use more than one pool slot (depending upon the need) URL: https://github.com/apache/airflow/pull/7160#issuecomment-574096290 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7160?src=pr&el

[GitHub] [airflow] kaxil commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
kaxil commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367477888 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, you

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485786 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367490433 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367490433 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mik-laj commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
mik-laj commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367485195 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, y

[GitHub] [airflow] mbelang commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error

2020-01-16 Thread GitBox
mbelang commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read time out error URL: https://github.com/apache/airflow/pull/6643#issuecomment-575214026 @maxirus Any progress? This is an automated message from th

[GitHub] [airflow] kaxil commented on a change in pull request #7190: [AIRFLOW-XXXX] Add cross-reference between connection and fernet

2020-01-16 Thread GitBox
kaxil commented on a change in pull request #7190: [AIRFLOW-] Add cross-reference between connection and fernet URL: https://github.com/apache/airflow/pull/7190#discussion_r367498997 ## File path: docs/howto/connection/index.rst ## @@ -221,6 +221,13 @@ To fix this, you

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367495835 ## File path: airflow/contrib/sensors/emr_job_flow_sensor.py ## @@ -16,48 +16,96 @@ # KI

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367498157 ## File path: airflow/contrib/sensors/emr_step_sensor.py ## @@ -16,52 +16,102 @@ # KIND,

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367497128 ## File path: airflow/contrib/sensors/emr_job_flow_sensor.py ## @@ -16,48 +16,96 @@ # KI

[GitHub] [airflow] nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states

2020-01-16 Thread GitBox
nuclearpinguin commented on a change in pull request #7146: [AIRFLOW-6541] Use EmrJobFlowSensor for other states URL: https://github.com/apache/airflow/pull/7146#discussion_r367496595 ## File path: airflow/contrib/sensors/emr_job_flow_sensor.py ## @@ -16,48 +16,96 @@ # KI

[GitHub] [airflow] kaxil merged pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread GitBox
kaxil merged pull request #7175: [AIRFLOW-6568] Add some more entries (Emacs related files) to .gitignore URL: https://github.com/apache/airflow/pull/7175 This is an automated message from the Apache Git Service. To respond

[jira] [Resolved] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread Kaxil Naik (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Kaxil Naik resolved AIRFLOW-6568. - Fix Version/s: 2.0.0 Resolution: Fixed > Add some more entries (Emacs related files) to

[jira] [Commented] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread ASF GitHub Bot (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017060#comment-17017060 ] ASF GitHub Bot commented on AIRFLOW-6568: - kaxil commented on pull request #717

[jira] [Commented] (AIRFLOW-6568) Add some more entries (Emacs related files) to .gitignore

2020-01-16 Thread ASF subversion and git services (Jira)
[ https://issues.apache.org/jira/browse/AIRFLOW-6568?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17017061#comment-17017061 ] ASF subversion and git services commented on AIRFLOW-6568: -- Co

[GitHub] [airflow] ashb commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries

2020-01-16 Thread GitBox
ashb commented on issue #6792: [AIRFLOW-5930] Use cached-SQL query building for hot-path queries URL: https://github.com/apache/airflow/pull/6792#issuecomment-575220751 Updated numbers from master branch. I'm not sure these will equate to _such_ a speed up in terms of actual task execution

[GitHub] [airflow] dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor

2020-01-16 Thread GitBox
dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor URL: https://github.com/apache/airflow/pull/7027#discussion_r367505849 ## File path: airflow/cli/commands/knative_worker_command.py ## @@ -0,0 +1,67 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-573300577 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7128?src=pr&el=h1) Report > :exclamation

[GitHub] [airflow] codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS.

2020-01-16 Thread GitBox
codecov-io edited a comment on issue #7128: [AIRFLOW-6529] Pickle error occurs when the scheduler tries to run on macOS. URL: https://github.com/apache/airflow/pull/7128#issuecomment-573300577 # [Codecov](https://codecov.io/gh/apache/airflow/pull/7128?src=pr&el=h1) Report > :exclamation

[GitHub] [airflow] dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor

2020-01-16 Thread GitBox
dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor URL: https://github.com/apache/airflow/pull/7027#discussion_r367507145 ## File path: airflow/executors/knative_executor.py ## @@ -0,0 +1,210 @@ +# -*- coding: utf-8 -*- +# +# Licen

[GitHub] [airflow] dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor

2020-01-16 Thread GitBox
dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor URL: https://github.com/apache/airflow/pull/7027#discussion_r367507948 ## File path: airflow/executors/knative_executor.py ## @@ -0,0 +1,210 @@ +# -*- coding: utf-8 -*- +# +# Licen

[GitHub] [airflow] dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor

2020-01-16 Thread GitBox
dazza-codes commented on a change in pull request #7027: [WIP][AIRFLOW-6441] KnativeExecutor URL: https://github.com/apache/airflow/pull/7027#discussion_r367505849 ## File path: airflow/cli/commands/knative_worker_command.py ## @@ -0,0 +1,67 @@ +# -*- coding: utf-8 -*- +#

[GitHub] [airflow] nuclearpinguin merged pull request #7189: [AIRFLOW-XXXX] Move email configuration from the concept page

2020-01-16 Thread GitBox
nuclearpinguin merged pull request #7189: [AIRFLOW-] Move email configuration from the concept page URL: https://github.com/apache/airflow/pull/7189 This is an automated message from the Apache Git Service. To respond to

[GitHub] [airflow] hmike96 commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file

2020-01-16 Thread GitBox
hmike96 commented on issue #6230: [AIRFLOW-5413] Allow K8S worker pod to be configured from JSON/YAML file URL: https://github.com/apache/airflow/pull/6230#issuecomment-575229660 Is the full_pod_spec feature released yet?? I tried it out but get this bug as if it is not released? ` │

  1   2   >