date:20210817



uranusjr commented on pull request #17667:
URL: https://github.com/apache/airflow/pull/17667#issuecomment-900832092


   One pedantic nit; why change the ordering?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] uranusjr commented on a change in pull request #17671: Allow google-auth < 3



uranusjr commented on a change in pull request #17671:
URL: https://github.com/apache/airflow/pull/17671#discussion_r690920880



##
File path: setup.py
##
@@ -319,7 +319,7 @@ def write_version(filename: str = os.path.join(*[my_dir, 
"airflow", "git_version
 'pandas-gbq<0.15.0',
 ]
 grpc = [
-'google-auth>=1.0.0, <2.0.0dev',
+'google-auth>=1.0.0, <3.0.0dev',

Review comment:
   (Not directly related to this PR) @potiuk Why was the `dev` suffix added 
in the first place and can we remove it? This seems to be the only place we are 
specifying prereleases explicitly (in cdb3f25456e49d0199cd7ccd680626dac01c9be6).




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] uranusjr opened a new pull request #17676: Mark DAG.param as a decorated field



uranusjr opened a new pull request #17676:
URL: https://github.com/apache/airflow/pull/17676


   Fix #17582.
   
   This mainly affects how this field is deserialized; previously it would be 
deserialized as-is, which is problematic if the param is a nested dict since 
the inner dicts were serialized with the {"__type": "dict", "__val": ...}` 
wrapper and not deserialized properly.
   
   I am not at all familiar with the related logic and not sure if I am doing 
the right thing.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] uranusjr edited a comment on issue #17582: DAG trigger with config params visualisation with proper deserialisation



uranusjr edited a comment on issue #17582:
URL: https://github.com/apache/airflow/issues/17582#issuecomment-900825011






-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] uranusjr commented on issue #17582: DAG trigger with config params visualisation with proper deserialisation



uranusjr commented on issue #17582:
URL: https://github.com/apache/airflow/issues/17582#issuecomment-900825011


   Those `__type` and `__val` keys are added by Airflow’s DAG serialisation 
logic, and the UI shouldn’t see them in the first place. I’m suspecting this is 
a bug in (de)serialisation, and if that’s correct this would be very deep down 
in the stack.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] glingle05 commented on issue #14417: DruidOperator failing to submit ingestion tasks : Getting 500 error code from Druid



glingle05 commented on issue #14417:
URL: https://github.com/apache/airflow/issues/14417#issuecomment-900799207


   This fix is a workaround to a bug in the DruidHook.submit_indexing_job() 
itself. 
   The requests.post line in submit_indexing_job is the real problem:
   `
   req_index = requests.post(url, data=json_index_spec, 
headers=self.header, auth=self.get_auth())
   `
   should be
   `
 req_index = requests.post(url, json=json_index_spec, 
headers=self.header, auth=self.get_auth())
   `
   Notice that passing the json_index_spec Dict using the data argument causes 
the dict to be converted
   using simple string conversion. This results in the string keys and values 
to be quoted with single-tick (')
   which results in the payload Not being json-compliant. If the 
json_index_spec is passed in using the json param
   it is converted to string using json lib and the payload is json with string 
keys and values being quoted with
   double-tick (") and request will succeed.
   HTH, Glenn


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] jedcunningham commented on a change in pull request #17675: Update docs on syncing forks



jedcunningham commented on a change in pull request #17675:
URL: https://github.com/apache/airflow/pull/17675#discussion_r690875650



##
File path: CONTRIBUTING.rst
##
@@ -1230,11 +1230,11 @@ How to sync your fork
 When you have your fork, you should periodically synchronize the main of your 
fork with the
 Apache Airflow main. In order to do that you can ``git pull --rebase`` to your 
local git repository from
 apache remote and push the main (often with ``--force`` to your fork). There 
is also an easy
-way using ``Force sync main from apache/airflow`` workflow. You can go to 
"Actions" in your repository and
-choose the workflow and manually trigger the workflow using "Run workflow" 
command.
+way using ``Fetch upstream`` feature as described in
+`GitHub docs 
`_.

Review comment:
   ```suggestion
   way to sync your fork in GitHub's web UI with the `Fetch upstream feature
   
`_.
   ```




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] SimonOsipov commented on issue #17629: KubernetesExecutor do not spawn Kubernetes Pod Operator pods.



SimonOsipov commented on issue #17629:
URL: https://github.com/apache/airflow/issues/17629#issuecomment-900755679


   I redeployed configmap, used with the git-sync container, and this problem 
above (`Kubernetes resource version is too old`) is gone.
   But the problem with 1.20 Kubernetes remains.
   Airflow successfully creates Executor Pods, but it can't create any 
Kubernetes Pod Operators with no specific errors logged.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] LionelZhao28 commented on a change in pull request #17502: localize the run_id in dagrun



LionelZhao28 commented on a change in pull request #17502:
URL: https://github.com/apache/airflow/pull/17502#discussion_r690845281



##
File path: airflow/models/dagrun.py
##
@@ -286,7 +287,17 @@ def find(
 @staticmethod
 def generate_run_id(run_type: DagRunType, execution_date: datetime) -> str:
 """Generate Run ID based on Run Type and Execution Date"""
-return f"{run_type}__{execution_date.isoformat()}"
+from airflow.configuration import conf
+local_run_id = conf.getboolean("core", "localize_dag_run_id", 
fallback=False)
+if local_run_id:
+local_time = 
pendulum.instance(execution_date).astimezone(tz=settings.TIMEZONE)

Review comment:
   @ashb 
   I checked the codes, we can not use the `tzinfo` in the execution_date 
directly, because it has been transformed into UTC already.
   
![image](https://user-images.githubusercontent.com/7628879/129824951-cf0ff5bd-916e-42af-82eb-1c9315afbeab.png)
   
   So we have two ways to implement:
   1. change the method generate_run_id from static method to class method
   2. add a parameter `timezone` in the method `generate_run_id` and the 
default value is settings.TIMEZONE.
   
   Which one do you prefer? Or there is something I miss that we can have a 
better choice?
   Let me know what do you think.
   Thanks




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] josh-fell commented on a change in pull request #16866: Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs



josh-fell commented on a change in pull request #16866:
URL: https://github.com/apache/airflow/pull/16866#discussion_r690843263



##
File path: airflow/example_dags/example_xcom.py
##
@@ -78,6 +104,14 @@ def puller(**kwargs):
 pull = PythonOperator(
 task_id='puller',
 python_callable=puller,
+op_kwargs={
+'pulled_value_1': push1.output['value from pusher 1'],
+'pulled_value_3': push2.output,
+},

Review comment:
   Reverted Taskflow API and `get_current_context()` changes in the 
"example_xcom" DAG.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] josh-fell commented on a change in pull request #16866: Remove default_args pattern + added get_current_context() use for Core Airflow example DAGs



josh-fell commented on a change in pull request #16866:
URL: https://github.com/apache/airflow/pull/16866#discussion_r690843020



##
File path: airflow/example_dags/example_xcom.py
##
@@ -18,50 +18,76 @@
 
 """Example DAG demonstrating the usage of XComs."""
 from airflow import DAG
-from airflow.operators.python import PythonOperator
+from airflow.decorators import task
+from airflow.operators.python import PythonOperator, get_current_context
 from airflow.utils.dates import days_ago
 
 value_1 = [1, 2, 3]
 value_2 = {'a': 'b'}
+value_3 = 'some value'
 
 
 def push(**kwargs):
 """Pushes an XCom without a specific target"""
 kwargs['ti'].xcom_push(key='value from pusher 1', value=value_1)
 
 
+@task
+def push_with_taskflow(val=value_2):
+"""
+Pushes an XCom from within a task-decorated function aka using the 
Taskflow API.
+
+.. note::
+Retrieving the current execution context using the 
``get_current_context()`` method should only be
+done when using the Taskflow API.
+"""
+
+context = get_current_context()
+context['ti'].xcom_push(key='other value from pusher 1', value=val)

Review comment:
   > No, this is wrong, and I think this much simpler way will work:
   > 
   > (But could you test it please)
   
   Tested this out. Just needed to make `ti` an optional arg -- otherwise DAG 
parsing would throw an exception -- and it worked just fine.  Seems to make the 
use of `get_current_context()` more nebulous.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil opened a new pull request #17675: Update docs on syncing forks



kaxil opened a new pull request #17675:
URL: https://github.com/apache/airflow/pull/17675


   closes https://github.com/apache/airflow/issues/17665
   
   
   
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
 for more information.
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] branch constraints-2-1 updated: Updating constraints. Build id:1141271872

2021-08-17 Thread github-bot

This is an automated email from the ASF dual-hosted git repository.

github-bot pushed a commit to branch constraints-2-1
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/constraints-2-1 by this push:
 new a6726b9  Updating constraints. Build id:1141271872
a6726b9 is described below

commit a6726b902d8fafec1e80145006fc2af939a50bd7
Author: Automated GitHub Actions commit 
AuthorDate: Wed Aug 18 01:02:26 2021 +

Updating constraints. Build id:1141271872

This update in constraints is automatically committed by the CI 
'constraints-push' step based on
HEAD of 'refs/heads/v2-1-test' in 'apache/airflow'
with commit sha 2b80c1edec85fb2b0312b6ae7f415c6f744e322e.

All tests passed in this build so we determined we can push the updated 
constraints.

See 
https://github.com/apache/airflow/blob/main/README.md#installing-from-pypi for 
details.
---
 constraints-3.6.txt  | 2 +-
 constraints-3.7.txt  | 2 +-
 constraints-3.8.txt  | 2 +-
 constraints-3.9.txt  | 2 +-
 constraints-no-providers-3.6.txt | 2 +-
 constraints-no-providers-3.7.txt | 2 +-
 constraints-no-providers-3.8.txt | 2 +-
 constraints-no-providers-3.9.txt | 2 +-
 constraints-source-providers-3.6.txt | 2 +-
 constraints-source-providers-3.7.txt | 2 +-
 constraints-source-providers-3.8.txt | 2 +-
 constraints-source-providers-3.9.txt | 2 +-
 12 files changed, 12 insertions(+), 12 deletions(-)

diff --git a/constraints-3.6.txt b/constraints-3.6.txt
index 9d93c46..d6cdf04 100644
--- a/constraints-3.6.txt
+++ b/constraints-3.6.txt
@@ -469,7 +469,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==7.2.1
+sphinxcontrib-spelling==5.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-3.7.txt b/constraints-3.7.txt
index 5be379b..f0e5ad2 100644
--- a/constraints-3.7.txt
+++ b/constraints-3.7.txt
@@ -467,7 +467,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==7.2.1
+sphinxcontrib-spelling==5.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-3.8.txt b/constraints-3.8.txt
index 5be379b..f0e5ad2 100644
--- a/constraints-3.8.txt
+++ b/constraints-3.8.txt
@@ -467,7 +467,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==7.2.1
+sphinxcontrib-spelling==5.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-3.9.txt b/constraints-3.9.txt
index 1a1505c..5c83a8a 100644
--- a/constraints-3.9.txt
+++ b/constraints-3.9.txt
@@ -463,7 +463,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==7.2.1
+sphinxcontrib-spelling==5.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-no-providers-3.6.txt b/constraints-no-providers-3.6.txt
index 6f09e57..ec7bbad 100644
--- a/constraints-no-providers-3.6.txt
+++ b/constraints-no-providers-3.6.txt
@@ -65,7 +65,7 @@ eventlet==0.31.1
 filelock==3.0.12
 flower==0.9.7
 gevent==21.8.0
-google-auth==1.35.0
+google-auth==2.0.0
 graphviz==0.17
 greenlet==1.1.1
 gunicorn==20.1.0
diff --git a/constraints-no-providers-3.7.txt b/constraints-no-providers-3.7.txt
index efdfa25..7c4fca6 100644
--- a/constraints-no-providers-3.7.txt
+++ b/constraints-no-providers-3.7.txt
@@ -63,7 +63,7 @@ filelock==3.0.12
 flower==0.9.7
 fsspec==2021.7.0
 gevent==21.8.0
-google-auth==1.35.0
+google-auth==2.0.0
 graphviz==0.17
 greenlet==1.1.1
 gunicorn==20.1.0
diff --git a/constraints-no-providers-3.8.txt b/constraints-no-providers-3.8.txt
index 3c94c9a..5429dfa 100644
--- a/constraints-no-providers-3.8.txt
+++ b/constraints-no-providers-3.8.txt
@@ -62,7 +62,7 @@ filelock==3.0.12
 flower==0.9.7
 fsspec==2021.7.0
 gevent==21.8.0
-google-auth==1.35.0
+google-auth==2.0.0
 graphviz==0.17
 greenlet==1.1.1
 gunicorn==20.1.0
diff --git a/constraints-no-providers-3.9.txt b/constraints-no-providers-3.9.txt
index fe53790..3c660b9 100644
--- a/constraints-no-providers-3.9.txt
+++ b/constraints-no-providers-3.9.txt
@@ -62,7 +62,7 @@ filelock==3.0.12
 flower==0.9.7
 fsspec==2021.7.0
 gevent==21.8.0
-google-auth==1.35.0
+google-auth==2.0.0
 graphviz==0.17
 greenlet==1.1.1
 gunicorn==20.1.0
diff --git a/constraints-source-providers-3.6.txt 
b/constraints-source-providers-3.6.txt
index 2aadde0..0d7eeb4 100644
--- a/constraints-source-providers-3.6.txt
+++ b/constraints-source-providers-3.6.txt
@@ -398,7 +398,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==7.2.1

[airflow] branch main updated: Dev: Remove duplicate step to push Docker Image (#17674)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
 new 7c96800  Dev: Remove duplicate step to push Docker Image (#17674)
7c96800 is described below

commit 7c96800426946e563d12fdfeb80b20f4c0002aaf
Author: Kaxil Naik 
AuthorDate: Wed Aug 18 02:02:25 2021 +0100

Dev: Remove duplicate step to push Docker Image (#17674)

We have the same step few lines below "## Prepare production Docker Image"
---
 dev/README_RELEASE_AIRFLOW.md | 15 +--
 1 file changed, 1 insertion(+), 14 deletions(-)

diff --git a/dev/README_RELEASE_AIRFLOW.md b/dev/README_RELEASE_AIRFLOW.md
index 9faecbb..7e9e566 100644
--- a/dev/README_RELEASE_AIRFLOW.md
+++ b/dev/README_RELEASE_AIRFLOW.md
@@ -24,7 +24,6 @@
   - [Selecting what to cherry-pick](#selecting-what-to-cherry-pick)
 - [Prepare the Apache Airflow Package 
RC](#prepare-the-apache-airflow-package-rc)
   - [Build RC artifacts](#build-rc-artifacts)
-  - [Manually prepare production Docker 
Image](#manually-prepare-production-docker-image)
   - [[\Optional\] Create new release 
branch](#%5Coptional%5C-create-new-release-branch)
   - [Prepare PyPI convenience "snapshot" 
packages](#prepare-pypi-convenience-snapshot-packages)
   - [Prepare production Docker Image](#prepare-production-docker-image)
@@ -40,7 +39,7 @@
   - [Publish release to SVN](#publish-release-to-svn)
   - [Prepare PyPI "release" packages](#prepare-pypi-release-packages)
   - [Update CHANGELOG.md](#update-changelogmd)
-  - [Manually prepare production Docker 
Image](#manually-prepare-production-docker-image-1)
+  - [Manually prepare production Docker 
Image](#manually-prepare-production-docker-image)
   - [Publish documentation](#publish-documentation)
   - [Notify developers of release](#notify-developers-of-release)
   - [Update Announcements page](#update-announcements-page)
@@ -149,18 +148,6 @@ The Release Candidate artifacts we vote upon should be the 
exact ones we vote ag
 svn commit -m "Add artifacts for Airflow ${VERSION}"
 ```
 
-
-## Manually prepare production Docker Image
-
-
-```shell script
-./scripts/ci/tools/prepare_prod_docker_images.sh ${VERSION}
-```
-
-This will wipe Breeze cache and docker-context-files in order to make sure the 
build is "clean". It
-also performs image verification before pushing the images.
-
-
 ## [\Optional\] Create new release branch
 
 When you just released the `X.Y.0` version (first release of new minor 
version) you need to create release

[GitHub] [airflow] jhtimmins merged pull request #17674: Dev: Remove duplicate step to push Docker Image



jhtimmins merged pull request #17674:
URL: https://github.com/apache/airflow/pull/17674


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on pull request #17674: Dev: Remove duplicate step to push Docker Image



github-actions[bot] commented on pull request #17674:
URL: https://github.com/apache/airflow/pull/17674#issuecomment-900734527


   The PR is likely ready to be merged. No tests are needed as no important 
environment files, nor python files were modified by it. However, committers 
might decide that full test matrix is needed and add the 'full tests needed' 
label. Then you should rebase it to the latest main or amend the last commit of 
the PR, and push it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil opened a new pull request #17674: Dev: Remove duplicate step to push Docker Image



kaxil opened a new pull request #17674:
URL: https://github.com/apache/airflow/pull/17674


   We have the same step few lines below "## Prepare production Docker Image"
   
   
   
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
 for more information.
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil merged pull request #17670: Fix link to generating constraints in BREEZE.rst



kaxil merged pull request #17670:
URL: https://github.com/apache/airflow/pull/17670


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] branch main updated: Fix link to generating constraints in BREEZE.rst (#17670)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
 new dfdffa6  Fix link to generating constraints in BREEZE.rst (#17670)
dfdffa6 is described below

commit dfdffa6a4922a85405f9b71520129590c2188ec8
Author: Jed Cunningham <66968678+jedcunning...@users.noreply.github.com>
AuthorDate: Tue Aug 17 18:24:39 2021 -0600

Fix link to generating constraints in BREEZE.rst (#17670)
---
 BREEZE.rst | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/BREEZE.rst b/BREEZE.rst
index f86f6f8..d44514f 100644
--- a/BREEZE.rst
+++ b/BREEZE.rst
@@ -799,7 +799,7 @@ Constraints are generated separately for each python 
version and there are separ
 
 In case someone modifies setup.py, the ``CRON`` scheduled CI build 
automatically upgrades and
 pushes changed to the constraint files, however you can also perform test run 
of this locally using
-the procedure described in 
``_ which utilises
+the procedure described in 
``_ which utilises
 multiple processors on your local machine to generate such constraints faster.
 
 This bumps the constraint files to latest versions and stores hash of 
setup.py. The generated constraint

[airflow] annotated tag constraints-2.1.3rc1 updated (595fb4c -> 3a0b413)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to annotated tag constraints-2.1.3rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.


*** WARNING: tag constraints-2.1.3rc1 was modified! ***

from 595fb4c  (commit)
  to 3a0b413  (tag)
 tagging 595fb4c95f91eeae5581bf37ca51360960561dd2 (commit)
 replaces constraints-2.1.2
  by Kaxil Naik
  on Wed Aug 18 01:19:43 2021 +0100

- Log -
Apache Airflow constraints 2.1.3rc1
-BEGIN PGP SIGNATURE-

iQEzBAABCAAdFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcUikACgkQZnTgitfe
QG9yZwf/R2YpRytdXzpPnKf4/X8j6G4CELRyZus/pnJMyE7LjEvPrPzzc0rltS38
HiJWLv5r+P981es2tmLkRUFKLnNahwLbK0fkl6SXNoXc4hQrlaq9rYnJMf5jML+X
UH5IvyWuiDU27uCbh+5lNobXP+It0GgJVADxfcx2wHNFZAI21jjBxRuRh5EpCIQJ
nhHfeXWKjzZ3r7tLx76SAytwUCU1DbcZ89VWif3nmVjcbOvRilOepslV8bT4GPMn
5gPs4Zu+jyfOG2aTPRW9VvBBdLMidIDJcmkRssw6vayFpHZ24T69Ys3LlkaYSENv
nsKDHAe0YRjUndsTYv8N0rKRywkHHg==
=rob/
-END PGP SIGNATURE-
---


No new revisions were added by this update.

Summary of changes:

svn commit: r49550 - /dev/airflow/2.1.3rc1/

Author: kaxilnaik
Date: Wed Aug 18 00:16:40 2021
New Revision: 49550

Log:
Update artifacts for Airflow 2.1.3rc1

Modified:
dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz
dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc
dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512
dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz
dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc
dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512
dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl
dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl.asc
dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl.sha512

Modified: dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz
==
Binary files - no diff available.

Modified: dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc (original)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc Wed Aug 18 
00:16:40 2021
@@ -1,11 +1,11 @@
 -BEGIN PGP SIGNATURE-
 
-iQFJBAABCAAzFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcPZsVHGtheGlsbmFp
-a0BhcGFjaGUub3JnAAoJEGZ04IrX3kBvNSsIAKSUj3wzs4XHvOK3ylmgxDWrSltz
-bLP7+hYnsql9eal4EgWgza4D9TIk67V3jt+mNqGnFzABEQJBLyq2AIcl+qyVqaiF
-gbIRRAEI+Vja48QvYwpdKoj1JowSfeeKLHqxj8mQHKjA4HL1zyLNBevMRlOSyDNH
-i1u8A8ON9HlhDPlFE41o6e5d96IsTloIlaA2RhFpIi9NRsOb+h8xWqmxpgPagR7w
-65Vd+/E9iEkg+cpX9JU6H6QGl4A7b0mRMKsl5AUbB0L29kfrknbQ4lajts0chvjg
-zBLGBzuaWqz3NM4qqvgZeO37vBJWqHFHsL6mSPZVfCbhft+eQtNnH3gDF/c=
-=nHqh
+iQFJBAABCAAzFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcUQIVHGtheGlsbmFp
+a0BhcGFjaGUub3JnAAoJEGZ04IrX3kBvD3oIAJZG179gqIgIAnVhaXniWSSQBDP2
+TVBlxBLuq3+ta0llA5QuoEucKPazJhE3/5V25j9K9oMamfPqSGJqVMS9fKfZdnx4
+kWGBQq/4LfueJPyiqFV/iK/vqIStX6uy/BKy/F5mqwqGYjEPsu7frLjZeaUflxKq
+RmPRd3XIeqf5abUdbdP5khw0EH/RzUq82UKO/anD7J0PIovjZYadLYYFJY90eevf
+MIib9WZBnFjqfwG6F5RbOgLPysdmzZBermAX2HmRQO7ECPBryyS6iAiGbKxUpRUg
+k3vl2LZZ8IgdQHwOBUsKJaaQtw76fEFJ3m1tz2jAp3TjQFuXhpLMoRfyNJo=
+=eEsG
 -END PGP SIGNATURE-

Modified: dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512 (original)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512 Wed Aug 18 
00:16:40 2021
@@ -1 +1 @@
-66199642ee3d9c73c2d1ed2901cfdbc6177f67a1f07d7d352ac8755f48ff4cc8941e5fea22f5b951731f2ada7816566f572211f412a3b9cf0236fca7dc1a90fd
  apache-airflow-2.1.3-source.tar.gz
+7553fd422cb9e316d3f8987721e0ae3cd646e0180ce0e52c7e455a1606e76df60c3421b7d6727e517a0ab6cab74cd64d10bd3e97497380bb2601b9e2be1f4522
  dist/apache-airflow-2.1.3-source.tar.gz

Modified: dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz
==
Binary files - no diff available.

Modified: dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc (original)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc Wed Aug 18 00:16:40 
2021
@@ -1,11 +1,11 @@
 -BEGIN PGP SIGNATURE-
 
-iQFJBAABCAAzFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcPZwVHGtheGlsbmFp
-a0BhcGFjaGUub3JnAAoJEGZ04IrX3kBvCfEIALY647uyOii2+rZw77+8g4LPacsc
-vtb0iOWPGQO7tzGA/eL8nxD7a+/0DXYz8G7oVFis7bWRgGA605e3taaR/jUCC2Mr
-E5lrFnqZWw7TUqu4Aa9PDqTX0g9w+MSw6bg64s+9f4x5/AxOVSff1r6caPRVm2sF
-isEeGKZO45kbrGiEVJDiFEwTktE/6p8XcACL4UiS7Verz1L+1cNn57huC8XWz8T9
-7RMxDIyavxpUiODouFDd9XiYlCHfYMcF4jykX/mmj8wUUYQneH0t9PrPe4zGWDnZ
-WD3sni+CobL4S/t70HxXmzenuORHgnc8w6d01sbeLzMTcDG4s0X17Whtkk8=
-=DSp0
+iQFJBAABCAAzFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcUQIVHGtheGlsbmFp
+a0BhcGFjaGUub3JnAAoJEGZ04IrX3kBvfXIH/34QiWfqW8EeiZWJRKi9t6GawjCA
+kflh0V6wQci9ShxY4kI/Sf+G3aArOuVDaxmCGc6NpTG5Nj4HPxEKwJIkmtUKkbLA
+PtOSsExBAL+Ay8bA2bnTMW1DLYlai21hgKibrBhlLO1/0A16JAW124d/99p6934q
+nqarGv2c551w6VgWDY1D+y4htt3iBp8a34cSkjac8ig2U9pNGblqKPgj64qzyzPN
+GJazqBp0J7Y5HYmgN6U+04lGK7HLhERlft9znQop0FS92fJcIPsYApogu09wUoBX
+7A1e1oGlChO1Aeih6sPyeZlW6wRPszxFIaGjHHoHi/2qwe/Yrxi8X0zJepE=
+=qTd0
 -END PGP SIGNATURE-

Modified: dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512 (original)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512 Wed Aug 18 00:16:40 
2021
@@ -1 +1 @@
-3c096a74314ff8244cd937b2cd4e12c2efc677c301fd8d292d22678b6848a8eb81465d0dc49662a796e10536d574bccaa0696257c4a80de27bb5e64b0db6d450
  apache-airflow-2.1.3.tar.gz
+73a86c616142e3b9ab1a3c1742fd977de0934a70c4d0776c1cecc9d8c1a511b006ccd7fb8b324ad3295606271f1893e7c9d4e3aa03259ecfb4aa114d69392a27
  dist/apache-airflow-2.1.3.tar.gz

Modified:

[GitHub] [airflow] VLADPOLUNIN commented on issue #17582: DAG trigger with config params visualisation with proper deserialisation



VLADPOLUNIN commented on issue #17582:
URL: https://github.com/apache/airflow/issues/17582#issuecomment-900715611


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] annotated tag 2.1.3rc1 updated (c46bccb -> bfa2dad)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to annotated tag 2.1.3rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.


*** WARNING: tag 2.1.3rc1 was modified! ***

from c46bccb  (tag)
  to bfa2dad  (tag)
 tagging 2b80c1edec85fb2b0312b6ae7f415c6f744e322e (commit)
 replaces 2.1.2rc1
  by Kaxil Naik
  on Wed Aug 18 01:09:17 2021 +0100

- Log -
Apache Airflow 2.1.3rc1
-BEGIN PGP SIGNATURE-

iQEzBAABCAAdFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcT64ACgkQZnTgitfe
QG+cUgf+I4/fLodFi0uoFTVDgHLG0LNtoqRjBvwSbu9YcJCbhcnrMSmUw3sf1F2j
/ISqsvp0x4d86R2UYwRKqTrWboPclj/dTuqO1CvWv9DkMOVFkneXn+ARgBMzXaqG
6Mb4tz43QbhXMhc1i2CE/AIauSQbc2Pd/85B4ukrBGlBDqKZI43Em/GJMBiFSuVe
hp08gzMlpPRz43PktnIrNhNP+hEkB3fXxCKZFyhuh2sfKPGThS64J144wLOAnX4f
LPMRQXG/hjZ4frripf6Tdb7D8caLBXKt6td8RjZtxUy9MLtDvZHq623WiNZeafvQ
6zVP4vgi9WlUhaFHBWJB6SyGLCmT7w==
=8Tkn
-END PGP SIGNATURE-
---

from d25854d  Update changelog with Python 3.9 support. (#16918)
 add 6720544  Fix permissions for CodeQL workflows (#16660)
 add 71fec5d  Remove upstart from docs (#16672)
 add 2b393ee  Add preparation of images as part of RC preparation process 
(#16674)
 add d95a6bd  Add --executor option to breeze kind-cluster deploy command 
(#15661)
 add 90b2ac6  Use different executors for Helm Chart tests in CI (#15791)
 add 172599e  Change default airflow version in Dockerfile (#16714)
 add 9d528d4  Adding missing word to welcome message (#16726)
 add 4e174b3  Fix timing out tests for public GitHub Runners. (#16750)
 add 24fd4d7  Breeze should work with new docker-compose fallback (#16743)
 add 02c92c8  Switches to ghcr.io container registry (#16775)
 add 8fd4cf4  Removes coverage from kubernetes tests (#16794)
 add 236bb43  Remove legacy GitHub Packages (#16776)
 add 07e3789  Fix Airflow releasing guide (#16924)
 add ac98256  Avoid verification of images multiple times (#16928)
 add 324c342  Remove cache for kubernetes tests (#16927)
 add 8691ca0  Switch Breeze/CI to ghcr.io excusively (#16780)
 add 7fc74c1  Pulls latest images to build images in "Build Image" flow 
(#16948)
 add 85b3057  Fixed parsing issue of _docker.env file for docker-compose v2 
(#16950)
 add 373007b  Fixes passing variables via docker --env-file command (#16959)
 add 6263871  Fixes typo in the name of file for Breeze docker compose env 
(#16971)
 add b0a006c  Move CI-integration images to ghcr.io (#16797)
 add 5f3b53f  Errors out instead of trying to workaround buggy 
docker-compose v2 (#16989)
 add b954390  Fix release guide when copying artifacts (#17001)
 add e6ac8e9  Drop support for Airflow 1.10 in entrypoint_prod.sh and 
improve MSSQL compatibility (#17011)
 add d1cb4e4  Fix bug and small improvements in 
scripts/tools/list-integrations.py (#17004)
 add 6e8c5f6  Dev: Bump stale action to v4 (#17025)
 add 33b7bda  Fixes "development" and "rc" cross dependencies between 
providers (#17023)
 add 2f20298  Updated clean-logs.sh (#16978)
 add 7829e33  Fixes detection of version 2 of docker-compose (#17062)
 add 3e2da93  Add SSH_PORT variable
 add b043f4b  Converts the specification of branch for pushes to be 
flexible (#17065)
 add 16d1ff0  Support secret backends/airflow.cfg for celery broker in 
entrypoint_prod.sh (#17069)
 add 219e9b2  Fixes UI assets compilation from PROD image built from 
sources (#17086)
 add 0509113  Avoid logging in to GitHub Container Registry when not in CI 
(#17169)
 add f99a023  Do not fail-fast kubernetes tests (#17228)
 add 1491db2  Remove support for Airflow 1.10 cmds in entrypoint_prod.sh 
(#17248)
 add 28562ef  Stop attempting to pull base python image when pulling commit 
hash (#17231)
 add f05a9e5  Do not use constraints when preparing venv for k8s tests on 
CI (#17290)
 add a3e9e2c  Uses current sources when running k8s tests (#17289)
 add 3f584b2  Fix breeze kind-cluster deploy failing with ECONREFUSED 
(#17293)
 add c828c0c  Fix typo in build_images (#17327)
 add 3f30eed  Added print statements for clarity in provider yaml checks 
(#17322)
 add ac483d1  Adds compile_assets to INSTALL (#17377)
 add e183834  Moves SchedulerJob initialization to within daemon context 
(#17157)
 add 769779b  Update best-practices.rst (#17357)
 add 32937fa  Fix link (#17351)
 add 5a3a874  docs: fix inconsistencies in configuration docs (#17317)
 add 1419b22  Grammar and clarity pass on documentation (#17318)
 add 249721c  Fix docs link for using SQLite as Metadata DB (#17308)
 add 9ccac6c  More optimized lazy-loading of provider information (#17304)
 add b2f607c  Doc: Strip unnecessary arguments from MariaDB JIRA URL 
(#17296)
 add a31e02c  Fix typo in

[airflow] branch v2-1-stable updated (130e2f4 -> 2b80c1e)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to branch v2-1-stable
in repository https://gitbox.apache.org/repos/asf/airflow.git.


from 130e2f4  Add Changelog updates for 2.1.3
 add 7cc13c1  Add new committers: ``Jed`` and ``TP`` (#16671)
 add a9b776b  Add Aneesh Joseph as Airflow Committer (#16835)
 add 2b80c1e  Bump ``sphinxcontrib-spelling`` and minor improvements 
(#16675)

No new revisions were added by this update.

Summary of changes:
 CHANGELOG.txt |  4 +-
 airflow/providers/amazon/aws/sensors/s3_prefix.py |  4 +-
 docs/apache-airflow/project.rst   |  3 +
 docs/conf.py  |  3 +
 docs/spelling_wordlist.txt| 96 +--
 setup.py  |  2 +-
 6 files changed, 12 insertions(+), 100 deletions(-)

[GitHub] [airflow] kaxil merged pull request #17673: Sync v2-1-test and v2-1-stable



kaxil merged pull request #17673:
URL: https://github.com/apache/airflow/pull/17673


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on pull request #17673: Sync v2-1-test and v2-1-stable



github-actions[bot] commented on pull request #17673:
URL: https://github.com/apache/airflow/pull/17673#issuecomment-900712086


   The PR most likely needs to run full matrix of tests because it modifies 
parts of the core of Airflow. However, committers might decide to merge it 
quickly and take the risk. If they don't merge it quickly - please rebase it to 
the latest main at your convenience, or amend the last commit of the PR, and 
push it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil opened a new pull request #17673: Sync v2-1-test and v2-1-stable



kaxil opened a new pull request #17673:
URL: https://github.com/apache/airflow/pull/17673


   
   
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
 for more information.
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on issue #16298: Scheduler fails with BrokenPipeError



github-actions[bot] commented on issue #16298:
URL: https://github.com/apache/airflow/issues/16298#issuecomment-900710661


   This issue has been automatically marked as stale because it has been open 
for 30 days with no response from the author. It will be closed in next 7 days 
if no further activity occurs from the issue author.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] github-actions[bot] closed pull request #14176: Simplify CONTRIBUTING.rst



github-actions[bot] closed pull request #14176:
URL: https://github.com/apache/airflow/pull/14176


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on pull request #16755: Add option to ignore host for misconfigured passive FTP servers



github-actions[bot] commented on pull request #16755:
URL: https://github.com/apache/airflow/pull/16755#issuecomment-900710635


   This pull request has been automatically marked as stale because it has not 
had recent activity. It will be closed in 5 days if no further activity occurs. 
Thank you for your contributions.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] branch constraints-2-1 updated: Bump to 7.2.1

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch constraints-2-1
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/constraints-2-1 by this push:
 new 595fb4c  Bump to  7.2.1
595fb4c is described below

commit 595fb4c95f91eeae5581bf37ca51360960561dd2
Author: Kaxil Naik 
AuthorDate: Wed Aug 18 01:02:52 2021 +0100

Bump to  7.2.1
---
 constraints-3.6.txt  | 2 +-
 constraints-3.7.txt  | 2 +-
 constraints-3.8.txt  | 2 +-
 constraints-3.9.txt  | 2 +-
 constraints-source-providers-3.6.txt | 2 +-
 constraints-source-providers-3.7.txt | 2 +-
 constraints-source-providers-3.8.txt | 2 +-
 constraints-source-providers-3.9.txt | 2 +-
 8 files changed, 8 insertions(+), 8 deletions(-)

diff --git a/constraints-3.6.txt b/constraints-3.6.txt
index d6cdf04..9d93c46 100644
--- a/constraints-3.6.txt
+++ b/constraints-3.6.txt
@@ -469,7 +469,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-3.7.txt b/constraints-3.7.txt
index f0e5ad2..5be379b 100644
--- a/constraints-3.7.txt
+++ b/constraints-3.7.txt
@@ -467,7 +467,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-3.8.txt b/constraints-3.8.txt
index f0e5ad2..5be379b 100644
--- a/constraints-3.8.txt
+++ b/constraints-3.8.txt
@@ -467,7 +467,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-3.9.txt b/constraints-3.9.txt
index 5c83a8a..1a1505c 100644
--- a/constraints-3.9.txt
+++ b/constraints-3.9.txt
@@ -463,7 +463,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.1
 sqlparse==0.4.1
diff --git a/constraints-source-providers-3.6.txt 
b/constraints-source-providers-3.6.txt
index 0d7eeb4..2aadde0 100644
--- a/constraints-source-providers-3.6.txt
+++ b/constraints-source-providers-3.6.txt
@@ -398,7 +398,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.0
 sqlparse==0.4.1
diff --git a/constraints-source-providers-3.7.txt 
b/constraints-source-providers-3.7.txt
index 69d4edf..24f 100644
--- a/constraints-source-providers-3.7.txt
+++ b/constraints-source-providers-3.7.txt
@@ -396,7 +396,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.0
 sqlparse==0.4.1
diff --git a/constraints-source-providers-3.8.txt 
b/constraints-source-providers-3.8.txt
index 69d4edf..24f 100644
--- a/constraints-source-providers-3.8.txt
+++ b/constraints-source-providers-3.8.txt
@@ -396,7 +396,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.0
 sqlparse==0.4.1
diff --git a/constraints-source-providers-3.9.txt 
b/constraints-source-providers-3.9.txt
index 642e035..f33928d 100644
--- a/constraints-source-providers-3.9.txt
+++ b/constraints-source-providers-3.9.txt
@@ -394,7 +394,7 @@ sphinxcontrib-jsmath==1.0.1
 sphinxcontrib-qthelp==1.0.3
 sphinxcontrib-redoc==1.6.0
 sphinxcontrib-serializinghtml==1.1.5
-sphinxcontrib-spelling==5.2.1
+sphinxcontrib-spelling==7.2.1
 spython==0.1.15
 sqlalchemy-drill==1.1.0
 sqlparse==0.4.1

[airflow] branch main updated: Update pre-commit checks-flynt to 0.66 (#17672)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git


The following commit(s) were added to refs/heads/main by this push:
 new 495535b  Update pre-commit checks-flynt to 0.66 (#17672)
495535b is described below

commit 495535b81e0ac9fbbc25d39aa3b1ad1303417c42
Author: Kamil Breguła 
AuthorDate: Wed Aug 18 01:56:38 2021 +0200

Update pre-commit checks-flynt to 0.66 (#17672)

Additionally, we now download flynt configurations from the official 
repository, which allows us to automatically download updates using the 
pre-commit autoupdate command
---
 .pre-commit-config.yaml | 15 +++
 dev/airflow-license |  2 +-
 2 files changed, 8 insertions(+), 9 deletions(-)

diff --git a/.pre-commit-config.yaml b/.pre-commit-config.yaml
index 992ea5f..e71573f 100644
--- a/.pre-commit-config.yaml
+++ b/.pre-commit-config.yaml
@@ -250,6 +250,13 @@ repos:
 exclude: |
   (?x)
   ^airflow/_vendor/
+  - repo: https://github.com/ikamensh/flynt/
+rev: '0.66'
+hooks:
+  - id: flynt
+exclude: |
+  (?x)
+  ^airflow/_vendor/
   - repo: local
 hooks:
   - id: lint-openapi
@@ -622,14 +629,6 @@ repos:
 files: airflow/config_templates/config\.yml$
 require_serial: true
 additional_dependencies: ['jsonschema==3.2.0', 'PyYAML==5.3.1', 
'requests==2.25.0']
-  - id: flynt
-name: Convert to f-strings with flynt
-entry: flynt
-language: python
-language_version: python3
-additional_dependencies: ['flynt==0.63']
-files: \.py$
-exclude: ^airflow/_vendor/
   - id: ui-lint
 name: ESLint against airflow/ui
 language: node
diff --git a/dev/airflow-license b/dev/airflow-license
index 80ddfbf..aa72d0b 100755
--- a/dev/airflow-license
+++ b/dev/airflow-license
@@ -68,7 +68,7 @@ def parse_license_file(project_name):
 
 
 if __name__ == "__main__":
-print("{:<30}|{:<50}||{:<20}||{:<10}".format("PROJECT", "URL", "LICENSE 
TYPE DEFINED", "DETECTED"))
+print(f"{'PROJECT':<30}|{'URL':<50}||{'LICENSE TYPE 
DEFINED':<20}||{'DETECTED':<10}")
 
 notices = get_notices()

[GitHub] [airflow] kaxil merged pull request #17672: Update pre-commit checks - flynt to 0.66



kaxil merged pull request #17672:
URL: https://github.com/apache/airflow/pull/17672


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] mik-laj opened a new pull request #17672: Update pre-commit checks - flynt to 0.66



mik-laj opened a new pull request #17672:
URL: https://github.com/apache/airflow/pull/17672


   Additionally, we now download flynt configurations from the official 
repository, which allows us to automatically download updates using the 
`pre-commit autoupdate` command
   
   
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
 for more information.
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17671: Allow google-auth < 3

boring-cyborg[bot] commented on pull request #17671:
URL: https://github.com/apache/airflow/pull/17671#issuecomment-900694234

Congratulations on your first Pull Request and welcome to the Apache Airflow
community! If you have any issues or are unsure about any anything please check
our Contribution Guide
(https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst)
Here are some useful points:
- Pay attention to the quality of your code (flake8, mypy and type
annotations). Our [pre-commits](
https://github.com/apache/airflow/blob/main/STATIC_CODE_CHECKS.rst#prerequisites-for-pre-commit-hooks)
will help you with that.
- In case of a new feature add useful documentation (in docstrings or in
`docs/` directory). Adding a new operator? Check this short
[guide](https://github.com/apache/airflow/blob/main/docs/apache-airflow/howto/custom-operator.rst)
Consider adding an example DAG that shows how users should use it.
- Consider using [Breeze
environment](https://github.com/apache/airflow/blob/main/BREEZE.rst) for
testing locally, it’s a heavy docker but it ships with a working Airflow and a
lot of integrations.
- Be patient and persistent. It might take some time to get a review or get
the final approval from Committers.
- Please follow [ASF Code of
Conduct](https://www.apache.org/foundation/policies/conduct) for all
communication including (but not limited to) comments on Pull Requests, Mailing
list and Slack.
- Be sure to read the [Airflow Coding style](
https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#coding-style-and-best-practices).
Apache Airflow is a community-driven project and together we are making it
better .
In case of doubts contact the developers at:
Mailing List: d...@airflow.apache.org
Slack: https://s.apache.org/airflow-slack

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] busunkim96 opened a new pull request #17671: Allow google-auth < 3

busunkim96 opened a new pull request #17671:
URL: https://github.com/apache/airflow/pull/17671

`google-auth` recently published a 2.0.0 release which removed support for
Python 2.7. `google-auth` now requires Python >=3.6. No other breaking changes
were made. You can see the full list of changes
[here](https://github.com/googleapis/google-auth-library-python/commit/560cf1ed02a900436c5d9e0a0fb3f94b5fd98c55).

I am opening PRs to expand google-auth version ranges for packages that meet
either of the following criteria:
* Package has >10,000 monthly downloads as of June 2021
* Package is owned by a Google team

`google-auth` is a dependency of many different libraries that interact with
Google APIs. Increasing the time and number of packages with compatible pins on
`google-auth` lowers the chance end developers who use multiple libraries will
see dependency conflicts.

If possible, please do not require `google-auth>=2.0.0` until
https://github.com/googleapis/google-cloud-python/issues/10566 is resolved, as
that will further reduce the likelihood of diamond dependency conflicts.

Googlers, see [this
doc](https://docs.google.com/document/d/1euAvUsia_4zf98lNvpwA3K0o2b4y5Xr9xAkyzCnIMzQ/edit)
for more information.

Given the number of google-cloud-* packages this library pins directly I
think it may make more sense to expand pins on `google-api-core` and
`google-auth` in one PR. (I've left this PR as a draft as the google-api-core
release is planned for tomorrow, August 18).

**Constraints files**: I looked at
https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pinned-constraint-files
but am not quite sure what that means for this change.

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] jedcunningham commented on a change in pull request #17666: [Chart] Add option to set loadBalancerSourceRanges in webserver service



jedcunningham commented on a change in pull request #17666:
URL: https://github.com/apache/airflow/pull/17666#discussion_r690778830



##
File path: chart/values.schema.json
##
@@ -1818,6 +1818,12 @@
 ],
 "default": null
 }
+},
+"loadBalancerSourceRanges": {
+"description": "Webserver Service 
loadBalancerSourceRanges.",
+"type": "array",
+"default": []

Review comment:
   ```suggestion
   "default": [],
   "examples": [
   "143.231.0.0/16"
   ]
   ```

##
File path: chart/templates/webserver/webserver-service.yaml
##
@@ -51,3 +51,9 @@ spec:
   {{- if .Values.webserver.service.loadBalancerIP }}
   loadBalancerIP: {{ .Values.webserver.service.loadBalancerIP }}
   {{- end }}
+  {{- if .Values.service.loadBalancerSourceRanges }}
+  loadBalancerSourceRanges:
+  {{- range $cidr := .Values.service.loadBalancerSourceRanges }}
+- {{ $cidr }}
+  {{- end }}

Review comment:
   ```suggestion
 {{- toYaml .Values.service.loadBalancerSourceRanges | nindent 4 }}
   ```
   
   I think this is cleaner?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] 03/03: Bump ``sphinxcontrib-spelling`` and minor improvements (#16675)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 5f9930bd3df4119b19baedd2722b4e9c3359b08e
Author: Kaxil Naik 
AuthorDate: Sat Jun 26 18:33:22 2021 +0100

Bump ``sphinxcontrib-spelling`` and minor improvements (#16675)

- Bump `sphinxcontrib-spelling` from `5.2.1` to `7.2.1`
- Excludes `project.rst` and `changelog.rst` from spell-check for 
`apache-airflow` package so that we don't need to add Committer's Name 
everytime.
- Removes committers name and ``'airfl%'`` from 
`docs/spelling_wordlist.txt` as it isn't needed. It should be a code-block not 
an actual word.

(cherry picked from commit 3a57d9fc604f4478fd51e20287494d0d7a33f0e4)
---
 airflow/providers/amazon/aws/sensors/s3_prefix.py |  4 +-
 docs/conf.py  |  3 +
 docs/spelling_wordlist.txt| 99 ---
 setup.py  |  2 +-
 4 files changed, 6 insertions(+), 102 deletions(-)

diff --git a/airflow/providers/amazon/aws/sensors/s3_prefix.py 
b/airflow/providers/amazon/aws/sensors/s3_prefix.py
index 2fa923a..54270ac 100644
--- a/airflow/providers/amazon/aws/sensors/s3_prefix.py
+++ b/airflow/providers/amazon/aws/sensors/s3_prefix.py
@@ -24,8 +24,8 @@ from airflow.sensors.base import BaseSensorOperator
 class S3PrefixSensor(BaseSensorOperator):
 """
 Waits for a prefix to exist. A prefix is the first part of a key,
-thus enabling checking of constructs similar to glob airfl* or
-SQL LIKE 'airfl%'. There is the possibility to precise a delimiter to
+thus enabling checking of constructs similar to glob ``airfl*`` or
+SQL LIKE ``'airfl%'``. There is the possibility to precise a delimiter to
 indicate the hierarchy or keys, meaning that the match will stop at that
 delimiter. Current code accepts sane delimiters, i.e. characters that
 are NOT special characters in the Python regex engine.
diff --git a/docs/conf.py b/docs/conf.py
index da3b8e2..fb5a884 100644
--- a/docs/conf.py
+++ b/docs/conf.py
@@ -633,6 +633,9 @@ redirects_file = 'redirects.txt'
 
 # -- Options for sphinxcontrib-spelling 

 spelling_word_list_filename = [os.path.join(CONF_DIR, 'spelling_wordlist.txt')]
+if PACKAGE_NAME == 'apache-airflow':
+spelling_exclude_patterns = ['project.rst', 'changelog.rst']
+spelling_ignore_contributor_names = False
 
 # -- Options for sphinxcontrib.redoc 
---
 # See: https://sphinxcontrib-redoc.readthedocs.io/en/stable/
diff --git a/docs/spelling_wordlist.txt b/docs/spelling_wordlist.txt
index 4b071a8..0ad4070 100644
--- a/docs/spelling_wordlist.txt
+++ b/docs/spelling_wordlist.txt
@@ -4,14 +4,11 @@ AgentKey
 Airbnb
 Airbyte
 AirflowException
-Aizhamal
 Alphasort
 Analytics
 AnalyzeEntitiesResponse
 AnalyzeSentimentResponse
 AnalyzeSyntaxResponse
-Anand
-Anierobi
 AnnotateTextResponse
 Ansible
 AppBuilder
@@ -32,7 +29,6 @@ Backfill
 BackfillJobTest
 Backfills
 Banco
-Bas
 BaseClient
 BaseOperator
 BaseView
@@ -42,14 +38,11 @@ Bigquery
 Bigtable
 Bitshift
 Bluecore
-Bolke
 Bool
 Booleans
 Boto
 BounceX
-Boxel
 Bq
-Breguła
 CSRFProtect
 Cancelled
 Cassanda
@@ -57,11 +50,9 @@ Catchup
 Celect
 Cgroups
 Changelog
-Chao
 CheckOperator
 Checklicence
 Checkr
-Chung
 Cinimex
 ClassifyTextResponse
 CloudTasksClient
@@ -78,7 +69,6 @@ Configs
 ContainerPort
 Cron
 Ctrl
-Cunningham
 DBs
 Daemonize
 DagFileProcessorManager
@@ -103,8 +93,6 @@ Datasync
 DateFrame
 Datetimepicker
 Datetimes
-Davydov
-De
 Decrypt
 Decrypts
 DeidentifyContentResponse
@@ -122,7 +110,6 @@ Dockerise
 Docstring
 Docstrings
 Dont
-Driesprong
 Drillbit
 Drivy
 Dsn
@@ -130,17 +117,14 @@ Dynamodb
 EDITMSG
 ETag
 Eg
-Elad
 EmrAddSteps
 EmrCreateJobFlow
 Enum
 Env
 EnvVar
-Ephraim
 ExaConnection
 Exasol
 Failover
-Feng
 Fernet
 FileSensor
 Filebeat
@@ -152,14 +136,12 @@ Firehose
 Firestore
 Flink
 FluentD
-Fokko
 Formaturas
 Fundera
 GCS
 GH
 GSoD
 Gantt
-Gao
 Gcp
 Gentner
 GetPartitions
@@ -172,39 +154,28 @@ Groupalia
 Groupon
 Grpc
 Gunicorn
-Guziel
 Gzip
 HCatalog
 HTTPBasicAuth
-Harenslak
 Hashable
 Hashicorp
 Highcharts
-Hitesh
 Hiveserver
 Hoc
-Homan
 HostAliases
 Hostname
-Hou
 Http
 HttpError
 HttpRequest
-Huang
 IdP
 ImageAnnotatorClient
 Imap
-Imberman
 InsecureClient
 InspectContentResponse
 InspectTemplate
 Investorise
 JPype
-Jakob
-Jarek
 Jdbc
-Jed
-Jiajie
 Jinja
 Jinjafied
 Jinjafy
@@ -217,19 +188,13 @@ Json
 Jupyter
 KYLIN
 Kalibrr
-Kalif
-Kamil
-Kaxil
-Kengo
 Kerberized
 Kerberos
 KerberosClient
-KevinYang
 KeyManagementServiceClient
 Keyfile
 Kibana
 Kinesis
-Koka
 Kombu
 Kube
 Kubernetes
@@ -248,7 +213,6 @@ Liveness
 Logstash
 Lowin
 Lyft
-Maheshwari
 Makefile
 Mapreduce
 Mariadb
@@ -266,7 +230,6 @@ Multinamespace
 Mysql
 NFS
 NaN
-Naik
 Namenode
 Namespace
 Neo4j
@@ -274,7 +237,6 @@ Nextdoor
 Nones

[airflow] 01/03: Add new committers: ``Jed`` and ``TP`` (#16671)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit f010eb9a878108f757e38249b3bbb5d5dc7ab3ee
Author: Kaxil Naik 
AuthorDate: Sat Jun 26 09:04:57 2021 +0100

Add new committers: ``Jed`` and ``TP`` (#16671)

Announcement Email: 
https://lists.apache.org/thread.html/rae56495ae62fc28cfe1a88e9d28043d78fdbdb611e8a8437bb044ae4%40%3Cdev.airflow.apache.org%3E

(cherry picked from commit 1a532eb3fad188f6cffdbdc7c1a29a8d0e0e2860)
---
 docs/apache-airflow/project.rst | 2 ++
 docs/spelling_wordlist.txt  | 5 +
 2 files changed, 7 insertions(+)

diff --git a/docs/apache-airflow/project.rst b/docs/apache-airflow/project.rst
index 0a97e0f..cd47a05 100644
--- a/docs/apache-airflow/project.rst
+++ b/docs/apache-airflow/project.rst
@@ -56,6 +56,7 @@ Committers
 - Jakob Homan (@jghoman)
 - James Timmins (@jhtimmins)
 - Jarek Potiuk (@potiuk)
+- Jed Cunningham (@jedcunningham)
 - Jiajie Zhong (@zhongjiajie)
 - Joshua Carp (@jmcarp)
 - Joy Gao (@joygao)
@@ -73,6 +74,7 @@ Committers
 - Sumit Maheshwari (@msumit)
 - Tao Feng (@feng-tao)
 - Tomasz Urbaszek (@turbaszek)
+- Tzu-ping Chung (@uranusjr)
 - Vikram Koka (@vikramkoka)
 - Xiaodong Deng (@XD-DENG)
 - Xinbin Huang (@xinbinhuang)
diff --git a/docs/spelling_wordlist.txt b/docs/spelling_wordlist.txt
index 7631c6c..4b071a8 100644
--- a/docs/spelling_wordlist.txt
+++ b/docs/spelling_wordlist.txt
@@ -61,6 +61,7 @@ Chao
 CheckOperator
 Checklicence
 Checkr
+Chung
 Cinimex
 ClassifyTextResponse
 CloudTasksClient
@@ -77,6 +78,8 @@ Configs
 ContainerPort
 Cron
 Ctrl
+Cunningham
+DBs
 Daemonize
 DagFileProcessorManager
 DagRun
@@ -200,6 +203,7 @@ JPype
 Jakob
 Jarek
 Jdbc
+Jed
 Jiajie
 Jinja
 Jinjafied
@@ -392,6 +396,7 @@ Tomasz
 Tooltip
 Tsai
 Tuneables
+Tzu-ping
 UA
 Uellendall
 Umask

[airflow] branch v2-1-test updated (332415a -> 5f9930b)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.


from 332415a  Add Changelog updates for 2.1.3
 new f010eb9  Add new committers: ``Jed`` and ``TP`` (#16671)
 new b71bda6  Add Aneesh Joseph as Airflow Committer (#16835)
 new 5f9930b  Bump ``sphinxcontrib-spelling`` and minor improvements 
(#16675)

The 3 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 airflow/providers/amazon/aws/sensors/s3_prefix.py |  4 +-
 docs/apache-airflow/project.rst   |  3 +
 docs/conf.py  |  3 +
 docs/spelling_wordlist.txt| 96 +--
 setup.py  |  2 +-
 5 files changed, 10 insertions(+), 98 deletions(-)

[airflow] 02/03: Add Aneesh Joseph as Airflow Committer (#16835)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit b71bda6945659e367a3374378f4ca31706aacccd
Author: Kaxil Naik 
AuthorDate: Tue Jul 6 16:08:55 2021 +0100

Add Aneesh Joseph as Airflow Committer (#16835)


https://lists.apache.org/thread.html/r2995b1c1614aa1f9b0b8b5c1ee27dbb285016b203ae547b2d488%40%3Cdev.airflow.apache.org%3E
(cherry picked from commit 1eed6b4f37ddf2086bf06fb5c4475c68fadac0f9)
---
 docs/apache-airflow/project.rst | 1 +
 1 file changed, 1 insertion(+)

diff --git a/docs/apache-airflow/project.rst b/docs/apache-airflow/project.rst
index cd47a05..8c2ea3a 100644
--- a/docs/apache-airflow/project.rst
+++ b/docs/apache-airflow/project.rst
@@ -39,6 +39,7 @@ Committers
 - Aizhamal Nurmamat kyzy (@aijamalnk)
 - Alex Guziel (@saguziel)
 - Alex Van Boxel (@alexvanboxel)
+- Aneesh Joseph (@aneesh-joseph)
 - Arthur Wiedmer (@artwr)
 - Ash Berlin-Taylor (@ashb)
 - Bas Harenslak (@basph)

svn commit: r49549 - /dev/airflow/2.1.2rc1/

Author: kaxilnaik
Date: Tue Aug 17 22:54:22 2021
New Revision: 49549

Log:
Remove old release: 2.1.2

Removed:
dev/airflow/2.1.2rc1/

[GitHub] [airflow] github-actions[bot] commented on pull request #17670: Fix link to generating constraints in BREEZE.rst



github-actions[bot] commented on pull request #17670:
URL: https://github.com/apache/airflow/pull/17670#issuecomment-900683787


   The PR is likely ready to be merged. No tests are needed as no important 
environment files, nor python files were modified by it. However, committers 
might decide that full test matrix is needed and add the 'full tests needed' 
label. Then you should rebase it to the latest main or amend the last commit of 
the PR, and push it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

svn commit: r49548 - /dev/airflow/2.1.3rc1/

Author: kaxilnaik
Date: Tue Aug 17 22:53:34 2021
New Revision: 49548

Log:
Add artifacts for Airflow 2.1.3rc1

Added:
dev/airflow/2.1.3rc1/
dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz   (with props)
dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc
dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512
dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz   (with props)
dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc
dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512
dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl   (with props)
dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl.asc
dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl.sha512

Added: dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz
==
Binary file - no diff available.

Propchange: dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc (added)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.asc Tue Aug 17 
22:53:34 2021
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQFJBAABCAAzFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcPZsVHGtheGlsbmFp
+a0BhcGFjaGUub3JnAAoJEGZ04IrX3kBvNSsIAKSUj3wzs4XHvOK3ylmgxDWrSltz
+bLP7+hYnsql9eal4EgWgza4D9TIk67V3jt+mNqGnFzABEQJBLyq2AIcl+qyVqaiF
+gbIRRAEI+Vja48QvYwpdKoj1JowSfeeKLHqxj8mQHKjA4HL1zyLNBevMRlOSyDNH
+i1u8A8ON9HlhDPlFE41o6e5d96IsTloIlaA2RhFpIi9NRsOb+h8xWqmxpgPagR7w
+65Vd+/E9iEkg+cpX9JU6H6QGl4A7b0mRMKsl5AUbB0L29kfrknbQ4lajts0chvjg
+zBLGBzuaWqz3NM4qqvgZeO37vBJWqHFHsL6mSPZVfCbhft+eQtNnH3gDF/c=
+=nHqh
+-END PGP SIGNATURE-

Added: dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512 (added)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3-source.tar.gz.sha512 Tue Aug 17 
22:53:34 2021
@@ -0,0 +1 @@
+66199642ee3d9c73c2d1ed2901cfdbc6177f67a1f07d7d352ac8755f48ff4cc8941e5fea22f5b951731f2ada7816566f572211f412a3b9cf0236fca7dc1a90fd
  apache-airflow-2.1.3-source.tar.gz

Added: dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz
==
Binary file - no diff available.

Propchange: dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz
--
svn:mime-type = application/octet-stream

Added: dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc (added)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.asc Tue Aug 17 22:53:34 
2021
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQFJBAABCAAzFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcPZwVHGtheGlsbmFp
+a0BhcGFjaGUub3JnAAoJEGZ04IrX3kBvCfEIALY647uyOii2+rZw77+8g4LPacsc
+vtb0iOWPGQO7tzGA/eL8nxD7a+/0DXYz8G7oVFis7bWRgGA605e3taaR/jUCC2Mr
+E5lrFnqZWw7TUqu4Aa9PDqTX0g9w+MSw6bg64s+9f4x5/AxOVSff1r6caPRVm2sF
+isEeGKZO45kbrGiEVJDiFEwTktE/6p8XcACL4UiS7Verz1L+1cNn57huC8XWz8T9
+7RMxDIyavxpUiODouFDd9XiYlCHfYMcF4jykX/mmj8wUUYQneH0t9PrPe4zGWDnZ
+WD3sni+CobL4S/t70HxXmzenuORHgnc8w6d01sbeLzMTcDG4s0X17Whtkk8=
+=DSp0
+-END PGP SIGNATURE-

Added: dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512
==
--- dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512 (added)
+++ dev/airflow/2.1.3rc1/apache-airflow-2.1.3.tar.gz.sha512 Tue Aug 17 22:53:34 
2021
@@ -0,0 +1 @@
+3c096a74314ff8244cd937b2cd4e12c2efc677c301fd8d292d22678b6848a8eb81465d0dc49662a796e10536d574bccaa0696257c4a80de27bb5e64b0db6d450
  apache-airflow-2.1.3.tar.gz

Added: dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl
==
Binary file - no diff available.

Propchange: dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl
--
svn:mime-type = application/octet-stream

Added: dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl.asc
==
--- dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl.asc (added)
+++ dev/airflow/2.1.3rc1/apache_airflow-2.1.3-py3-none-any.whl.asc Tue Aug 17 
22:53:34 2021
@@ -0,0 +1,11 @@
+-BEGIN PGP SIGNATURE-
+
+iQFJBAABCAAzFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcPZwVHGtheGlsbmFp

[GitHub] [airflow] jedcunningham commented on issue #17343: Dags added by DagBag interrupt randomly



jedcunningham commented on issue #17343:
URL: https://github.com/apache/airflow/issues/17343#issuecomment-900681488


   If it were me, I'd use `TriggerDagRunOperator` directly and put a 
`ShortCircuirOperator` in front of it to check your `random_condition`, 
something like:
   
   ```
   check = ShortCircuitOperator(
   task_id="check",
   python_callable=lamda: random_condition,
   )
   
   trigger = TriggerDagRunOperator(
   task_id="trigger",
   trigger_dag_id=dag_name,
   conf={"group_nr": next_group_nr, "group": next_group},
   )
   
   check >> trigger
   ```
   
   Generally, I'd say using `.execute()` on an operator directly is an 
anti-pattern.
   
   Also, as mentioned in #17344 Airflow really does expect a single DAG folder. 
Finding a simpler way to do multi-tenancy would probably be a good idea.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] baryluk commented on pull request #17649: Do not fail KubernetesPodOperator tasks if log following fails



baryluk commented on pull request #17649:
URL: https://github.com/apache/airflow/pull/17649#issuecomment-900678795


   > We also need test coverage for this change.
   
   That makes sense. Let me take a look at mocking facilities available to test 
this.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] baryluk commented on a change in pull request #17649: Do not fail KubernetesPodOperator tasks if log following fails



baryluk commented on a change in pull request #17649:
URL: https://github.com/apache/airflow/pull/17649#discussion_r690771413



##
File path: airflow/providers/cncf/kubernetes/utils/pod_launcher.py
##
@@ -143,12 +143,21 @@ def monitor_pod(self, pod: V1Pod, get_logs: bool) -> 
Tuple[State, V1Pod, Optiona
 read_logs_since_sec = None
 last_log_time = None
 while True:
-logs = self.read_pod_logs(pod, timestamps=True, 
since_seconds=read_logs_since_sec)
-for line in logs:
-timestamp, message = 
self.parse_log_line(line.decode('utf-8'))
-self.log.info(message)
-if timestamp:
-last_log_time = timestamp
+try:
+logs = self.read_pod_logs(pod, timestamps=True, 
since_seconds=read_logs_since_sec)
+for line in logs:
+timestamp, message = 
self.parse_log_line(line.decode('utf-8'))
+self.log.info(message)
+if timestamp:
+last_log_time = timestamp
+except Exception as e:

Review comment:
   Ok. Used `urllib3.exceptions.HTTPError` which is a base for many socket 
related errors in `urllib3` including connection, protocol, timeouts, response 
parsing errors, etc.
   
   Should be good.

##
File path: airflow/providers/cncf/kubernetes/utils/pod_launcher.py
##
@@ -217,7 +223,7 @@ def base_container_is_running(self, pod: V1Pod):
 return False
 return status.state.running is not None
 
-@tenacity.retry(stop=tenacity.stop_after_attempt(3), 
wait=tenacity.wait_exponential(), reraise=True)
+@tenacity.retry(stop=tenacity.stop_after_attempt(4), 
wait=tenacity.wait_exponential(), reraise=True)

Review comment:
   Removed.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] baryluk commented on a change in pull request #17649: Do not fail KubernetesPodOperator tasks if log following fails



baryluk commented on a change in pull request #17649:
URL: https://github.com/apache/airflow/pull/17649#discussion_r690766253



##
File path: airflow/providers/cncf/kubernetes/utils/pod_launcher.py
##
@@ -143,12 +143,21 @@ def monitor_pod(self, pod: V1Pod, get_logs: bool) -> 
Tuple[State, V1Pod, Optiona
 read_logs_since_sec = None
 last_log_time = None
 while True:
-logs = self.read_pod_logs(pod, timestamps=True, 
since_seconds=read_logs_since_sec)
-for line in logs:
-timestamp, message = 
self.parse_log_line(line.decode('utf-8'))
-self.log.info(message)
-if timestamp:
-last_log_time = timestamp
+try:
+logs = self.read_pod_logs(pod, timestamps=True, 
since_seconds=read_logs_since_sec)
+for line in logs:
+timestamp, message = 
self.parse_log_line(line.decode('utf-8'))
+self.log.info(message)
+if timestamp:
+last_log_time = timestamp
+except Exception as e:

Review comment:
   I wanted something broad, `Exception` might be a bit too much. But there 
might be more things beyond TimeoutError, i.e. dns issue, authorization issue, 
ssl errors, protocol error, etc. Basically all of this should be ignored, check 
if pod is still alive, and retry later.
   
   `TimeoutError` would definitively help in my use case, but I think it is a 
bit too narrow, and also relays on the fact kube client is using urllib3 
internally, which might not be the case in the future.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] baryluk commented on a change in pull request #17649: Do not fail KubernetesPodOperator tasks if log following fails



baryluk commented on a change in pull request #17649:
URL: https://github.com/apache/airflow/pull/17649#discussion_r690765281



##
File path: airflow/providers/cncf/kubernetes/utils/pod_launcher.py
##
@@ -217,7 +223,7 @@ def base_container_is_running(self, pod: V1Pod):
 return False
 return status.state.running is not None
 
-@tenacity.retry(stop=tenacity.stop_after_attempt(3), 
wait=tenacity.wait_exponential(), reraise=True)
+@tenacity.retry(stop=tenacity.stop_after_attempt(4), 
wait=tenacity.wait_exponential(), reraise=True)

Review comment:
   I can revert that part for now. It does help a little, but with the 
retry that will be now attempted if needed in the outer loop (as long as the 
pod is alive) it indeed seems not necessary.




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] annotated tag 2.1.3rc1 updated (039d1af -> c46bccb)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to annotated tag 2.1.3rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.


*** WARNING: tag 2.1.3rc1 was modified! ***

from 039d1af  (tag)
  to c46bccb  (tag)
 tagging d25854dd413aa68ea70fb1ade7fe01425f456192 (commit)
 replaces 2.1.1
  by Kaxil Naik
  on Tue Aug 17 23:25:29 2021 +0100

- Log -
Apache Airflow 2.1.3rc1
-BEGIN PGP SIGNATURE-

iQEzBAABCAAdFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcN1sACgkQZnTgitfe
QG+dywf7B5HuRP9DfvFxVo+BeA4PMDYwqsg8P2EIx6NlbxxKqVNqSJvZp3PedIIu
y5PYkSqIHraaSIQ6FLkFgJvWkYgG+oGmGIiCqLEfEvzmRO3MAMtp6UdIOjTGnc3S
+OLL6Q2n0koZmCqtUtFM2jS7wVfIvPLoK4Ln9UGg7AuCBy2hrq3bUtnkXbfIlq9m
V9axhKQIfzeqXR/tSRn8f+w2OhezILO7Ufg+JVOb23ZLZOZ+rfMc0oiYn6bIQ/pR
nCxf+U4kuvHf9qZe1txUVxrrRc5GUUd1lYukMLTqlvDQo/D4PN1dY5PGz4LzhOn/
7IeWvAiAJNgyuc7+giErFPaeXi8SIg==
=n0uO
-END PGP SIGNATURE-
---


No new revisions were added by this update.

Summary of changes:

[airflow] annotated tag 2.1.3rc1 updated (d25854d -> 039d1af)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to annotated tag 2.1.3rc1
in repository https://gitbox.apache.org/repos/asf/airflow.git.


*** WARNING: tag 2.1.3rc1 was modified! ***

from d25854d  (commit)
  to 039d1af  (tag)
 tagging d25854dd413aa68ea70fb1ade7fe01425f456192 (commit)
 replaces 2.1.1
  by Kaxil Naik
  on Tue Aug 17 23:21:52 2021 +0100

- Log -
Apache Airflow 2.1.3
-BEGIN PGP SIGNATURE-

iQEzBAABCAAdFiEEzeFcbk06jsTs9LpLZnTgitfeQG8FAmEcNocACgkQZnTgitfe
QG/4UQgAgGoDHn3iQr8+wr0+CLNKWIECoXt+6ZoFmroHjMpxiSoMi0UjSoSzcCoh
FwVeM1rCdPIQjbq0t2URWNXDu/eMuDQu30/i4ygVqj+rjoaqy9XFA/e7mDNr5jBg
VTZ1srn54Flj+2/kstytjzfwfZfMWEjCZeI7LJ7f9yDyvGy9Cw6ZBSiCXxeIJP7E
ZUvF2fgOhRtzyaxexLUER4LE5PQ5ROynytxjKOzXxNSSIaPXPRsPWi4h1fL/WWJd
NrRgXBi7vWs4rALQBKzVvXvMAShdhURVAK/mBs8ouu81uRY0kggcK7L8exoMlX9t
sCzqmpNyK8ZoxAc5avgUW5vzRmhzWg==
=3IpR
-END PGP SIGNATURE-
---


No new revisions were added by this update.

Summary of changes:

[GitHub] [airflow] jedcunningham opened a new pull request #17670: Fix link to generating constraints in BREEZE.rst



jedcunningham opened a new pull request #17670:
URL: https://github.com/apache/airflow/pull/17670


   Ran across this broken deep link when trying to generate constraints.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] branch v2-1-stable updated (d25854d -> 130e2f4)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a change to branch v2-1-stable
in repository https://gitbox.apache.org/repos/asf/airflow.git.


from d25854d  Update changelog with Python 3.9 support. (#16918)
 new 6720544  Fix permissions for CodeQL workflows (#16660)
 new 71fec5d  Remove upstart from docs (#16672)
 new 2b393ee  Add preparation of images as part of RC preparation process 
(#16674)
 new d95a6bd  Add --executor option to breeze kind-cluster deploy command 
(#15661)
 new 90b2ac6  Use different executors for Helm Chart tests in CI (#15791)
 new 172599e  Change default airflow version in Dockerfile (#16714)
 new 9d528d4  Adding missing word to welcome message (#16726)
 new 4e174b3  Fix timing out tests for public GitHub Runners. (#16750)
 new 24fd4d7  Breeze should work with new docker-compose fallback (#16743)
 new 02c92c8  Switches to ghcr.io container registry (#16775)
 new 8fd4cf4  Removes coverage from kubernetes tests (#16794)
 new 236bb43  Remove legacy GitHub Packages (#16776)
 new 07e3789  Fix Airflow releasing guide (#16924)
 new ac98256  Avoid verification of images multiple times (#16928)
 new 324c342  Remove cache for kubernetes tests (#16927)
 new 8691ca0  Switch Breeze/CI to ghcr.io excusively (#16780)
 new 7fc74c1  Pulls latest images to build images in "Build Image" flow 
(#16948)
 new 85b3057  Fixed parsing issue of _docker.env file for docker-compose v2 
(#16950)
 new 373007b  Fixes passing variables via docker --env-file command (#16959)
 new 6263871  Fixes typo in the name of file for Breeze docker compose env 
(#16971)
 new b0a006c  Move CI-integration images to ghcr.io (#16797)
 new 5f3b53f  Errors out instead of trying to workaround buggy 
docker-compose v2 (#16989)
 new b954390  Fix release guide when copying artifacts (#17001)
 new e6ac8e9  Drop support for Airflow 1.10 in entrypoint_prod.sh and 
improve MSSQL compatibility (#17011)
 new d1cb4e4  Fix bug and small improvements in 
scripts/tools/list-integrations.py (#17004)
 new 6e8c5f6  Dev: Bump stale action to v4 (#17025)
 new 33b7bda  Fixes "development" and "rc" cross dependencies between 
providers (#17023)
 new 2f20298  Updated clean-logs.sh (#16978)
 new 7829e33  Fixes detection of version 2 of docker-compose (#17062)
 new 3e2da93  Add SSH_PORT variable
 new b043f4b  Converts the specification of branch for pushes to be 
flexible (#17065)
 new 16d1ff0  Support secret backends/airflow.cfg for celery broker in 
entrypoint_prod.sh (#17069)
 new 219e9b2  Fixes UI assets compilation from PROD image built from 
sources (#17086)
 new 0509113  Avoid logging in to GitHub Container Registry when not in CI 
(#17169)
 new f99a023  Do not fail-fast kubernetes tests (#17228)
 new 1491db2  Remove support for Airflow 1.10 cmds in entrypoint_prod.sh 
(#17248)
 new 28562ef  Stop attempting to pull base python image when pulling commit 
hash (#17231)
 new f05a9e5  Do not use constraints when preparing venv for k8s tests on 
CI (#17290)
 new a3e9e2c  Uses current sources when running k8s tests (#17289)
 new 3f584b2  Fix breeze kind-cluster deploy failing with ECONREFUSED 
(#17293)
 new c828c0c  Fix typo in build_images (#17327)
 new 3f30eed  Added print statements for clarity in provider yaml checks 
(#17322)
 new ac483d1  Adds compile_assets to INSTALL (#17377)
 new e183834  Moves SchedulerJob initialization to within daemon context 
(#17157)
 new 769779b  Update best-practices.rst (#17357)
 new 32937fa  Fix link (#17351)
 new 5a3a874  docs: fix inconsistencies in configuration docs (#17317)
 new 1419b22  Grammar and clarity pass on documentation (#17318)
 new 249721c  Fix docs link for using SQLite as Metadata DB (#17308)
 new 9ccac6c  More optimized lazy-loading of provider information (#17304)
 new b2f607c  Doc: Strip unnecessary arguments from MariaDB JIRA URL 
(#17296)
 new a31e02c  Fix typo in webserver.rst (#17288)
 new 549862e  Switch back http provider after requests removes LGPL 
dependency (#16974)
 new a5dbded  Remove SQLAlchemy <1.4 constraint (#16630)
 new 8da2998  Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
 new 35109a1  Add type annotations to setup.py (#16658)
 new 77ce1c5  bump dnspython (#16698)
 new b766304  AIRFLOW-5529 Add Apache Drill provider. (#16884)
 new fc7042f  Update alias for field_mask in Google Memmcache (#16975)
 new f729323  Updates to FlaskAppBuilder 3.3.2+ (#17208)
 new 6fad2cb  Enhancement to bash scripts (#17098)
 new ae90a47  Do not pull CI image for ownership fixing on first, fresh 
breeze run (#17419)
 new 1d29e59  Increases timeout for helm chart builds (#17417)
 new db55756  Improve image building documentation for new users (#17409)
 new 78527e3  Optimizes structure of the

[airflow] branch v2-1-test updated (6dc2d31 -> 332415a)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.


 discard 6dc2d31  Add Changelog updates for 2.1.3 (#17644)
 discard b2dbe4b  Remove repeated test.
 discard 236233c  Improve `dag_maker` fixture (#17324)
 discard cd8b04f  Fix task retries when they receive sigkill and have retries 
and properly handle sigterm (#16301)
 discard e17ddbd  Add Pytest fixture to create dag and dagrun and use it on 
local task job tests (#16889)
 discard a3fea9c  Run mini scheduler in LocalTaskJob during task exit (#16289)
 discard 6971a27  Add Changelog updates for 2.1.3
 add 332415a  Add Changelog updates for 2.1.3

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (6dc2d31)
\
 N -- N -- N   refs/heads/v2-1-test (332415a)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

No new revisions were added by this update.

Summary of changes:

[GitHub] [airflow] jedcunningham commented on a change in pull request #17649: Do not fail KubernetesPodOperator tasks if log following fails



jedcunningham commented on a change in pull request #17649:
URL: https://github.com/apache/airflow/pull/17649#discussion_r690623986



##
File path: airflow/providers/cncf/kubernetes/utils/pod_launcher.py
##
@@ -217,7 +223,7 @@ def base_container_is_running(self, pod: V1Pod):
 return False
 return status.state.running is not None
 
-@tenacity.retry(stop=tenacity.stop_after_attempt(3), 
wait=tenacity.wait_exponential(), reraise=True)
+@tenacity.retry(stop=tenacity.stop_after_attempt(4), 
wait=tenacity.wait_exponential(), reraise=True)

Review comment:
   How'd you land on 4 attempts? Do we even need to bump this with the 
other change?

##
File path: airflow/providers/cncf/kubernetes/utils/pod_launcher.py
##
@@ -143,12 +143,21 @@ def monitor_pod(self, pod: V1Pod, get_logs: bool) -> 
Tuple[State, V1Pod, Optiona
 read_logs_since_sec = None
 last_log_time = None
 while True:
-logs = self.read_pod_logs(pod, timestamps=True, 
since_seconds=read_logs_since_sec)
-for line in logs:
-timestamp, message = 
self.parse_log_line(line.decode('utf-8'))
-self.log.info(message)
-if timestamp:
-last_log_time = timestamp
+try:
+logs = self.read_pod_logs(pod, timestamps=True, 
since_seconds=read_logs_since_sec)
+for line in logs:
+timestamp, message = 
self.parse_log_line(line.decode('utf-8'))
+self.log.info(message)
+if timestamp:
+last_log_time = timestamp
+except Exception as e:

Review comment:
   This is pretty broad, maybe we only look for `TimeoutError`'s?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] jhtimmins merged pull request #17669: Sync v2-1-test and v2-1-stable



jhtimmins merged pull request #17669:
URL: https://github.com/apache/airflow/pull/17669


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on pull request #17669: Sync v2-1-test and v2-1-stable



github-actions[bot] commented on pull request #17669:
URL: https://github.com/apache/airflow/pull/17669#issuecomment-900662858


   The PR most likely needs to run full matrix of tests because it modifies 
parts of the core of Airflow. However, committers might decide to merge it 
quickly and take the risk. If they don't merge it quickly - please rebase it to 
the latest main at your convenience, or amend the last commit of the PR, and 
push it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] branch v2-1-test updated (e6478fe -> 6dc2d31)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.


omit e6478fe  Add Changelog updates for 2.1.3 (#17644)
omit 489f9be  Remove repeated test.
omit 8f3cce6  Improve `dag_maker` fixture (#17324)
omit 4f2f346  Fix task retries when they receive sigkill and have retries 
and properly handle sigterm (#16301)
omit 95e251a  Add Pytest fixture to create dag and dagrun and use it on 
local task job tests (#16889)
omit 970c6a2  Run mini scheduler in LocalTaskJob during task exit (#16289)
omit 02d3703  Add Changelog updates for 2.1.3
omit 53b3adb  Forces rebuilding the image for cache pushing
omit eaa09ed  Improve validation of Group id (#17578)
omit 06d0918  Improve `dag_maker` fixture (#17324)
omit eadacc3  Use dag_maker fixture in test_backfill_job.py (#17118)
omit 73ff5a8  Fix redacting secrets in context exceptions. (#17618)
omit f77cdb6  Update documentation regarding Python 3.9 support (#17611)
omit 7d1c056  Bump version to 2.1.3
omit 12f2467  Fix task retries when they receive sigkill and have retries 
and properly handle sigterm (#16301)
omit 343beb6  Add Pytest fixture to create dag and dagrun and use it on 
local task job tests (#16889)
omit 7cc6002  Fix race condition with dagrun callbacks (#16741)
omit 5c3e373  Add 'queued' to DagRunState (#16854)
omit ee67daa  Add 'queued' state to DagRun (#16401)
omit 2256716  Move DagFileProcessor and DagFileProcessorProcess out of 
scheduler_job.py (#16581)
omit e8e8b19  Run mini scheduler in LocalTaskJob during task exit (#16289)
omit 73ff980  Fix external elasticsearch logs link (#16357)
omit 6b8398a  Proper warning message when recorded PID is different from 
current PID (#17411)
omit 43a31e1   Fix running tasks with default_impersonation config (#17229)
omit 84df5ff  Rescue if a DagRun's DAG was removed from db (#17544)
omit 42b6e2f  Fixed broken json_client (#17529)
omit 65667b5  Add missing permissions to varimport (#17468)
omit 93b4c7b  Optimize context sent for docker build (#17415)
omit 0678a94  Handle and log exceptions raised during task callback (#17347)
omit 5739fed  Fix CLI 'kubernetes cleanup-pods' which fails on invalid 
label key (#17298)
omit db96ee5  Show serialization exceptions in DAG parsing log (#17277)
omit 20f6edf  Do not seek error file when it is closed (#17187)
omit 0656f10  Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
omit 18c6baf  Switch test_backfill_job.py from unittest to pytest style 
(#17112)
omit 4709c65  Adds more explanatory message when SecretsMasker is not 
configured (#17101)
omit f5ef0dd  #16976 Add json.dumps() for templated fields objects: 'dict' 
and 'list' (#17082)
omit 75c3e75  Core: Enable the use of __init_subclass__ in subclasses of 
BaseOperator (#17027)
omit e7a87e5  Fix UPDATING.md (#16933)
omit 84bb043  Fixed task instance retrieval in XCom view (#16923)
omit ae4ab58  Don't check execution_date in refresh_from_db (#16809)
omit d04fe50  Validate type of `priority_weight` during parsing (#16765)
omit 1aa156a  Fix unchecked indexing in _build_metrics (#16744)
omit 943d3c5  BugFix: Correctly handle custom `deps` and `task_group` 
during DAG Serialization (#16734)
omit 3211672  Fix slow (cleared) tasks being be adopted by Celery worker. 
(#16718)
omit 748c662  Fix calculating duration in tree view (#16695)
omit 600309b  Set Process title for Worker when using ``LocalExecutor`` 
(#16623)
omit e593671  Fix ``AttributeError``: ``datetime.timezone`` object has no 
attribute ``name`` (#16599)
omit 6eec6d0  Redact conn secrets in webserver logs (#16579)
omit f3d431d  fix: change graph focus to top of view instead of center 
(#16484)
omit c6d09ed  Fail tasks in scheduler when executor reports they failed 
(#15929)
omit dd3c06f  commiting dagPickle session when the airflow tasks run 
--ship-dag --interactive command is executed FIXES: 15748 (#15890)
omit dd94647  Add State types for tasks and DAGs (#15285)
omit 6ebbf82  fix(smart_sensor): Unbound variable errors (#14774)
omit 0d0f4e8  Fix minor typo in configuration.py (#16832)
omit e2be8d3  fix: instance name env var (#16749)
omit be09eef  Path correction in docs for airflow core (#17567)
omit b82782c  Add back missing permissions to UserModelView controls. 
(#17431)
omit 3833fb7  Better diagnostics and self-healing of docker-compose (#17484)
omit 0948366  Install providers from sources in prod image only on main 
(#17458)
omit 8bd1a7d  Attempt to reduce flakiness of PythonVirtualeEnv 
test_airflow_context (#17486)
omit 562be8c  Disable Helm tests when branch is not main
omit 2ba71c9  Fixes some static check errors (#17432)
omit 8fc7697  Switches to "/"

[GitHub] [airflow] github-actions[bot] commented on pull request #17667: [DOCS] Update DAG.is_active property



github-actions[bot] commented on pull request #17667:
URL: https://github.com/apache/airflow/pull/17667#issuecomment-900658458


   The PR is likely OK to be merged with just subset of tests for default 
Python and Database versions without running the full matrix of tests, because 
it does not modify the core of Airflow. If the committers decide that the full 
tests matrix is needed, they will add the label 'full tests needed'. Then you 
should rebase to the latest main or amend the last commit of the PR, and push 
it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil opened a new pull request #17669: Sync v2-1-test and v2-1-stable



kaxil opened a new pull request #17669:
URL: https://github.com/apache/airflow/pull/17669


   Just needs an approval so that we can push commits from v2-1-test to 
v2-1-stable
   
   
   
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
 for more information.
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil closed pull request #17668: Prepare v2 1 3



kaxil closed pull request #17668:
URL: https://github.com/apache/airflow/pull/17668


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] jhtimmins opened a new pull request #17668: Prepare v2 1 3



jhtimmins opened a new pull request #17668:
URL: https://github.com/apache/airflow/pull/17668


   v2-1-test is stable. So this PR attempts to sync v2-1-stable with v2-1-test.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] 05/06: Remove repeated test.

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 489f9be29892cd82abfc34742ec5f921817ee51a
Author: James Timmins 
AuthorDate: Mon Aug 16 19:04:13 2021 -0700

Remove repeated test.
---
 tests/jobs/test_local_task_job.py | 28 
 1 file changed, 28 deletions(-)

diff --git a/tests/jobs/test_local_task_job.py 
b/tests/jobs/test_local_task_job.py
index c18e6e5..14c74ce 100644
--- a/tests/jobs/test_local_task_job.py
+++ b/tests/jobs/test_local_task_job.py
@@ -864,34 +864,6 @@ class TestLocalTaskJob:
 session.refresh(dr)
 assert dr.state == State.SUCCESS
 
-def 
test_task_exit_should_update_state_of_finished_dagruns_with_dag_paused(self, 
dag_maker):
-"""Test that with DAG paused, DagRun state will update when the tasks 
finishes the run"""
-with dag_maker(dag_id='test_dags') as dag:
-op1 = PythonOperator(task_id='dummy', python_callable=lambda: True)
-
-session = settings.Session()
-dagmodel = dag_maker.dag_model
-dagmodel.next_dagrun_create_after = 
dag.following_schedule(DEFAULT_DATE)
-dagmodel.is_paused = True
-session.merge(dagmodel)
-session.flush()
-
-# Write Dag to DB
-dagbag = DagBag(dag_folder="/dev/null", include_examples=False, 
read_dags_from_db=False)
-dagbag.bag_dag(dag, root_dag=dag)
-dagbag.sync_to_db()
-
-dr = dag_maker.create_dagrun(run_type=DagRunType.SCHEDULED)
-
-assert dr.state == State.RUNNING
-ti = TaskInstance(op1, dr.execution_date)
-job1 = LocalTaskJob(task_instance=ti, ignore_ti_state=True, 
executor=SequentialExecutor())
-job1.task_runner = StandardTaskRunner(job1)
-job1.run()
-session.add(dr)
-session.refresh(dr)
-assert dr.state == State.SUCCESS
-
 
 @pytest.fixture()
 def clean_db_helper():

[airflow] 03/06: Fix task retries when they receive sigkill and have retries and properly handle sigterm (#16301)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 4f2f346b84c5102d5f636214d920258edaa036db
Author: Ephraim Anierobi 
AuthorDate: Wed Jul 28 15:57:35 2021 +0100

Fix task retries when they receive sigkill and have retries and properly 
handle sigterm (#16301)

Currently, tasks are not retried when they receive SIGKILL or SIGTERM even 
if the task has retry. This change fixes it
and added test for both SIGTERM and SIGKILL so we don't experience 
regression

Also, SIGTERM sets the task as failed and raises AirflowException which 
heartbeat sometimes see as externally set to fail
and not call failure_callbacks. This commit also fixes this by calling 
handle_task_exit when a task gets SIGTERM

Co-authored-by: Ash Berlin-Taylor 
(cherry picked from commit 4e2a94c6d1bde5ddf2aa0251190c318ac22f3b17)
---
 tests/jobs/test_local_task_job.py | 50 +++
 1 file changed, 50 insertions(+)

diff --git a/tests/jobs/test_local_task_job.py 
b/tests/jobs/test_local_task_job.py
index c6a92b2..2e28332 100644
--- a/tests/jobs/test_local_task_job.py
+++ b/tests/jobs/test_local_task_job.py
@@ -786,6 +786,56 @@ class TestLocalTaskJob:
 assert retry_callback_called.value == 1
 assert task_terminated_externally.value == 1
 
+def test_process_sigterm_works_with_retries(self, dag_maker):
+"""
+Test that ensures that task runner sets tasks to retry when they(task 
runner)
+ receive sigterm
+"""
+# use shared memory value so we can properly track value change even if
+# it's been updated across processes.
+retry_callback_called = Value('i', 0)
+task_terminated_externally = Value('i', 1)
+shared_mem_lock = Lock()
+
+def retry_callback(context):
+with shared_mem_lock:
+retry_callback_called.value += 1
+assert context['dag_run'].dag_id == 'test_mark_failure_2'
+
+def task_function(ti):
+time.sleep(60)
+# This should not happen -- the state change should be noticed and 
the task should get killed
+with shared_mem_lock:
+task_terminated_externally.value = 0
+
+with dag_maker(dag_id='test_mark_failure_2'):
+task = PythonOperator(
+task_id='test_on_failure',
+python_callable=task_function,
+retries=1,
+retry_delay=timedelta(seconds=2),
+on_retry_callback=retry_callback,
+)
+ti = TaskInstance(task=task, execution_date=DEFAULT_DATE)
+ti.refresh_from_db()
+job1 = LocalTaskJob(task_instance=ti, ignore_ti_state=True, 
executor=SequentialExecutor())
+job1.task_runner = StandardTaskRunner(job1)
+job1.task_runner.start()
+settings.engine.dispose()
+process = multiprocessing.Process(target=job1.run)
+process.start()
+for _ in range(0, 25):
+ti.refresh_from_db()
+if ti.state == State.RUNNING and ti.pid is not None:
+break
+time.sleep(0.2)
+os.kill(process.pid, signal.SIGTERM)
+process.join()
+ti.refresh_from_db()
+assert ti.state == State.UP_FOR_RETRY
+assert retry_callback_called.value == 1
+assert task_terminated_externally.value == 1
+
 def 
test_task_exit_should_update_state_of_finished_dagruns_with_dag_paused(self):
 """Test that with DAG paused, DagRun state will update when the tasks 
finishes the run"""
 dag = DAG(dag_id='test_dags', start_date=DEFAULT_DATE)

[airflow] 02/06: Add Pytest fixture to create dag and dagrun and use it on local task job tests (#16889)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 95e251af19e884ae249975111d9bedf33d8ca004
Author: Ephraim Anierobi 
AuthorDate: Tue Jul 20 18:48:35 2021 +0100

Add Pytest fixture to create dag and dagrun and use it on local task job 
tests (#16889)

This change adds pytest fixture to create dag and dagrun then use it on 
local task job tests

Co-authored-by: Tzu-ping Chung 
(cherry picked from commit 7c0d8a2f83cc6db25bdddcf6cecb6fb56f05f02f)
---
 tests/jobs/test_local_task_job.py | 77 ---
 1 file changed, 32 insertions(+), 45 deletions(-)

diff --git a/tests/jobs/test_local_task_job.py 
b/tests/jobs/test_local_task_job.py
index 060bce8..c6a92b2 100644
--- a/tests/jobs/test_local_task_job.py
+++ b/tests/jobs/test_local_task_job.py
@@ -786,55 +786,42 @@ class TestLocalTaskJob:
 assert retry_callback_called.value == 1
 assert task_terminated_externally.value == 1
 
-def test_process_sigterm_works_with_retries(self, dag_maker):
-"""
-Test that ensures that task runner sets tasks to retry when they(task 
runner)
- receive sigterm
-"""
-# use shared memory value so we can properly track value change even if
-# it's been updated across processes.
-retry_callback_called = Value('i', 0)
-task_terminated_externally = Value('i', 1)
-shared_mem_lock = Lock()
-
-def retry_callback(context):
-with shared_mem_lock:
-retry_callback_called.value += 1
-assert context['dag_run'].dag_id == 'test_mark_failure_2'
+def 
test_task_exit_should_update_state_of_finished_dagruns_with_dag_paused(self):
+"""Test that with DAG paused, DagRun state will update when the tasks 
finishes the run"""
+dag = DAG(dag_id='test_dags', start_date=DEFAULT_DATE)
+op1 = PythonOperator(task_id='dummy', dag=dag, owner='airflow', 
python_callable=lambda: True)
 
-def task_function(ti):
-time.sleep(60)
-# This should not happen -- the state change should be noticed and 
the task should get killed
-with shared_mem_lock:
-task_terminated_externally.value = 0
+session = settings.Session()
+orm_dag = DagModel(
+dag_id=dag.dag_id,
+has_task_concurrency_limits=False,
+next_dagrun=dag.start_date,
+next_dagrun_create_after=dag.following_schedule(DEFAULT_DATE),
+is_active=True,
+is_paused=True,
+)
+session.add(orm_dag)
+session.flush()
+# Write Dag to DB
+dagbag = DagBag(dag_folder="/dev/null", include_examples=False, 
read_dags_from_db=False)
+dagbag.bag_dag(dag, root_dag=dag)
+dagbag.sync_to_db()
 
-with dag_maker(dag_id='test_mark_failure_2'):
-task = PythonOperator(
-task_id='test_on_failure',
-python_callable=task_function,
-retries=1,
-retry_delay=timedelta(seconds=2),
-on_retry_callback=retry_callback,
-)
-ti = TaskInstance(task=task, execution_date=DEFAULT_DATE)
-ti.refresh_from_db()
+dr = dag.create_dagrun(
+run_type=DagRunType.SCHEDULED,
+state=State.RUNNING,
+execution_date=DEFAULT_DATE,
+start_date=DEFAULT_DATE,
+session=session,
+)
+assert dr.state == State.RUNNING
+ti = TaskInstance(op1, dr.execution_date)
 job1 = LocalTaskJob(task_instance=ti, ignore_ti_state=True, 
executor=SequentialExecutor())
 job1.task_runner = StandardTaskRunner(job1)
-job1.task_runner.start()
-settings.engine.dispose()
-process = multiprocessing.Process(target=job1.run)
-process.start()
-for _ in range(0, 25):
-ti.refresh_from_db()
-if ti.state == State.RUNNING and ti.pid is not None:
-break
-time.sleep(0.2)
-os.kill(process.pid, signal.SIGTERM)
-process.join()
-ti.refresh_from_db()
-assert ti.state == State.UP_FOR_RETRY
-assert retry_callback_called.value == 1
-assert task_terminated_externally.value == 1
+job1.run()
+session.add(dr)
+session.refresh(dr)
+assert dr.state == State.SUCCESS
 
 def 
test_task_exit_should_update_state_of_finished_dagruns_with_dag_paused(self, 
dag_maker):
 """Test that with DAG paused, DagRun state will update when the tasks 
finishes the run"""

[airflow] 06/06: Add Changelog updates for 2.1.3 (#17644)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit e6478fe749aeed18d5c73249cfe037fd5769197b
Author: James Timmins 
AuthorDate: Tue Aug 17 14:12:35 2021 -0700

Add Changelog updates for 2.1.3 (#17644)

Co-authored-by: Kaxil Naik 
(cherry picked from commit 808fb2ad3024f4855fb11a99128b9f67bad44a26)
---
 CHANGELOG.txt | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

diff --git a/CHANGELOG.txt b/CHANGELOG.txt
index ab92577..0b69b8e 100644
--- a/CHANGELOG.txt
+++ b/CHANGELOG.txt
@@ -58,8 +58,7 @@ Misc
 
 - Switch back http provider after requests removes LGPL dependency (#16974)
 
-
-Airflow 2.1.2, 2021-07-13
+Airflow 2.1.2, 2021-07-14
 -
 
 Bug Fixes

[airflow] 04/06: Improve `dag_maker` fixture (#17324)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 8f3cce6e2e7a3f831c1abeeeccbab9b4e9ff789e
Author: Ephraim Anierobi 
AuthorDate: Mon Aug 2 07:37:40 2021 +0100

Improve `dag_maker` fixture (#17324)

This PR improves the dag_maker fixture to enable creation of dagrun, dag 
and dag_model separately

Co-authored-by: Tzu-ping Chung 
(cherry picked from commit 5c1e09cafacea922b9281e901db7da7cadb3e9be)
---
 tests/jobs/test_local_task_job.py | 21 ++---
 1 file changed, 6 insertions(+), 15 deletions(-)

diff --git a/tests/jobs/test_local_task_job.py 
b/tests/jobs/test_local_task_job.py
index 2e28332..c18e6e5 100644
--- a/tests/jobs/test_local_task_job.py
+++ b/tests/jobs/test_local_task_job.py
@@ -836,34 +836,25 @@ class TestLocalTaskJob:
 assert retry_callback_called.value == 1
 assert task_terminated_externally.value == 1
 
-def 
test_task_exit_should_update_state_of_finished_dagruns_with_dag_paused(self):
+def 
test_task_exit_should_update_state_of_finished_dagruns_with_dag_paused(self, 
dag_maker):
 """Test that with DAG paused, DagRun state will update when the tasks 
finishes the run"""
-dag = DAG(dag_id='test_dags', start_date=DEFAULT_DATE)
-op1 = PythonOperator(task_id='dummy', dag=dag, owner='airflow', 
python_callable=lambda: True)
+with dag_maker(dag_id='test_dags') as dag:
+op1 = PythonOperator(task_id='dummy', python_callable=lambda: True)
 
 session = settings.Session()
-orm_dag = DagModel(
-dag_id=dag.dag_id,
+dag_maker.make_dagmodel(
 has_task_concurrency_limits=False,
-next_dagrun=dag.start_date,
 next_dagrun_create_after=dag.following_schedule(DEFAULT_DATE),
 is_active=True,
 is_paused=True,
 )
-session.add(orm_dag)
-session.flush()
 # Write Dag to DB
 dagbag = DagBag(dag_folder="/dev/null", include_examples=False, 
read_dags_from_db=False)
 dagbag.bag_dag(dag, root_dag=dag)
 dagbag.sync_to_db()
 
-dr = dag.create_dagrun(
-run_type=DagRunType.SCHEDULED,
-state=State.RUNNING,
-execution_date=DEFAULT_DATE,
-start_date=DEFAULT_DATE,
-session=session,
-)
+dr = dag_maker.create_dagrun(run_type=DagRunType.SCHEDULED)
+
 assert dr.state == State.RUNNING
 ti = TaskInstance(op1, dr.execution_date)
 job1 = LocalTaskJob(task_instance=ti, ignore_ti_state=True, 
executor=SequentialExecutor())

[airflow] branch v2-1-test updated (02d3703 -> e6478fe)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a change to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.


from 02d3703  Add Changelog updates for 2.1.3
 new 970c6a2  Run mini scheduler in LocalTaskJob during task exit (#16289)
 new 95e251a  Add Pytest fixture to create dag and dagrun and use it on 
local task job tests (#16889)
 new 4f2f346  Fix task retries when they receive sigkill and have retries 
and properly handle sigterm (#16301)
 new 8f3cce6  Improve `dag_maker` fixture (#17324)
 new 489f9be  Remove repeated test.
 new e6478fe  Add Changelog updates for 2.1.3 (#17644)

The 6 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 CHANGELOG.txt | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

[airflow] 01/06: Run mini scheduler in LocalTaskJob during task exit (#16289)

This is an automated email from the ASF dual-hosted git repository.

jhtimmins pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 970c6a2af420156c51137772e138d4f6e7313360
Author: Ephraim Anierobi 
AuthorDate: Thu Jun 10 14:29:30 2021 +0100

Run mini scheduler in LocalTaskJob during task exit (#16289)

Currently, the chances of tasks being killed by the LocalTaskJob heartbeat 
is high.

This is because, after marking a task successful/failed in Taskinstance.py 
and mini scheduler is enabled,
we start running the mini scheduler. Whenever the mini scheduling takes 
time and meet the next job heartbeat,
the heartbeat detects that this task has succeeded with no return code 
because LocalTaskJob.handle_task_exit
was not called after the task succeeded. Hence, the heartbeat thinks that 
this task was externally marked failed/successful.

This change resolves this by moving the mini scheduler to LocalTaskJob at 
the handle_task_exit method ensuring
that the task will no longer be killed by the next heartbeat

(cherry picked from commit 408bd26c22913af93d05aa70abc3c66c52cd4588)
---
 tests/jobs/test_local_task_job.py | 12 ++--
 1 file changed, 6 insertions(+), 6 deletions(-)

diff --git a/tests/jobs/test_local_task_job.py 
b/tests/jobs/test_local_task_job.py
index 14c74ce..060bce8 100644
--- a/tests/jobs/test_local_task_job.py
+++ b/tests/jobs/test_local_task_job.py
@@ -842,12 +842,12 @@ class TestLocalTaskJob:
 op1 = PythonOperator(task_id='dummy', python_callable=lambda: True)
 
 session = settings.Session()
-dag_maker.make_dagmodel(
-has_task_concurrency_limits=False,
-next_dagrun_create_after=dag.following_schedule(DEFAULT_DATE),
-is_active=True,
-is_paused=True,
-)
+dagmodel = dag_maker.dag_model
+dagmodel.next_dagrun_create_after = 
dag.following_schedule(DEFAULT_DATE)
+dagmodel.is_paused = True
+session.merge(dagmodel)
+session.flush()
+
 # Write Dag to DB
 dagbag = DagBag(dag_folder="/dev/null", include_examples=False, 
read_dags_from_db=False)
 dagbag.bag_dag(dag, root_dag=dag)

[GitHub] [airflow] gmcrocetti opened a new pull request #17667: [DOCS] Update DAG.is_active property



gmcrocetti opened a new pull request #17667:
URL: https://github.com/apache/airflow/pull/17667


   Description
   ---
   Pretty simple patch updating documentation. Adds `readOnly=True` to 
`DAG.is_active`.
   
   closes: #17639 
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
 for more information.
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md).
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] 02/02: Add Changelog updates for 2.1.3

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 02d370312ea962999c545a40259ed0980856699a
Author: James Timmins 
AuthorDate: Mon Aug 16 18:39:18 2021 -0700

Add Changelog updates for 2.1.3
---
 CHANGELOG.txt | 61 +++
 1 file changed, 61 insertions(+)

diff --git a/CHANGELOG.txt b/CHANGELOG.txt
index 0ff1f3f..ab92577 100644
--- a/CHANGELOG.txt
+++ b/CHANGELOG.txt
@@ -1,3 +1,64 @@
+Airflow 2.1.3, 2021-08-23
+-
+
+Bug Fixes
+"
+
+- Fix task retries when they receive ``sigkill`` and have retries and properly 
handle ``sigterm`` (#16301)
+- Fix redacting secrets in context exceptions. (#17618)
+- Fix race condition with dagrun callbacks (#16741)
+- Add 'queued' to DagRunState (#16854)
+- Add 'queued' state to DagRun (#16401)
+- Fix external elasticsearch logs link (#16357)
+- Add proper warning message when recorded PID is different from current PID 
(#17411)
+- Fix running tasks with ``default_impersonation`` config (#17229)
+- Rescue if a DagRun's DAG was removed from db (#17544)
+- Fixed broken json_client (#17529)
+- Handle and log exceptions raised during task callback (#17347)
+- Fix CLI ``kubernetes cleanup-pods`` which fails on invalid label key (#17298)
+- Show serialization exceptions in DAG parsing log (#17277)
+- Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
+- Adds more explanatory message when ``SecretsMasker`` is not configured 
(#17101)
+- Enable the use of ``__init_subclass__`` in subclasses of ``BaseOperator`` 
(#17027)
+- Fix task instance retrieval in XCom view (#16923)
+- Validate type of ``priority_weight`` during parsing (#16765)
+- Correctly handle custom ``deps` and ``task_group`` during DAG Serialization 
(#16734)
+- Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
+- Fix calculating duration in tree view (#16695)
+- Fix ``AttributeError``: ``datetime.timezone`` object has no attribute 
``name`` (#16599)
+- Redact conn secrets in webserver logs (#16579)
+- Change graph focus to top of view instead of center (#16484)
+- Fail tasks in scheduler when executor reports they failed (#15929)
+- fix(smart_sensor): Unbound variable errors (#14774)
+- Add back missing permissions to ``UserModelView`` controls. (#17431)
+- Better diagnostics and self-healing of docker-compose (#17484)
+- Improve diagnostics message when users have ``secret_key`` mis-configured 
(#17410)
+- Stop checking ``execution_date`` in ``task_instance.refresh_from_db`` 
(#16809)
+
+Improvements
+
+
+- Run mini scheduler in ``LocalTaskJob`` during task exit (#16289)
+- Remove ``SQLAlchemy<1.4`` constraint (#16630)
+- Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
+- Bump ``dnspython`` (#16698)
+- Updates to ``FlaskAppBuilder`` 3.3.2+ (#17208)
+- Add State types for tasks and DAGs (#15285)
+- Set Process title for Worker when using ``LocalExecutor`` (#16623)
+- Move ``DagFileProcessor`` and ``DagFileProcessorProcess`` out of 
``scheduler_job.py`` (#16581)
+
+Doc only changes
+
+
+- Fix inconsistencies in configuration docs (#17317)
+- Fix docs link for using SQLite as Metadata DB (#17308)
+
+Misc
+
+
+- Switch back http provider after requests removes LGPL dependency (#16974)
+
+
 Airflow 2.1.2, 2021-07-13
 -

[airflow] branch v2-1-test updated (dff4950 -> 02d3703)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git.


 discard dff4950  Forces rebuilding the image for cache pushing
 discard f5954bb  Add Changelog updates for 2.1.3
 new 53b3adb  Forces rebuilding the image for cache pushing
 new 02d3703  Add Changelog updates for 2.1.3

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (dff4950)
\
 N -- N -- N   refs/heads/v2-1-test (02d3703)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 CHANGELOG.txt | 38 --
 1 file changed, 28 insertions(+), 10 deletions(-)

[airflow] 01/02: Forces rebuilding the image for cache pushing

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a commit to branch v2-1-test
in repository https://gitbox.apache.org/repos/asf/airflow.git

commit 53b3adba13f9839eb5fb9285fea6383fd40fc4a4
Author: Jarek Potiuk 
AuthorDate: Mon Aug 16 16:07:47 2021 +0200

Forces rebuilding the image for cache pushing

Fixes bug in pushing latest image to cache on "push/schedule".

When the build is successful and passes all tests vi either
`push' or 'schedule' events, we attempt to rebuild the image
with latest constraints just pushed and push it as a fresh
cache for Github Registry. This keeps the time to build image
small without manually refreshing the cache, it also automatically
checks if there is a new "python" base image available so that
we can use it in the new cache.

There was a bug that the image has not been FORCE_PULLED and
rebuilt in this case - just latest images were used.

This had so far no negative effects because due to test
instability, latest main images pretty much never succeeded in
all tests, so the images in `main` were refreshed manually
periodically anyway. However for v2-1-test the scope of tests
run is far smaller now (no Helm tests, no Provider tests)
and they succeed mostly when they should.

Also PROD image was built without ".dev0" suffix which
also failed.

This PR fixes it so that the images are built properly and pushed.

(cherry picked from commit dac71ef45fdbeba585ddb5b4211b31ef8643371f)
---
 .github/workflows/ci.yml | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/.github/workflows/ci.yml b/.github/workflows/ci.yml
index 0d65286..f8bc251 100644
--- a/.github/workflows/ci.yml
+++ b/.github/workflows/ci.yml
@@ -1145,10 +1145,18 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
 env:
   RUNS_ON: ${{ fromJson(needs.build-info.outputs.runsOn) }}
   PYTHON_MAJOR_MINOR_VERSION: ${{ matrix.python-version }}
+  # Rebuild images before push using the latest constraints (just pushed) 
without
+  # eager upgrade. Do not wait for images, but rebuild them, but always 
check if
+  # there is a new Python base image to pull and rebuild. This way, when 
latest python
+  # is not pushed, we will re-use the last cache to start from and when 
there is
+  # a new python image, we will rebuild it from scratch (same as during 
the "build-images.ci")
   GITHUB_REGISTRY_PULL_IMAGE_TAG: "latest"
   GITHUB_REGISTRY_PUSH_IMAGE_TAG: "latest"
   PUSH_PYTHON_BASE_IMAGE: "true"
+  FORCE_PULL_IMAGES: "true"
   CHECK_IF_BASE_PYTHON_IMAGE_UPDATED: "true"
+  GITHUB_REGISTRY_WAIT_FOR_IMAGE: "false"
+  UPGRADE_TO_NEWER_DEPENDENCIES: "false"
 steps:
   - name: "Checkout ${{ github.ref }} ( ${{ github.sha }} )"
 uses: actions/checkout@v2
@@ -1164,6 +1172,8 @@ ${{ hashFiles('.pre-commit-config.yaml') }}"
 run: ./scripts/ci/images/ci_prepare_ci_image_on_ci.sh
   - name: "Prepare PROD image ${{env.PYTHON_MAJOR_MINOR_VERSION}}:latest"
 run: ./scripts/ci/images/ci_prepare_prod_image_on_ci.sh
+env:
+  VERSION_SUFFIX_FOR_PYPI: ".dev0"
   - name: "Push CI image ${{ env.PYTHON_MAJOR_MINOR_VERSION }}:latest"
 run: ./scripts/ci/images/ci_push_ci_images.sh
   - name: "Push PROD images ${{ env.PYTHON_MAJOR_MINOR_VERSION }}:latest"

[GitHub] [airflow] ShakaibKhan commented on pull request #15385: Added table to view providers in airflow ui under admin tab



ShakaibKhan commented on pull request #15385:
URL: https://github.com/apache/airflow/pull/15385#issuecomment-900638820


   Looks like I re-commited all my commits. Although pre-commit and 
statickcheck passed locally


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #17662: Dags volume not getting mounted in webserver pod?



potiuk commented on issue #17662:
URL: https://github.com/apache/airflow/issues/17662#issuecomment-900638058


   See this page - it explains everything 
https://airflow.apache.org/docs/apache-airflow/stable/dag-serialization.html


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #17662: Dags volume not getting mounted in webserver pod?



potiuk commented on issue #17662:
URL: https://github.com/apache/airflow/issues/17662#issuecomment-900637436


   This has been also possible to not mount dags in few last versions of 
airflow if you had serialization turned on  BTW. Simply in Airlfow 2 Dag 
Serialization is the only way.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #17662: Dags volume not getting mounted in webserver pod?



potiuk commented on issue #17662:
URL: https://github.com/apache/airflow/issues/17662#issuecomment-900636540


   This is also done through DB - there is a DB "import errors"  that is 
populated by scheduler (and I believe it's always been like that)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[airflow] branch main updated (c22ed08 -> 808fb2a)

This is an automated email from the ASF dual-hosted git repository.

kaxilnaik pushed a change to branch main
in repository https://gitbox.apache.org/repos/asf/airflow.git.


from c22ed08  Chart: use serviceaccount template for log reader rolebinding 
(#17645)
 add 808fb2a  Add Changelog updates for 2.1.3 (#17644)

No new revisions were added by this update.

Summary of changes:
 CHANGELOG.txt | 60 +++
 1 file changed, 60 insertions(+)

[GitHub] [airflow] kaxil merged pull request #17644: Add Changelog updates for 2.1.3



kaxil merged pull request #17644:
URL: https://github.com/apache/airflow/pull/17644


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil commented on a change in pull request #17644: Add Changelog updates for 2.1.3



kaxil commented on a change in pull request #17644:
URL: https://github.com/apache/airflow/pull/17644#discussion_r690726494



##
File path: CHANGELOG.txt
##
@@ -1,3 +1,62 @@
+Airflow 2.1.3, 2021-08-23
+-
+
+Bug Fixes
+"
+
+- Fix task retries when they receive ``sigkill`` and have retries and properly 
handle ``sigterm`` (#16301)
+- Fix redacting secrets in context exceptions. (#17618)
+- Fix race condition with dagrun callbacks (#16741)
+- Add 'queued' to DagRunState (#16854)
+- Add 'queued' state to DagRun (#16401)
+- Fix external elasticsearch logs link (#16357)
+- Add proper warning message when recorded PID is different from current PID 
(#17411)
+- Fix running tasks with ``default_impersonation`` config (#17229)
+- Rescue if a DagRun's DAG was removed from db (#17544)
+- Fixed broken json_client (#17529)
+- Handle and log exceptions raised during task callback (#17347)
+- Fix CLI ``kubernetes cleanup-pods`` which fails on invalid label key (#17298)
+- Show serialization exceptions in DAG parsing log (#17277)
+- Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
+- Adds more explanatory message when ``SecretsMasker`` is not configured 
(#17101)
+- Enable the use of ``__init_subclass__`` in subclasses of ``BaseOperator`` 
(#17027)
+- Fix task instance retrieval in XCom view (#16923)
+- Validate type of ``priority_weight`` during parsing (#16765)
+- Correctly handle custom ``deps` and ``task_group`` during DAG Serialization 
(#16734)
+- Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
+- Fix calculating duration in tree view (#16695)
+- Fix ``AttributeError``: ``datetime.timezone`` object has no attribute 
``name`` (#16599)
+- Redact conn secrets in webserver logs (#16579)
+- Change graph focus to top of view instead of center (#16484)
+- Fail tasks in scheduler when executor reports they failed (#15929)
+- fix(smart_sensor): Unbound variable errors (#14774)
+- Add back missing permissions to ``UserModelView`` controls. (#17431)
+- Better diagnostics and self-healing of docker-compose (#17484)
+- Improve diagnostics message when users have ``secret_key`` mis-configured 
(#17410)
+- Stop checking ``execution_date`` in ``task_instance.refresh_from_db`` 
(#16809)
+
+Improvements
+
+
+- Run mini scheduler in ``LocalTaskJob`` during task exit (#16289)
+- Remove ``SQLAlchemy<1.4`` constraint (#16630)
+- Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
+- Bump ``dnspython`` (#16698)
+- Updates to ``FlaskAppBuilder`` 3.3.2+ (#17208)
+- Add State types for tasks and DAGs (#15285)
+- Set Process title for Worker when using ``LocalExecutor`` (#16623)
+- Move ``DagFileProcessor`` and ``DagFileProcessorProcess`` out of 
``scheduler_job.py`` (#16581)
+
+Doc only changes
+
+
+- Fix inconsistencies in configuration docs (#17317)
+- Fix docs link for using SQLite as Metadata DB (#17308)
+
+Misc
+
+
+- Switch back http provider after requests removes LGPL dependency (#16974)

Review comment:
   ```suggestion
   - Switch back http provider after requests removes LGPL dependency (#16974)
   
   ```




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kn6405 commented on issue #17662: Dags volume not getting mounted in webserver pod?



kn6405 commented on issue #17662:
URL: https://github.com/apache/airflow/issues/17662#issuecomment-900632611


   > This is correct behaviour. Dags no longer need to be mounted in Webserver 
in Airflow 2. Webserver reads everything it needs from Serialized DAGs table 
and will never read DAGs from the files. This is absolutely expected and 
correct.
   
   With older versions python errors within dags would be displayed on the UI 
and I believe where checked against python modules installed within the 
webserver container. How are these dependencies now checked? What container(s) 
does it look to have all the proper dependencies? 
   
   On my old install 1.x the dags had requirement.txt that was mounted and it 
installed them at startup in most of the containers. 
   
   Just want to make sure I understand the new logic in the 2.x version of 
airflow. Thanks!


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #17662: Dags volume not getting mounted in webserver pod?



potiuk commented on issue #17662:
URL: https://github.com/apache/airflow/issues/17662#issuecomment-900624765


   This is correct behaviour. Dags no longer need to be mounted in Webserver in 
Airflow 2. Webserver reads everything it needs from Serialized DAGs table and 
will never read DAGs from the files. This is absolutely expected and correct.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk closed issue #17662: Dags volume not getting mounted in webserver pod?



potiuk closed issue #17662:
URL: https://github.com/apache/airflow/issues/17662


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil commented on a change in pull request #17644: Add Changelog updates for 2.1.3



kaxil commented on a change in pull request #17644:
URL: https://github.com/apache/airflow/pull/17644#discussion_r690715735



##
File path: CHANGELOG.txt
##
@@ -1,3 +1,45 @@
+Airflow 2.1.3, 2021-08-23
+-
+
+Bug Fixes
+"
+
+- Fix task retries when they receive sigkill and have retries and properly 
handle sigterm (#16301)
+- Fix redacting secrets in context exceptions. (#17618)
+- Fix race condition with dagrun callbacks (#16741)
+- Add 'queued' to DagRunState (#16854)
+- Add 'queued' state to DagRun (#16401)
+- Fix external elasticsearch logs link (#16357)
+- Add proper warning message when recorded PID is different from current PID 
(#17411)
+- Fix running tasks with default_impersonation config (#17229)
+- Rescue if a DagRun's DAG was removed from db (#17544)
+- Fixed broken json_client (#17529)
+- Handle and log exceptions raised during task callback (#17347)
+- Fix CLI 'kubernetes cleanup-pods' which fails on invalid label key (#17298)
+- Show serialization exceptions in DAG parsing log (#17277)
+- Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
+- Enable the use of __init_subclass__ in subclasses of BaseOperator (#17027)
+- Fix task instance retrieval in XCom view (#16923)
+- Validate type of `priority_weight` during parsing (#16765)
+- Correctly handle custom `deps` and `task_group` during DAG Serialization 
(#16734)
+- Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
+- Fix calculating duration in tree view (#16695)
+- Fix ``AttributeError``: ``datetime.timezone`` object has no attribute 
``name`` (#16599)
+- Redact conn secrets in webserver logs (#16579)
+- Change graph focus to top of view instead of center (#16484)
+- Fail tasks in scheduler when executor reports they failed (#15929)
+- fix(smart_sensor): Unbound variable errors (#14774)
+- Add back missing permissions to UserModelView controls. (#17431)
+- Run mini scheduler in LocalTaskJob during task exit (#16289)
+
+Misc
+
+
+- Adds more explanatory message when SecretsMasker is not configured (#17101)
+- Better diagnostics and self-healing of docker-compose (#17484)
+- Improve diagnostics message when users have secret_key misconfigured (#17410)
+
+

Review comment:
   Some of the commits were missing and I added some formatting and 
improved commit messages to make them more readable





-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil commented on a change in pull request #17644: Add Changelog updates for 2.1.3



kaxil commented on a change in pull request #17644:
URL: https://github.com/apache/airflow/pull/17644#discussion_r690715735



##
File path: CHANGELOG.txt
##
@@ -1,3 +1,45 @@
+Airflow 2.1.3, 2021-08-23
+-
+
+Bug Fixes
+"
+
+- Fix task retries when they receive sigkill and have retries and properly 
handle sigterm (#16301)
+- Fix redacting secrets in context exceptions. (#17618)
+- Fix race condition with dagrun callbacks (#16741)
+- Add 'queued' to DagRunState (#16854)
+- Add 'queued' state to DagRun (#16401)
+- Fix external elasticsearch logs link (#16357)
+- Add proper warning message when recorded PID is different from current PID 
(#17411)
+- Fix running tasks with default_impersonation config (#17229)
+- Rescue if a DagRun's DAG was removed from db (#17544)
+- Fixed broken json_client (#17529)
+- Handle and log exceptions raised during task callback (#17347)
+- Fix CLI 'kubernetes cleanup-pods' which fails on invalid label key (#17298)
+- Show serialization exceptions in DAG parsing log (#17277)
+- Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
+- Enable the use of __init_subclass__ in subclasses of BaseOperator (#17027)
+- Fix task instance retrieval in XCom view (#16923)
+- Validate type of `priority_weight` during parsing (#16765)
+- Correctly handle custom `deps` and `task_group` during DAG Serialization 
(#16734)
+- Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
+- Fix calculating duration in tree view (#16695)
+- Fix ``AttributeError``: ``datetime.timezone`` object has no attribute 
``name`` (#16599)
+- Redact conn secrets in webserver logs (#16579)
+- Change graph focus to top of view instead of center (#16484)
+- Fail tasks in scheduler when executor reports they failed (#15929)
+- fix(smart_sensor): Unbound variable errors (#14774)
+- Add back missing permissions to UserModelView controls. (#17431)
+- Run mini scheduler in LocalTaskJob during task exit (#16289)
+
+Misc
+
+
+- Adds more explanatory message when SecretsMasker is not configured (#17101)
+- Better diagnostics and self-healing of docker-compose (#17484)
+- Improve diagnostics message when users have secret_key misconfigured (#17410)
+
+

Review comment:
   Some of the commits were missing
   




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kaxil commented on a change in pull request #17644: Add Changelog updates for 2.1.3



kaxil commented on a change in pull request #17644:
URL: https://github.com/apache/airflow/pull/17644#discussion_r690715522



##
File path: CHANGELOG.txt
##
@@ -1,3 +1,45 @@
+Airflow 2.1.3, 2021-08-23
+-
+
+Bug Fixes
+"
+
+- Fix task retries when they receive sigkill and have retries and properly 
handle sigterm (#16301)
+- Fix redacting secrets in context exceptions. (#17618)
+- Fix race condition with dagrun callbacks (#16741)
+- Add 'queued' to DagRunState (#16854)
+- Add 'queued' state to DagRun (#16401)
+- Fix external elasticsearch logs link (#16357)
+- Add proper warning message when recorded PID is different from current PID 
(#17411)
+- Fix running tasks with default_impersonation config (#17229)
+- Rescue if a DagRun's DAG was removed from db (#17544)
+- Fixed broken json_client (#17529)
+- Handle and log exceptions raised during task callback (#17347)
+- Fix CLI 'kubernetes cleanup-pods' which fails on invalid label key (#17298)
+- Show serialization exceptions in DAG parsing log (#17277)
+- Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
+- Enable the use of __init_subclass__ in subclasses of BaseOperator (#17027)
+- Fix task instance retrieval in XCom view (#16923)
+- Validate type of `priority_weight` during parsing (#16765)
+- Correctly handle custom `deps` and `task_group` during DAG Serialization 
(#16734)
+- Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
+- Fix calculating duration in tree view (#16695)
+- Fix ``AttributeError``: ``datetime.timezone`` object has no attribute 
``name`` (#16599)
+- Redact conn secrets in webserver logs (#16579)
+- Change graph focus to top of view instead of center (#16484)
+- Fail tasks in scheduler when executor reports they failed (#15929)
+- fix(smart_sensor): Unbound variable errors (#14774)
+- Add back missing permissions to UserModelView controls. (#17431)
+- Run mini scheduler in LocalTaskJob during task exit (#16289)
+
+Misc
+
+
+- Adds more explanatory message when SecretsMasker is not configured (#17101)
+- Better diagnostics and self-healing of docker-compose (#17484)
+- Improve diagnostics message when users have secret_key misconfigured (#17410)
+
+

Review comment:
   ```suggestion
   Airflow 2.1.3, 2021-08-23
   -
   
   Bug Fixes
   "
   
   - Fix task retries when they receive ``sigkill`` and have retries and 
properly handle ``sigterm`` (#16301)
   - Fix redacting secrets in context exceptions. (#17618)
   - Fix race condition with dagrun callbacks (#16741)
   - Add 'queued' to DagRunState (#16854)
   - Add 'queued' state to DagRun (#16401)
   - Fix external elasticsearch logs link (#16357)
   - Add proper warning message when recorded PID is different from current PID 
(#17411)
   - Fix running tasks with ``default_impersonation`` config (#17229)
   - Rescue if a DagRun's DAG was removed from db (#17544)
   - Fixed broken json_client (#17529)
   - Handle and log exceptions raised during task callback (#17347)
   - Fix CLI ``kubernetes cleanup-pods`` which fails on invalid label key 
(#17298)
   - Show serialization exceptions in DAG parsing log (#17277)
   - Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
   - Adds more explanatory message when ``SecretsMasker`` is not configured 
(#17101)
   - Enable the use of ``__init_subclass__`` in subclasses of ``BaseOperator`` 
(#17027)
   - Fix task instance retrieval in XCom view (#16923)
   - Validate type of ``priority_weight`` during parsing (#16765)
   - Correctly handle custom ``deps` and ``task_group`` during DAG 
Serialization (#16734)
   - Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
   - Fix calculating duration in tree view (#16695)
   - Fix ``AttributeError``: ``datetime.timezone`` object has no attribute 
``name`` (#16599)
   - Redact conn secrets in webserver logs (#16579)
   - Change graph focus to top of view instead of center (#16484)
   - Fail tasks in scheduler when executor reports they failed (#15929)
   - fix(smart_sensor): Unbound variable errors (#14774)
   - Add back missing permissions to ``UserModelView`` controls. (#17431)
   - Better diagnostics and self-healing of docker-compose (#17484)
   - Improve diagnostics message when users have ``secret_key`` mis-configured 
(#17410)
   - Stop checking ``execution_date`` in ``task_instance.refresh_from_db`` 
(#16809)
   
   Improvements
   
   
   - Run mini scheduler in ``LocalTaskJob`` during task exit (#16289)
   - Remove ``SQLAlchemy<1.4`` constraint (#16630)
   - Bump Jinja2 upper-bound from 2.12.0 to 4.0.0 (#16595)
   - Bump ``dnspython`` (#16698)
   - Updates to ``FlaskAppBuilder`` 3.3.2+ (#17208)
   - Add State types for tasks and DAGs (#15285)
   - Set Process title for Worker when using ``LocalExecutor`` (#16623)
   - Move ``DagFileProcessor`` and ``DagFileProcessorProcess`` out

[GitHub] [airflow] github-actions[bot] commented on pull request #17644: Add Changelog updates for 2.1.3



github-actions[bot] commented on pull request #17644:
URL: https://github.com/apache/airflow/pull/17644#issuecomment-900620977


   The PR is likely ready to be merged. No tests are needed as no important 
environment files, nor python files were modified by it. However, committers 
might decide that full test matrix is needed and add the 'full tests needed' 
label. Then you should rebase it to the latest main or amend the last commit of 
the PR, and push it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] Diogo-Costa opened a new pull request #17666: [Chart] Add option to set loadBalancerSourceRanges in webserver service



Diogo-Costa opened a new pull request #17666:
URL: https://github.com/apache/airflow/pull/17666


   Description
   It is not possible to create the service type "LoadBalancer" with option 
loadBalancerSourceRanges
   
   Use case / motivation
   When created webserver service with type "LoadBalancer" this value is 
"0.0.0.0/0" per default, In order to limit which client IP's can access the 
Load Balancer, we can specify loadBalancerSourceRanges.
   
   related: #17660
   ---
   **^ Add meaningful description above**
   
   Read the **[Pull Request 
Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**
 for more information.
   In case of fundamental code change, Airflow Improvement Proposal 
([AIP](https://cwiki.apache.org/confluence/display/AIRFLOW/Airflow+Improvements+Proposals))
 is needed.
   In case of a new dependency, check compliance with the [ASF 3rd Party 
License Policy](https://www.apache.org/legal/resolved.html#category-x).
   In case of backwards incompatible changes please leave a note in 
[UPDATING.md](https://github.com/apache/airflow/blob/main/UPDATING.md).
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on pull request #17666: [Chart] Add option to set loadBalancerSourceRanges in webserver service

boring-cyborg[bot] commented on pull request #17666:
URL: https://github.com/apache/airflow/pull/17666#issuecomment-900620417

--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #17665: Documentation "how to sync your fork" is wrong, should be updated.



potiuk commented on issue #17665:
URL: https://github.com/apache/airflow/issues/17665#issuecomment-900620074


   BTW. The reason is because the "fetch upstream" was added couple of months 
ago and we removed the old worklow (but not the docs).


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] github-actions[bot] commented on pull request #17650: Renames main workflow to `Tests`



github-actions[bot] commented on pull request #17650:
URL: https://github.com/apache/airflow/pull/17650#issuecomment-900619685


   The PR most likely needs to run full matrix of tests because it modifies 
parts of the core of Airflow. However, committers might decide to merge it 
quickly and take the risk. If they don't merge it quickly - please rebase it to 
the latest main at your convenience, or amend the last commit of the PR, and 
push it with --force-with-lease.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk edited a comment on issue #17665: Documentation "how to sync your fork" is wrong, should be updated.



potiuk edited a comment on issue #17665:
URL: https://github.com/apache/airflow/issues/17665#issuecomment-900619384


   Happy if you submit PR. I think when you submit PR there will be some people 
who will help you with wording! Shall I assign you the issue?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #17665: Documentation "how to sync your fork" is wrong, should be updated.



potiuk commented on issue #17665:
URL: https://github.com/apache/airflow/issues/17665#issuecomment-900619384


   Happy if you submit PR. I think when you submit PR there will be some people 
who will help you with wording! Shall I assign you the PR?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17665: Documentation "how to sync your fork" is wrong, should be updated.



boring-cyborg[bot] commented on issue #17665:
URL: https://github.com/apache/airflow/issues/17665#issuecomment-900613110


   Thanks for opening your first issue here! Be sure to follow the issue 
template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] artik00 opened a new issue #17665: Documentation "how to sync your fork" is wrong, should be updated.



artik00 opened a new issue #17665:
URL: https://github.com/apache/airflow/issues/17665


   **Description**
   From documentation , "CONTRIBUTING.rst" : 
_There is also an easy way using ``Force sync main from apache/airflow`` 
workflow. You can go to "Actions" in your repository and choose the workflow 
and manually trigger the workflow using "Run workflow" command._
   This doesn't work in the current GitHub UI, there is no such option.
   
   **Use case / motivation**
   Should be changed to reflect current github options, selecting ""Fetch 
upstream" -> "Fetch and merge X upstream commits from apache:main" 
   
   **Are you willing to submit a PR?**
   I will need help with wording
   
   **Related Issues**
   No.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] jhtimmins commented on a change in pull request #17644: Add Changelog updates for 2.1.3



jhtimmins commented on a change in pull request #17644:
URL: https://github.com/apache/airflow/pull/17644#discussion_r690688057



##
File path: CHANGELOG.txt
##
@@ -1,3 +1,46 @@
+Airflow 2.1.3, 2021-08-23
+-
+
+Bug Fixes
+"
+
+- Fix task retries when they receive sigkill and have retries and properly 
handle sigterm (#16301)
+- Fix redacting secrets in context exceptions. (#17618)
+- Fix race condition with dagrun callbacks (#16741)
+- Add 'queued' to DagRunState (#16854)
+- Add 'queued' state to DagRun (#16401)
+- Fix external elasticsearch logs link (#16357)
+- Add proper warning message when recorded PID is different from current PID 
(#17411)
+- Fix running tasks with default_impersonation config (#17229)
+- Rescue if a DagRun's DAG was removed from db (#17544)
+- Fixed broken json_client (#17529)
+- Handle and log exceptions raised during task callback (#17347)
+- Fix CLI 'kubernetes cleanup-pods' which fails on invalid label key (#17298)
+- Show serialization exceptions in DAG parsing log (#17277)
+- Fix: ``TaskInstance`` does not show ``queued_by_job_id`` & 
``external_executor_id`` (#17179)
+- Adds more explanatory message when SecretsMasker is not configured (#17101)
+- Enable the use of __init_subclass__ in subclasses of BaseOperator (#17027)
+- Fix task instance retrieval in XCom view (#16923)
+- Validate type of `priority_weight` during parsing (#16765)
+- Correctly handle custom `deps` and `task_group` during DAG Serialization 
(#16734)
+- Fix slow (cleared) tasks being be adopted by Celery worker. (#16718)
+- Fix calculating duration in tree view (#16695)
+- Fix ``AttributeError``: ``datetime.timezone`` object has no attribute 
``name`` (#16599)
+- Redact conn secrets in webserver logs (#16579)
+- Change graph focus to top of view instead of center (#16484)
+- Fail tasks in scheduler when executor reports they failed (#15929)
+- fix(smart_sensor): Unbound variable errors (#14774)
+- Add back missing permissions to UserModelView controls. (#17431)
+- Better diagnostics and self-healing of docker-compose (#17484)
+- Improve diagnostics message when users have secret_key misconfigured (#17410)
+- Add SSH_PORT variable

Review comment:
   Thanks @mik-laj @potiuk, mind taking a look at my edits?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] potiuk commented on a change in pull request #17650: Renames main workflow to `Tests`



potiuk commented on a change in pull request #17650:
URL: https://github.com/apache/airflow/pull/17650#discussion_r690687207



##
File path: BREEZE.rst
##
@@ -664,7 +664,7 @@ This install additional pypi dependency - torchio in 
specified version.
  ./breeze build-image --production-image --additional-dev-apt-deps 
"libasound2-dev" \
 --additional-runtime-apt-deps "libasound2"
 
-This install additional apt dependencies - ``libasound2-dev`` in build image 
and ``libasound`` in the
+This install additional apt dependencies - ``libasound2-dev`` in built image 
and ``libasound`` in the

Review comment:
   dunno :). But you likely now better as native speker :)




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] ephraimbuddy closed pull request #17581: Remove the use of multiprocessing in TestLocalTaskJob and Improve Tests



ephraimbuddy closed pull request #17581:
URL: https://github.com/apache/airflow/pull/17581


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] kn6405 opened a new issue #17662: Dags volume not getting mounted in webserver pod?



kn6405 opened a new issue #17662:
URL: https://github.com/apache/airflow/issues/17662


   When I deploy via the helm chart the dags volume gets mounted in worker 
pods, schedular, etc... but does not get mounted in the webserver pod. Noticed 
the yaml is coded differently than for workers or the schedular (vs. others) 
and references version numbers older than 2.0.0. So running 2.1.2 the dag never 
gets mounted. 
   
   
https://github.com/apache/airflow/blob/c22ed08ec4d8a9def1f09e74d51eafee83f87e8c/chart/templates/webserver/webserver-deployment.yaml#L147


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #17661: Support git sync from multiple repositories