[GitHub] [airflow] ephraimbuddy merged pull request #23667: Fix mapped task immutability after clear

2022-06-18 Thread GitBox
ephraimbuddy merged PR #23667: URL: https://github.com/apache/airflow/pull/23667 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

[GitHub] [airflow] ephraimbuddy closed issue #23550: Dynamic Task Mapping is Immutable within a Run

2022-06-18 Thread GitBox
ephraimbuddy closed issue #23550: Dynamic Task Mapping is Immutable within a Run URL: https://github.com/apache/airflow/issues/23550 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

[airflow] branch main updated: Fix mapped task immutability after clear (#23667)

2022-06-18 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new b692517ce3 Fix mapped task immutability af

[GitHub] [airflow] mik-laj commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
mik-laj commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900742043 ## airflow/utils/jwt_signer.py: ## @@ -0,0 +1,82 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the N

[GitHub] [airflow] potiuk commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900780330 ## airflow/utils/jwt_signer.py: ## @@ -0,0 +1,82 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agreements. See the NO

[GitHub] [airflow] potiuk commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900780424 ## airflow/utils/serve_logs.py: ## @@ -16,55 +16,86 @@ # under the License. """Serve logs process""" +import logging import os -import time import gunicorn.app.

[GitHub] [airflow] potiuk commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900782570 ## airflow/utils/serve_logs.py: ## @@ -16,55 +16,86 @@ # under the License. """Serve logs process""" +import logging import os -import time import gunicorn.app.

[GitHub] [airflow] potiuk commented on pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on PR #24519: URL: https://github.com/apache/airflow/pull/24519#issuecomment-1159413355 All fixed @mik-laj -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

[GitHub] [airflow] potiuk commented on pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on PR #24519: URL: https://github.com/apache/airflow/pull/24519#issuecomment-1159414691 I also added `algorithm` constructor argument, as we will likely use different algorithm (symmetric RS) in the future for Internal API -- This is an automated message from the Apache G

[GitHub] [airflow] mik-laj commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
mik-laj commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900790476 ## airflow/utils/serve_logs.py: ## @@ -16,55 +16,87 @@ # under the License. """Serve logs process""" +import logging import os -import time import gunicorn.app

[GitHub] [airflow] potiuk commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900793627 ## airflow/utils/serve_logs.py: ## @@ -16,55 +16,87 @@ # under the License. """Serve logs process""" +import logging import os -import time import gunicorn.app.

[GitHub] [airflow] potiuk commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900793627 ## airflow/utils/serve_logs.py: ## @@ -16,55 +16,87 @@ # under the License. """Serve logs process""" +import logging import os -import time import gunicorn.app.

[GitHub] [airflow] potiuk commented on a diff in pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on code in PR #24519: URL: https://github.com/apache/airflow/pull/24519#discussion_r900796932 ## airflow/utils/serve_logs.py: ## @@ -16,55 +16,87 @@ # under the License. """Serve logs process""" +import logging import os -import time import gunicorn.app.

[GitHub] [airflow] potiuk commented on pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on PR #24519: URL: https://github.com/apache/airflow/pull/24519#issuecomment-1159438626 Right. Fixed and reviewed all. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[GitHub] [airflow] potiuk commented on pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on PR #24519: URL: https://github.com/apache/airflow/pull/24519#issuecomment-1159439234 BTW. Interesting dicussion here https://bugs.python.org/issue46200 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and us

[GitHub] [airflow] luiztauffer opened a new issue, #24537: Create DAG with Airflow REST API

2022-06-18 Thread GitBox
luiztauffer opened a new issue, #24537: URL: https://github.com/apache/airflow/issues/24537 ### Description Given that all DAGs are serialized in the database ([reference](https://airflow.apache.org/docs/apache-airflow/stable/dag-serialization.html)), it feels like a POST request in

[GitHub] [airflow] boring-cyborg[bot] commented on issue #24537: Create DAG with Airflow REST API

2022-06-18 Thread GitBox
boring-cyborg[bot] commented on issue #24537: URL: https://github.com/apache/airflow/issues/24537#issuecomment-1159441907 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] vinicvaz commented on issue #24537: Create DAG with Airflow REST API

2022-06-18 Thread GitBox
vinicvaz commented on issue #24537: URL: https://github.com/apache/airflow/issues/24537#issuecomment-1159444583 following -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r900855610 ## docs/apache-airflow/security/secrets/secrets-backend/index.rst: ## @@ -101,8 +143,8 @@ Roll your own secrets backend A secrets backend is a subclass of :py:clas

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r900877600 ## airflow/configuration.py: ## @@ -1487,47 +1500,118 @@ def set(*args, **kwargs) -> None: conf.set(*args, **kwargs) -def ensure_secrets_loaded() -> List[Ba

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r900879673 ## airflow/configuration.py: ## @@ -1487,47 +1500,118 @@ def set(*args, **kwargs) -> None: conf.set(*args, **kwargs) -def ensure_secrets_loaded() -> List[Ba

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r900879673 ## airflow/configuration.py: ## @@ -1487,47 +1500,118 @@ def set(*args, **kwargs) -> None: conf.set(*args, **kwargs) -def ensure_secrets_loaded() -> List[Ba

[GitHub] [airflow] potiuk commented on issue #24537: Create DAG with Airflow REST API

2022-06-18 Thread GitBox
potiuk commented on issue #24537: URL: https://github.com/apache/airflow/issues/24537#issuecomment-1159462106 The serialization only stores dag structure and configuration not python code. So basic assumption here does not hold unfortunately because what your serialization idea is, it is di

[GitHub] [airflow] boring-cyborg[bot] commented on issue #24538: Airflow Scheduler continuously restarts when using the CeleryKubernetesExecutor

2022-06-18 Thread GitBox
boring-cyborg[bot] commented on issue #24538: URL: https://github.com/apache/airflow/issues/24538#issuecomment-1159464141 Thanks for opening your first issue here! Be sure to follow the issue template! -- This is an automated message from the Apache Git Service. To respond to the mess

[GitHub] [airflow] meetri opened a new issue, #24538: Airflow Scheduler continuously restarts when using the CeleryKubernetesExecutor

2022-06-18 Thread GitBox
meetri opened a new issue, #24538: URL: https://github.com/apache/airflow/issues/24538 ### Apache Airflow version 2.3.2 (latest released) ### What happened The scheduler crashes with the following exception. Once the scheduler crashes restarts will cause it to immediatel

[GitHub] [airflow] potiuk closed issue #24537: Create DAG with Airflow REST API

2022-06-18 Thread GitBox
potiuk closed issue #24537: Create DAG with Airflow REST API URL: https://github.com/apache/airflow/issues/24537 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

[GitHub] [airflow] meetri commented on issue #24538: Airflow Scheduler continuously restarts when using the CeleryKubernetesExecutor

2022-06-18 Thread GitBox
meetri commented on issue #24538: URL: https://github.com/apache/airflow/issues/24538#issuecomment-1159467742 Not sure how to or if it's worth making a pull request for this, but here is the change I made to get airflow scheduler back working. ``` diff --git a/airflow/callbacks/callbac

[GitHub] [airflow] chenglongyan opened a new pull request, #24540: Migrate Google example DAG mysql_to_gcs to new design AIP-47

2022-06-18 Thread GitBox
chenglongyan opened a new pull request, #24540: URL: https://github.com/apache/airflow/pull/24540 related: #22447, #22430 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request

[GitHub] [airflow] chenglongyan opened a new pull request, #24541: Migrate Google example DAG mssql_to_gcs to new design AIP-47

2022-06-18 Thread GitBox
chenglongyan opened a new pull request, #24541: URL: https://github.com/apache/airflow/pull/24541 related: #22447, #22430 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request

[GitHub] [airflow] dstandish commented on pull request #24496: Add `db+` prefix if missing for celery result backend

2022-06-18 Thread GitBox
dstandish commented on PR #24496: URL: https://github.com/apache/airflow/pull/24496#issuecomment-1159524107 i see re https://github.com/apache/airflow/blob/main/chart/templates/secrets/result-backend-connection-secret.yaml#L21 we create the secret when none referenced in your config. good

[GitHub] [airflow] dstandish commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
dstandish commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r901001809 ## docs/apache-airflow/security/secrets/secrets-backend/index.rst: ## @@ -101,8 +143,8 @@ Roll your own secrets backend A secrets backend is a subclass of :py:clas

[GitHub] [airflow] chenglongyan opened a new pull request, #24542: Migrate Google example DAG oracle_to_gcs to new design AIP-47

2022-06-18 Thread GitBox
chenglongyan opened a new pull request, #24542: URL: https://github.com/apache/airflow/pull/24542 related: #22447, #22430 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r901002985 ## docs/apache-airflow/security/secrets/secrets-backend/index.rst: ## @@ -101,8 +143,8 @@ Roll your own secrets backend A secrets backend is a subclass of :py:clas

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r901003363 ## docs/apache-airflow/security/secrets/secrets-backend/index.rst: ## @@ -101,8 +143,8 @@ Roll your own secrets backend A secrets backend is a subclass of :py:clas

[GitHub] [airflow] chenglongyan opened a new pull request, #24543: Migrate Google example DAG bigquery_transfer to new design AIP-47

2022-06-18 Thread GitBox
chenglongyan opened a new pull request, #24543: URL: https://github.com/apache/airflow/pull/24543 related: #22447, #22430 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request

[GitHub] [airflow] Aakcht commented on pull request #24496: Add `db+` prefix if missing for celery result backend

2022-06-18 Thread GitBox
Aakcht commented on PR #24496: URL: https://github.com/apache/airflow/pull/24496#issuecomment-1159536912 Sure, I'll try implementing the change so sql_alchemy_conn is used when result_backend is not set. Looks like I'll have to change default value of result_backend to None (currently it is

[GitHub] [airflow] potiuk merged pull request #24536: Move LOAD_DEFAULT_CONNECTIONS env var to database config section in CI

2022-06-18 Thread GitBox
potiuk merged PR #24536: URL: https://github.com/apache/airflow/pull/24536 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated (b692517ce3 -> fe105f8887)

2022-06-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git from b692517ce3 Fix mapped task immutability after clear (#23667) add fe105f8887 Move LOAD_DEFAULT_CONNECTIONS env var

[GitHub] [airflow] potiuk commented on issue #22397: Upgrade to FlaskAppBuilder 4.0.*

2022-06-18 Thread GitBox
potiuk commented on issue #22397: URL: https://github.com/apache/airflow/issues/22397#issuecomment-1159547353 Good news. Static checka are all fixed and now I got to **real** tests to fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log o

[GitHub] [airflow] potiuk commented on pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk commented on PR #24519: URL: https://github.com/apache/airflow/pull/24519#issuecomment-1159553963 All should be cool @mik-laj :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

[airflow] branch constraints-main updated: Updating constraints. Build id:2521526509

2022-06-18 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 7531b0da71 Updating con

[GitHub] [airflow] enzoIto commented on issue #24286: Removed DAG Reporting import_errors to Datadog

2022-06-18 Thread GitBox
enzoIto commented on issue #24286: URL: https://github.com/apache/airflow/issues/24286#issuecomment-1159561800 Oook, I would like to work on this then -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to g

[GitHub] [airflow] github-actions[bot] commented on pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
github-actions[bot] commented on PR #24519: URL: https://github.com/apache/airflow/pull/24519#issuecomment-1159563508 The PR most likely needs to run full matrix of tests because it modifies parts of the core of Airflow. However, committers might decide to merge it quickly and take the risk

[GitHub] [airflow] potiuk merged pull request #24519: Get rid of TimedJSONWebSignatureSerializer

2022-06-18 Thread GitBox
potiuk merged PR #24519: URL: https://github.com/apache/airflow/pull/24519 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[airflow] branch main updated: Get rid of TimedJSONWebSignatureSerializer (#24519)

2022-06-18 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 1f8e4c9553 Get rid of TimedJSONWebSignatureSerializ

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r901024555 ## docs/apache-airflow/security/secrets/secrets-backend/index.rst: ## @@ -101,8 +143,8 @@ Roll your own secrets backend A secrets backend is a subclass of :py:clas

[GitHub] [airflow] dstandish commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
dstandish commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r901027524 ## docs/apache-airflow/security/secrets/secrets-backend/index.rst: ## @@ -101,8 +143,8 @@ Roll your own secrets backend A secrets backend is a subclass of :py:clas

[GitHub] [airflow] allenhaozi commented on issue #18041: Tasks intermittently gets terminated with SIGTERM on kubernetes executor

2022-06-18 Thread GitBox
allenhaozi commented on issue #18041: URL: https://github.com/apache/airflow/issues/18041#issuecomment-1159584124 I have the same problem I'm using airflow 2.2.5, SparkKubernetesOperator and SparkKubernetesSensor Driver is running But the sensor displays the following logs until the

[GitHub] [airflow] Taragolis commented on a diff in pull request #23560: Add advanced secrets backend configurations

2022-06-18 Thread GitBox
Taragolis commented on code in PR #23560: URL: https://github.com/apache/airflow/pull/23560#discussion_r901030614 ## docs/apache-airflow/security/secrets/secrets-backend/index.rst: ## @@ -101,8 +143,8 @@ Roll your own secrets backend A secrets backend is a subclass of :py:clas