[I] Issue with Airflow Webserver when Configured with External DB (Airflow's webserver fails to start, `signal: 15`) [airflow]

2023-11-02 Thread via GitHub
ylnsnv opened a new issue, #35364: URL: https://github.com/apache/airflow/issues/35364 ### Official Helm Chart version 1.11.0 (latest released) ### Apache Airflow version airflowVersion: 2.7.1 ### Kubernetes Version minikube version: v1.31.1 ### Helm

Re: [I] Celery Executor is not working with redis-py 5.0.0 [airflow]

2023-11-02 Thread via GitHub
rdjouder commented on issue #33744: URL: https://github.com/apache/airflow/issues/33744#issuecomment-1790190903 Thanks a lot for you answer. I did check with a small py script calling symbol_by_name from kombu with same argument and it worked. But the whole stack (Airflow 2.7.2) went

Re: [I] After installing using HELM in EKS, PostgreSQL consistently crashes LoopBackOff [airflow]

2023-11-02 Thread via GitHub
kaneenak commented on issue #35363: URL: https://github.com/apache/airflow/issues/35363#issuecomment-1790193999 I hope you can help me solve this problem -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to

Re: [I] Celery Executor is not working with redis-py 5.0.0 [airflow]

2023-11-02 Thread via GitHub
potiuk commented on issue #33744: URL: https://github.com/apache/airflow/issues/33744#issuecomment-1790216854 > Thanks a lot for you answer. I did check with a small py script calling symbol_by_name from kombu with same argument and it worked. But the whole stack (Airflow 2.7.2) went OK onl

Re: [PR] Add pagination to `HttpOperator` and make it more modular [airflow]

2023-11-02 Thread via GitHub
potiuk commented on code in PR #34669: URL: https://github.com/apache/airflow/pull/34669#discussion_r1379705858 ## airflow/providers/discord/operators/discord_webhook.py: ## @@ -77,11 +77,10 @@ def __init__( self.avatar_url = avatar_url self.tts = tts

Re: [PR] Add pagination to `HttpOperator` and make it more modular [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #34669: URL: https://github.com/apache/airflow/pull/34669#issuecomment-1790234005 (and yes - removed the milestone- this is "provider only" change and will go in the next provider release as part of HTTP provider as @eladkal mentioned - no need to wait for 2.8.0 (and

Re: [PR] Add pagination to `HttpOperator` and make it more modular [airflow]

2023-11-02 Thread via GitHub
potiuk commented on code in PR #34669: URL: https://github.com/apache/airflow/pull/34669#discussion_r1379713447 ## airflow/operators/__init__.py: ## @@ -90,6 +90,7 @@ "HiveToSambaOperator": "airflow.providers.apache.hive.transfers.hive_to_samba.HiveToSambaOperator",

Re: [PR] Add pagination to `HttpOperator` and make it more modular [airflow]

2023-11-02 Thread via GitHub
potiuk commented on code in PR #34669: URL: https://github.com/apache/airflow/pull/34669#discussion_r1379713447 ## airflow/operators/__init__.py: ## @@ -90,6 +90,7 @@ "HiveToSambaOperator": "airflow.providers.apache.hive.transfers.hive_to_samba.HiveToSambaOperator",

Re: [PR] Fixes typing in `get_provider_name_from_short_hand` and its uses [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #34507: URL: https://github.com/apache/airflow/pull/34507#issuecomment-1790242653 I think there are some errors (see the build failing) also rather than changing method name, I think you should change argument name (short_package_name)? -> the way the method is named

Re: [I] Airflow scheduler stopped working [airflow]

2023-11-02 Thread via GitHub
pspeter commented on issue #35272: URL: https://github.com/apache/airflow/issues/35272#issuecomment-1790297168 We've also run into this problem. It only affects DAGs which have a start_time with a timezone, which have not gotten a new dag_run since the weekend. Our scheduler logs also look

Re: [PR] Add tests to `airflow/auth/managers/fab/decorators/auth.py` [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #35358: URL: https://github.com/apache/airflow/pull/35358#issuecomment-1790298521 I think first case where you need to mark a test with DB marker :). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and

[PR] Remove unused `can_read_dags` function from `api_connexion/security.py` [airflow]

2023-11-02 Thread via GitHub
ephraimbuddy opened a new pull request, #35365: URL: https://github.com/apache/airflow/pull/35365 This function is not used and was introduced in commit #33ec72948f74f56f2adb5e2d388e60e88e8a3fa3. Opening this PR to discuss it cc @hussein-awala -- This is an automated message from

Re: [PR] Add a method to find end date for previous success TI [airflow]

2023-11-02 Thread via GitHub
Bowrna commented on PR #34528: URL: https://github.com/apache/airflow/pull/34528#issuecomment-1790338948 Please review this PR and let me know if I have to add anything to this. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

Re: [I] Airflow Scheduler with Kubernetes Executor has errors in logs and stuck slots with no running tasks [airflow]

2023-11-02 Thread via GitHub
crabio commented on issue #35354: URL: https://github.com/apache/airflow/issues/35354#issuecomment-1790365264 Also we figured out that some time tasks failed without any reason and without retries. ```log [2023-11-02T03:13:05.686+] {taskinstance.py:1441} WARN

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
raphaelauv commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1790372305 this is the run in the main branch of my fork -> https://github.com/raphaelauv/airflow/actions/runs/6727169212 -- This is an automated message from the Apache Git Service. To respo

[PR] `synchronize_log_template`: limit query result on DB rather than client [airflow]

2023-11-02 Thread via GitHub
Taragolis opened a new pull request, #35366: URL: https://github.com/apache/airflow/pull/35366 In two queries in this function we take only need the first record, however database might return more than one record. ```console 2023-11-02 13:30:24,586 INFO sqlalchemy.

Re: [I] Airflow scheduler stopped working [airflow]

2023-11-02 Thread via GitHub
stijndehaes commented on issue #35272: URL: https://github.com/apache/airflow/issues/35272#issuecomment-1790381710 I have created a drawing of what the current state is. The schedule for this DAG is a bit complex: `0,15,30,45 6-22 * * *` ![New Drawing 6](https://github.com/apache/

Re: [PR] Make pyodbc.Row and databricks.Row JSON-serializable via new `make_serializable` method [airflow]

2023-11-02 Thread via GitHub
Joffreybvn commented on PR #32319: URL: https://github.com/apache/airflow/pull/32319#issuecomment-1790382272 Aside from one last databricks test failing, other ones fails because a common.sql with version `1.8.1` do not exists yet. Should this PR be split and merged over multiple providers

Re: [PR] Fix changelog for Dockerfile with 2.7.3 cherry-pick [airflow]

2023-11-02 Thread via GitHub
V0lantis commented on PR #35359: URL: https://github.com/apache/airflow/pull/35359#issuecomment-1790395280 Amazing, thanks guys, this is going to be very handy for us -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[PR] Refactor azure manged identity [airflow]

2023-11-02 Thread via GitHub
Lee-W opened a new pull request, #35367: URL: https://github.com/apache/airflow/pull/35367 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines)**

[PR] openlineage: add basic metrics to stats collector. [airflow]

2023-11-02 Thread via GitHub
JDarDagran opened a new pull request, #35368: URL: https://github.com/apache/airflow/pull/35368 Follow up for https://github.com/apache/airflow/pull/31223/ Added unit tests. -- This is an automated message from the Apache Git Service. To respond to the message, pleas

Re: [PR] Make pyodbc.Row and databricks.Row JSON-serializable via new `make_serializable` method [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #32319: URL: https://github.com/apache/airflow/pull/32319#issuecomment-1790413620 Quite the opposite. You need to update common.sql provider to 1.8.1 version in this PR and then PROD image build will succeed. It fails BECAUSE the version in the common.sql is not updat

Re: [PR] Add Cohere Provider [airflow]

2023-11-02 Thread via GitHub
pankajastro commented on PR #34921: URL: https://github.com/apache/airflow/pull/34921#issuecomment-1790420816 @utkarsharma2 we have `security.rst` in other provider docs example: https://github.com/apache/airflow/blob/main/docs/apache-airflow-providers-apache-cassandra/security.rst do we ne

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1790432213 Looks pretty good. celery integration test fails and production image need some fixes but other than that it seems almost working -- This is an automated message from the Apache Git Se

Re: [PR] Remove unused `can_read_dags` function from `api_connexion/security.py` [airflow]

2023-11-02 Thread via GitHub
ephraimbuddy merged PR #35365: URL: https://github.com/apache/airflow/pull/35365 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

(airflow) branch main updated: Remove unused `can_read_dags` function from `api_connexion/security.py` (#35365)

2023-11-02 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 47c90cfbde Remove unused `can_read_dags` f

Re: [PR] Add OpenAI Provider [airflow]

2023-11-02 Thread via GitHub
pankajastro commented on code in PR #35023: URL: https://github.com/apache/airflow/pull/35023#discussion_r1379871629 ## airflow/providers/openai/CHANGELOG.rst: ## @@ -0,0 +1,24 @@ + .. Licensed to the Apache Software Foundation (ASF) under one +or more contributor license ag

(airflow) branch v2-7-stable updated (c8b25cb3ee -> f124353783)

2023-11-02 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch v2-7-stable in repository https://gitbox.apache.org/repos/asf/airflow.git from c8b25cb3ee Update RELEASE_NOTES.rst add 11320c4a15 Add __init__ to params subpackage (#34710)

Re: [PR] Sync v2-7-stable with v2-7-test to release 2.7.3 [airflow]

2023-11-02 Thread via GitHub
ephraimbuddy merged PR #35270: URL: https://github.com/apache/airflow/pull/35270 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@air

Re: [PR] Add Weaviate Provider [airflow]

2023-11-02 Thread via GitHub
pankajastro commented on code in PR #35060: URL: https://github.com/apache/airflow/pull/35060#discussion_r1379884803 ## airflow/providers/weaviate/hooks/weaviate.py: ## @@ -0,0 +1,177 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [PR] Add Pinecone Provider [airflow]

2023-11-02 Thread via GitHub
pankajastro commented on code in PR #35094: URL: https://github.com/apache/airflow/pull/35094#discussion_r1379913447 ## airflow/providers/pinecone/hooks/pinecone.py: ## @@ -0,0 +1,128 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [PR] Fix system test for GoogleCalendarToGCSOperator [airflow]

2023-11-02 Thread via GitHub
VladaZakharova commented on PR #34452: URL: https://github.com/apache/airflow/pull/34452#issuecomment-1790495962 Hi @potiuk @eladkal ! @Taragolis , thank you, I think this could be moved to our Slack chat to discuss it inside Community, because it is not related to the current PR Could

Re: [PR] Add Pinecone Provider [airflow]

2023-11-02 Thread via GitHub
pankajastro commented on code in PR #35094: URL: https://github.com/apache/airflow/pull/35094#discussion_r1379919473 ## tests/providers/pinecone/hooks/test_pinecone.py: ## Review Comment: can we have few more test for other hook methods -- This is an automated message f

Re: [PR] Add Cohere Provider [airflow]

2023-11-02 Thread via GitHub
pankajastro commented on code in PR #34921: URL: https://github.com/apache/airflow/pull/34921#discussion_r1379921858 ## airflow/providers/cohere/operators/embedding.py: ## @@ -0,0 +1,70 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor licen

[PR] Use string python version in Python*Operator(s) tests [airflow]

2023-11-02 Thread via GitHub
Taragolis opened a new pull request, #35370: URL: https://github.com/apache/airflow/pull/35370 https://github.com/apache/airflow/pull/34359 deprecate numeric values for `python_version`, however tests use default value as integer. --- **^ Add meaningful descript

(airflow) annotated tag constraints-2.7.3rc1 updated (c0d764a566 -> 8bbd3543c8)

2023-11-02 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to annotated tag constraints-2.7.3rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag constraints-2.7.3rc1 was modified! *** from c0d764a566 (commit) to 8

Re: [PR] Fix system test for GoogleCalendarToGCSOperator [airflow]

2023-11-02 Thread via GitHub
Taragolis merged PR #34452: URL: https://github.com/apache/airflow/pull/34452 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflo

(airflow) branch main updated: Fix system test for GoogleCalendarToGCSOperator (#34452)

2023-11-02 Thread taragolis
This is an automated email from the ASF dual-hosted git repository. taragolis pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 99fdc2fa8d Fix system test for GoogleCalendarToG

svn commit: r64983 - /dev/airflow/2.7.3rc1/

2023-11-02 Thread ephraimanierobi
Author: ephraimanierobi Date: Thu Nov 2 11:47:10 2023 New Revision: 64983 Log: Add artifacts for Airflow 2.7.3rc1 Added: dev/airflow/2.7.3rc1/ dev/airflow/2.7.3rc1/apache-airflow-2.7.3-source.tar.gz (with props) dev/airflow/2.7.3rc1/apache-airflow-2.7.3-source.tar.gz.asc dev/ai

svn commit: r64984 - /dev/airflow/2.7.2rc1/

2023-11-02 Thread ephraimanierobi
Author: ephraimanierobi Date: Thu Nov 2 11:47:26 2023 New Revision: 64984 Log: Remove old release: 2.7.2rc1 Removed: dev/airflow/2.7.2rc1/

Re: [PR] (AIP-44) Migrate TaskCommand._get_ti to Internal API [airflow]

2023-11-02 Thread via GitHub
mhenc commented on code in PR #35312: URL: https://github.com/apache/airflow/pull/35312#discussion_r1379987451 ## airflow/api/common/experimental/get_task_instance.py: ## @@ -42,5 +42,6 @@ def get_task_instance(dag_id: str, task_id: str, execution_date: datetime) -> Ta if

(airflow) annotated tag 2.7.3rc1 updated (f124353783 -> 2672bfe133)

2023-11-02 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to annotated tag 2.7.3rc1 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag 2.7.3rc1 was modified! *** from f124353783 (commit) to 2672bfe133 (tag) tagging

Re: [I] Statsd metrics dagrun.schedule_delay sends time in different format against the seconds specified in docs [airflow]

2023-11-02 Thread via GitHub
Bowrna commented on issue #33426: URL: https://github.com/apache/airflow/issues/33426#issuecomment-1790610192 This is the code I retrieved from the python StatsdClient and it shows that timer if we pass the timedelta converts it into milliseconds and push it. With that said could I s

Re: [PR] Add OpenAI Provider [airflow]

2023-11-02 Thread via GitHub
utkarsharma2 commented on code in PR #35023: URL: https://github.com/apache/airflow/pull/35023#discussion_r1380010363 ## airflow/providers/openai/provider.yaml: ## @@ -0,0 +1,54 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license agree

[I] Status of testing of Apache Airflow 2.7.3rc1 [airflow]

2023-11-02 Thread via GitHub
ephraimbuddy opened a new issue, #35372: URL: https://github.com/apache/airflow/issues/35372 ### Body We are kindly requesting that contributors to [Apache Airflow RC 2.7.3rc1](https://pypi.org/project/apache-airflow/2.7.3rc1/) help test the RC. Please let us know by commenting

Re: [PR] Add OpenAI Provider [airflow]

2023-11-02 Thread via GitHub
utkarsharma2 commented on code in PR #35023: URL: https://github.com/apache/airflow/pull/35023#discussion_r1380013934 ## airflow/providers/openai/operators/openai.py: ## @@ -0,0 +1,75 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [I] Status of testing of Apache Airflow 2.7.3rc1 [airflow]

2023-11-02 Thread via GitHub
JDarDagran commented on issue #35372: URL: https://github.com/apache/airflow/issues/35372#issuecomment-1790639357 #35022 working as expected. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the s

Re: [I] Kubernetes pod log reding [airflow]

2023-11-02 Thread via GitHub
vchiapaikeo commented on issue #35010: URL: https://github.com/apache/airflow/issues/35010#issuecomment-1790649690 @romanzdk , are you still having these issues? I am unable to repro. Granted, I'm testing against debian 11 and not debian 10... can you provide any more details? Perhaps a sam

Re: [I] Status of testing of Apache Airflow 2.7.3rc1 [airflow]

2023-11-02 Thread via GitHub
poupounetjoyeux commented on issue #35372: URL: https://github.com/apache/airflow/issues/35372#issuecomment-1790649194 It's ok for #34836 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [I] Support multi-select state filtering on grid view [airflow]

2023-11-02 Thread via GitHub
vchiapaikeo commented on issue #34795: URL: https://github.com/apache/airflow/issues/34795#issuecomment-1790651365 Happy to give this a try! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] Status of testing of Apache Airflow 2.7.3rc1 [airflow]

2023-11-02 Thread via GitHub
utkarsharma2 commented on issue #35372: URL: https://github.com/apache/airflow/issues/35372#issuecomment-1790655101 #34952 working fine. Thanks, Utkarsh Sharma On Thu, Nov 2, 2023 at 6:07 PM Quentin Bray ***@***.***> wrote:

Re: [I] Status of testing of Apache Airflow 2.7.3rc1 [airflow]

2023-11-02 Thread via GitHub
vchiapaikeo commented on issue #35372: URL: https://github.com/apache/airflow/issues/35372#issuecomment-1790664230 https://github.com/apache/airflow/pull/35122 working as expected -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHu

Re: [PR] Add borderWidthRight to grid for Firefox scrollbar [airflow]

2023-11-02 Thread via GitHub
vchiapaikeo commented on PR #35346: URL: https://github.com/apache/airflow/pull/35346#issuecomment-1790668915 @pierrejeambrun , wdyt? I tried other options like manipulating scrollbar-gutter, adding extra padding, and margin but none seemed to work. -- This is an automated message from th

Re: [I] Status of testing of Apache Airflow 2.7.3rc1 [airflow]

2023-11-02 Thread via GitHub
Taragolis commented on issue #35372: URL: https://github.com/apache/airflow/issues/35372#issuecomment-1790683588 Successfully build custom image with MariaDB client libraries instead of Oracle MySQL from https://github.com/apache/airflow/tree/2.7.3rc1 - https://github.com/apache/airflow/

Re: [I] Status of testing of Apache Airflow 2.7.3rc1 [airflow]

2023-11-02 Thread via GitHub
Taragolis commented on issue #35372: URL: https://github.com/apache/airflow/issues/35372#issuecomment-1790689771 https://github.com/apache/airflow/pull/35132 also included into the `all_dbs` package extra -- This is an automated message from the Apache Git Service. To respond to the messa

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
raphaelauv commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1790718161 celery integration fail was flaky ( rerun workerd ) thank to my last commit I could build locally the prod image ``` breeze prod-image build ``` github ac

Re: [I] Airflow scheduler stopped working [airflow]

2023-11-02 Thread via GitHub
potiuk commented on issue #35272: URL: https://github.com/apache/airflow/issues/35272#issuecomment-1790734850 You've done all you could hopefully someone will take a look and help you. I am individual contributors and I have no power over telling other volunteers to do with their free time.

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1790778237 Looks great then. I might want to take it from here and add option to choose bookworm or bullseye as breeze option (but it might be a good exercise for you - happy to help with it :)

Re: [PR] Update Google Ads API version from v14 to v15 [airflow]

2023-11-02 Thread via GitHub
MaksYermak commented on code in PR #35295: URL: https://github.com/apache/airflow/pull/35295#discussion_r1380178705 ## airflow/providers/google/ads/hooks/ads.py: ## @@ -31,9 +31,9 @@ from airflow.providers.google.common.hooks.base_google import get_field if TYPE_CHECKING: -

Re: [PR] Add tests to `airflow/auth/managers/fab/decorators/auth.py` [airflow]

2023-11-02 Thread via GitHub
vincbeck commented on code in PR #35358: URL: https://github.com/apache/airflow/pull/35358#discussion_r1380188321 ## tests/auth/managers/fab/decorators/test_auth.py: ## @@ -0,0 +1,141 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more contributor license

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
raphaelauv commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1790795621 ``` I might want to take it from here ``` I agree , thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

Re: [PR] (AIP-44) Migrate TaskCommand._get_ti to Internal API [airflow]

2023-11-02 Thread via GitHub
vincbeck commented on PR #35312: URL: https://github.com/apache/airflow/pull/35312#issuecomment-1790797063 There are some circular dependency issues -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go t

[PR] Add tests for FAB basic auth [airflow]

2023-11-02 Thread via GitHub
vincbeck opened a new pull request, #35374: URL: https://github.com/apache/airflow/pull/35374 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/CONTRIBUTING.rst#pull-request-guidelines

Re: [PR] Use `is_authorized_*` APIs in views [airflow]

2023-11-02 Thread via GitHub
vincbeck closed pull request #35000: Use `is_authorized_*` APIs in views URL: https://github.com/apache/airflow/pull/35000 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To un

(airflow) branch main updated: Use string python version in Python*Operator(s) tests (#35370)

2023-11-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new d97f7a6c4a Use string python version in Python*Oper

Re: [I] ImportError: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: cannot allocate memory in static TLS block [airflow]

2023-11-02 Thread via GitHub
gempir commented on issue #17546: URL: https://github.com/apache/airflow/issues/17546#issuecomment-1790881461 Could anyone ever track down this Bug? This thread seems to be the most interesting one. The workaround works but is annoying and needs to be configured everywhere again and

Re: [PR] Use string python version in Python*Operator(s) tests [airflow]

2023-11-02 Thread via GitHub
potiuk merged PR #35370: URL: https://github.com/apache/airflow/pull/35370 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] ImportError: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: cannot allocate memory in static TLS block [airflow]

2023-11-02 Thread via GitHub
potiuk commented on issue #17546: URL: https://github.com/apache/airflow/issues/17546#issuecomment-1790896032 I think you should ask at mysql forums. They are responsible for the bug and they are the only one who can solve it. -- This is an automated message from the Apache Git Service. T

Re: [I] ImportError: /usr/lib/x86_64-linux-gnu/libstdc++.so.6: cannot allocate memory in static TLS block [airflow]

2023-11-02 Thread via GitHub
gempir commented on issue #17546: URL: https://github.com/apache/airflow/issues/17546#issuecomment-1790898533 Agreed, was just hoping anyone here had narrowed it down because their Bug Tracker is hard to search. -- This is an automated message from the Apache Git Service. To respond to th

Re: [I] Support multi-select state filtering on grid view [airflow]

2023-11-02 Thread via GitHub
potiuk commented on issue #34795: URL: https://github.com/apache/airflow/issues/34795#issuecomment-1790881435 Pls -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To uns

Re: [PR] Add tests for FAB basic auth [airflow]

2023-11-02 Thread via GitHub
potiuk merged PR #35374: URL: https://github.com/apache/airflow/pull/35374 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add tests for FAB basic auth (#35374)

2023-11-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 89bffad867 Add tests for FAB basic auth (#35374) 89

(airflow) branch main updated: `synchronize_log_template`: limit query result on DB rather than client (#35366)

2023-11-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 536c9fb1f2 `synchronize_log_template`: limit query

Re: [PR] Add tests to `airflow/auth/managers/fab/decorators/auth.py` [airflow]

2023-11-02 Thread via GitHub
vincbeck merged PR #35358: URL: https://github.com/apache/airflow/pull/35358 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

Re: [I] BaseBranchOperator should allow passing of a Taskgroup group_id. [airflow]

2023-11-02 Thread via GitHub
bfeif commented on issue #34526: URL: https://github.com/apache/airflow/issues/34526#issuecomment-1791043181 > can I take this issue ? Fine by me, @tsafacjo! I look forward to seeing you solution ;) -- This is an automated message from the Apache Git Service. To respond to the messa

Re: [PR] `synchronize_log_template`: limit query result on DB rather than client [airflow]

2023-11-02 Thread via GitHub
potiuk merged PR #35366: URL: https://github.com/apache/airflow/pull/35366 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Add tests to `airflow/auth/managers/fab/decorators/auth.py` (#35358)

2023-11-02 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 4d86340e5a Add tests to `airflow/auth/managers/fa

(airflow) branch main updated: Use `is_authorized_*` APIs in views (#35000)

2023-11-02 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new aaa2aedb1c Use `is_authorized_*` APIs in views (#

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1790979710 Smth still not fine with K8S tests though it might be a CI issue - maybe you could run K8S tests locally and see if this is replicable locally (there is a really nice chapter explaining

Re: [PR] Use `requires_access_custom_view` for user and roles API endpoints [airflow]

2023-11-02 Thread via GitHub
vincbeck commented on PR #35207: URL: https://github.com/apache/airflow/pull/35207#issuecomment-1791230396 PR rebased. It is easier to review now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to t

Re: [I] Pgbouncer not set properly upon using data.metadataSecretName [airflow]

2023-11-02 Thread via GitHub
hakuno commented on issue #33924: URL: https://github.com/apache/airflow/issues/33924#issuecomment-1791268201 @eladkal Actually I'll be away this and next week (on vacation). But I think it needs a fix. -- This is an automated message from the Apache Git Service. To respond to the messag

[I] airflow db migrate crashing with new connexion == 3.0.0 [airflow]

2023-11-02 Thread via GitHub
eselyavka opened a new issue, #35375: URL: https://github.com/apache/airflow/issues/35375 ### Apache Airflow version 2.7.2 ### What happened Team, it looks like i just discovered bug in airflow 2.7.2(latest) which were introduced by this package https://pypi.org/project/

Re: [I] airflow db migrate crashing with new connexion == 3.0.0 [airflow]

2023-11-02 Thread via GitHub
boring-cyborg[bot] commented on issue #35375: URL: https://github.com/apache/airflow/issues/35375#issuecomment-1791267540 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

Re: [I] airflow db migrate crashing with new connexion == 3.0.0 [airflow]

2023-11-02 Thread via GitHub
Taragolis closed issue #35375: airflow db migrate crashing with new connexion == 3.0.0 URL: https://github.com/apache/airflow/issues/35375 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] airflow db migrate crashing with new connexion == 3.0.0 [airflow]

2023-11-02 Thread via GitHub
Taragolis commented on issue #35375: URL: https://github.com/apache/airflow/issues/35375#issuecomment-1791285661 connexion already limited in: - https://github.com/apache/airflow/pull/35218 Follow up task exists: - https://github.com/apache/airflow/issues/35234 For avoid

[PR] Switch our base image to use Debian bookworm [airflow]

2023-11-02 Thread via GitHub
potiuk opened a new pull request, #35376: URL: https://github.com/apache/airflow/pull/35376 Debian bookworm (12) is the current stable version of Debian and it is on the market for more than a year so all the other dependencies should have enough time to catch up. While Debian bullse

(airflow) branch bookworm created (now 5dada460bf)

2023-11-02 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to branch bookworm in repository https://gitbox.apache.org/repos/asf/airflow.git at 5dada460bf Switch our base image to use Debian bookworm This branch includes the following new commits: new

Re: [PR] Switch our base image to use Debian bookworm [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #35376: URL: https://github.com/apache/airflow/pull/35376#issuecomment-1791326903 cc: @raphaelauv -> opened this PR in Airlfow Repo after my changes to see if it builds with our self-hosted runners. -- This is an automated message from the Apache Git Service. To re

Re: [PR] Use `is_authorized_*` APIs in views [airflow]

2023-11-02 Thread via GitHub
vincbeck merged PR #35000: URL: https://github.com/apache/airflow/pull/35000 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1791329691 I pushed a fixup with `--debian-version` switch. Now you can choose which version you want to build. It also has release notes, documentation in "Build imaages" about it, and CI job that

Re: [PR] bump debian to bookworm [airflow]

2023-11-02 Thread via GitHub
potiuk commented on PR #32004: URL: https://github.com/apache/airflow/pull/32004#issuecomment-1791330829 (you are co-author BTW). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comm

Re: [I] Issue with Airflow Webserver when Configured with External DB (Airflow's webserver fails to start, `signal: 15`) [airflow]

2023-11-02 Thread via GitHub
jens-scheffler-bosch commented on issue #35364: URL: https://github.com/apache/airflow/issues/35364#issuecomment-1791349683 Error code 137 is raised by docker usually when a process runs out of memory. Can you check adding more memory in your helm chart if this helps? e.g. via `webserver

[I] Airflow SFTP Operator cannot connect to a remote endpoint due to no using "expanduser" to read file directory [airflow]

2023-11-02 Thread via GitHub
MemphisMeng opened a new issue, #35377: URL: https://github.com/apache/airflow/issues/35377 ### Apache Airflow version Other Airflow 2 version (please specify below) ### What happened I tried to set up a task that uploads files to an endpoint via SFTP using SFTP Operator

Re: [I] After installing using HELM in EKS, PostgreSQL consistently crashes LoopBackOff [airflow]

2023-11-02 Thread via GitHub
jens-scheffler-bosch commented on issue #35363: URL: https://github.com/apache/airflow/issues/35363#issuecomment-1791361571 Postgres within the helm deployment is for testing and development use only. It is recommended to use a "real" postgres, probably as a PaaS offering if you don't want

Re: [I] Dynamic Task Mapping: transforming dict data with map results in KeyError [airflow]

2023-11-02 Thread via GitHub
jens-scheffler-bosch commented on issue #35361: URL: https://github.com/apache/airflow/issues/35361#issuecomment-1791379422 Mhm, I don't get your point. Iterable is for dict keys. Dynamic task mapping needs a list in order to be able to map tasks to it. You need to know the mapping is using

[PR] Add optional exit code to list import errors [airflow]

2023-11-02 Thread via GitHub
drapail opened a new pull request, #35378: URL: https://github.com/apache/airflow/pull/35378 --- Added a flag to list-import-errors command that returns exit code '1' if there are import errors. Will be useful when used in CI pipelines. **^ Add meani

Re: [PR] Add optional exit code to list import errors [airflow]

2023-11-02 Thread via GitHub
boring-cyborg[bot] commented on PR #35378: URL: https://github.com/apache/airflow/pull/35378#issuecomment-1791390304 Congratulations on your first Pull Request and welcome to the Apache Airflow community! If you have any issues or are unsure about any anything please check our Contribution

Re: [I] Dynamic task mapping over task_group expands over length of return_value dictionary instead of targeted XCom value [airflow]

2023-11-02 Thread via GitHub
jens-scheffler-bosch commented on issue #35355: URL: https://github.com/apache/airflow/issues/35355#issuecomment-1791404071 I fear this is a mis-understanding. I have never seen it working - and would be surprised if it is - that you can map on additional XCom results like you went down wit

Re: [I] DAG runs from TriggerDagRunOperator is missing Start Date [airflow]

2023-11-02 Thread via GitHub
sudiptad2017 closed issue #35281: DAG runs from TriggerDagRunOperator is missing Start Date URL: https://github.com/apache/airflow/issues/35281 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [I] DAG runs from TriggerDagRunOperator is missing Start Date [airflow]

2023-11-02 Thread via GitHub
sudiptad2017 commented on issue #35281: URL: https://github.com/apache/airflow/issues/35281#issuecomment-1791412630 Hi @josh-fell! Thanks for your response. In that case I would have to find a workaround for now. We have an upgrade planned soon. I will raise another issue if this issue pers

  1   2   >