Re: [I] No response from gunicorn master within 120 seconds After Changing Worker Class [airflow]

2023-12-14 Thread via GitHub
ramkunwarmeghwal commented on issue #10964: URL: https://github.com/apache/airflow/issues/10964#issuecomment-1857435187 Thanks @potiuk , solved this problem, increased timeout in airflow.cfg file `web_server_master_timeout = 300` and `web_server_worker_timeout = 300` -- This is an

Re: [PR] Update BREEZE.rst with different test example [airflow]

2023-12-14 Thread via GitHub
Bowrna closed pull request #36234: Update BREEZE.rst with different test example URL: https://github.com/apache/airflow/pull/36234 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

(airflow-site) branch airflow_280blog updated (b4405292d7 -> 6b2c41fc21)

2023-12-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch airflow_280blog in repository https://gitbox.apache.org/repos/asf/airflow-site.git from b4405292d7 fixup! fixup! Airflow 2.8.0 blog post add 6b2c41fc21 fixup! fixup! fixup!

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
Joffreybvn commented on code in PR #36205: URL: https://github.com/apache/airflow/pull/36205#discussion_r1427221843 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -80,8 +85,18 @@ def __init__( self.http_headers = http_headers self.catalog =

[PR] Update BREEZE.rst with different test example [airflow]

2023-12-14 Thread via GitHub
Bowrna opened a new pull request, #36234: URL: https://github.com/apache/airflow/pull/36234 Updating the breeze docs with different pytest example as the function mentioned in the example is removed from the test_core.py --- **^ Add meaningful

Re: [PR] Airflow 2.8.0 blog post [airflow-site]

2023-12-14 Thread via GitHub
phanikumv commented on code in PR #906: URL: https://github.com/apache/airflow-site/pull/906#discussion_r1427558606 ## landing-pages/site/content/en/blog/airflow-2.8.0/index.md: ## @@ -0,0 +1,114 @@ +--- +title: "Apache Airflow 2.8.0 is here" +linkTitle: "Apache Airflow 2.8.0

Re: [PR] Airflow 2.8.0 blog post [airflow-site]

2023-12-14 Thread via GitHub
phanikumv commented on code in PR #906: URL: https://github.com/apache/airflow-site/pull/906#discussion_r1427557860 ## landing-pages/site/content/en/blog/airflow-2.8.0/index.md: ## @@ -0,0 +1,114 @@ +--- +title: "Apache Airflow 2.8.0 is here" +linkTitle: "Apache Airflow 2.8.0

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
calvinwijya commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1857274476 > > > i think the new key version is: A8D3785C > > > https://dev.mysql.com/doc/refman/8.2/en/checking-gpg-signature.html > > > the thing is even if i set this before my

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
Taragolis commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1857165776 > we have a chance to get the same troubleshooting in the end of the 2024 Clarification in the end of October 2025 ```console pub rsa4096 2023-10-23 [SC]

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
Taragolis commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1857158711 I think the problem might be on Oracle side, packages are signed by expired key `3A79BD29` and new GPG key doesn't `3A79BD29`, but according to the

Re: [I] ECS Executor - Overriding Additional ECS Task Properties [airflow]

2023-12-14 Thread via GitHub
shubham22 commented on issue #35490: URL: https://github.com/apache/airflow/issues/35490#issuecomment-1857074044 I'd vote for simplicity and keeping things consistent irrespective of the type of the field, which means `executor_config` should _always_ override the `run_task_kwargs` for any

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
mycaule commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1857053157 you can also `RUN apt update --allow-insecure-repositories` until a fix is coming out. -- This is an automated message from the Apache Git Service. To respond to the message,

Re: [PR] Don't get DAG out of DagBag when we already have it [airflow]

2023-12-14 Thread via GitHub
github-actions[bot] commented on PR #35243: URL: https://github.com/apache/airflow/pull/35243#issuecomment-1857050406 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Defined Constants for Repo Routes in Databricks Hook [airflow]

2023-12-14 Thread via GitHub
github-actions[bot] commented on PR #34666: URL: https://github.com/apache/airflow/pull/34666#issuecomment-1857050517 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Fix: added re-raising of exceptions to dag.test() execution [airflow]

2023-12-14 Thread via GitHub
github-actions[bot] commented on PR #34311: URL: https://github.com/apache/airflow/pull/34311#issuecomment-1857050732 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Refactor usage of str() [airflow]

2023-12-14 Thread via GitHub
github-actions[bot] commented on PR #34321: URL: https://github.com/apache/airflow/pull/34321#issuecomment-1857050654 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [PR] Add watchdog for immediately processing changes in the DAGs folder [airflow]

2023-12-14 Thread via GitHub
github-actions[bot] commented on PR #34487: URL: https://github.com/apache/airflow/pull/34487#issuecomment-1857050587 This pull request has been automatically marked as stale because it has not had recent activity. It will be closed in 5 days if no further activity occurs. Thank you for

Re: [I] GlueJobSensor stuck in Running state with Verbose set to True [airflow]

2023-12-14 Thread via GitHub
github-actions[bot] commented on issue #35431: URL: https://github.com/apache/airflow/issues/35431#issuecomment-1857050343 This issue has been automatically marked as stale because it has been open for 14 days with no response from the author. It will be closed in next 7 days if no further

Re: [PR] adding triggerer option in breeze command [airflow]

2023-12-14 Thread via GitHub
o-nikolas commented on PR #36063: URL: https://github.com/apache/airflow/pull/36063#issuecomment-1856968452 Yeah, I think this is fine if the triggerer doesn't take up too many resources. Since often the test may not be making use of it. Depending on whether the operators support it or not

Re: [PR] Implement task duration page in react. [airflow]

2023-12-14 Thread via GitHub
tirkarthi commented on PR #35863: URL: https://github.com/apache/airflow/pull/35863#issuecomment-1856858784 @bbovenzi Please feel free to push changes. I tried to fix conflicts since recent xcom details page also had changes to tab number and panels in same file so please verify if the

Re: [I] Official Airflow Helm Chart Adding EmptyDir Sizes and Basic Probes to all Containers to Values File [airflow]

2023-12-14 Thread via GitHub
shohamy7 commented on issue #35353: URL: https://github.com/apache/airflow/issues/35353#issuecomment-1856750083 Hi! @ahipp13 I saw your issue, and took a look in the current helm chart (1.12.0-dev) and it looks that the first proposal of supporting extra configuration such as

[I] UI Bug: Max active dag, task, and concurrency show up as datetime in Grid view (dag details) [airflow]

2023-12-14 Thread via GitHub
ketozhang opened a new issue, #36233: URL: https://github.com/apache/airflow/issues/36233 ### Apache Airflow version 2.7.3 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened?

Re: [PR] Support not/and/or search filter for tags [airflow]

2023-12-14 Thread via GitHub
raghukpara commented on PR #33490: URL: https://github.com/apache/airflow/pull/33490#issuecomment-1856667241 All I'm looking for is the endpoint URL to contain "?tags=" at the end. If I give multiple tags I get all DAGs that have them in common. However, I want the AND operator to act

Re: [I] AIP-56 - FAB AM - Move FAB auth manager to new provider [airflow]

2023-12-14 Thread via GitHub
vincbeck commented on issue #32210: URL: https://github.com/apache/airflow/issues/32210#issuecomment-1856643074 Not so much actually: #36232 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[PR] Move config related to FAB auth manager to FAB provider [airflow]

2023-12-14 Thread via GitHub
vincbeck opened a new pull request, #36232: URL: https://github.com/apache/airflow/pull/36232 Some config is now used only by the new fab provider. Thus, we should move this config to the provider See #32210. --- **^ Add meaningful description

Re: [PR] Upgrade bitnami/postgresql subchart to 13.2.24 [airflow]

2023-12-14 Thread via GitHub
dnskr commented on code in PR #36156: URL: https://github.com/apache/airflow/pull/36156#discussion_r1427284234 ## chart/values.yaml: ## @@ -2277,8 +2277,6 @@ cleanup: # Not recommended for production postgresql: enabled: true - image: -tag: "11" Review Comment:

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856588839 Yeah. That's a quick fix if you need no mysql. I still cannot reproduce it even if I run it from scratch . So I think it really depends which cache you hit ... I am afraid we have

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
acmarco commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856583460 > It looks as though the apt repository still has the old gpg key set: https://repo.mysql.com/apt/debian/conf/distributions For us we couldn't get the reference to the old

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856580159 I think it might depend on which cache you hit -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
fdintino commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856575558 It looks as though the apt repository still has the old gpg key set: https://repo.mysql.com/apt/debian/conf/distributions -- This is an automated message from the Apache Git

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
souzagmu commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856574225 > > i think the new key version is: A8D3785C > > https://dev.mysql.com/doc/refman/8.2/en/checking-gpg-signature.html > > the thing is even if i set this before my apt-get

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856568052 ``` > i think the new key version is: A8D3785C > https://dev.mysql.com/doc/refman/8.2/en/checking-gpg-signature.html > the thing is even if i set this before my

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
furquan39 commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856566185 > Can anyone post the full log of failing installation in text form, please? ##[error]#7 0.874 Get:12 http://deb.debian.org/debian-security bullseye-security/main

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
souzagmu commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856564664 > Can anyone post the full log of failing installation in text form, please? ``` Removing intermediate container 046364755c82 ---> 191275aaf947 Step 18/31 : RUN

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
ltken123 commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856564080 If you add the new key `Step 5/38 : RUN sudo apt-key adv --keyserver keyserver.ubuntu.com --recv-keys A8D3785C ---> Running in bcfe67535615 Warning: apt-key is

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
ltken123 commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856562881 If you replace the key `#8 [stage-1 3/29] RUN gpg --keyserver keyserver.ubuntu.com --recv-keys A8D3785C 2>&1 #8

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
souzagmu commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856559164 > How about this: > > ```dockerfile > RUN sudo gpg --recv-keys 3A79BD29 > ``` i think the new key version is: A8D3785C

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856558211 Can anyone post the full log of failing installation in text form, please? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
ltken123 commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856555458 `RUN sudo gpg --recv-keys 3A79BD29` This isn't working for me either, no so great workaround to get my builds to continue is just to remove mysql for now -- This is an

Re: [PR] WIP KPO log cleanup [airflow]

2023-12-14 Thread via GitHub
dstandish commented on PR #36227: URL: https://github.com/apache/airflow/pull/36227#issuecomment-1856550024 also @troyharvey interestingly we have received reports of this happening with DBT. it always seems to be DBT-related. we actually worked pretty hard to reproduce but could not.

Re: [PR] Base date for fetching dag grid view must include selected run_id [airflow]

2023-12-14 Thread via GitHub
bbovenzi commented on PR #34887: URL: https://github.com/apache/airflow/pull/34887#issuecomment-1856537227 @hterik Ok I'm happy to clean up this filters+main logic. Mind to rebase the PR first? -- This is an automated message from the Apache Git Service. To respond to the message, please

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856536425 ( and I am talking about time not timezone) - whether your time is set properly on your machine -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856535208 How about this: ```Dockerfile RUN gpg --recv-keys 3A79BD29 ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Support not/and/or search filter for tags [airflow]

2023-12-14 Thread via GitHub
bbovenzi commented on PR #33490: URL: https://github.com/apache/airflow/pull/33490#issuecomment-1856534988 UX wise, I think its difficult to keep the dropdown simple while allowing different logic gates. Perhaps we allow the input to be both a select and a text input where a power user can

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
mycaule commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856533398 I am in Europe just like you. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856531953 > A quick workaround that should fix if anyone sees the problem (I can't reproduce it - likely due to timezone). I will come with some better fix also for historical images but

Re: [PR] Support not/and/or search filter for tags [airflow]

2023-12-14 Thread via GitHub
bbovenzi commented on code in PR #33490: URL: https://github.com/apache/airflow/pull/33490#discussion_r1427231779 ## airflow/www/views.py: ## @@ -911,10 +928,11 @@ def index(self): dag.can_trigger = dag.can_edit and can_create_dag_run

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
mycaule commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856523265 > A quick workaround that should fix if anyone sees the problem (I can't reproduce it - likely due to timezone). I will come with some better fix also for historical images but

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856515408 A quick workaround that should fix if anyone sees the problem (I can't reproduce it - likely due to timezone). I will come with some better fix also for historical images but this

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
Joffreybvn commented on code in PR #36205: URL: https://github.com/apache/airflow/pull/36205#discussion_r1427221843 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -80,8 +85,18 @@ def __init__( self.http_headers = http_headers self.catalog =

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
Joffreybvn commented on code in PR #36205: URL: https://github.com/apache/airflow/pull/36205#discussion_r1427222586 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -80,8 +85,18 @@ def __init__( self.http_headers = http_headers self.catalog =

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
Joffreybvn commented on code in PR #36205: URL: https://github.com/apache/airflow/pull/36205#discussion_r1427221843 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -80,8 +85,18 @@ def __init__( self.http_headers = http_headers self.catalog =

Re: [PR] WIP KPO log cleanup [airflow]

2023-12-14 Thread via GitHub
dstandish commented on PR #36227: URL: https://github.com/apache/airflow/pull/36227#issuecomment-1856504013 Hi @troyharvey , my secret master plan is to do a larger refactor of KPO logging. In short here's the plan: * run a log fetcher in a thread per container * each log

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856469644 Similar to https://github.com/apache/airflow/pull/20912 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #36231: URL: https://github.com/apache/airflow/issues/36231#issuecomment-1856468916 Looks like Oracle did it again and changed their key. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the

[I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk opened a new issue, #36231: URL: https://github.com/apache/airflow/issues/36231 ### Discussed in https://github.com/apache/airflow/discussions/36230 Originally posted by **furquan39** December 14, 2023 ### Apache Airflow version Other Airflow 2 version (please

Re: [I] Webserver returns 500 for POST requests to api/dag/*/dagrun from anonymous user [airflow]

2023-12-14 Thread via GitHub
eliskovets commented on issue #36110: URL: https://github.com/apache/airflow/issues/36110#issuecomment-1856464285 Hi @pateash , Sorry, forgot to tell you, that I also have `"AIRFLOW__API__AUTH_BACKENDS": "airflow.api.auth.backend.default"` set. -- This is an automated message from

Re: [PR] WIP KPO log cleanup [airflow]

2023-12-14 Thread via GitHub
troyharvey commented on PR #36227: URL: https://github.com/apache/airflow/pull/36227#issuecomment-1856462164 @dstandish Let me know if we can help test this. We have a long-running KubernetesPodOperator running dbt and we had to turn off `get_logs` because of timeout issues with the task

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
potiuk closed issue #36229: MYSQL fails to install due to incorrect GPG Key URL: https://github.com/apache/airflow/issues/36229 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [PR] Add TemplatedSmtpNotifier [airflow]

2023-12-14 Thread via GitHub
vchiapaikeo commented on PR #36226: URL: https://github.com/apache/airflow/pull/36226#issuecomment-1856403567 cc @eladkal , @potiuk , @BasPH, @hussein-awala - would love to hear what you think when you have a moment -- This is an automated message from the Apache Git Service. To respond

Re: [PR] Syedahsn/aws executors ecs credentials refresh [airflow]

2023-12-14 Thread via GitHub
syedahsn commented on code in PR #36179: URL: https://github.com/apache/airflow/pull/36179#discussion_r1427137966 ## airflow/providers/amazon/aws/utils/exponential_backoff_retry.py: ## @@ -0,0 +1,60 @@ +# Licensed to the Apache Software Foundation (ASF) under one +# or more

Re: [I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
boring-cyborg[bot] commented on issue #36229: URL: https://github.com/apache/airflow/issues/36229#issuecomment-1856376817 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for

[I] MYSQL fails to install due to incorrect GPG Key [airflow]

2023-12-14 Thread via GitHub
furquan39 opened a new issue, #36229: URL: https://github.com/apache/airflow/issues/36229 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.4.1 ### What happened? When

[PR] KPO write_logs does not need to use complicated pod logs reader [airflow]

2023-12-14 Thread via GitHub
dstandish opened a new pull request, #36228: URL: https://github.com/apache/airflow/pull/36228 Method `write_logs` was using pod manager method `read_pod_logs` which has some rather complicated logic that it doesn't need, because it does not "follow" the logs and because by the time we

Re: [I] Webserver returns 500 for POST requests to api/dag/*/dagrun from anonymous user [airflow]

2023-12-14 Thread via GitHub
pateash commented on issue #36110: URL: https://github.com/apache/airflow/issues/36110#issuecomment-1856364682 Hi @eliskovets, i am not able to repo it using `AUTH_ROLE_PUBLIC = "Admin"` as per my knowledge it will only affect UI access not API. Could you please help on how

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
vincbeck commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1856225351 Creating diagrams is actually super fun! I experienced a bug though. When I run the script as is, everything is fine but when I generate the diagrams through the static checks

[PR] WIP KPO log cleanup [airflow]

2023-12-14 Thread via GitHub
dstandish opened a new pull request, #36227: URL: https://github.com/apache/airflow/pull/36227 I am trying to clean up KPO logging logic a bit. I was trying to better understand the logic in https://github.com/apache/airflow/pull/34412. It occurred to me that one way to understand

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
vincbeck commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1856213983 > Sphinx speaking riddles again > > I will take a look after my talk (I have a talk at https://osacon.io in 45 minutes so a little stressed ;) . Thank you :D! And good

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1856211195 Sphinx speaking riddles again I will take a look after my talk (I have a talk at https://osacon.io in 45 minutes so a little stressed ;) . -- This is an automated message from

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
vincbeck commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1856206101 In the meantime, do you know why it is complaining about `sphinx.errors.SphinxWarning: /opt/airflow/docs/apache-airflow/security/api.rst:24:unknown document:

[PR] Add TemplatedSmtpNotifier [airflow]

2023-12-14 Thread via GitHub
vchiapaikeo opened a new pull request, #36226: URL: https://github.com/apache/airflow/pull/36226 closes: https://github.com/apache/airflow/issues/35381 Creating a TemplatedSmtpNotifier class that simplifies sending emails based on the discussion in

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1856184404 Constraints with databricks 5.0.0 updated https://github.com/apache/airflow/commit/33121932d4cdcd2da27756ac149791365a88f08c and tag for 2.8.0rc3 moved @ephraimbuddy -- This is an

(airflow) annotated tag constraints-2.8.0rc3 updated (9e3c26f64b -> f07a9837d6)

2023-12-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a change to annotated tag constraints-2.8.0rc3 in repository https://gitbox.apache.org/repos/asf/airflow.git *** WARNING: tag constraints-2.8.0rc3 was modified! *** from 9e3c26f64b (tag) to f07a9837d6

(airflow) branch constraints-2-8 updated: Updating constraints. Github run id:7199187385

2023-12-14 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-2-8 in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-2-8 by this push: new 33121932d4 Updating

Re: [PR] Fix: test_auth fails [airflow]

2023-12-14 Thread via GitHub
romsharon98 closed pull request #36225: Fix: test_auth fails URL: https://github.com/apache/airflow/pull/36225 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe,

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
bolkedebruin commented on code in PR #36205: URL: https://github.com/apache/airflow/pull/36205#discussion_r1426953507 ## airflow/providers/databricks/hooks/databricks_sql.py: ## @@ -80,8 +85,18 @@ def __init__( self.http_headers = http_headers self.catalog =

[PR] Fix: test_auth fails [airflow]

2023-12-14 Thread via GitHub
romsharon98 opened a new pull request, #36225: URL: https://github.com/apache/airflow/pull/36225 It's been an error in the [test_auth.py ](https://github.com/apache/airflow/blame/01fd0d31b46682f4d700aaacf19cfe7a0fe9a057/tests/www/test_auth.py#L126) that makes this command to fails breeze

(airflow-site) branch airflow_280blog updated (f75cdbd1ce -> b4405292d7)

2023-12-14 Thread ephraimanierobi
This is an automated email from the ASF dual-hosted git repository. ephraimanierobi pushed a change to branch airflow_280blog in repository https://gitbox.apache.org/repos/asf/airflow-site.git from f75cdbd1ce fixup! Airflow 2.8.0 blog post add b4405292d7 fixup! fixup! Airflow 2.8.0

Re: [PR] Implement task duration page in react. [airflow]

2023-12-14 Thread via GitHub
bbovenzi commented on PR #35863: URL: https://github.com/apache/airflow/pull/35863#issuecomment-1856136606 I'm also happy to contribute to this branch if that would be helpful. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub

(airflow) branch constraints-main updated: Updating constraints. Github run id:7210923285

2023-12-14 Thread github-bot
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a commit to branch constraints-main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/constraints-main by this push: new 8bc15c3ee3 Updating

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1856113825 BTW. You can run the pre-comit script "as-is" - as long as you have diagrams installed in your venv it works as regular Python script -- This is an automated message from the Apache

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1856112440 > Sounds exciting! Let me try that Indeed, I love how they implemented it and it's really nice to iterate on diagram, it's super-fast- just change the code, run the pre-commit

Re: [PR] KubernetesPodTrigger: add exception stack trace in TriggerEvent [airflow]

2023-12-14 Thread via GitHub
potiuk commented on code in PR #35716: URL: https://github.com/apache/airflow/pull/35716#discussion_r1426903084 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -672,6 +672,7 @@ def invoke_defer_method(self): ) def execute_complete(self, context:

Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #34644: URL: https://github.com/apache/airflow/issues/34644#issuecomment-1856083901 Please let us know after you investigate and (hopefully) upgrade how the things go, so that we can (hopefully) close the ticket - in the meantime I mark it as pending response.

Re: [I] Invalid kube-config file. Expected key current-context in kube-config when using deferrable=True [airflow]

2023-12-14 Thread via GitHub
potiuk commented on issue #34644: URL: https://github.com/apache/airflow/issues/34644#issuecomment-1856081623 The lack of more details seems to be because the message is not coming from airflow but from the POD. The message is "just" displayed by the airflow's KPO and the error is

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
vincbeck commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1856046976 > Comment/ Proposal. Why don't you prepare one/two diagrams, similar to the ones that you had in the AIP. I recently integrated the nice Python "Diagram as a Code" tool into our

Re: [PR] Remove Redshift mention from the list of managed Postgres backends [airflow]

2023-12-14 Thread via GitHub
vincbeck merged PR #36217: URL: https://github.com/apache/airflow/pull/36217 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

(airflow) branch main updated: Remove Redshift mention from the list of managed Postgres backends (#36217)

2023-12-14 Thread vincbeck
This is an automated email from the ASF dual-hosted git repository. vincbeck pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 01fd0d31b4 Remove Redshift mention from the list

Re: [PR] add param proxy user for hive [airflow]

2023-12-14 Thread via GitHub
nadavgross commented on code in PR #36221: URL: https://github.com/apache/airflow/pull/36221#discussion_r1426847708 ## airflow/providers/apache/hive/operators/hive.py: ## @@ -72,6 +72,7 @@ class HiveOperator(BaseOperator): "hiveconfs", "mapred_job_name",

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1856011705 Also cc: @ephraimbuddy -> since we yanked 5.0.1, I will rerun the last build for v2-8-stable to refresh constraints and move the tag once done (currentlly 5.0.1 was in the constraints

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1856003948 Yanked -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1855996509 > The databricks provider was already released with the breaking change-> [5.0.1](https://pypi.org/project/apache-airflow-providers-databricks/5.0.1/). Maybe this version should be

Re: [PR] Create auth manager documentation [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36211: URL: https://github.com/apache/airflow/pull/36211#issuecomment-1855988839 Comment/ Proposal. Why don't you prepare one/two diagrams, similar to the ones that you had in the AIP. I recently integrated the nice Python "Diagram as a Code" tool into our

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
Joffreybvn commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1855988794 The databricks provider was already released with the breaking change-> [5.0.1](https://pypi.org/project/apache-airflow-providers-databricks/5.0.1/). Maybe this version should be

Re: [PR] Fix broken regex for allowed_deserialization_classes [airflow]

2023-12-14 Thread via GitHub
potiuk commented on code in PR #36147: URL: https://github.com/apache/airflow/pull/36147#discussion_r1426814072 ## airflow/serialization/serde.py: ## @@ -360,7 +360,7 @@ def _register(): @functools.lru_cache(maxsize=None) def _get_patterns() -> list[Pattern]: patterns =

Re: [PR] Fix broken regex for allowed_deserialization_classes [airflow]

2023-12-14 Thread via GitHub
potiuk commented on code in PR #36147: URL: https://github.com/apache/airflow/pull/36147#discussion_r1426809710 ## airflow/serialization/serde.py: ## @@ -360,7 +360,7 @@ def _register(): @functools.lru_cache(maxsize=None) def _get_patterns() -> list[Pattern]: patterns =

(airflow) branch main updated: iterate through blobs before checking prefixes (#36202)

2023-12-14 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new e83a98603e iterate through blobs before checking

Re: [PR] iterate through blobs before checking prefixes [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36202: URL: https://github.com/apache/airflow/pull/36202#issuecomment-1855973268 Just in time for RC3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific

Re: [PR] iterate through blobs before checking prefixes [airflow]

2023-12-14 Thread via GitHub
potiuk merged PR #36202: URL: https://github.com/apache/airflow/pull/36202 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

Re: [PR] Make databricks sql hook return a serializable namedtuple [airflow]

2023-12-14 Thread via GitHub
potiuk commented on PR #36205: URL: https://github.com/apache/airflow/pull/36205#issuecomment-1855968176 And I created https://github.com/apache/airflow/issues/36224 and assigned to myself and will shortly take a close look at this - to make sure the common.sql API is not only defined but

  1   2   >