Re: [I] Celery worker enters a catatonic state after redis restart [airflow]

2024-01-26 Thread via GitHub
kaxil commented on issue #26542: URL: https://github.com/apache/airflow/issues/26542#issuecomment-1913058540 > We were able to improve the behavior with these settings: > > ``` > AIRFLOW__CELERY_BROKER_TRANSPORT_OPTIONS__SOCKET_TIMEOUT=30 > AIRFLOW__CELERY_BROKER_TRANSPORT_OPTION

Re: [PR] Move CI documentation to inside Breeze docs [airflow]

2024-01-26 Thread via GitHub
potiuk commented on code in PR #37039: URL: https://github.com/apache/airflow/pull/37039#discussion_r1468367132 ## dev/breeze/doc/ci/01_ci_environment.md: ## @@ -0,0 +1,132 @@ + + + + +**Table of Contents** *generated with [DocToc](https://github.com/thlorenz/doctoc)* + +- [CI

Re: [PR] Move CI documentation to inside Breeze docs [airflow]

2024-01-26 Thread via GitHub
aritra24 commented on code in PR #37039: URL: https://github.com/apache/airflow/pull/37039#discussion_r1468361184 ## dev/breeze/doc/ci/01_ci_environment.md: ## @@ -0,0 +1,132 @@ + + + + +**Table of Contents** *generated with [DocToc](https://github.com/thlorenz/doctoc)* + +- [

Re: [PR] Secret masker ignores passwords with special chars [airflow]

2024-01-26 Thread via GitHub
aritra24 commented on PR #36692: URL: https://github.com/apache/airflow/pull/36692#issuecomment-1913025814 @hussein-awala pinging you for a re-review. This commits ready to merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitH

Re: [I] Externally terminated task marked as failed twice, no retry initiated [airflow]

2024-01-26 Thread via GitHub
boring-cyborg[bot] commented on issue #37041: URL: https://github.com/apache/airflow/issues/37041#issuecomment-1913022601 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

[I] Externally terminated task marked as failed twice, no retry initiated [airflow]

2024-01-26 Thread via GitHub
rubanolha opened a new issue, #37041: URL: https://github.com/apache/airflow/issues/37041 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.7.3 ### What happened? Note: our execu

[PR] Draft: kubernetes version bump [airflow]

2024-01-26 Thread via GitHub
dirrao opened a new pull request, #37040: URL: https://github.com/apache/airflow/pull/37040 close: #36678 extension: #36684 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comme

Re: [PR] bump: kubernetes client version [airflow]

2024-01-26 Thread via GitHub
dirrao commented on PR #36684: URL: https://github.com/apache/airflow/pull/36684#issuecomment-1912977346 > > @potiuk I'm not available to finish this PR in the next days , should I close it ? > > cc: @dirrao -> maybe you would like to take that over and open a new one? sure -

Re: [PR] Airflow Teradata Provider: Initial implementation of Airflow Teradata Provider [airflow]

2024-01-26 Thread via GitHub
sunilkmallam commented on PR #36953: URL: https://github.com/apache/airflow/pull/36953#issuecomment-1912928299 > > Partial review for now > > > > Addressed the review comments. Hi @eladkal, have you had a chance to review the changes we did? -- This is an automated me

Re: [I] Cluster policies on mapped tasks cause broken DAGs [airflow]

2024-01-26 Thread via GitHub
RNHTTR commented on issue #37013: URL: https://github.com/apache/airflow/issues/37013#issuecomment-1912873822 Possibly related: #28313 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [I] Kubernetes doubling logs [airflow]

2024-01-26 Thread via GitHub
github-actions[bot] closed issue #35019: Kubernetes doubling logs URL: https://github.com/apache/airflow/issues/35019 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [I] Kubernetes doubling logs [airflow]

2024-01-26 Thread via GitHub
github-actions[bot] commented on issue #35019: URL: https://github.com/apache/airflow/issues/35019#issuecomment-1912854849 This issue has been closed because it has not received response from the issue author. -- This is an automated message from the Apache Git Service. To respond to the

Re: [I] Status of testing of Apache Airflow 2.8.1rc1 [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #36808: URL: https://github.com/apache/airflow/issues/36808#issuecomment-1912842931 > hello! have you goes still facing something like that? i'm using windows 10. Yes. Because You need to use WSL2 if you want to run Airflow on Eindows. Read prerequisites.

[PR] Move CI documentation to inside Breeze docs [airflow]

2024-01-26 Thread via GitHub
potiuk opened a new pull request, #37039: URL: https://github.com/apache/airflow/pull/37039 This PR moves the documentation of CI of ours to inside Breeze doc folder and splits the documentation in separate docs / chapters following similar changes done for Breeze docs #36936 and the contri

Re: [I] Status of testing of Apache Airflow 2.8.1rc1 [airflow]

2024-01-26 Thread via GitHub
gabrielbrittes commented on issue #36808: URL: https://github.com/apache/airflow/issues/36808#issuecomment-1912827561 > All my changes are in and good ! > > Particularly happy with that one: > > ``` > airflow@e6cddae1d57a:/opt/airflow$ AIRFLOW_HOME=./test airflow db init >

Re: [PR] Allow for helm plugin installation to be happening more than once [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37038: URL: https://github.com/apache/airflow/pull/37038#issuecomment-1912722614 Example failure: https://github.com/apache/airflow/actions/runs/7673556789/job/20916435973 -- This is an automated message from the Apache Git Service. To respond to the message, pleas

[PR] Allow for helm plugin installation to be happening more than once [airflow]

2024-01-26 Thread via GitHub
potiuk opened a new pull request, #37038: URL: https://github.com/apache/airflow/pull/37038 In our current CI setup, helm plugin could sometimes be installed already (because we do not use --ephemeral setup of github workers) This change allows the installation to fails as "already in

(airflow) branch main updated: Update GCP Dataproc ClusterGenerator to support GPU params (#37036)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 770a96f4c5 Update GCP Dataproc ClusterGenerator to

Re: [PR] Update GCP Dataproc ClusterGenerator to support GPU params [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #37036: URL: https://github.com/apache/airflow/pull/37036 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] UI: DAG Conf Parameters Form - Param Type of Boolean, Null converted to String for JSON config [airflow]

2024-01-26 Thread via GitHub
mblakely commented on issue #36369: URL: https://github.com/apache/airflow/issues/36369#issuecomment-1912713796 @jscheffl sorry for the delay. That is a great question, at a high level, the goal is to create an optional parameter so that code which the DAG calls can define a default.

Re: [PR] fix task_instance can not get task attribute correctly when turning on sentry [airflow]

2024-01-26 Thread via GitHub
potiuk closed pull request #36968: fix task_instance can not get task attribute correctly when turning on sentry URL: https://github.com/apache/airflow/pull/36968 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL ab

Re: [PR] Remove superfluous `@Sentry.enrich_errors` [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #37002: URL: https://github.com/apache/airflow/pull/37002 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Update GCP Dataproc ClusterGenerator to support GPU params [airflow]

2024-01-26 Thread via GitHub
dmedora commented on PR #37036: URL: https://github.com/apache/airflow/pull/37036#issuecomment-1912710722 Thanks @potiuk, all tests passed, ready to merge. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

(airflow) branch main updated: Remove superfluous `@Sentry.enrich_errors` (#37002)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 45b6b7a7a3 Remove superfluous `@Sentry.enrich_error

Re: [I] Scheduler exceptions when Sentry and schedule_after_task_execution are enabled [airflow]

2024-01-26 Thread via GitHub
potiuk closed issue #36957: Scheduler exceptions when Sentry and schedule_after_task_execution are enabled URL: https://github.com/apache/airflow/issues/36957 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above

(airflow) branch main updated: Adding Amazon Neptune Hook and Operators (#37000)

2024-01-26 Thread eladkal
This is an automated email from the ASF dual-hosted git repository. eladkal pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 004d1d3a84 Adding Amazon Neptune Hook and Operator

Re: [PR] Adding Amazon Neptune Hook and Operators [airflow]

2024-01-26 Thread via GitHub
eladkal merged PR #37000: URL: https://github.com/apache/airflow/pull/37000 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.

Re: [I] Add AWS Neptune hook and operators [airflow]

2024-01-26 Thread via GitHub
eladkal closed issue #28289: Add AWS Neptune hook and operators URL: https://github.com/apache/airflow/issues/28289 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscri

(airflow) branch main updated: Add coding rule for operators to avoid logic in constructors (#37035)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new acc81213e6 Add coding rule for operators to avoid l

Re: [PR] Add coding rule for operators to avoid logic in constructors [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #37035: URL: https://github.com/apache/airflow/pull/37035 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Rebuild pgbouncer and pgbouncer-exporter images with newer versions [airflow]

2024-01-26 Thread via GitHub
ahipp13 commented on PR #36898: URL: https://github.com/apache/airflow/pull/36898#issuecomment-1912657061 I have tested these images (airflow-pgbouncer-exporter-2024.01.19-0.16.0 and airflow-pgbouncer-2024.01.19-1.21.0) in my 3 airflow environments (Airflow version 2.6.3 helm chart version

Re: [PR] Update GCP Dataproc ClusterGenerator to support GPU params [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37036: URL: https://github.com/apache/airflow/pull/37036#issuecomment-1912621963 Some static/spellcheck fixes needed -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the sp

Re: [PR] Remove superfluous `@Sentry.enrich_errors` [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37002: URL: https://github.com/apache/airflow/pull/37002#issuecomment-1912618291 Yes. The MyPy issues are (somewhat) releated seems that your changes triggered it. Unfortunately MyPy checks are based on heuristics, and it sometimes only starts detecting issues after

Re: [I] Pendulum 3.0.0 broke DBAPI interaction [airflow]

2024-01-26 Thread via GitHub
potiuk closed issue #37032: Pendulum 3.0.0 broke DBAPI interaction URL: https://github.com/apache/airflow/issues/37032 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubs

(airflow) branch main updated: Use execution_date= param as a backup to base date for grid view (#37018)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new fee7e33983 Use execution_date= param as a backup to

Re: [PR] Use execution_date= param as a backup to base date for grid view [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #37018: URL: https://github.com/apache/airflow/pull/37018 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] Links to specific dagruns don't work when older than 25 runs [airflow]

2024-01-26 Thread via GitHub
potiuk closed issue #34723: Links to specific dagruns don't work when older than 25 runs URL: https://github.com/apache/airflow/issues/34723 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the speci

Re: [PR] Adding Amazon Neptune Hook and Operators [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37000: URL: https://github.com/apache/airflow/pull/37000#issuecomment-1912608008 LGTM @Lee-W @Taragolis @eladkal ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [I] [Docker-compose] apache-airflow-providers-daskexecutor FileNotFoundError(2, 'No such file or directory') [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #37024: URL: https://github.com/apache/airflow/issues/37024#issuecomment-1912606384 Actually- if you want, you can still continue using the dask executor that is released. Just build custom image where you install the provider and it **should work**. But yes, if th

Re: [I] Bad UI performance on "Add Dag Run" (/dagrun/add) with many task instances [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #37026: URL: https://github.com/apache/airflow/issues/37026#issuecomment-1912604019 Yes. you can clean stuff with `airflow db clean` command (see the docs).. Not sure if the current behaviour can be easily improved. One way to do it is to replace the drop-down with

(airflow) branch main updated: fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. (#36954)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new edce53582c fix: DagRuns with UPSTREAM_FAILED tasks

Re: [I] dag stuck in "running" status when running in backfill job [airflow]

2024-01-26 Thread via GitHub
potiuk closed issue #34448: dag stuck in "running" status when running in backfill job URL: https://github.com/apache/airflow/issues/34448 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specifi

Re: [PR] fix: DagRuns with UPSTREAM_FAILED tasks get stuck in the backfill. [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36954: URL: https://github.com/apache/airflow/pull/36954 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: fix for role and permission count in export (#36589)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new ce246c0ed8 fix for role and permission count in exp

Re: [PR] fix for role and permission count in airflow export cli command [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36589: URL: https://github.com/apache/airflow/pull/36589 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[PR] Update GCP Dataproc ClusterGenerator to support GPU params [airflow]

2024-01-26 Thread via GitHub
dmedora opened a new pull request, #37036: URL: https://github.com/apache/airflow/pull/37036 Updated Google Cloud Dataproc operator's ClusterGenerator to support GPU accelerator configuration parameters. --- **^ Add meaningful description above** Read the **[Pull Request Gu

(airflow) branch main updated: Add data_interval_start and data_interval_end in dagrun create API endpoint (#36630)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 714a9a79a5 Add data_interval_start and data_interva

Re: [PR] Add data_interval_start and data_interval_end in dagrun create API endpoint [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36630: URL: https://github.com/apache/airflow/pull/36630 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Remove superfluous `@Sentry.enrich_errors` [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37002: URL: https://github.com/apache/airflow/pull/37002#issuecomment-1912577102 Let's see. Rebased the PR. For the future @jkramer-ginkgo - the best way to check failing checks is to rebase. Super easy in GitHub - with Rebase button. -- This is an automated messag

Re: [PR] Fix assignment of template field in `__init__` in `custom_job` [airflow]

2024-01-26 Thread via GitHub
potiuk commented on code in PR #36789: URL: https://github.com/apache/airflow/pull/36789#discussion_r1468059293 ## airflow/providers/google/cloud/operators/vertex_ai/custom_job.py: ## @@ -445,9 +445,19 @@ def __init__( self, *, command: Sequence[str] =

Re: [PR] Add coding rule for operators to avoid logic in constructors [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37035: URL: https://github.com/apache/airflow/pull/37035#issuecomment-1912540641 The header changes are needed to fix the lack of TOC in this document (the header's levels were wrong) -- This is an automated message from the Apache Git Service. To respond to the me

Re: [PR] Add coding rule for operators to avoid logic in constructors [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37035: URL: https://github.com/apache/airflow/pull/37035#issuecomment-1912538450 cc: @shahar1 @romsharon98 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific co

[PR] Add coding rule for operators to avoid logic in constructors [airflow]

2024-01-26 Thread via GitHub
potiuk opened a new pull request, #37035: URL: https://github.com/apache/airflow/pull/37035 Related: #36484 #33786 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing

Re: [PR] Fix assignment of template field in `__init__` in `KubernetesPodOperator` [airflow]

2024-01-26 Thread via GitHub
potiuk commented on code in PR #37010: URL: https://github.com/apache/airflow/pull/37010#discussion_r1468017952 ## airflow/providers/cncf/kubernetes/operators/pod.py: ## @@ -309,16 +309,19 @@ def __init__( self.labels = labels or {} self.startup_timeout_seconds

(airflow) branch main updated: Create DataprocStartClusterOperator and DataprocStopClusterOperator (#36996)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 0f2670e7ac Create DataprocStartClusterOperator and

Re: [PR] Create DataprocStartClusterOperator and DataprocStopClusterOperator [airflow]

2024-01-26 Thread via GitHub
boring-cyborg[bot] commented on PR #36996: URL: https://github.com/apache/airflow/pull/36996#issuecomment-1912481625 Awesome work, congrats on your first merged pull request! You are invited to check our [Issue Tracker](https://github.com/apache/airflow/issues) for additional contributions.

Re: [PR] Create DataprocStartClusterOperator and DataprocStopClusterOperator [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36996: URL: https://github.com/apache/airflow/pull/36996 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] Status of testing Providers that were prepared on January 26, 2024 [airflow]

2024-01-26 Thread via GitHub
vizeit commented on issue #36948: URL: https://github.com/apache/airflow/issues/36948#issuecomment-1912479986 Tested #36922 and #37001, working as expected cc: @potiuk -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub a

Re: [I] Button on UI to pause all DAGs [airflow]

2024-01-26 Thread via GitHub
cnkumar20 commented on issue #36994: URL: https://github.com/apache/airflow/issues/36994#issuecomment-1912478677 such a button should also make sure dag-parsing is not paused so when unpause it scheduled tasks picks the latest code at point of time, and any particular dag should still be ab

Re: [I] WORKER_AUTOSCALE should not allow max workers < min workers [airflow]

2024-01-26 Thread via GitHub
RNHTTR commented on issue #35332: URL: https://github.com/apache/airflow/issues/35332#issuecomment-1912454616 Interesting... so this config works in either direction? For example `2,16` works exactly the same as `16,2`? If so, it might make sense to update the docs accordingly. -- This i

Re: [PR] Add Qdrant Provider [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #36805: URL: https://github.com/apache/airflow/pull/36805#issuecomment-1912417454 Ah... Now ... after I refactored the contributing guide - there you need to solve conflicts move things around I am afraid :( .. sorry for that @Anush008 -- This is an automated mess

Re: [PR] Add celery pid suffix to fix duplicate pid issue [airflow]

2024-01-26 Thread via GitHub
pavansharma36 commented on code in PR #36794: URL: https://github.com/apache/airflow/pull/36794#discussion_r1467918497 ## airflow/cli/commands/celery_command.py: ## @@ -170,7 +170,7 @@ def worker(args): "--loglevel", celery_log_level, "--pidfile", -

Re: [I] Celery worker enters a catatonic state after redis restart [airflow]

2024-01-26 Thread via GitHub
dstandish commented on issue #26542: URL: https://github.com/apache/airflow/issues/26542#issuecomment-1912386701 > @dstandish dude, it's passed about 30 minutes since after applying your solution. my celery worker was throwing `connection reset by peer.` errors and freezing very frequently,

Re: [PR] bump: kubernetes client version [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #36684: URL: https://github.com/apache/airflow/pull/36684#issuecomment-1912362381 > @potiuk I'm not available to finish this PR in the next days , should I close it ? cc: @dirrao -> maybe you would like to take that over and open a new one? -- This is an auto

(airflow) branch main updated: Add Constance to triage team (#37033)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new bd06434200 Add Constance to triage team (#37033) bd

Re: [PR] Add Constance to triage team [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #37033: URL: https://github.com/apache/airflow/pull/37033 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

(airflow) branch main updated: Implement deferrable mode for CreateHyperparameterTuningJobOperator (#36594)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 35617620a9 Implement deferrable mode for CreateHyp

Re: [PR] Implement deferrable mode for CreateHyperparameterTuningJobOperator [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36594: URL: https://github.com/apache/airflow/pull/36594 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] Celery worker enters a catatonic state after redis restart [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #26542: URL: https://github.com/apache/airflow/issues/26542#issuecomment-1912349988 > @dstandish dude, it's passed about 30 minutes since after applying your solution. my celery worker was throwing `connection reset by peer.` errors and freezing very frequently, bu

(airflow) branch main updated: Enable '_enable_tcp_keepalive' functionality for GKEPodHook (#36999)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 35daa3462b Enable '_enable_tcp_keepalive' functiona

Re: [PR] Enable '_enable_tcp_keepalive' functionality for GKEPodHook [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36999: URL: https://github.com/apache/airflow/pull/36999 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Enable '_enable_tcp_keepalive' functionality for GKEPodHook [airflow]

2024-01-26 Thread via GitHub
potiuk commented on code in PR #36999: URL: https://github.com/apache/airflow/pull/36999#discussion_r1467870365 ## airflow/providers/google/cloud/hooks/kubernetes_engine.py: ## @@ -352,6 +353,7 @@ def __init__( self, cluster_url: str, ssl_ca_cert: str,

Re: [I] Celery worker enters a catatonic state after redis restart [airflow]

2024-01-26 Thread via GitHub
kim-youngseop-developer commented on issue #26542: URL: https://github.com/apache/airflow/issues/26542#issuecomment-1912341464 @dstandish dude, it's passed about 30 minutes since after applying your solution. my celery worker was throwing `connection reset by peer.` errors and freezin

[I] API Bug: patch a task instance state to skipped crashes. [airflow]

2024-01-26 Thread via GitHub
avandierast opened a new issue, #37034: URL: https://github.com/apache/airflow/issues/37034 ### Apache Airflow version Other Airflow 2 version (please specify below) ### If "Other Airflow 2 version" selected, which one? 2.7.2 ### What happened? Hi :)

Re: [I] API Bug: patch a task instance state to skipped crashes. [airflow]

2024-01-26 Thread via GitHub
boring-cyborg[bot] commented on issue #37034: URL: https://github.com/apache/airflow/issues/37034#issuecomment-1912329955 Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for ap

(airflow) branch main updated: Handle SystemExit raised in the task. (#36986)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new 574d90f217 Handle SystemExit raised in the task. (#

Re: [PR] Handle SystemExit raised in the task. [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36986: URL: https://github.com/apache/airflow/pull/36986 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [I] ShortCircuitOperator does not properly retry when python_callable exits unexpectedly [airflow]

2024-01-26 Thread via GitHub
potiuk closed issue #36809: ShortCircuitOperator does not properly retry when python_callable exits unexpectedly URL: https://github.com/apache/airflow/issues/36809 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[PR] Add Constance to triage team [airflow]

2024-01-26 Thread via GitHub
potiuk opened a new pull request, #37033: URL: https://github.com/apache/airflow/pull/37033 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing-docs/05_pull_requests.rst#pul

(airflow) branch main updated: Small follow-up after splitting contributing docs (#37031)

2024-01-26 Thread potiuk
This is an automated email from the ASF dual-hosted git repository. potiuk pushed a commit to branch main in repository https://gitbox.apache.org/repos/asf/airflow.git The following commit(s) were added to refs/heads/main by this push: new bc0e0d95d4 Small follow-up after splitting contribu

Re: [PR] Small follow-up after splitting contributing docs [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #37031: URL: https://github.com/apache/airflow/pull/37031 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

Re: [PR] Remove superfluous `@Sentry.enrich_errors` [airflow]

2024-01-26 Thread via GitHub
jkramer-ginkgo commented on PR #37002: URL: https://github.com/apache/airflow/pull/37002#issuecomment-1912211423 Retry passed the integration test. Static/mypy checks are unrelated to this PR -- This is an automated message from the Apache Git Service. To respond to the message, please lo

[I] Pendulum 3.0.0 broke DBAPI interaction [airflow]

2024-01-26 Thread via GitHub
rishi-kulkarni opened a new issue, #37032: URL: https://github.com/apache/airflow/issues/37032 ### Apache Airflow version 2.8.1 ### If "Other Airflow 2 version" selected, which one? _No response_ ### What happened? My team uses the provided SQLiteHook to sto

Re: [I] ShortCircuitOperator does not properly retry when python_callable exits unexpectedly [airflow]

2024-01-26 Thread via GitHub
vlieven commented on issue #36809: URL: https://github.com/apache/airflow/issues/36809#issuecomment-1912157884 Hi @avkirilishin, thanks for your work on the PR, it looks like this will definitely improve the behavior! -- This is an automated message from the Apache Git Service. To respond

Re: [I] Dependency Issue with apache-airflow-providers-fab [airflow]

2024-01-26 Thread via GitHub
aashishshrestha09 closed issue #37020: Dependency Issue with apache-airflow-providers-fab URL: https://github.com/apache/airflow/issues/37020 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the spec

Re: [I] Button on UI to pause all DAGs [airflow]

2024-01-26 Thread via GitHub
coolbeans201 commented on issue #36994: URL: https://github.com/apache/airflow/issues/36994#issuecomment-1912145639 If there's a button for this in the UI, we'd definitely want to make sure that only the highest level of roles within a given server have access to this feature. That's probab

Re: [I] WORKER_AUTOSCALE should not allow max workers < min workers [airflow]

2024-01-26 Thread via GitHub
Bowrna commented on issue #35332: URL: https://github.com/apache/airflow/issues/35332#issuecomment-1912134234 @RNHTTR @eladkal @Taragolis could you give me update about the above comment? -- This is an automated message from the Apache Git Service. To respond to the message, please log on

Re: [PR] Small follow-up after splitting contributing docs [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #37031: URL: https://github.com/apache/airflow/pull/37031#issuecomment-1912123177 :facepalm: -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsu

[PR] Small follow-up after splitting contributing docs [airflow]

2024-01-26 Thread via GitHub
potiuk opened a new pull request, #37031: URL: https://github.com/apache/airflow/pull/37031 Yeah, of course #36969 --- **^ Add meaningful description above** Read the **[Pull Request Guidelines](https://github.com/apache/airflow/blob/main/contributing

Re: [PR] Split contributing docs to multiple files [airflow]

2024-01-26 Thread via GitHub
potiuk commented on PR #36969: URL: https://github.com/apache/airflow/pull/36969#issuecomment-1912117628 Boom :) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubsc

Re: [PR] Split contributing docs to multiple files [airflow]

2024-01-26 Thread via GitHub
potiuk merged PR #36969: URL: https://github.com/apache/airflow/pull/36969 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.a

[I] Add a Reset Password button under Security > List Users > Edit user [airflow]

2024-01-26 Thread via GitHub
ecerulm opened a new issue, #37030: URL: https://github.com/apache/airflow/issues/37030 ### Description Currently the way to reset the password via the UI is to go to Security > List Users > Show record (loupe icon) > Show User > Reset Password I think it's counterintuitive th

Re: [I] Add "airflow users change-user-password" [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #37009: URL: https://github.com/apache/airflow/issues/37009#issuecomment-1912093640 It's the right one - it's deprecated only because it's moved with AuthManager implementatiobn (but we have not described it well enough and did not generate swagger/API documentatio

Re: [I] Add a log callback option within Task Instances [airflow]

2024-01-26 Thread via GitHub
potiuk closed issue #36964: Add a log callback option within Task Instances URL: https://github.com/apache/airflow/issues/36964 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment.

Re: [I] Add a log callback option within Task Instances [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #36964: URL: https://github.com/apache/airflow/issues/36964#issuecomment-1912089299 > It does but to a degree - it also forces me to expose API GET endpoints by setting the api.auth.backend to basic_auth or rolling my own API authentication. I'd rather have it bloc

Re: [I] Add "airflow users change-user-password" [airflow]

2024-01-26 Thread via GitHub
ecerulm commented on issue #37009: URL: https://github.com/apache/airflow/issues/37009#issuecomment-1912084855 You also mention Airflow REST API as a way, I found https://airflow.apache.org/docs/apache-airflow/stable/stable-rest-api-ref.html#operation/patch_user but it seems deprecated, is

Re: [I] Add "airflow users change-user-password" [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #37009: URL: https://github.com/apache/airflow/issues/37009#issuecomment-1912079249 > > Click on the "show user" (a small looking glass icon) for a user as an admin and you will see reset password button. > > Ok, found it, well definitely I didn't expect to f

Re: [I] Add "airflow users change-user-password" [airflow]

2024-01-26 Thread via GitHub
ecerulm commented on issue #37009: URL: https://github.com/apache/airflow/issues/37009#issuecomment-1912074947 >Click on the "show user" (a small looking glass icon) for a user as an admin and you will see reset password button. Ok, found it, well definitely I didn't expect to find "r

Re: [I] Add "airflow users change-user-password" [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #37009: URL: https://github.com/apache/airflow/issues/37009#issuecomment-1912062010 Cick on the "show user" (a small looking glass icon) for a user as an admin and you will see `reset password` button. -- This is an automated message from the Apache Git Service.

Re: [I] Add CLI support for bulk pause and resume of DAGs [airflow]

2024-01-26 Thread via GitHub
potiuk commented on issue #36956: URL: https://github.com/apache/airflow/issues/36956#issuecomment-1912050780 > @shahar1 @potiuk I think [this feature request](https://github.com/apache/airflow/issues/36994) could be developed along with the PR for this feature. Or separately. There

  1   2   >