BasPH opened a new pull request, #34487:
URL: https://github.com/apache/airflow/pull/34487
This PR implements a filesystem listener to immediately process changes in
the DAGs folder.
Still some TODOs but creating the PR for testing/feedback.
closes: https://github.com/apache/ai
github-actions[bot] commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-1857050587
This pull request has been automatically marked as stale because it has not
had recent activity. It will be closed in 5 days if no further activity occurs.
Thank you for you
BasPH commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-1858741935
Bump
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe,
potiuk commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-1858934930
I guess resolving conflicts and rebasing would be good
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL ab
BasPH commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-1860039192
Yes, need to find time to sit down and finish this
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above t
github-actions[bot] commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-2041658627
This pull request has been automatically marked as stale because it has not
had recent activity. It will be closed in 5 days if no further activity occurs.
Thank you for you
github-actions[bot] closed pull request #34487: Add watchdog for immediately
processing changes in the DAGs folder
URL: https://github.com/apache/airflow/pull/34487
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL
Michalosu commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-1956175285
+1, waiting for this nice feature :pray:
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go
cmarteepants commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-1921605523
@BasPH Just curious where we are - do you think you'll have time to get this
in for 2.9?
--
This is an automated message from the Apache Git Service.
To respond to the message, p
jscheffl commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-2118762342
@BasPH You presented this last summit, was eagerly waiting on this - were
you dragged to other priorities or missing support making this to main? Or
technical limitations? Would be gre
BasPH commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-2120314813
Hi @jscheffl, unfortunately life got in the way of investing time in OSS
work the last year.
The essentials are there but I was working on integrating this code nicely
with Airflow
kaxil commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-2122746104
My 2 cents:
For AF 3: Would move the callbacks and stuff to the workers or separate
components
For Option (2): How much less work is it? :)
--
This is an automated me
potiuk commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-2122934731
> For AF 3: Would move the callbacks and stuff to the workers or separate
components
Agree.
--
This is an automated message from the Apache Git Service.
To respond to the me
BasPH commented on PR #34487:
URL: https://github.com/apache/airflow/pull/34487#issuecomment-2172850732
> For Option (2): How much less work is it? :)
That will be a lot less work since we don't have to invent a way to handle
callbacks etc. separately.
--
This is an automated messa
troxil commented on code in PR #34487:
URL: https://github.com/apache/airflow/pull/34487#discussion_r1349790150
##
airflow/dag_processing/manager.py:
##
@@ -466,6 +475,12 @@ def __init__(
else {}
)
+dags_directory_event_handler =
AirflowFileSyste
BasPH commented on code in PR #34487:
URL: https://github.com/apache/airflow/pull/34487#discussion_r1349925772
##
airflow/dag_processing/manager.py:
##
@@ -466,6 +475,12 @@ def __init__(
else {}
)
+dags_directory_event_handler =
AirflowFileSystem
16 matches
Mail list logo
