Re: [I] DAGs disappearing after some idle time [airflow]
ephraimbuddy closed issue #47294: DAGs disappearing after some idle time URL: https://github.com/apache/airflow/issues/47294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ephraimbuddy commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2909732545 Closing this as resolved. @vatsrahul1001 , you can reopen it if you reproduce it again -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
phanikumv commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2908731933 Can we close this @ephraimbuddy ? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ephraimbuddy commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2896828390 > I have not noticed this. But PR: [#50238](https://github.com/apache/airflow/pull/50238) is for some mapped operator fix Possible that the right PR that fixed it was not linked. cc @ashb -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vatsrahul1001 commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2896807232 I have not noticed this. But PR: https://github.com/apache/airflow/pull/50238 is for some mapped operator fix -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ephraimbuddy commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2896797257 This PR: https://github.com/apache/airflow/pull/50238 was marked as solving the issue, as it closed the PR I had for the issue:https://github.com/apache/airflow/pull/48004#issuecomment-2857637757. @vatsrahul1001, are you still experiencing this issue? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vatsrahul1001 commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2889956012 @ashb is this fixed already? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
pierrejeambrun commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2831061397 > Just managed to reproduce this and I think I have a fix. Great to hear -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ashb commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2830472022 Just managed to reproduce this and I think I have a fix. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
kaxil commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2792078105 Let's create a new one when someone can reproduce it -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
kaxil closed issue #47294: DAGs disappearing after some idle time URL: https://github.com/apache/airflow/issues/47294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vikramkoka commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2762042994 Unless someone can reproduce outside of Breeze, I think this should be medium or low, rather than high. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ashb commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2757748181 That said I don't have time right now to devote to looking in to this issue in any more detail. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ashb commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2757747348 If we've been unable to reproduce outside breeze I guess so. I don't love the idea of this happening elsewhere, as in some regards breeze, or running in docker generally, is representative of how many people run Airflow. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vatsrahul1001 commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2757744113 @ashb Since this is happening only in the Breeze environment, I think we should lower the priority to high instead of critical. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
phanikumv commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2728358369 @ephraimbuddy will look into this tomorrow -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vatsrahul1001 commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2724860338 I am again able to reproduce this again. I see below error in DAG Processor `[2025-03-14T14:21:02.057+] {manager.py:970} ERROR - Processor for DagFileInfo(rel_path=PosixPath('metadata_and_inlets/fetch_extra_info.py'), bundle_name='dags-folder', bundle_path=PosixPath('/files/dags'), bundle_version=None) with PID 14418 started 432 ago killing it. 2025-03-14 14:21:02 [debug] Workload process exited[supervisor] exit_code= 2025-03-14 14:21:02 [info ] Process exited [supervisor] exit_code= pid=14418 signal=SIGKILL [2025-03-14T14:21:07.071+] {manager.py:500} INFO - Not time to refresh bundle dags-folder [2025-03-14T14:21:12.135+] {manager.py:500} INFO - Not time to refresh bundle dags-folder` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vatsrahul1001 closed issue #47294: DAGs disappearing after some idle time URL: https://github.com/apache/airflow/issues/47294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vatsrahul1001 commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2716847664 @tirkarthi Thanks for the fix I have verified this and it works well in main now -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
phanikumv commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2716848704 Great work @tirkarthi !! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
tirkarthi commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2716807701 @vatsrahul1001 #47574 is merged now. Can you please test the change in main branch to see if you are still facing dag processor issues? Thanks -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ashb closed issue #47294: DAGs disappearing after some idle time URL: https://github.com/apache/airflow/issues/47294 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
tirkarthi commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2713964434 #47574 should fix the issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
vatsrahul1001 commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2713894100 I am still noticing this issue. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
ashb commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2704534091 Fixed by #47304 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [I] DAGs disappearing after some idle time [airflow]
bbovenzi commented on issue #47294: URL: https://github.com/apache/airflow/issues/47294#issuecomment-2702215779 Yes, I have had to restart my dag processor sometimes while running breeze locally -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org