ephraimbuddy commented on issue #50303: URL: https://github.com/apache/airflow/issues/50303#issuecomment-2916778310
This issue is caused by a segmentation fault disrupting the DAG file [loading process](https://github.com/apache/airflow/blob/7fa85e2b4ea09084e40f2dbf09342ff7c96c3e40/airflow-core/src/airflow/models/dagbag.py#L382). When it occurs, the process exits immediately. Since segmentation faults cannot be caught with try...except, one viable solution would be to load DAG file modules in a subprocess. However, I'm thinking this might increase the time it takes to process each file. Wdyt, @jedcunningham? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
