[GitHub] [airflow] XD-DENG commented on a change in pull request #15112: Avoid scheduler/parser manager deadlock by using non-blocking IO

[GitBox]

XD-DENG commented on a change in pull request #15112:
URL: https://github.com/apache/airflow/pull/15112#discussion_r605184402



##########
File path: airflow/utils/dag_processing.py
##########
@@ -141,7 +141,7 @@ def waitable_handle(self):
 class DagParsingStat(NamedTuple):
     """Information on processing progress"""
 
-    file_paths: List[str]
+    num_file_paths: int

Review comment:
       Checking `self._sync_metadata` also leads me to something else:
   
   
https://github.com/apache/airflow/blob/1bec3b21266764f367431ab5d9a5b75f52b9b6d2/airflow/utils/dag_processing.py#L323-L326
 is doing exactly the same thing in `self._process_message()`, which has been 
invoked just before L323-326. 
   
   A clean-up refactor to do? Or I misunderstood something?




-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org