maxirus commented on issue #6643: [AIRFLOW-6040] Fix KubernetesJobWatcher Read 
time out error
URL: https://github.com/apache/airflow/pull/6643#issuecomment-595017078
 
 
   @sbrandtb You shouldn't catch (and subsequently ignore) a 
connection/response timeout error. `_request_timeout` is setting the connection 
timeout and response timeout for the underlying urllib3 library. This timeout 
is being hit because Watcher sends no data back when it doesn't have any 
matches for it's query (it's a stream). This will hide the real error when 
there's a case of the API server not responding. 
   
   Setting `timeout_seconds` is telling the Watcher to just stop watching and 
allow processing to continue. This PR is the proper fix as it's gracefully 
handling the case where there are no active pods (airflow tasks) running with 
this particular uuid and the API server has no data about them.
   
   @ashb @dimberman I would suggest taking another look at PR #7616 

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org


With regards,
Apache Git Services

Reply via email to