[GitHub] [airflow] potiuk commented on pull request #21825: Add CI jobs and tooling to aid with tracking backtracking pip issues

[GitBox]

potiuk commented on pull request #21825:
URL: https://github.com/apache/airflow/pull/21825#issuecomment-1052132664


   I think this one is ready for review and it should be really helpful in the 
future when analysing `pip resolver` issues.
   
   You can see an example of what happens, here: 
https://github.com/potiuk/airflow/actions/runs/1903230054
   
   If there is a sudden problem with backtracking, there is a "failure" handler 
in the Build Image step and will produce candidates of packages that have been 
updated in the last 1 day:
   
   <img width="1612" alt="Screenshot 2022-02-26 at 14 47 16" 
src="https://user-images.githubusercontent.com/595491/155845696-bb07f46b-b689-4026-88b9-2816574cd6db.png";>
   
   This will not only produce the list and information about those "candidates" 
but also a `pip install` command that we should use to iterate in order to find 
the problem. Detailed instruction on what to do is added in this PR and should 
be avaliable under the link when we merge it.
   
   Also I improved something that we knew needs fixing  (@ashb) - cancelling 
the "waiting" job in case Building Image fails. Rather than finding and 
cancelling job, I simply build and push empty images, which is properly 
detected by the "waiting for image" job:
   
   <img width="1510" alt="Screenshot 2022-02-26 at 14 48 32" 
src="https://user-images.githubusercontent.com/595491/155845795-3f3b0117-c1fa-4b07-aca8-ff5db471adf2.png";>
   
   
   
   
   
   
   
   
   
   
   
   
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscr...@airflow.apache.org

For queries about this service, please contact Infrastructure at:
us...@infra.apache.org