szafonimateusz-mi commented on PR #18481: URL: https://github.com/apache/nuttx/pull/18481#issuecomment-3989575373
@lupyuen hi, this adds only 15 minutes to total CI execution time: <img width="1422" height="122" alt="image" src="https://github.com/user-attachments/assets/3026cfad-524e-4fc2-a4fc-f62ab1d0b671"; /> <img width="1396" height="120" alt="image" src="https://github.com/user-attachments/assets/ecd1d8d7-7238-4713-a95a-ed391dd4c248"; /> Each NTFC run returns a report of the test execution time, so it should be possible to extract this information from the CI logs for monitoring purposes. But I've never done it. The more tests we run, the longer it will take. The longest tests are the LPT tests that are enabled now only for the sim and risc-v 32bit targets. I think that automated testing with NTFC is much more valuable than building a lot of small configurations that basically test nothing and duplicate compilation coverage. We can get more benefits by disabling some of the builds than by disabling NTFC, e.g., by selecting specific configurations to compile, instead of compiling all the configs in boards. Unfortunately, this is a lot of work. Regarding disabling NTFC for nuttx-apps, this is also problematic because we lose coverage for apps. Disabling NTFC for releases probably makes more sense. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
