renflo commented on issue #5849: URL: https://github.com/apache/incubator-devlake/issues/5849#issuecomment-1674235622
> Hi @renflo , were these ten projects collecting data at the same time of day? @klesh : i have spread the pipelines over many hours a few months back, because as i mentioned concurrency issues has been a recurring topic. That does help a bit but not all jobs are taking the same amount of time so it's not trivial to spread them correcly - but it's doable (ui support is not great though, i need to click myself in in each project, i've thought of a feature request for that but it can wait). Until concurrency is solved a "run all pipelines for this connection" sequentially would be great. @Startrekzky no, actually i had failed pipelines with just two concurrent pipelines. Also i can add that by running one ine at a time even the slowest ones (ie largest most active repos). So that is also a temporary workaround for me but I really hope you don't close this issue because of it: the usability of the system is really difficult when i have to do so much fiddling and manual operations (eg spread batch job execution by hand,verify pipeline status by hand in each pipeline and the rerun them one by one until they all are green). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
