pimguilherme commented on issue #7099: URL: https://github.com/apache/incubator-devlake/issues/7099#issuecomment-2020615780
sounds good @klesh, thanks! :smile: we have been able to run 3 parallel pipelines very stable in this fashion.. we did a few load tests and I think the summary for being able to cope with parallelism in devlake is that it is ideal to have 1 CPU + 4 GB memory on a MySQL database per parallel pipeline so, for 3 pipelines in parallel, at least 3 CPUs and 12 GB memory.. at least in our setup, devlake is quite CPU intensive on the database during some pipeline steps (specially the dora calculation on bigger repos I think, but without further investigation yet) as for the devlake process itself, we have been running it with 3Gi memory and it doesnt seem to be very CPU intensive we basically use the Github connector (without issue tracking) for all our repos, and DORA and Azure Devops for some we haven't hit any rate limits on github yet :raised_hands: thanks for the support! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected]
