GitHub user dosubot[bot] edited a comment on the discussion: Pipeline running for days
<!-- Greeting --> Hi @danielemoraschi! I'm [Dosu](https://go.dosu.dev/dosubot) and I’m helping the incubator-devlake team. <!-- Answer --> The log messages showing slow, steady increments in "finished records" for the "Collect Job Runs" step—without errors—usually mean DevLake is still collecting data, but it's progressing very slowly. This often happens with large repositories if the backend runs out of memory or resources. There are two common causes for this: 1. **Resource constraints:** When DevLake runs with limited memory (e.g., 4GB RAM), the backend can freeze or become unresponsive during large data collection tasks, especially with GitHub or Jira. Increasing the container memory to 6GB has resolved similar issues for others, allowing the pipeline to complete successfully on large projects while smaller ones finish quickly regardless of memory limits [[source](https://github.com/apache/incubator-devlake/issues/8480)]. 2. **GitHub GraphQL plugin bugs:** In some versions (notably v1.0.2-beta7), there was a bug where the "Collect Job Runs" task would collect data as check runs, but the extraction step expected check suite data, causing the process to hang or produce incomplete results. Upgrading to v1.0.2-beta8 or later and recollecting data fixes this issue [[source](https://github.com/apache/incubator-devlake/issues/8415)]. Try increasing your DevLake container's memory allocation and make sure you're running the latest version. If you recently upgraded, you may need to recollect data for the affected repositories. <!-- Dosu Comment Footer --> *To reply, just mention [@dosu](https://go.dosu.dev/dosubot?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=reply-with-mention&utm_term=apache%2Fincubator-devlake).* --- Share context across your team and agents. Try [Dosu](https://dosu.dev?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-tagline&utm_term=apache%2Fincubator-devlake). [](https://app.dosu.dev/response-feedback?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-feedback&utm_term=apache%2Fincubator-devlake#message_id=e928c6ef-8883-4001-a195-9fa08a1130e8) [](https://github.dosu.com/apache/incubator-devlake?utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-learn-repo&utm_term=apache%2Fincubator-devlake) [](https://app.dosu.dev/signup?referrer=openSource&source=github-footer&utm_source=github&utm_medium=bot-comment&utm_campaign=github-comment-footer-20260415&utm_content=knowledge-infrastructure-add-team&utm_term=apache%2Fincubator-devlake) GitHub link: https://github.com/apache/incubator-devlake/discussions/8576#discussioncomment-14400995 ---- This is an automatically sent email for [email protected]. To unsubscribe, please send an email to: [email protected]
