[
https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17261670#comment-17261670
]
Hyukjin Kwon commented on SPARK-34053:
--------------------------------------
BTW, i have been contacting GitHub to address this resource issue separately
few days ago.
There are already too many repos in ASF organisation, and we Spark have tried
to reduce the matrix. Actually there are more combinations to test but we're
currently not adding them due the the resource issue.
> Please reduce GitHub Actions matrix or improve the build time
> -------------------------------------------------------------
>
> Key: SPARK-34053
> URL: https://issues.apache.org/jira/browse/SPARK-34053
> Project: Spark
> Issue Type: Bug
> Components: Project Infra
> Affects Versions: 3.0.1, 3.1.0, 3.2.0
> Reporter: Vladimir Sitnikov
> Priority: Critical
> Attachments: Screen Shot 2021-01-08 at 2.57.07 PM.png
>
>
> GitHub Actions queue is very high for Apache projects, and it looks like a
> significant number of executors are occupied by Spark jobs :-(
> Note: all Apache projects share the same limit of shared GitHub Actions
> runners, and based on the chart below Spark is consuming 20+ runners while
> the total limit (for all ASF projects) is 180.
> See
> https://lists.apache.org/thread.html/r5303eec41cc1dfc51c15dbe44770e37369330f9644ef09813f649120%40%3Cbuilds.apache.org%3E
> >number of GA workflows in/progress/queued per project and they clearly show
> >the situation is getting worse by day: https://pasteboard.co/JIJa5Xg.png
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
