[
https://issues.apache.org/jira/browse/SPARK-34053?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17262325#comment-17262325
]
Dongjoon Hyun commented on SPARK-34053:
---------------------------------------
For the record, this will kill the previous commit's run.
Although we know the behavior change, Apache Spark community merge this
approach because it's inevitable until Apache project has enough resource pool
or better management in GitHub Action runners.
> Please reduce GitHub Actions matrix or improve the build time
> -------------------------------------------------------------
>
> Key: SPARK-34053
> URL: https://issues.apache.org/jira/browse/SPARK-34053
> Project: Spark
> Issue Type: Bug
> Components: Project Infra
> Affects Versions: 3.0.1, 3.1.0, 3.2.0
> Reporter: Vladimir Sitnikov
> Assignee: Kamil Bregula
> Priority: Critical
> Fix For: 3.2.0
>
> Attachments: Screen Shot 2021-01-08 at 2.57.07 PM.png
>
>
> GitHub Actions queue is very high for Apache projects, and it looks like a
> significant number of executors are occupied by Spark jobs :-(
> Note: all Apache projects share the same limit of shared GitHub Actions
> runners, and based on the chart below Spark is consuming 20+ runners while
> the total limit (for all ASF projects) is 180.
> See
> https://lists.apache.org/thread.html/r5303eec41cc1dfc51c15dbe44770e37369330f9644ef09813f649120%40%3Cbuilds.apache.org%3E
> >number of GA workflows in/progress/queued per project and they clearly show
> >the situation is getting worse by day: https://pasteboard.co/JIJa5Xg.png
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
