[ https://issues.apache.org/jira/browse/SPARK-3431?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14234783#comment-14234783 ]
Nicholas Chammas commented on SPARK-3431: ----------------------------------------- As an aside, I expect there to be some work required to let certain tests play nicely with one another. But if we figure out how to specify test groupings and make sure the forked JVMs are configured correctly, refactoring tests where necessary should be very doable. > Parallelize execution of tests > ------------------------------ > > Key: SPARK-3431 > URL: https://issues.apache.org/jira/browse/SPARK-3431 > Project: Spark > Issue Type: Improvement > Components: Build > Reporter: Nicholas Chammas > > Running all the tests in {{dev/run-tests}} takes up to 2 hours. A common > strategy to cut test time down is to parallelize the execution of the tests. > Doing that may in turn require some prerequisite changes to be made to how > certain tests run. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org