nchammas commented on PR #58892: URL: https://github.com/apache/spark/pull/58892#issuecomment-5782092001
> I think a major problem here is that, the more explicit we make the modules, the more manual work is required to make the graph. I don't expect it to be too much work provided that the modules are sufficiently coarse-grained. Making them more explicit is definitely one of changes I'm planning to make as part of [SPARK-59180](https://issues.apache.org/jira/browse/SPARK-59180). Let's continue the discussion here and on the PRs associated with that ticket and its subtasks. I hope we can converge on a good solution that improves our CI test precision while making the build infra easier to understand. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
