andygrove opened a new issue, #4963:
URL: https://github.com/apache/datafusion-comet/issues/4963
Spark 4.2 adds a "SQL Last Attempt Metric" (SLAM) feature and test suites
that assert on the metric value recorded for a query's executed plan.
When Comet is enabled, Comet replaces the Spark operators with native
equivalents and the SLAM metric value is not propagated through the plan, so
`lastAttemptValueForDataset` / `lastAttemptValueForHighestRDDId` return `None`.
Affected Spark SQL test suites (currently marked `IgnoreComet` /
`IgnoreCometSuite` in `dev/diffs/4.2.0.diff`):
- `SQLLastAttemptMetricPlanShapesSuite` (whole suite)
- `MetricsFailureInjectionSuite` (whole suite)
- `SQLLastAttemptMetricIntegrationSuite` ("dataset updates")
Part of #4142 (Track Spark 4.2 test failures).
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
