Weixin-Xu commented on code in PR #13492:
URL: https://github.com/apache/gluten/pull/13492#discussion_r4421410492
##########
backends-bolt/src-delta/main/scala/org/apache/gluten/component/BoltDeltaComponent.scala:
##########
@@ -37,7 +37,10 @@ class BoltDeltaComponent extends Component {
val legacy = injector.gluten.legacy
legacy.injectTransform {
c =>
- val offload = Seq(OffloadDeltaScan(), OffloadDeltaProject(),
OffloadDeltaFilter())
+ val offload = Seq(
+ OffloadDeltaScan(enableNativeDmlRowIndexScan = true),
Review Comment:
Added a Bolt-specific Delta scan eligibility check. Scans selecting files
with deletion vectors now remain on Spark, preserving Spark’s DV filtering.
When the selected files cannot be safely determined, DV-capable snapshots also
fall back conservatively. Added regression coverage for DV reads, including
existing DVs after the table property is disabled.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: [email protected]
For queries about this service, please contact Infrastructure at:
[email protected]
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
