LuciferYang commented on PR #55579: URL: https://github.com/apache/spark/pull/55579#issuecomment-6570101604
@pan3793 Done in bfc057d, after merging master. `SupportsRuntimeCatalystFiltering`, its three methods and the `plannedPartitions` memo now live in `RuntimePartitionPruningFileScan`, which `ParquetScan`, `OrcScan`, `AvroScan` and `TextBasedFileScan` extend, and `FileScan` is the same as on master. `DataSourceV2FileScanSubclassSuite` covers the shapes from the probe: a Kyuubi-like `FileScan with SupportsRuntimeFiltering`, the same with a SPYT-like cache in `partitions`, and a Sedona-like scan with its own partition type. @dongjoon-hyun this covers items 1, 2 and 4; the description update comes next. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
