vbarua commented on issue #12223: URL: https://github.com/apache/datafusion/issues/12223#issuecomment-2330309852
From conversations with @Blizzara, the requirement that the DataFusion and Substrait schemas match exactly is stricter than it needs to be. In practice, if the Substrait schema is a subset of the DataFusion schema, the consumer can adapt the plan as it consumes it to make it match the shape expected by Substrait. For example, if DataFusion has a schema `[a, b, c]` for table `t`, and Substrait has a schema `[b, c]` for table `t`, as DataFusion consumes the plan it may add a project for fields `[b,c]` immediately after the read from table `t` to bring it in line with what the Substrait plan expects. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org --------------------------------------------------------------------- To unsubscribe, e-mail: github-unsubscr...@datafusion.apache.org For additional commands, e-mail: github-h...@datafusion.apache.org
