Omega359 commented on PR #18635: URL: https://github.com/apache/datafusion/pull/18635#issuecomment-3523077800
> > Just saw this. I was thinking of a 'spark' extension option to handle this myself. > > Could you please elaborate? Do you mean to have a set of spark related config options? If so, I was thinking the same thing one day, but `ansi` may relate to both Spark and DataFusion IMO Essentially yes. Spark seems to have a - let's put this politely - abundance of configuration options. I'm sure more than just the ansi one will apply to DF spark functions at some point. The only real concern I have with having an `ansi` config option in the main df execution config is that it might start to be applied piecemeal outside of the spark crate. Think implicit casting, [normal scalar udfs](https://github.com/Omega359/arrow-datafusion/commit/91e6e26cf43c85fbf3f96c48d7303c7f0e272db6), etc. I'm not against that at all but it's a concern for me because I have my doubts DF itself would (or perhaps even should?) support anything but what spark deems strict ansi mode (ansi = true). It's a topic that likely should get much more community involvement if this was to be used outside of the spark crate. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
