rizzabhdwaj commented on issue #300: URL: https://github.com/apache/datafusion-spark/issues/300#issuecomment-6911250906
Looking into this, SessionStateBuilder::with_config() replaces the entire SessionConfig, so this behavior can affect other configuration extensions too, not just SparkOptions. I understand that replacement may be intentional. Should the solution stay specific to Spark, or should we discuss a broader extension-preservation mechanism in DataFusion core? For now, the PR documents calling with_config() before with_spark_features(). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
