goutamadwant opened a new pull request, #24179: URL: https://github.com/apache/datafusion/pull/24179
## Which issue does this PR close? - Closes #24146. ## Rationale for this change `datafusion-cli` does not currently register the `datafusion-spark` function library, so Spark-compatible functions cannot be explored interactively. Registering them by default would silently override core DataFusion functions with the same names and could change existing CLI behavior. ## What changes are included in this PR? - Add a `--spark` CLI flag. - Register Spark-compatible scalar, aggregate, and window functions only when the flag is enabled. - Add CLI integration coverage for both the default and opt-in paths. - Document the flag and its function-override behavior. ## Are these changes tested? Yes. The following checks pass: - `cargo test -p datafusion-cli --test cli_integration spark_functions_require_opt_in` - `cargo test -p datafusion-cli --all-targets` - `cargo fmt --all -- --check` - `cargo clippy --all-targets --all-features -- -D warnings` - `./ci/scripts/doc_prettier_check.sh` - `./ci/scripts/license_header.sh` - `./ci/scripts/typos_check.sh` - `./ci/scripts/rust_docs.sh` ## Are there any user-facing changes? Yes. Users can pass `--spark` to enable Spark-compatible functions for the CLI session. The option is disabled by default, so existing CLI behavior is unchanged. When enabled, Spark-compatible functions override DataFusion functions with the same name. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
