This is an automated email from the ASF dual-hosted git repository. blaginin pushed a commit to branch sandbox-main in repository https://gitbox.apache.org/repos/asf/datafusion-sandbox.git
commit 0ffbca61131883b63a41a7816307bce9a26a37c8 Author: blaginin <[email protected]> AuthorDate: Sat Nov 8 14:13:15 2025 +0000 Update sandbox --- .asf.yaml | 95 +++--------------------------------------- README.md | 139 ++------------------------------------------------------------ 2 files changed, 9 insertions(+), 225 deletions(-) diff --git a/.asf.yaml b/.asf.yaml index 99fd6fac2..9345aae23 100644 --- a/.asf.yaml +++ b/.asf.yaml @@ -27,18 +27,7 @@ notifications: discussions: [email protected] jira_options: link label worklog github: - description: "Apache DataFusion SQL Query Engine" - homepage: https://datafusion.apache.org/ - labels: - - arrow - - big-data - - dataframe - - datafusion - - olap - - python - - query-engine - - rust - - sql + description: "DataFusion Test Sandbox" enabled_merge_buttons: squash: true squash_commit_message: PR_TITLE_AND_DESC @@ -47,85 +36,11 @@ github: features: issues: true discussions: true - protected_branches: - main: - required_pull_request_reviews: - required_approving_review_count: 1 - # needs to be updated as part of the release process - # .asf.yaml doesn't support wildcard branch protection rules, only exact branch names - # https://github.com/apache/infrastructure-asfyaml?tab=readme-ov-file#branch-protection - # Keeping set of protected branches for future releases - # Meanwhile creating a prerelease script that will update the branch protection names - # automatically. Keep track on it https://github.com/apache/datafusion/issues/17134 - branch-50: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-51: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-52: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-53: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-54: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-55: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-56: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-57: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-58: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-59: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-60: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-61: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-62: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-63: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-64: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-65: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-66: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-67: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-68: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-69: - required_pull_request_reviews: - required_approving_review_count: 1 - branch-70: - required_pull_request_reviews: - required_approving_review_count: 1 pull_requests: # enable updating head branches of pull requests allow_update_branch: true allow_auto_merge: true - -# publishes the content of the `asf-site` branch to -# https://datafusion.apache.org/ -publish: - whoami: asf-site + protected_branches: + main: + required_pull_request_reviews: + required_approving_review_count: 0 diff --git a/README.md b/README.md index 5191496ea..2a0fa70e7 100644 --- a/README.md +++ b/README.md @@ -17,140 +17,9 @@ under the License. --> -# Apache DataFusion +> [!WARNING] +> This is NOT [DataFusion](https://github.com/apache/datafusion/). -[![Crates.io][crates-badge]][crates-url] -[![Apache licensed][license-badge]][license-url] -[![Build Status][actions-badge]][actions-url] -![Commit Activity][commit-activity-badge] -[![Open Issues][open-issues-badge]][open-issues-url] -[![Discord chat][discord-badge]][discord-url] -[![Linkedin][linkedin-badge]][linkedin-url] -![Crates.io MSRV][msrv-badge] +# DataFusion Sandbox -[crates-badge]: https://img.shields.io/crates/v/datafusion.svg -[crates-url]: https://crates.io/crates/datafusion -[license-badge]: https://img.shields.io/badge/license-Apache%20v2-blue.svg -[license-url]: https://github.com/apache/datafusion/blob/main/LICENSE.txt -[actions-badge]: https://github.com/apache/datafusion/actions/workflows/rust.yml/badge.svg -[actions-url]: https://github.com/apache/datafusion/actions?query=branch%3Amain -[discord-badge]: https://img.shields.io/badge/Chat-Discord-purple -[discord-url]: https://discord.com/invite/Qw5gKqHxUM -[commit-activity-badge]: https://img.shields.io/github/commit-activity/m/apache/datafusion -[open-issues-badge]: https://img.shields.io/github/issues-raw/apache/datafusion -[open-issues-url]: https://github.com/apache/datafusion/issues -[linkedin-badge]: https://img.shields.io/badge/Follow-Linkedin-blue -[linkedin-url]: https://www.linkedin.com/company/apache-datafusion/ -[msrv-badge]: https://img.shields.io/crates/msrv/datafusion?label=Min%20Rust%20Version - -[Website](https://datafusion.apache.org/) | -[API Docs](https://docs.rs/datafusion/latest/datafusion/) | -[Chat](https://discord.com/channels/885562378132000778/885562378132000781) - -<a href="https://datafusion.apache.org/";> - <img src="https://github.com/apache/datafusion/raw/HEAD/docs/source/_static/images/2x_bgwhite_original.png"; width="512" alt="logo"/> -</a> - -DataFusion is an extensible query engine written in [Rust] that -uses [Apache Arrow] as its in-memory format. - -This crate provides libraries and binaries for developers building fast and -feature rich database and analytic systems, customized to particular workloads. -See [use cases] for examples. The following related subprojects target end users: - -- [DataFusion Python](https://github.com/apache/datafusion-python/) offers a Python interface for SQL and DataFrame - queries. -- [DataFusion Comet](https://github.com/apache/datafusion-comet/) is an accelerator for Apache Spark based on - DataFusion. - -"Out of the box," -DataFusion offers [SQL](https://datafusion.apache.org/user-guide/sql/index.html) and [Dataframe](https://datafusion.apache.org/user-guide/dataframe.html) APIs, excellent [performance], -built-in support for CSV, Parquet, JSON, and Avro, extensive customization, and -a great community. - -DataFusion features a full query planner, a columnar, streaming, multi-threaded, -vectorized execution engine, and partitioned data sources. You can -customize DataFusion at almost all points including additional data sources, -query languages, functions, custom operators and more. -See the [Architecture] section for more details. - -[rust]: http://rustlang.org -[apache arrow]: https://arrow.apache.org -[use cases]: https://datafusion.apache.org/user-guide/introduction.html#use-cases -[python bindings]: https://github.com/apache/datafusion-python -[performance]: https://benchmark.clickhouse.com/ -[architecture]: https://datafusion.apache.org/contributor-guide/architecture.html - -Here are links to some important information - -- [Project Site](https://datafusion.apache.org/) -- [Installation](https://datafusion.apache.org/user-guide/cli/installation.html) -- [Rust Getting Started](https://datafusion.apache.org/user-guide/example-usage.html) -- [Rust DataFrame API](https://datafusion.apache.org/user-guide/dataframe.html) -- [Rust API docs](https://docs.rs/datafusion/latest/datafusion) -- [Rust Examples](https://github.com/apache/datafusion/tree/main/datafusion-examples) -- [Python DataFrame API](https://arrow.apache.org/datafusion-python/) -- [Architecture](https://docs.rs/datafusion/latest/datafusion/index.html#architecture) - -## What can you do with this crate? - -DataFusion is great for building projects such as domain specific query engines, new database platforms and data pipelines, query languages and more. -It lets you start quickly from a fully working engine, and then customize those features specific to your use. [Click Here](https://datafusion.apache.org/user-guide/introduction.html#known-users) to see a list known users. - -## Contributing to DataFusion - -Please see the [contributor guide] and [communication] pages for more information. - -[contributor guide]: https://datafusion.apache.org/contributor-guide -[communication]: https://datafusion.apache.org/contributor-guide/communication.html - -## Crate features - -This crate has several [features] which can be specified in your `Cargo.toml`. - -[features]: https://doc.rust-lang.org/cargo/reference/features.html - -Default features: - -- `nested_expressions`: functions for working with nested type function such as `array_to_string` -- `compression`: reading files compressed with `xz2`, `bzip2`, `flate2`, and `zstd` -- `crypto_expressions`: cryptographic functions such as `md5` and `sha256` -- `datetime_expressions`: date and time functions such as `to_timestamp` -- `encoding_expressions`: `encode` and `decode` functions -- `parquet`: support for reading the [Apache Parquet] format -- `sql`: Support for sql parsing / planning -- `regex_expressions`: regular expression functions, such as `regexp_match` -- `unicode_expressions`: Include unicode aware functions such as `character_length` -- `unparser`: enables support to reverse LogicalPlans back into SQL -- `recursive_protection`: uses [recursive](https://docs.rs/recursive/latest/recursive/) for stack overflow protection. - -Optional features: - -- `avro`: support for reading the [Apache Avro] format -- `backtrace`: include backtrace information in error messages -- `parquet_encryption`: support for using [Parquet Modular Encryption] -- `pyarrow`: conversions between PyArrow and DataFusion types -- `serde`: enable arrow-schema's `serde` feature - -[apache avro]: https://avro.apache.org/ -[apache parquet]: https://parquet.apache.org/ -[parquet modular encryption]: https://parquet.apache.org/docs/file-format/data-pages/encryption/ - -## DataFusion API Evolution and Deprecation Guidelines - -Public methods in Apache DataFusion evolve over time: while we try to maintain a -stable API, we also improve the API over time. As a result, we typically -deprecate methods before removing them, according to the [deprecation guidelines]. - -[deprecation guidelines]: https://datafusion.apache.org/contributor-guide/api-health.html - -## Dependencies and `Cargo.lock` - -Following the [guidance] on committing `Cargo.lock` files, this project commits -its `Cargo.lock` file. - -CI uses the committed `Cargo.lock` file, and dependencies are updated regularly -using [Dependabot] PRs. - -[guidance]: https://blog.rust-lang.org/2023/08/29/committing-lockfiles.html -[dependabot]: https://docs.github.com/en/code-security/dependabot/working-with-dependabot +This repo is a sandbox for experimenting with DataFusion CI. **Do not use this repo for anything else.** \ No newline at end of file --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
![https://github.com/apache/datafusion/raw/HEAD/docs/source/_static/images/2x_bgwhite_original.png"](https://github.com/apache/datafusion/raw/HEAD/docs/source/_static/images/2x_bgwhite_original.png"){kind=link}