This is an automated email from the ASF dual-hosted git repository.
jiayuliu pushed a change to branch upgrade-to-support-311
in repository https://gitbox.apache.org/repos/asf/arrow-datafusion-python.git
omit 61cfee5 upgrade to support python 3.11
add 3711c73 Add Python script for generating changelog (#383)
add 82b4a95 Update for DataFusion 25.0.0 (#386)
add d912db5 Add Expr::Case when_then_else support to rex_call_operands
function (#388)
add 5664a1e Introduce BaseSessionContext abstract class (#390)
add 931cabc CRUD Schema support for `BaseSessionContext` (#392)
add 51158bd CRUD Table support for `BaseSessionContext` (#394)
add 1174969 Prepare for 26.0.0 release (#410)
add c0be61b LogicalPlan.to_variant() make public (#412)
add 3f81513 Prepare 27.0.0 release (#423)
add 58bdbd8 File based input utils (#433)
add 5793db3 Upgrade to 28.0.0-rc1 (#434)
add 93f8063 Introduces utility for obtaining SqlTable information from a
file like location (#398)
add 309fc48 feat: expose offset in python API (#437)
add ffd1541 Use DataFusion 28 (#439)
add 92ca34b Build Linux aarch64 wheel (#443)
add 1fde8e4 feat: add case function (#447) (#448)
add e34d203 enhancement(docs): Add user guide (#432) (#445)
add 37c91f4 docs: include pre-commit hooks section in contributor guide
(#455)
add e1b3740 feat: add compression options (#456)
add 0b22c97 Upgrade to DF 28.0.0-rc1 (#457)
add 217ede8 feat: add register_json (#458)
add 499f045 feat: add basic compression configuration to write_parquet
(#459)
add 9c643bf feat: add example of reading parquet from s3 (#460)
add e24dc75 feat: add register_avro and read_table (#461)
add bc62aaf feat: add missing scalar math functions (#465)
add 944b1c9 build(deps): bump arduino/setup-protoc from 1 to 2 (#452)
add b4d383b Revert "build(deps): bump arduino/setup-protoc from 1 to 2
(#452)" (#474)
add 0d7c19e Minor: fix wrongly copied function description (#497)
add af4f758 Upgrade to Datafusion 31.0.0 (#491)
add beabf26 Add `isnan` and `iszero` (#495)
add a47712e Update CHANGELOG and run cargo update (#500)
add 41d65d1 Improve release process documentation (#505)
add 106786a add Binary String Functions (#494)
add c574d68 build(deps): bump mimalloc from 0.1.38 to 0.1.39 (#502)
add 31241f8 build(deps): bump syn from 2.0.32 to 2.0.35 (#503)
add 9ef0a57 build(deps): bump syn from 2.0.35 to 2.0.37 (#506)
add 8e430ab Use latest DataFusion (#511)
add 4c7b14c add bit_and,bit_or,bit_xor,bool_add,bool_or (#496)
add 804d0eb Use DataFusion 32 (#515)
add a91188c add first_value last_value (#498)
add 484ed11 build(deps): bump regex-syntax from 0.7.5 to 0.8.1 (#517)
add c4675b7 build(deps): bump pyo3-build-config from 0.19.2 to 0.20.0
(#516)
add 5ec45dd add regr_* functions (#499)
add 399fa75 feat: expose PyWindowFrame (#509)
add c2768d8 Add random missing bindings (#522)
add 59140f2 build(deps): bump rustix from 0.38.18 to 0.38.19 (#523)
add 1a18099 upgrade to support python 3.11
This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version. This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:
* -- * -- B -- O -- O -- O (61cfee5)
\
N -- N -- N refs/heads/upgrade-to-support-311 (1a18099)
You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.
Any revisions marked "omit" are not gone; other references still
refer to them. Any revisions marked "discard" are gone forever.
No new revisions were added by this update.
Summary of changes:
.github/workflows/build.yml | 30 +
.gitignore | 8 +-
CHANGELOG.md | 93 +-
Cargo.lock | 2247 +++++++-------------
Cargo.toml | 24 +-
README.md | 6 +-
datafusion/__init__.py | 2 +
datafusion/context.py | 142 ++
datafusion/cudf.py | 54 +-
.../rust_fmt.sh => datafusion/input/__init__.py | 9 +-
datafusion/{tests/conftest.py => input/base.py} | 49 +-
datafusion/input/location.py | 87 +
datafusion/pandas.py | 44 +-
datafusion/polars.py | 36 +-
datafusion/tests/test_aggregation.py | 70 +-
datafusion/tests/test_context.py | 48 +-
datafusion/tests/test_dataframe.py | 119 +-
datafusion/tests/test_expr.py | 8 +
datafusion/tests/test_functions.py | 206 +-
datafusion/{common.py => tests/test_input.py} | 16 +-
datafusion/tests/test_sql.py | 100 +-
datafusion/tests/test_store.py | 2 +-
datafusion/tests/test_substrait.py | 4 +-
dev/release/README.md | 86 +-
dev/release/generate-changelog.py | 123 ++
dev/release/rat_exclude_files.txt | 3 +-
docs/mdbook/src/usage/create-table.md | 2 +-
docs/requirements.txt | 4 +-
docs/source/api.rst | 1 -
docs/source/conf.py | 1 +
docs/source/contributor-guide/introduction.rst | 94 +
docs/source/index.rst | 263 +--
docs/source/user-guide/basics.rst | 89 +
.../user-guide/common-operations/aggregations.rst | 60 +
.../user-guide/common-operations/basic-info.rst | 61 +
.../user-guide/common-operations/functions.rst | 117 +
.../common-operations/index.rst} | 20 +-
docs/source/user-guide/common-operations/joins.rst | 104 +
.../common-operations/select-and-filter.rst | 67 +
.../user-guide/common-operations/udf-and-udfa.rst | 85 +
.../user-guide/common-operations/windows.rst | 93 +
.../introduction.rst} | 32 +-
.../io/avro.rst} | 19 +-
docs/source/{api.rst => user-guide/io/csv.rst} | 28 +-
.../expression.rst => user-guide/io/index.rst} | 15 +-
docs/source/{api.rst => user-guide/io/json.rst} | 21 +-
docs/source/{api.rst => user-guide/io/parquet.rst} | 28 +-
.../{api/dataframe.rst => user-guide/sql.rst} | 26 +-
examples/sql-on-cudf.py | 2 +-
examples/sql-on-pandas.py | 2 +-
examples/sql-on-polars.py | 2 +-
.../{dataframe-parquet.py => sql-parquet-s3.py} | 24 +-
src/catalog.rs | 4 +-
src/common.rs | 7 +
src/common/data_type.rs | 110 +-
src/common/df_field.rs | 2 +-
src/common/function.rs | 55 +
src/common/schema.rs | 225 ++
src/context.rs | 146 +-
src/dataframe.rs | 84 +-
src/dataset.rs | 2 +-
src/dataset_exec.rs | 15 +-
src/expr.rs | 114 +-
src/expr/aggregate.rs | 49 +
src/expr/{in_list.rs => conditional_expr.rs} | 43 +-
src/expr/create_view.rs | 15 +-
src/expr/indexed_field.rs | 9 +-
src/expr/join.rs | 14 +
src/expr/literal.rs | 2 +-
src/expr/projection.rs | 4 +-
src/expr/scalar_function.rs | 2 +-
src/expr/sort.rs | 4 +
src/expr/subquery.rs | 44 +
src/expr/table_scan.rs | 26 +-
src/functions.rs | 126 +-
src/lib.rs | 2 +
src/physical_plan.rs | 2 +-
src/pyarrow_filter_expression.rs | 6 +-
src/record_batch.rs | 2 +-
src/sql/logical.rs | 6 +-
src/substrait.rs | 6 +-
src/udaf.rs | 38 +-
src/udf.rs | 2 +-
src/window_frame.rs | 110 +
84 files changed, 4109 insertions(+), 2043 deletions(-)
create mode 100644 datafusion/context.py
copy ci/scripts/rust_fmt.sh => datafusion/input/__init__.py (90%)
mode change 100755 => 100644
copy datafusion/{tests/conftest.py => input/base.py} (52%)
create mode 100644 datafusion/input/location.py
copy datafusion/{common.py => tests/test_input.py} (63%)
create mode 100755 dev/release/generate-changelog.py
create mode 100644 docs/source/contributor-guide/introduction.rst
create mode 100644 docs/source/user-guide/basics.rst
create mode 100644 docs/source/user-guide/common-operations/aggregations.rst
create mode 100644 docs/source/user-guide/common-operations/basic-info.rst
create mode 100644 docs/source/user-guide/common-operations/functions.rst
copy docs/source/{api.rst => user-guide/common-operations/index.rst} (83%)
create mode 100644 docs/source/user-guide/common-operations/joins.rst
create mode 100644
docs/source/user-guide/common-operations/select-and-filter.rst
create mode 100644 docs/source/user-guide/common-operations/udf-and-udfa.rst
create mode 100644 docs/source/user-guide/common-operations/windows.rst
copy docs/source/{api/execution_context.rst => user-guide/introduction.rst}
(58%)
copy docs/source/{api/execution_context.rst => user-guide/io/avro.rst} (72%)
copy docs/source/{api.rst => user-guide/io/csv.rst} (68%)
copy docs/source/{api/expression.rst => user-guide/io/index.rst} (87%)
copy docs/source/{api.rst => user-guide/io/json.rst} (69%)
copy docs/source/{api.rst => user-guide/io/parquet.rst} (65%)
copy docs/source/{api/dataframe.rst => user-guide/sql.rst} (59%)
copy examples/{dataframe-parquet.py => sql-parquet-s3.py} (61%)
create mode 100644 src/common/function.rs
create mode 100644 src/common/schema.rs
copy src/expr/{in_list.rs => conditional_expr.rs} (50%)
create mode 100644 src/window_frame.rs
