This is an automated email from the ASF dual-hosted git repository.
Rich-T-kid pushed a change to branch alamb/coalesce-copy-rows-safe
in repository https://gitbox.apache.org/repos/asf/arrow-rs.git
from 209188fe7d cleanup
add 2177b8e86f Fix CI on ubuntu-latest (Ubuntu 26.04): use Python 3.12 and
JDK 17 instead of pinning runners (#11799)
add d03274a7f6 bench: add `MutableBuffer::extend`, enhance
`MutableArrayData` (#11742)
add b90914fecd fix(arrow-select): bounds-check take_record_batch once,
with a faster check_bounds for null indices (#11829)
add 3db18f75b4 bench: improve `concat`, `coalesce_kernels` benchmarks
(#11768)
add df4dc3ede5 Run Miri on a daily schedule, require it before releases
(#11631)
add 2a22dd7438 [Variant] Restore object field offsets after failed append
(#11403)
add 9c9b6a0ce5 fix(arrow-select): reject nulls in non-nullable columns in
take_record_batch (#11831)
add 31caa38f5a ci: move several jobs to `ubuntu-slim` runner (#11774)
add f1a5016241 perf(arrow-buffer): divide `i256` by a single word with a
reciprocal on 64-bit targets other than x86_64 (#11580)
add 46a4abb8bc Fix BatchCoalescer::is_empty documentation (#11790)
add afb3d77bda bench: Add 0.5% selectivity to coalesce benchmarks (#11772)
add a1eb450122 Run fork PR test suites in contributor forks (#11788)
add b391e5af7d Update version to `60.1.0` and add CHANGELOG (#11750)
add e1bcd0942b chore(deps): bump black from 26.3.1 to 26.10.1 in
/parquet/pytest (#11847)
add 1731c4ca9b chore(deps): bump the all-other-cargo-deps group across 1
directory with 4 updates (#11863)
add 995a5343fe fix(arrow-select): include column name in BatchCoalescer
errors (#11870)
add 31ee5e0222 ci: serialize docs deploys to asf-site to avoid push races
(#11795)
add b9176b5011 perf: Do not compute the entire byte view buffer size in
`set_source` (#11830)
add 621c22a04f chore(deps): bump the codeql-actions group across 1
directory with 2 updates (#11745)
add dccb297554 chore(deps): bump taiki-e/install-action from 2.87.23 to
2.87.30 (#11746)
add cb1ed6ee3d feat(buffer): add `NullBufferBuilder::append_word` (#11867)
add e53a811f41 [Parquet] Create zstd contexts on first use (#11858)
add 9d7f294ca6 Re-export `GetTableTypesBuilder`, `GetSqlInfoBuilder` and
`GetXdbcTypeInfoBuilder` from `arrow_flight::sql::metadata` (#11846)
add 34bf27befe ci: prevent skipped push checks from bypassing merge queue
(#11894)
add 6db3c54bec chore: Update README release schedule (#11889)
add e0908622a9 [Variant] Add variant_to_json benchmarks (#11773)
add 09bb64ac5c feat(parquet): expose encryption key metadata by column
name (#11733)
add 9a95c6da17 perf(arrow-array): skip `DataType` drop glue in generic
temporal converters (#11896)
add eecf5f3870 fix(arrow-array): reset the lone offset of an empty FFI
byte array (#11661)
add a543411b6a perf(arrow): specialize Boolean filtering (#11732)
add e7c6d29df6 docs(flight): document Flight SQL schema listing (#11897)
add fb88f81d39 fix(arrow-ipc): reject negative FixedSizeBinary byte width
in IPC schema (#11883)
add 08928b340c bench(arrow): cover interleave of lists with primitive
struct children (#11714)
add 258f331c94 fix(arrow-ipc): return an error instead of panicking on
unions with more than 128 fields (#11882)
add a2c689866f bench(ipc): cover LZ4 reader and writer buffer layouts
(#11138)
add 3f1668719d fix(parquet): release bloom filter capacity after folding
(#11701)
add 8953c9014c fix(array-data): return an error on FixedSizeList
validation overflow (#11859)
add 03d40357b7 arrow-select: error on empty input and keep row count for
column-less batches in interleave_record_batch (#11845)
add deeb725611 perf(parquet-variant): Avoid intermediate string
allocations in JSON serialization (#11402)
add b5e7cad208 fix(arrow-data): extend Interval(DayTime) as
IntervalDayTime in MutableArrayData (#11906)
add 5b02c08e6a docs: make fork CI setup harder to miss (#11914)
add 69be95c1d9 chore: port changelog entries to main (#11916)
add a191461997 chore(ci): ignore unaffected tonic zstd advisories (#11922)
add 91c5db296f fix(parquet): apply max_row_group_bytes to the first batch
of a row group (#11798)
add a404d6f9a0 fix(arrow-avro): keep nulls when reading strings as
Utf8View (#11915)
add 16310a9f7b bench(parquet): add FIXED_LEN_BYTE_ARRAY(7) decimal reader
benchmarks with negative values (#11909)
add fafa22b7c5 fix(arrow-cast): parse ISO 8601 timestamps without seconds
(#11179)
add c0fcd708bf fix(arrow-select): preserve nullif nulls for REE and Union
(#10991)
add 0e4a501155 Move remaining decimal adapters into the decimal submodule
(#11078)
add 513c92d5f1 refactor(parquet): simplify row selection normalization and
page scanning (#11687)
add 4eff191376 refactor(parquet): simplify
`expand_to_batch_boundaries_from_selectors` (#11684)
add 87b8013f9f refactor(parquet): share selector intersection and union
traversal (#11688)
add f23b77b6b9 fix(arrow-array): return overflow error instead of
panicking when negating `i32::MIN` months (#11611)
add f7a72ebaa0 Reject merging `Field`s of unions with different modes
(#11827)
add efb25a30d3 fix(arrow-array): make `record_batch!` usable without a
direct `arrow_schema` dependency (#11734)
add 901a171dbf Fix incorrect reversed `DataType::contains` check for union
type (#11826)
add 68cd02d3f9 bench(arrow): cover filtering of nested list types (#11871)
add c0acd1d7c1 fix(parquet): Properly account for boolean lists in Parquet
Thrift skipping code (#11923)
add ef22fc44f3 perf: Optimize appending out-of-line views in `concat`,
`BatchCoalescer` (#11770)
add 0b94195639 fix(arrow-avro): resolve named types declared with a full
name (#11730)
add dc59495122 perf(variant): avoid bracket path string allocations
(#11232)
add 5746b443f7 fix: prevent time64us and time64ns from wrapping
out-of-bounds seconds to valid times (#11899)
add 35b20e63dd refactor(bench) : reuse shared array builders across
benches (#11928)
add fd2b5d156d fix(arrow-ipc): return an error instead of panicking on
out-of-bounds IPC buffers (#11881)
add a45acd6dfc Raise arrow-ipc zstd minimum version to 0.14.3 (#11930)
add 5db01b1fa7 chore: update tonic to 0.14.7 (#11936)
add 6d4142670b chore(deps): bump taiki-e/install-action from 2.87.30 to
2.87.31 (#11934)
add 003546e364 chore(deps): bump actions/setup-python from 7.0.0 to 7.1.0
(#11933)
add 97d0934b26 chore(deps): bump the all-other-cargo-deps group across 1
directory with 2 updates (#11919)
add c544206082 test(arrow-cast): move decimal cast tests to integration
suite (#11645)
add 873c3f1b22 feat(arrow-array): support Date32/Date64 in
record_batch!/create_array! macros (#11962)
add f971a78518 Open an issue when daily Miri checks fail (#11935)
add d9d2d1edf4 perf(coalesce): specialize sparse byte array filters
(#11696)
add 7dcc1602c4 fix(parquet): validate Arrow writer shapes and map-key
schemas (#11838)
add 9532701801 fix(ipc): decode zero-length bodies without EOS (#11967)
add 14c2fef335 fix(arrow-select): merge dictionaries in merge and merge_n
instead of panicking on key overflow (#11925)
add b05fbc7aed refactor: check union type ids directly in
`UnionFields::try_merge` (#11840)
add b858a1f951 fix(arrow-select): merge dictionaries in zip instead of
panicking on key overflow (#11663)
add 6038304119 fix(parquet): count levels, not rows, when marking null
pages in the column index (#11828)
add 81392e3e99 fix(parquet): skip empty CDC page flushes in add_data_page
(#11003)
add fe77e4aa10 Merge branch 'main' into alamb/coalesce-copy-rows-safe
No new revisions were added by this update.
Summary of changes:
.../actions/setup-rustup/action.yaml | 34 +-
.github/ci/scripts/check-ci-config.py | 106 +-
.github/ci/scripts/compute-changes.py | 33 +-
.github/ci/scripts/test-fork-ci-status.cjs | 317 +
.github/pull_request_template.md | 6 +
.github/workflows/README.md | 19 +-
.github/workflows/audit.yml | 8 +-
.github/workflows/ci.yml | 53 +-
.github/workflows/codeql.yml | 4 +-
.github/workflows/dev.yml | 15 +-
.github/workflows/docs.yml | 10 +-
.github/workflows/fork_ci_status.yml | 229 +
.github/workflows/integration.yml | 4 +-
.github/workflows/miri.yaml | 43 +-
.github/workflows/parquet.yml | 9 +-
.github/workflows/release.yml | 2 +-
.github/workflows/rust.yml | 24 +-
CHANGELOG-old.md | 272 +
CHANGELOG.md | 382 +-
CONTRIBUTING.md | 18 +
Cargo.lock | 151 +-
Cargo.toml | 44 +-
README.md | 18 +-
arrow-arith/src/numeric.rs | 25 +
.../src/builder/generic_bytes_view_builder.rs | 28 +-
arrow-array/src/ffi.rs | 82 +-
arrow-array/src/record_batch.rs | 103 +-
arrow-array/src/temporal_conversions.rs | 52 +-
arrow-array/src/types.rs | 45 +-
arrow-avro/src/codec.rs | 88 +-
arrow-avro/src/reader/mod.rs | 22 +
arrow-avro/src/reader/record.rs | 13 +-
arrow-buffer/Cargo.toml | 8 +
arrow-buffer/benches/mutable_buffer_extend.rs | 136 +
arrow-buffer/benches/null_buffer_builder.rs | 59 +
arrow-buffer/src/bigint/div.rs | 246 +
arrow-buffer/src/buffer/immutable.rs | 51 +-
arrow-buffer/src/builder/null.rs | 50 +
arrow-buffer/src/error.rs | 38 +
arrow-buffer/src/lib.rs | 2 +-
arrow-cast/src/cast/decimal.rs | 284 +
arrow-cast/src/cast/mod.rs | 11012 ++++++-------------
arrow-cast/src/parse.rs | 33 +-
arrow-cast/tests/cast/decimal.rs | 3957 +++++++
arrow-cast/tests/cast/mod.rs | 1 +
arrow-data/src/data.rs | 65 +-
arrow-data/src/transform/mod.rs | 15 +-
arrow-flight/Cargo.toml | 4 +-
arrow-flight/README.md | 38 +
arrow-flight/gen/Cargo.toml | 2 +-
arrow-flight/src/arrow.flight.protocol.rs | 22 +
arrow-flight/src/sql/arrow.flight.protocol.sql.rs | 60 +
arrow-flight/src/sql/metadata/mod.rs | 15 +-
arrow-integration-testing/Cargo.toml | 2 +-
arrow-ipc/Cargo.toml | 2 +-
arrow-ipc/benches/ipc_reader.rs | 30 +-
arrow-ipc/benches/ipc_writer.rs | 32 +-
arrow-ipc/src/convert.rs | 52 +-
arrow-ipc/src/reader.rs | 101 +-
arrow-ipc/src/reader/stream.rs | 26 +-
arrow-schema/src/datatype.rs | 69 +-
arrow-schema/src/field.rs | 52 +-
arrow-schema/src/fields.rs | 14 +-
arrow-schema/src/schema.rs | 21 +
arrow-select/src/coalesce.rs | 154 +-
arrow-select/src/coalesce/boolean.rs | 159 +
arrow-select/src/coalesce/byte.rs | 201 +
arrow-select/src/coalesce/byte_view.rs | 45 +-
arrow-select/src/interleave.rs | 36 +-
arrow-select/src/merge.rs | 166 +-
arrow-select/src/nullif.rs | 216 +-
arrow-select/src/take.rs | 281 +-
arrow-select/src/zip.rs | 74 +-
arrow/benches/cast_kernels.rs | 85 +-
arrow/benches/coalesce_kernels.rs | 127 +-
arrow/benches/concatenate_kernel.rs | 44 +-
arrow/benches/filter_kernels.rs | 80 +-
arrow/benches/interleave_kernels.rs | 77 +-
arrow/benches/merge_kernels.rs | 33 +
arrow/benches/mutable_array.rs | 108 +-
arrow/benches/partition_kernels.rs | 22 +-
arrow/benches/primitive_run_take.rs | 18 -
arrow/benches/sort_kernel.rs | 65 +-
arrow/benches/take_kernels.rs | 147 +-
arrow/benches/zip_kernels.rs | 80 +-
arrow/src/util/bench_util.rs | 54 +-
arrow/tests/array_transform.rs | 26 +
dev/release/README.md | 13 +
parquet-variant-compute/benches/variant_kernels.rs | 106 +-
parquet-variant-json/src/to_json.rs | 43 +-
parquet-variant/src/builder/object.rs | 71 +-
parquet-variant/src/path.rs | 17 +
parquet-variant/src/utils.rs | 57 +-
parquet/benches/arrow_reader.rs | 68 +-
parquet/benches/parquet_round_trip.rs | 78 +-
parquet/pytest/requirements.txt | 56 +-
.../src/arrow/arrow_reader/selection/algebra.rs | 123 +-
parquet/src/arrow/arrow_reader/selection/mod.rs | 20 +-
parquet/src/arrow/arrow_reader/selection/ranges.rs | 56 +-
parquet/src/arrow/arrow_writer/mod.rs | 446 +-
parquet/src/bloom_filter/mod.rs | 5 +
parquet/src/column/chunker/cdc.rs | 69 +-
parquet/src/column/writer/mod.rs | 55 +-
parquet/src/compression.rs | 25 +-
parquet/src/encryption/encrypt.rs | 68 +
parquet/src/parquet_thrift.rs | 101 +-
106 files changed, 13664 insertions(+), 8869 deletions(-)
copy arrow-pyarrow-integration-testing/Cargo.toml =>
.github/actions/setup-rustup/action.yaml (56%)
create mode 100644 .github/ci/scripts/test-fork-ci-status.cjs
create mode 100644 .github/workflows/fork_ci_status.yml
create mode 100644 arrow-buffer/benches/mutable_buffer_extend.rs
create mode 100644 arrow-buffer/benches/null_buffer_builder.rs
create mode 100644 arrow-cast/tests/cast/decimal.rs
create mode 100644 arrow-select/src/coalesce/boolean.rs
create mode 100644 arrow-select/src/coalesce/byte.rs
