This is an automated email from the ASF dual-hosted git repository.
quinnj pushed a change to branch core-rewrite
in repository https://gitbox.apache.org/repos/asf/arrow-julia.git
at 30181d1 style: apply JuliaFormatter to the rewrite
This branch includes the following new commits:
new 71bd370 Add ArrowCore prove-out: runtime-tagged C-data-shaped core +
IPC/C-data adapter examples
new eba8eca Self-review fixes: seq_cst guard handshake, child-length
checks, identity-keyed dict ids, atomic release, schema release on failed import
new 04d0789 fix(core): harden lifetimes and validation
new b9afada fix(core): serialize concurrent closers
new 49899c8 fix(cdata): enforce tree ownership and release
new c5f218c fix(cdata): close descendant release races
new 11ba1a5 fix(core): enforce field contracts after caching
new 9516ec5 fix(core): validate map names and empty ranges
new fcf9444 fix(core): allow conventional map field names
new 2951444 fix(cdata): preserve moved descendant ownership
new ce92cfe fix(core): support duplicate struct field names
new 9deb269 fix(core): remove unsafe unaligned reinterpretation
new bacb6dd fix(ipc): verify and bound stream decoding
new 7f4913a fix(core): validate temporal value domains
new af9b496 docs(core): state prove-out limits precisely
new 922109b docs(core): clarify validation guarantees
new 9e2c68c docs(core): record round one findings
new 80c6eef fix(core): canonicalize lifecycle gates
new 35b9e62 fix(cdata): hide partial exports from reaper
new 59b5ae1 fix(core): reject managed raw loads
new 24384da fix(core): preserve non-symbol struct names
new b692594 fix(ipc): reject invalid metadata UTF-8
new ffc5023 fix(core): reject wrapping region extents
new d55bda5 fix(core): fail closed on structural-only layouts
new f8373cb fix(cdata): enforce UTF-8 boundaries
new 3b0d61c fix(core): bound descriptor wire values
new ad38281 fix(core): reject impossible REE geometry
new 1913d7a fix(ipc): reject concurrent cursor pulls
new a331758 test(ipc): prove dictionary snapshot replacement
new de0d505 docs(core): state current guard granularity
new be10935 fix(core): reject malformed field names
new 171d776 docs(core): record round two findings
new 73c0feb fix(core): compose masked validation stages
new 8dbf439 fix(cdata): own canonical release topology
new a080f4d fix(core): reject invalid descriptor enums
new 766d987 fix(core): validate schema string domains
new fb03d23 fix(core): enforce decimal precision
new f138f32 fix(core): preserve empty list child types
new 07e0ce4 fix(core): carry decimal precision limbs
new bf2c0e6 fix(core): reject malformed metadata sequences
new 91a0ee3 fix(core): retain nested dictionary contracts
new 2fab110 test(ipc): reject imprecise decimal coefficients
new af64e39 fix(core): reject non-native batch endianness
new 5b730d6 docs(core): state validation boundaries
new ed152dd test(core): cover masked composite contracts
new df21af0 docs(core): record round three findings
new 927904c fix(core): widen dictionary index before add
new aa622c7 fix(core): validate batch column structure
new 9e16099 fix(core): memoize shared dictionary contracts
new c2fbf14 fix(core): certify complete dictionary pools
new f92dd14 docs(core): record round four findings
new 59cd812 fix(core): gate IPC getters by host endian
new fed6303 docs(core): record round five findings
new 74e9ef7 fix(ipc): accept empty FlatBuffer vectors
new 1a7ac47 fix(ipc): require metadata values
new 3386c6f docs(core): describe planned source adapters honestly
new f14ef19 fix(ipc): require the schema fields vector
new 2b9c29a docs(core): state the intended batch boundary
new 759092d fix(ipc): align FlatBuffer vector length words
new b31c918 docs(core): record round six findings
new c87c038 fix(core): clean up failed mmap ownership handoff
new 9f9f325 fix(core): make C export acquisition exception-safe
new 737e7eb test(core): prove export registry roots sources
new dd53157 docs(core): correct prove-out boundary claims
new d9fc64a docs(core): record round seven findings
new c305742 fix(core): restore gate after interrupted close
new ca5f02b docs(core): state immutable borrow contract
new 1a0d1f6 fix(ipc): reject legacy V4 compression
new d120948 docs(core): complete backing storage contract
new 47082e9 fix(cdata): validate schema flags
new 4e459f8 docs(core): record round eight findings
new 4ece8bd fix(cdata): make import handoff atomic
new 2427c5b fix(cdata): make release callbacks retryable
new a4055b4 fix(cdata): make export cleanup retryable
new 4f3af27 fix(cdata): close task cancellation seams
new b38df35 fix(cdata): derive moved ownership from source
new 3be61d4 docs(core): record round nine findings
new e6197f2 fix(core): make mmap handoff exactly once
new 2809a0a fix(core): make lifecycle handoffs interruption-safe
new 8aafa54 fix(core): retry interrupted mmap release
new d5903a6 fix(core): finish mmap cleanup before escape
new 72aa6f3 fix(cdata): close export ownership handoffs
new 7eb1b96 fix(cdata): commit release nodes atomically
new 7df0af2 fix(cdata): own malloc before registration
new 02de76e fix(core): own mmap before finalizer handoff
new 07707d5 fix(cdata): stop retries after release commit
new bad7d1b fix(core): finish lifecycle rollback before escape
new fd3d088 fix(cdata): finish imported owner cleanup
new 4756b5f fix(ipc): make cursor pulls atomic
new fa1d0fc fix(core): own release through finalizer setup
new 47e1987 fix(core): retry constructor cleanup interruption
new 57e82e2 docs(core): record round ten findings
new eddd3c0 docs(core): declare interruption contract
new d378fa7 docs(core): record round eleven review
new 3988bdf Add IPC buffer compression to the adapter prove-out
(LZ4_FRAME + ZSTD)
new 1b28e2a Replace Any-typed release callbacks with concrete data-driven
ReleaseAction
new 6d6ae0f Remove interruption machinery and Threads.Atomic per design
direction
new 2f3f19c Add JuliaC --trim=safe support: zero verifier
errors/warnings, binary runs
new 6bd5963 fix(ipc): bound compressed buffer decoding
new 213daf5 fix(core): preserve release ownership on errors
new 054d3a6 refactor(cdata): remove interruption scaffolding
new 1bc466c fix(core): keep trim boundaries concrete
new abf4aef docs(core): align stated lifecycle and IPC contracts
new d23fbab test(core): exercise MapClaim CAS contention
new e8f6bd8 refactor(core): remove final release scaffolding
new 7f3ad2d docs(core): record round twelve review
new ef06f96 Condition-based region lifecycle + Mmap stdlib mapping per
design direction
new 2f0cbcb fix(core): harden condition lifecycle
new 58df2de fix(core): keep mapped pointers stable
new 28aa132 docs(core): align lifecycle contracts
new 4aafa86 fix(core): isolate mmap finalization
new f933bee test(core): cover close and mmap owner
new dcd43a8 refactor(core)!: constrain memory model to GC reachability
new dcf8dfc test(core): prove loadat roots the region across GC
new 028020c fix(core): require roots during raw access
new c805a05 docs(core): remove stale lifecycle claims
new 642aecd fix(cdata): clean failed finalizer handoff
new 4722370 fix(core): honor recorded alignment
new e1317a5 fix(cdata): close remaining ownership seams
new f5f4ace docs(core): align trim and atomic claims
new f57554e docs(core): record round thirteen review
new eb093e0 feat(core): add the IPC write half over the registry
new ee1268d feat(core): map intervals and unions through the IPC adapters
new b626138 feat(core): bring C-data format mapping to Core accessor
parity
new 4252342 feat(core): map the C stream interface in both directions
new 9ad953e fix(cdata): close C stream ownership gaps
new 8618d02 fix(ipc): enforce adapter wire invariants
new 0662b6a fix(ipc): compare file field metadata
new 6764cd1 fix(cdata): harden formats and empty offsets
new 462c3db test(core): release mmap before path cleanup
new d231092 fix(cdata): clean failed stream results
new fc77f5b docs(core): align adapter capability claims
new 74b8a6f fix(ipc): disambiguate optional file eos
new 891e38a docs(cdata): state timestamp canonicalization
new c4d2487 docs(core): record round fourteen review
new 9aa74c3 fix(ipc): bind blocks before eos detection
new e5486fc fix(ipc): verify block buffer extents
new 6edfe6f docs(core): record round fifteen review
new 949efe4 perf(ipc): reuse block preflight slice
new b0374be docs(core): record round sixteen review
new e39b275 docs(core): record round seventeen review
new 2636810 docs(core): design Tables.Scan pushdown, ranged reads, and
the trim tiers
new 9de423e feat(core): Tables.Scan Stage-A pushdown over the IPC file
adapter
new 3c3c5bc feat(core): RangedSource byte-range reads driven by the scan
column set
new b6f8dca feat(core): per-batch statistics in the official value
layout, with pruning
new 6a05250 fix(scan): preserve Stage-A contract
new 743e1a8 fix(ranges): validate plans before fetch
new 8ee162e fix(stats): make pruning one-sided
new 54b1cf8 fix(scan): residualize overflowing windows
new 0ed981e test(stats): pin ranged trust behavior
new 9dce6fb docs(core): align scan prove-out status
new 2c5b055 docs(core): record round 18 review
new cd786c6 fix(ranges): validate plans before body fetch
new aa9a801 docs(core): qualify ranged fetch claims
new de48462 fix(scan): guard aggregate row counts
new 4c6f0fc fix(ranges): preflight planned layouts before fetch
new 57b5762 fix(ranges): complete metadata plan checks
new 25db0ca docs(core): qualify skipped range reads
new ded6405 fix(ranges): reject empty required payloads
new 3b96b5e fix(ranges): preflight covered null contracts
new 8541624 docs(core): record round 19 review
new 6f3afc4 docs(core): qualify range-request test claims
new b817d52 docs(core): record round 20 review
new c08f9d2 docs(core): record the ladder-collapse experiment; add ::Any
fallbacks
new ce8a09a feat(core): semantic validation and accessors for view
layouts and REE
new 026bb15 fix(core): re-concretize the REE run-ends type for trim
new 779f9bc feat(core): map view layouts and REE through the IPC adapters
new 578c402 feat(core): map view layouts and REE through the C-data
adapter
new 75acaab docs(core): claim views and REE across Core, IPC, and C-data;
record trim lessons
new a51568e fix(core): reject unregistered descriptors in raw validation
new 5b28e44 fix(core): enforce ListView child field contracts
new ab96f18 fix(core): support sliced and nested REE arrays
new 38a1aad fix(core): validate legal REE schemas in IPC
new 7c6ca5f fix(core): keep ranged variadic accounting exact
new 0cfa693 fix(core): fold statistics through nested encodings
new 9d9e573 test(core): pin view and REE slice boundaries
new 2bb7337 docs(core): align active status with view and REE support
new bd0bbaf test(core): bound statistics harness compilation
new 45dc5c6 docs(core): record round 21 review findings
new a08dcb2 fix(core): run scan statistics first
new 35dc78e docs(core): record round 22 review finding
new a907e5b chore(core): follow Tables.jl's Tables.read -> Tables.scan
rename
new e978a01 docs(core): record round 23 review
new 2148d76 feat(core): regenerate FlatBuffers metadata bindings from the
current spec
new 569b515 fix(core): advisory validation tier + nested/shared
dictionary id fidelity
new 3df3619 feat(core): arrow-testing gold-corpus conformance runner +
arrowjson
new bf6c615 fix(core): accept zero-length arrays' omitted-offsets form
new e3e097b feat(core): pyarrow/nanoarrow oracle round-trip suite
new 6256041 docs(core): record round 24 review
new 923cdee fix(core): resolve round 24 findings
new 70b7199 docs(core): record round 25 review
new 56e8180 docs(core): state the exact-float contract in the corpus
overview
new ae5fe80 docs(core): record round 26 review
new 85dddea feat(core): generate the FlatBuffers verifier from the schema
new 592620a docs(core): record round 27 review
new 6b03ddb fix(core): staged root verification restores the fail-fast
version gate
new a09474f docs(core): record round 28 review
new d012e7c test(core): freeze 2.x-written fixtures; batteries replay
from disk
new 4701bb8 feat!: replace src/ with the rewrite — Arrow.jl 3.0, all 2.x
code removed
new 8750cd1 docs: record round 29 review
new e97d9e1 fix: resolve round 29 dependency findings
new 702b112 fix: co-resolvable TranscodingStreams bound; record round 30
review
new 313cb2f docs: record round 31 review
new 0625d0f fix: maintainer review batch 1 — canonical-bits check,
cleanups, Tables DSL sync
new a94392c feat: maintainer review batch 2 — close!, trim-compiled C
data, FlatBuffers findings
new f30fb53 docs: record round 32 review
new 3e0b7c7 feat: the public facade — Arrow.Table/Stream/write — on the
round-32 release architecture
new 8359aab docs: record round 33 review
new 5c170df fix: resolve round 33 findings — schema-authoritative facade
new f74e5a9 docs: record round 34 review
new 434e8de fix: resolve round 34 findings — semantics-preserving scans,
identity rewrites
new 06b9e1d docs: record round 35 review
new 35f8447 fix: resolve round 35 findings — facade-domain lowering,
identity gates
new fcccf2e docs: record round 36 review
new 5f5715c fix: resolve round 36 findings — finish-parity overrides,
universal identity gates
new f6b126a docs: record round 37 review
new adf72aa fix: resolve round 37 findings — authority-exact overrides,
zero-field filters
new 10fac82 docs: record round 38 review
new 0d71f2b fix: resolve round 38 findings — zero-field consumption, list
closure
new dd4725b docs: record round 39 review
new 31922e9 fix: resolve round 39 findings — frame trust, budgets, list
closure
new 4c8df01 docs: record round 40 review
new 621ea45 fix: resolve round 40 findings — orphan dicts, declared
parity, imposition
new 4882625 docs: record round 41 review
new 30066aa fix: resolve round 41 finding — complete the declared row
domain
new 8f7a81f docs: record round 42 review
new ca6c5c1 fix: resolve round 42 finding — declared domains match actual
containers
new 4c0781b docs: record round 43 review — facade arc CLEAN
new d74c909 feat: typed element access for static schemas (review R5)
new d5873a9 docs: record round 44 review
new 6658819 fix: resolve round 44 findings — descriptor preflight,
generated structs
new a12c6df docs: record round 45 review
new 8f0d9a1 fix: resolve round 45 findings — split recursion edge, exact
NT claims
new 96aa44b docs: record round 46 review
new acb5479 fix: resolve round 46 finding — complete the scalar fast
ladder
new 9a69a7e docs: record round 47 review — typed access arc CLEAN
new 5f36bda feat: C-data field metadata transport and bounded C-string
reads
new f744c37 docs: record round 48 review
new 98ecbc5 fix: resolve round 48 findings — scan window, dict value-node
metadata
new 75594ac docs: record round 49 review
new aa2ff79 fix: resolve round 49 finding — field metadata rides the
wrapper node
new 5ecc795 docs: record round 50 review — C-data metadata arc CLEAN
new abc8831 feat: serialize/deserialize benchmark harness (review R12)
new a45ac45 perf: facade reads ride the typed element path where the
claim closes
new 05b8f75 perf: bulk fixed-width extraction for closed typed claims
new 728e0ed docs: record round 51 review
new f8c334e fix: resolve round 51 findings — bitmap authority, routing,
fair legs
new 3ec81f3 docs: record round 52 review
new e0d2ce2 test: pin Float24 refusal and Dictionary-wrapped union routing
new 6333241 docs+test: record round 53 review; harden the Float24 bulk pin
new 7cb9675 docs: record round 54 review — R12 benchmark arc CLEAN
new 552e657 chore: finish review item #6 — no short-form `= begin`
definitions
new 06608b7 fix(cdata): semantic-tier boundary, stream schema metadata,
REE unknown null count
new 89195bd test(conformance): in-process pyarrow C Data / C Stream
oracle (review R19)
new 49bc5dd feat(core): fromcompactviews — CSV CompactString payloads →
Utf8View (review R18)
new 90f11af docs: comment and documentation history sweep — present tense
only (review R4)
new 35b41d6 fix(scan): follow Tables.jl's scan protocol change
(Tables.scan is the executor)
new 50e5934 docs: record round 55 review — 1 MEDIUM + 4 LOW on the
review-list batch
new fc0de92 fix: resolve round 55 findings — stream schema validation,
oracle sentinel, refusal contract
new 9d89d55 docs: rewrite the user manual and API reference for 3.0
new 49f6595 test(conformance): one docker image runs every conformance
suite (Harbor driver)
new beefc68 docs: record round 56 review — 2 MEDIUM + 3 LOW
new 79bd4ee feat(core): fromcompactviews is a zero-copy wrap —
CompactString entries ARE view entries
new 1284ecc fix: resolve round 56 findings — docs build, honest
write/type prose, typed empty scans
new dd84277 feat: ArrowStrings.jl — the shared inline-else-view string
package, in-repo
new ae3dce9 docs: record round 57 review — 3 MEDIUM + 3 LOW
new 8322039 fix: resolve round 57 findings — advisory nulls read, one
public type rule, self-bootstrapping driver
new d00e4c9 docs: record round 58 review — 1 MEDIUM + 4 LOW
new 95d2480 fix: resolve round 58 findings — zero-buffer views, length
refusal, ArrowStrings CI, prose
new e800c6f refactor(ArrowStrings): CompactString → ArrowString (and
family)
new d19e3c8 docs: record round 59 review — 2 LOW
new 10158a8 fix: resolve round 59 findings — per-package Julia floor in
CI, wrapper route prose
new 286fc76 docs: record round 60 review — 1 LOW
new 8b2103f ci: exclude ArrowTypes from the `min` cells
new 69ef8aa build: Julia 1.10 floor for Arrow.jl and ArrowTypes.jl
new ba06e93 docs: record round 61 review — CLEAN (Julia 1.10 floor)
new e39265b chore: ASF license headers on every source file; ArrowTypes
2.4.0
new 690e1cc chore: repository-wide cleanup pass — tests wired, dead code,
docs, comments
new 30181d1 style: apply JuliaFormatter to the rewrite
The 279 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
