github

Messages by Date

2026/10/02 Re: [PR] Add a fuzz target that flags superlinear parsing and printing [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] feat: error when the client and scheduler have different major versions [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Clarify how to run native Comet -> Celeborn shuffle end-to-end [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: fall back for Iceberg writes with float or double identity partitions [datafusion-comet] via GitHub
2026/10/02 [I] Final aggregate under AQE reads its shuffle through the JVM decoder instead of native direct read [datafusion-comet] via GitHub
2026/10/02 Re: [I] AQE skew join split makes the join fall back to Spark with no fallback reason [datafusion-comet] via GitHub
2026/10/02 Re: [PR] perf: stop redoing per-chunk setup on the hash join probe path [datafusion] via GitHub
2026/10/02 [PR] Js/store partitioning in dynamic filters [datafusion] via GitHub
2026/10/02 Re: [PR] perf(pwmj):settle never-matching streamed rows against the buffered extreme… [datafusion] via GitHub
2026/10/02 Re: [PR] fix: mark avg, bit_and/or/xor, stddev and variance as order-insensitive [datafusion] via GitHub
2026/10/02 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/10/02 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/10/02 Re: [PR] feat: add native Delta Lake scan contrib module (page/row-group pruning) [datafusion-comet] via GitHub
2026/10/02 Re: [I] Spark `xxhash64` ignores the running hash for dictionary-encoded values inside structs and lists [datafusion] via GitHub
2026/10/02 Re: [PR] perf: bounded distinct count optimization [datafusion] via GitHub
2026/10/02 Re: [I] Improve new top-level README for this project [datafusion-ballista] via GitHub
2026/10/02 [PR] Show decimal add bug [datafusion] via GitHub
2026/10/02 Re: [PR] perf: bounded distinct count optimization [datafusion] via GitHub
2026/10/02 Re: [PR] perf: evaluate AND chains as one n-ary conjunction (#25035) [datafusion] via GitHub
2026/10/02 Re: [PR] perf: normalize float hash join build keys once [datafusion] via GitHub
2026/10/02 [PR] fix: hash every NaN like the canonical NaN in Spark xxhash64 [datafusion] via GitHub
2026/10/02 Re: [I] Job hangs indefinitely instead of failing when all executors are lost [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: keep Spark's cache format when Kryo would reject Comet's or Comet disables itself [datafusion-comet] via GitHub
2026/10/02 Re: [PR] ci: Enforce PR limit to 3 for non-committers [datafusion] via GitHub
2026/10/02 Re: [PR] chore: Upgrade to Rust 1.99, MSRV to 1.95 [datafusion] via GitHub
2026/10/02 [PR] fix: array_concat panics or fails on non-default nested lists [datafusion] via GitHub
2026/10/02 Re: [PR] Capture the `COPY ... FROM STDIN` payload verbatim [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] ci: shard the Iceberg extensions test task [datafusion-comet] via GitHub
2026/10/02 Re: [I] Implement FFI versions of runtime environment and execution properties [datafusion] via GitHub
2026/10/02 Re: [PR] Add ordered bind placeholder dialect metadata [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] feat: record why Spark scans a relation cached in Comet's format when Comet is off [datafusion-comet] via GitHub
2026/10/02 Re: [PR] Support PostgreSQL `ALTER DEFAULT PRIVILEGES` [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] PostgreSQL: parse `CREATE GROUP` and `DROP GROUP` [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] feat: stage ORDER BY expression evaluation [datafusion] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 [PR] perf: PartitionedTopKRank on the shared store with decide-then-gather [datafusion] via GitHub
2026/10/02 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/02 Re: [I] TPC-H SF1000 results for Ballista main (DataFusion 55.1.0): 0.72x of Spark 3.5, 1.45x of Spark + Comet, 15% of time in planning (#2497) [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Implement fast path for QueryStageExec when writing 1 shuffle partition [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Proposal for more efficient disk-based shuffle mechanism [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] perf: normalize float hash join build keys once [datafusion] via GitHub
2026/10/02 Re: [PR] fix: rescale decimal results from dispatched functions to the declared type [datafusion-comet] via GitHub
2026/10/02 Re: [I] Reduce retained buffer allocation when map lookups select short nested values [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: keep decimal fractions in modulo by one [datafusion] via GitHub
2026/10/02 [I] PostgreSQL DO statement [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] Align statistics cache sharing test comments with reset-free contract [datafusion] via GitHub
2026/10/02 [PR] ci: Enforce PR limit to 3 for non-committers [datafusion] via GitHub
2026/10/02 [PR] fix: keep Spark's cache format when Kryo would reject Comet's or Comet disables itself [datafusion-comet] via GitHub
2026/10/02 [PR] perf: normalize float hash join build keys once [datafusion] via GitHub
2026/10/02 Re: [PR] Prune hash join probe side via a build-side key range bitmap [datafusion] via GitHub
2026/10/02 Re: [I] Consolidate built-in statistics estimation in one place [datafusion] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] chore: Upgrade to Rust 1.99, MSRV to 1.95 [datafusion] via GitHub
2026/10/02 Re: [PR] fix: truncate scalar timestamps in their own unit in date_trunc [datafusion] via GitHub
2026/10/02 Re: [PR] perf: stop redoing per-chunk setup on the hash join probe path [datafusion] via GitHub
2026/10/02 Re: [I] CI should run Ballista integration tests [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] test: strengthen scalar UDF type recovery regression coverage [datafusion] via GitHub
2026/10/02 Re: [I] Implement dynamic discrete pruning through a join [datafusion] via GitHub
2026/10/02 Re: [I] Implement FFI versions of runtime environment and execution properties [datafusion] via GitHub
2026/10/02 Re: [PR] fix: align nested collection buffer nullability before spilling [datafusion-comet] via GitHub
2026/10/02 Re: [PR] Feat(parquet) : Introduce support for optionally writing Distinct Values to statistics [datafusion] via GitHub
2026/10/02 Re: [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/02 Re: [I] reverse on a binary column fails with a native UTF-8 error on Spark 4.2 [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: run reverse of a binary value through the codegen dispatcher [datafusion-comet] via GitHub
2026/10/02 Re: [PR] perf: stop redoing per-chunk setup on the hash join probe path [datafusion] via GitHub
2026/10/02 Re: [PR] fix: plan and run repeated SUM(x + literal) on decimals and intervals [datafusion] via GitHub
2026/10/02 Re: [I] S3 credential SPI: honor expirationEpochMillis consistently on the Parquet and Iceberg paths [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: match Spark's whitespace trimming in casts from string to timestamp and timestamp_ntz [datafusion-comet] via GitHub
2026/10/02 Re: [I] [EPIC] cast from string: trim semantics diverge from Spark across all numeric, datetime and boolean targets [datafusion-comet] via GitHub
2026/10/02 Re: [PR] Plan struct colon access as get_field [datafusion] via GitHub
2026/10/02 Re: [I] Some Spark SQL and Iceberg test suites run without Comet in CI [datafusion-comet] via GitHub
2026/10/02 Re: [PR] test: run Comet in Spark SQL and Iceberg suites that build their own sessions [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: gate the power and log rewrites on the base's value, not its nullability [datafusion] via GitHub
2026/10/02 Re: [PR] feat: reuse S3 credentials until shortly before their reported expiry [datafusion-comet] via GitHub
2026/10/02 Re: [I] fix: string-to-timestamp does not trim ISO control characters, and leading '+' returns null under ANSI [datafusion-comet] via GitHub
2026/10/02 Re: [I] panic: GROUP BY or SELECT DISTINCT over a zero-field (empty) struct key [datafusion] via GitHub
2026/10/02 Re: [PR] fix: support zero-field struct group keys in aggregate emit [datafusion] via GitHub
2026/10/02 Re: [PR] fix: support zero-field struct group keys in aggregate emit [datafusion] via GitHub
2026/10/02 Re: [PR] chore: Hide internal public utility APIs [datafusion] via GitHub
2026/10/02 Re: [PR] fix: skip the null-aware join when a NOT IN correlation duplicates the IN equality [datafusion] via GitHub
2026/10/02 Re: [PR] fix: gate the power and log rewrites on the base's value, not its nullability [datafusion] via GitHub
2026/10/02 Re: [PR] fix: support zero-field struct group keys in aggregate emit [datafusion] via GitHub
2026/10/02 Re: [PR] fix: skip the null-aware join when a NOT IN correlation duplicates the IN equality [datafusion] via GitHub
2026/10/02 Re: [PR] fix: hash every NaN like the canonical NaN in Spark xxhash64 [datafusion] via GitHub
2026/10/02 Re: [PR] fix: keep decimal fractions in modulo by one [datafusion] via GitHub
2026/10/02 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/02 Re: [PR] fix: array_concat panics or fails on non-default nested lists [datafusion] via GitHub
2026/10/02 Re: [PR] perf: stop redoing per-chunk setup on the hash join probe path [datafusion] via GitHub
2026/10/02 Re: [PR] refactor: deprecate statistics providers that duplicate operator estimates [datafusion] via GitHub
2026/10/02 Re: [PR] fix: canonicalize NaN in xxhash64 to match Spark behavior (fixes #25913) [datafusion] via GitHub
2026/10/02 Re: [PR] fix: canonicalize NaN in xxhash64 to match Spark behavior (fixes #25913) [datafusion] via GitHub
2026/10/02 Re: [PR] ci: key TPC dataset caches on pinned generators [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix(functions): prevent invalid sort omission in log monotonicity when base <= 1 [datafusion] via GitHub
2026/10/02 Re: [PR] ci: drop non-existent suites from the Linux and macOS test matrices [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: keep decimal and temporal types in nvl and ifnull [datafusion] via GitHub
2026/10/02 Re: [I] Avoid single-task execution for null-aware anti joins (NOT IN subqueries) [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] perf: PartitionedTopKRank on the shared store with decide-then-gather [datafusion] via GitHub
2026/10/02 Re: [I] Implement hash partitioned aggregation in Ballista [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] refactor: deprecate statistics providers that duplicate operator estimates [datafusion] via GitHub
2026/10/02 Re: [I] Enable benchmark data validation for distributed execution [datafusion-ballista] via GitHub
2026/10/02 Re: [I] The type of Float64 >= Int64 of binary physical should be same [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: avoid query failures from inferred numeric cast bounds [datafusion] via GitHub
2026/10/02 Re: [PR] feat: error when the client and scheduler have different major versions [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: preserve sorts for wrapping integer negation [datafusion] via GitHub
2026/10/02 Re: [I] Support rolling upgrades without an outage window [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: Column statistics support v1 [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: [branch-1.1] fall back for incompatible regression aggregates (#6451) [datafusion-comet] via GitHub
2026/10/02 [I] Support rolling upgrades without an outage window [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Q10 SF1000 regression after #2315: SortPreservingMergeExec exhausts fair memory pool under AQE default-on [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: hash NaN the way Spark does in hash, xxhash64 and native shuffle [datafusion-comet] via GitHub
2026/10/02 Re: [PR] test: strengthen scalar UDF type recovery regression coverage [datafusion] via GitHub
2026/10/02 Re: [I] Consolidate built-in statistics estimation in one place [datafusion] via GitHub
2026/10/02 [PR] feat: record why Spark scans a relation cached in Comet's format when Comet is off [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: match Spark's float ordering in min, max, greatest and least [datafusion-comet] via GitHub
2026/10/02 Re: [PR] feat: error when the client and scheduler have different major versions [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Preserve primitive Iceberg pruning beside unsupported complex null conjuncts [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: [branch-1.1] match pre-epoch Iceberg temporal rounding (#6456) [datafusion-comet] via GitHub
2026/10/02 Re: [I] Ballista: Fix hacks around concurrency=2 to force hash-partitioned joins [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Q10 SF1000 regression after #2315: SortPreservingMergeExec exhausts fair memory pool under AQE default-on [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Stop showing very verbose streaming errors [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Avoid single-task execution for null-aware anti joins (NOT IN subqueries) [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Integration test script should test the Python bindings [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Native blocks without a JVM input publish SQL metrics on every batch, ignoring spark.comet.metrics.updateInterval [datafusion-comet] via GitHub
2026/10/02 Re: [I] Implement fast path for QueryStageExec when writing 1 shuffle partition [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Implement hash partitioned aggregation in Ballista [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: [branch-1.1] coerce native IF branches to a common type (#6458) [datafusion-comet] via GitHub
2026/10/02 Re: [I] The type of Timestamp(Nanosecond, None) >= Date32 of binary physical should be same [datafusion-ballista] via GitHub
2026/10/02 Re: [I] The type of Float64 >= Int64 of binary physical should be same [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Integration test script should test the Python bindings [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Add python crate to workspace [datafusion-ballista] via GitHub
2026/10/02 [PR] fix: plan and run repeated SUM(x + literal) on decimals and intervals [datafusion] via GitHub
2026/10/02 Re: [I] Move ballista-proto to separate module/crate [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Move ballista-proto to separate module/crate [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Scheduler infinite loop after failed/canceled job [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Scheduler infinite loop after failed/canceled job [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Add python crate to workspace [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Stop showing very verbose streaming errors [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Broadcast join promotion drops a sort order required by a parent SortMergeJoinExec, silently producing wrong results [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Implement memory management in shuffle writer [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/02 Re: [I] Implement memory management in shuffle writer [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista: Executor must return statistics in CompletedTask / CompletedJob [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Configuration guide should be generated from code [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Configuration guide should be generated from code [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista: Executor must return statistics in CompletedTask / CompletedJob [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Broadcast join promotion drops a sort order required by a parent SortMergeJoinExec, silently producing wrong results [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Enable benchmark data validation for distributed execution [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Provide integration with Grafana / Prometheus [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Optimize shuffle before coalesce [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Provide integration with Grafana / Prometheus [datafusion-ballista] via GitHub
2026/10/02 Re: [I] [Python] Allow configuration options to be set when creating BallistaContext [datafusion-ballista] via GitHub
2026/10/02 Re: [I] [Python] Allow configuration options to be set when creating BallistaContext [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Add "Getting Started" docs to repo [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista should serialize Parquet statistics [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: enable Comet's in-memory cache by default [datafusion-comet] via GitHub
2026/10/02 Re: [I] Ballista: Fix hacks around concurrency=2 to force hash-partitioned joins [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Ballista should serialize Parquet statistics [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Remove `datafusion.proto` and use the `datafusion-proto` api for logical plan serde [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Improve new top-level README for this project [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Distributed execution returns incorrect results for several TPC-DS queries (static planner) [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: publish metrics on the update interval for native blocks without a JVM input [datafusion-comet] via GitHub
2026/10/02 Re: [PR] chore: Hide internal public utility APIs [datafusion] via GitHub
2026/10/02 [I] S3 credential SPI: follow-ups from #6478 (hostless Iceberg metadata locations, docs, tests) [datafusion-comet] via GitHub
2026/10/02 Re: [I] Account for partitions in local TopK statistics [datafusion] via GitHub
2026/10/02 Re: [I] date_trunc rejects scalar timestamps that array evaluation accepts [datafusion] via GitHub
2026/10/02 Re: [PR] fix: account for every partition in local TopK and limit statistics [datafusion] via GitHub
2026/10/02 [PR] refactor: move shuffle planning into dedicated module [datafusion-comet] via GitHub
2026/10/02 [PR] test: strengthen scalar UDF type recovery regression coverage [datafusion] via GitHub
2026/10/02 Re: [PR] chore: Hide internal public utility APIs [datafusion] via GitHub
2026/10/02 Re: [I] Distributed execution returns incorrect results for several TPC-DS queries (static planner) [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Job hangs indefinitely instead of failing when all executors are lost [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] fix: match Spark statistical aggregate updates and merges [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: account for every partition in local TopK and limit statistics [datafusion] via GitHub
2026/10/02 Re: [PR] fix: account for every partition in local TopK and limit statistics [datafusion] via GitHub
2026/10/02 [PR] Align statistics cache sharing test comments with reset-free contract [datafusion] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 [PR] fix: keep decimal and temporal types in nvl and ifnull [datafusion] via GitHub
2026/10/02 Re: [I] Implement FFI versions of runtime environment and execution properties [datafusion] via GitHub
2026/10/02 [PR] chore: Hide internal public utility APIs [datafusion] via GitHub
2026/10/02 Re: [I] percentile_approx returns different percentiles from Spark when its input holds a NaN with the sign bit set [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: account for row duplication and padding in join null counts [datafusion] via GitHub
2026/10/02 Re: [PR] fix: use NDV for unresolved scalar subquery selectivity instead of 20% fallback [datafusion] via GitHub
2026/10/02 Re: [PR] feat: add opt-in probe selection for partitioned inner hash joins [datafusion] via GitHub
2026/10/02 Re: [PR] Fix array_except type mismatch issue #3646 [datafusion-comet] via GitHub
2026/10/02 Re: [PR] Generic: Parse IN lists that start with a parenthesized subquery [datafusion-sqlparser-rs] via GitHub
2026/10/02 Re: [PR] test: [branch-1.1] cover sliced boolean arrays in explode (#6473) [datafusion-comet] via GitHub
2026/10/02 Re: [PR] fix: use session statistics registry in dfbench reports [datafusion] via GitHub
2026/10/02 Re: [PR] feat: add opt-in probe selection for partitioned inner hash joins [datafusion] via GitHub
2026/10/02 [PR] refactor: Implement optimizer hook for combining partial/final aggregate in `AggregateExec` [datafusion] via GitHub
2026/10/02 Re: [PR] Add ComposedNamedPhysicalExtensionCodec [datafusion] via GitHub
2026/10/02 Re: [PR] Add ComposedNamedPhysicalExtensionCodec [datafusion] via GitHub
2026/10/02 Re: [PR] chore(release): release the Python client separately from the Rust crates [datafusion-ballista] via GitHub
2026/10/02 Re: [I] Discussion: release the Python client separately from the Rust crates [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] fix: infer LIMIT and OFFSET parameter types [datafusion] via GitHub
2026/10/02 Re: [PR] chore(ci): bump taiki-e/install-action from 2.87.21 to 2.87.22 [datafusion-ballista] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] feat: preserve bitmap-backed Parquet row selections [datafusion] via GitHub
2026/10/02 Re: [PR] Feat(parquet) : Introduce support for optionally writing Distinct Values to statistics [datafusion] via GitHub