github  

Messages by Thread

• [I] Final and Single aggregates over fully sorted input fail with ResourcesExhausted instead of emitting completed groups [datafusion] via GitHub
• [I] Spill files are mostly `Utf8` offsets, which zstd and lz4 barely compress [datafusion] via GitHub
• [I] SanityCheckPlan error for two window functions with `target_partitions = 1` (`WindowAggExec` loses `can_repartition` when its children are replaced) [datafusion] via GitHub
• [I] SanityCheckPlan error for `UNION ALL ... ORDER BY` when each arm selects the same column twice [datafusion] via GitHub
• [I] SanityCheckPlan error with sort-merge join when a filter makes a sort or join key constant (constant lost in `EquivalenceGroup` projection) [datafusion] via GitHub
• [I] SanityCheckPlan error with sort-merge join when a filter says `a + b = a` [datafusion] via GitHub
• [I] `x > ALL (subquery)` in the SELECT list fails with an internal schema error unless it is aliased [datafusion] via GitHub
• [I] `GROUP BY CAST(a AS VARCHAR), a` with a common subexpression fails in `optimize_projections` ("No field named t.a", sometimes a panic) [datafusion] via GitHub
• [I] Panic "all window expressions shall have the same sort keys" when two window functions share `ORDER BY a + 1` (debug builds) [datafusion] via GitHub
• Re: [PR] fix: reverse ordering and range in NegativeExpr::get_properties [datafusion-comet] via GitHub
• Re: [PR] fix: stop gating columnar shuffle on native-serde checks it never uses [datafusion-comet] via GitHub
• [I] `push_down_filter` substitutes the wrong expression when `col` and `CAST(col AS ...)` share a schema name (HAVING and correlated IN give type errors) [datafusion] via GitHub
• Re: [PR] perf: reuse prepared broadcast builds across executor tasks [datafusion-comet] via GitHub
  • Re: [PR] perf: reuse prepared broadcast builds across executor tasks [datafusion-comet] via GitHub
• [I] Wrong results: `ORDER BY <double>, ... LIMIT n` drops `-0.0` rows when 0.0 arrives in an earlier batch (TopK dynamic filter) [datafusion] via GitHub
• [I] Wrong result: `count(*) OVER ()` sees only the LIMIT rows when ORDER BY ... LIMIT sits on top of another window (target_partitions > 1) [datafusion] via GitHub
• Re: [PR] fix: refuse codegen dispatch for a TRY cast that can put a null key in a map [datafusion-comet] via GitHub
• Re: [PR] fix: preserve native sliding integer sum overflow semantics [datafusion-comet] via GitHub
• Re: [I] Decorrelate a window function below a correlated equality filter by extending `PARTITION BY` [datafusion] via GitHub
• Re: [I] Add a GroupsAccumulator for array_agg(DISTINCT) [datafusion] via GitHub
• Re: [I] Native CASE WHEN and COALESCE reconcile struct fields by name instead of position [datafusion-comet] via GitHub
• [PR] perf: defer CASE columns not read by WHEN expressions [datafusion] via GitHub
• [PR] chore(deps): bump rstest from 0.27.0 to 0.28.0 [datafusion] via GitHub
• [PR] chore(deps): bump the all-other-cargo-deps group with 2 updates [datafusion] via GitHub
• [PR] chore(deps): bump actions/setup-node from 7.0.0 to 7.1.0 [datafusion] via GitHub
• [PR] chore(deps): bump setuptools from 84.0.0 to 84.2.0 in the all-uv-deps group [datafusion] via GitHub
• [PR] chore(deps-dev): bump webpack-dev-server from 6.0.0 to 6.1.0 in /datafusion/wasmtest/datafusion-wasm-app in the all-npm-deps group [datafusion] via GitHub
• [PR] perf: look up few CASE literals by linear comparison [datafusion] via GitHub
• [PR] fix: don't treat planner-inserted casts as Parquet schema conversions [datafusion-comet] via GitHub
  • Re: [PR] fix: don't treat planner-inserted casts as Parquet schema conversions [datafusion-comet] via GitHub
  • Re: [PR] fix: don't treat planner-inserted casts as Parquet schema conversions [datafusion-comet] via GitHub
• [I] Native Parquet scan: casts the planner inserts into pushed-down filters are rejected as Parquet type promotions (Spark 3.x, row-level filter pushdown) [datafusion-comet] via GitHub
• Re: [I] Incorrect AVG result from empty native partial buffers [datafusion-comet] via GitHub
• [PR] fix: apply a pulled up HAVING in scalar subqueries whose aggregate is NULL for empty input [datafusion] via GitHub
• Re: [PR] fix: Return NULL for empty BIT_XOR sliding windows [datafusion] via GitHub
  • Re: [PR] fix: Return NULL for empty BIT_XOR sliding windows [datafusion] via GitHub
• [PR] fix(datetime): error on out-of-range date_bin timestamp bins [datafusion] via GitHub
  • Re: [PR] fix(datetime): error on out-of-range date_bin timestamp bins [datafusion] via GitHub
  • Re: [PR] fix(datetime): error on out-of-range date_bin timestamp bins [datafusion] via GitHub
  • Re: [PR] fix(datetime): error on out-of-range date_bin timestamp bins [datafusion] via GitHub
• Re: [PR] fix: accept NOT NULL input columns in partitioned INSERT [datafusion-iceberg] via GitHub
• [PR] perf: Precompute simple column-derived expressions for `ProjectedCaseBody` [datafusion] via GitHub
• Re: [PR] perf: specialize scattered Boolean shuffle gathers [datafusion-comet] via GitHub
• Re: [PR] fix: unwrap_cast_in_comparison drops the timezone shift when unwrapping CAST(timestamp AS timestamptz) = literal [datafusion] via GitHub
• [I] Joins with string view columns can become extremely slow [datafusion] via GitHub
• Re: [PR] fix: avoid Float64 percentile_cont interpolation overflow [datafusion] via GitHub
• Re: [PR] feat: push immutable scalar functions into CASE branches with literal outputs [datafusion] via GitHub
• Re: [PR] fix: rebase lambda params after projection schema changes [datafusion] via GitHub
• Re: [PR] fix(physical-optimizer): decline the WindowTopN rewrite when the FilterExec carries a fetch [datafusion] via GitHub
• [I] date_bin should error when the computed timestamp bin is out of range [datafusion] via GitHub
  • Re: [I] date_bin should error when the computed timestamp bin is out of range [datafusion] via GitHub
• Re: [I] Release DataFusion `56.0.0` (Oct/Nov 2026) [datafusion] via GitHub
• Re: [I] `min` / `max` over a list of lists (or of structs) fails with "Internal error: Uncomparable values" [datafusion] via GitHub
• [I] docs: add DataFrame aggregation example (select vs aggregate) [datafusion] via GitHub
  • Re: [I] docs: add DataFrame aggregation example (select vs aggregate) [datafusion] via GitHub
• [PR] chore: use shallow checkout for semver check [datafusion] via GitHub
  • Re: [PR] chore: use shallow checkout for semver check [datafusion] via GitHub
• [PR] fix: keep filters with subqueries correlated on an alias above the SubqueryAlias [datafusion] via GitHub
• Re: [I] [EPIC] Handle `-0.0` (and NaN) float keys in one place instead of per call site [datafusion] via GitHub
• [PR] feat(substrait): consume independent JOIN and UNION inputs concurrently [datafusion] via GitHub
• [I] Release DataFusion Iceberg `0.12.0` (??? 2026) [datafusion-iceberg] via GitHub
  • Re: [I] Release DataFusion Iceberg `0.12.0` (??? 2026) [datafusion-iceberg] via GitHub
• [I] Improve Substrait JOIN and UNION planning for async table providers [datafusion] via GitHub
• [PR] chore: speedup semver check using shared target directory [datafusion] via GitHub
• [PR] bench: add float canonicalization benchmark [datafusion] via GitHub
• [PR] add DataFrame aggregation example (#26597) [datafusion] via GitHub
• [PR] perf: faster character boundary scan for non-ASCII left and right [datafusion] via GitHub
• [PR] Refactoring: Move DCL parsing into `src/parser/dcl.rs` [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] Refactoring: Move DCL parsing into `src/parser/dcl.rs` [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] Refactoring: Move DCL parsing into `src/parser/dcl.rs` [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] Refactoring: Move DCL parsing into `src/parser/dcl.rs` [datafusion-sqlparser-rs] via GitHub
• [PR] Centralize float canonicalization [datafusion] via GitHub
  • Re: [PR] refactor: Centralize float canonicalization [datafusion] via GitHub
• Re: [PR] feat(iceberg): support HDFS storage via iceberg-rust hdfs-native backend [NOT FOR MERGE: pending apache/iceberg-rust#3111] [datafusion-comet] via GitHub
• [PR] feat: read Iceberg tables on HDFS natively through iceberg-rust's hdfs-native backend [datafusion-comet] via GitHub
• Re: [PR] feat: attach Diagnostic to duplicate table name errors [datafusion] via GitHub
  • Re: [PR] feat: attach Diagnostic to duplicate table name errors [datafusion] via GitHub
• [PR] chore: skip slow test under `force_hash_collisions` [datafusion] via GitHub
  • Re: [PR] chore: skip slow test under `force_hash_collisions` [datafusion] via GitHub
• [I] Support multiple output partitions for lazy file discovery [datafusion-iceberg] via GitHub
• Re: [PR] fix: give a multi-set aggregate the grouping set index Substrait defines [datafusion] via GitHub
• Re: [PR] fix: validate temporal display formats [datafusion] via GitHub
  • Re: [PR] fix: validate temporal display formats [datafusion] via GitHub
  • Re: [PR] fix: validate temporal display formats [datafusion] via GitHub
• [PR] ci: check all features with Clippy [datafusion] via GitHub
• [PR] feat: support partitioned execution for ASOF joins [datafusion] via GitHub
  • Re: [PR] feat: support partitioned execution for ASOF joins [datafusion] via GitHub
  • Re: [PR] feat: support partitioned execution for ASOF joins [datafusion] via GitHub
• [PR] fix: restore all-features Clippy for DataFrame aggregate rewrites [datafusion] via GitHub
  • Re: [PR] fix: restore all-features Clippy for DataFrame aggregate rewrites [datafusion] via GitHub
• Re: [I] Test our microbenchmarks as part of CI [datafusion] via GitHub
• Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
  • Re: [PR] fix: use null counts to estimate IS NULL and IS NOT NULL [datafusion] via GitHub
• Re: [PR] feat: add native Variant null and validity predicates [datafusion-comet] via GitHub
• Re: [PR] feat: plan Iceberg file tasks before execution [datafusion-iceberg] via GitHub
• Re: [I] ClickHouse: tuple element access followed by a field changes meaning after round-trip [datafusion-sqlparser-rs] via GitHub
  • Re: [I] ClickHouse: tuple element access followed by a field changes meaning after round-trip [datafusion-sqlparser-rs] via GitHub
  • Re: [I] ClickHouse: tuple element access followed by a field changes meaning after round-trip [datafusion-sqlparser-rs] via GitHub
• Re: [PR] fix: align nested types by position and preserve struct nullability [datafusion-comet] via GitHub
• Re: [I] [DISCUSSION] Rethinking Code Review and Testing in the Agent Era [datafusion] via GitHub
  • Re: [I] [DISCUSSION] Rethinking Code Review and Testing in the Agent Era [datafusion] via GitHub
  • Re: [I] [DISCUSSION] Rethinking Code Review and Testing in the Agent Era [datafusion] via GitHub
• [PR] CI: Use a Python release available on Ubuntu 26.04 for RAT [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] CI: Use a Python release available on Ubuntu 26.04 for RAT [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] CI: Use a Python release available on Ubuntu 26.04 for RAT [datafusion-sqlparser-rs] via GitHub
  • Re: [PR] CI: Use a Python release available on Ubuntu 26.04 for RAT [datafusion-sqlparser-rs] via GitHub
• [PR] fix(parquet): coerce INT96 inside legacy Parquet list layouts [datafusion] via GitHub
• Re: [I] Enable Bloom-filter pruning for joins on multiple columns [datafusion] via GitHub
• Re: [I] Examples of using `TreeNode` APIs to walk and manipulate LogicalPlans [datafusion] via GitHub
• [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
  • Re: [PR] perf: try bucket sort [datafusion] via GitHub
• Re: [PR] test: generate NULLs in equivalence fuzz tests [datafusion] via GitHub
• Re: [PR] fix: `PushDownLeafProjections` yields when the extraction cannot move [datafusion] via GitHub
  • Re: [PR] fix: `PushDownLeafProjections` yields when the extraction cannot move [datafusion] via GitHub
  • Re: [PR] fix: `PushDownLeafProjections` yields when the extraction cannot move [datafusion] via GitHub
• Re: [PR] docs: explain date_bin daylight saving behavior [datafusion] via GitHub
  • Re: [PR] docs: explain date_bin daylight saving behavior [datafusion] via GitHub
  • Re: [PR] docs: explain date_bin daylight saving behavior [datafusion] via GitHub
• Re: [I] Streaming Aggregate operator not being used in deduplication of pre-sorted Parquet files [datafusion] via GitHub
• Re: [PR] fix: requalify LATERAL filters through derived-table aliases [datafusion] via GitHub
  • Re: [PR] fix: requalify LATERAL filters through derived-table aliases [datafusion] via GitHub
• Re: [PR] docs: explain dialect requirement for lambda examples [datafusion] via GitHub
  • Re: [PR] docs: explain dialect requirement for lambda examples [datafusion] via GitHub
• Re: [PR] feat: show MERGE INTO details in EXPLAIN [datafusion] via GitHub
• Re: [PR] fix: remap nested TopK filter expressions before their children [datafusion] via GitHub
  • Re: [PR] fix: remap nested TopK filter expressions before their children [datafusion] via GitHub
  • Re: [PR] fix: remap nested TopK filter expressions before their children [datafusion] via GitHub
• Re: [PR] docs: add nuthatch to known users [datafusion] via GitHub
  • Re: [PR] docs: add nuthatch to known users [datafusion] via GitHub
  • Re: [PR] docs: add nuthatch to known users [datafusion] via GitHub
• [PR] refactor: limit the package root to the common entry points- #1771 [datafusion-python] via GitHub
• [PR] fix: reject null-aware `LeftAnti` hash join in `Partitioned` mode [datafusion] via GitHub
  • Re: [PR] fix: reject null-aware `LeftAnti` hash join in `Partitioned` mode [datafusion] via GitHub
• Re: [PR] fix: treat signed zeros as equal in window PARTITION BY [datafusion] via GitHub
• Re: [PR] feat: add opt-in readable column labels for SQL results [datafusion] via GitHub
• Re: [PR] fix(spark): array_contains float equality matches Spark [datafusion] via GitHub
  • Re: [PR] fix(spark): array_contains float equality matches Spark [datafusion] via GitHub
• Re: [I] Multi-key null-aware join silently defaults to one NOT IN value key [datafusion] via GitHub
• Re: [PR] fix: route sort-merge semi/anti/mark key equality through JoinKeyComparator [datafusion] via GitHub
• Re: [PR] fix: do not build TopK dynamic filters from nested sort key thresholds [datafusion] via GitHub
• [PR] fix: keep Iceberg residual pushdown within Spark semantics [datafusion-comet] via GitHub
• Re: [I] DataFrame API: allow aggregate functions in `select()` [datafusion] via GitHub
• [PR] chore(deps): bump rstest from 0.27.0 to 0.28.0 [datafusion-ballista] via GitHub
  • Re: [PR] chore(deps): bump rstest from 0.27.0 to 0.28.0 [datafusion-ballista] via GitHub
• [PR] chore(deps): bump lru from 0.18.5 to 0.19.0 [datafusion-ballista] via GitHub
  • Re: [PR] chore(deps): bump lru from 0.18.5 to 0.19.0 [datafusion-ballista] via GitHub
• [PR] DRAFT Bench 25811 [datafusion] via GitHub
  • Re: [PR] DRAFT Bench 25811 [datafusion] via GitHub
  • Re: [PR] DRAFT Bench 25811 [datafusion] via GitHub
  • Re: [PR] DRAFT Bench 25811 [datafusion] via GitHub
• [PR] fix: keep sort below OFFSET when the sort columns are projected away [datafusion] via GitHub
• Re: [PR] chore: migrate HawkEye to v7 [datafusion-sandbox] via GitHub
• [PR] feat: support native AssertNotNull for DataSource V2 writes [datafusion-comet] via GitHub
  • Re: [PR] feat: support native AssertNotNull for DataSource V2 writes [datafusion-comet] via GitHub
  • Re: [PR] feat: support native AssertNotNull for DataSource V2 writes [datafusion-comet] via GitHub
  • Re: [PR] feat: support native AssertNotNull for DataSource V2 writes [datafusion-comet] via GitHub
  • Re: [PR] feat: support native AssertNotNull for DataSource V2 writes [datafusion-comet] via GitHub
  • Re: [PR] feat: support native AssertNotNull for DataSource V2 writes [datafusion-comet] via GitHub
  • Re: [PR] feat: support native AssertNotNull for DataSource V2 writes [datafusion-comet] via GitHub
• Re: [PR] DataFrame API: allow aggregate functions in select() 2 (#17874) [datafusion] via GitHub
  • Re: [PR] DataFrame API: allow aggregate functions in select() 2 (#17874) [datafusion] via GitHub
• Re: [PR] Cache reusable Parquet pruning setup across files with the same schema [datafusion] via GitHub
  • Re: [PR] Cache reusable Parquet pruning setup across files with the same schema [datafusion] via GitHub
• [PR] perf: create DiskManager Directories-mode working dirs lazily [datafusion] via GitHub
  • Re: [PR] perf: create DiskManager Directories-mode working dirs lazily [datafusion] via GitHub
• [PR] chore: check for circular dependencies with a publish dry run [datafusion] via GitHub
  • Re: [PR] chore: check for circular dependencies with `cargo publish` [datafusion] via GitHub
  • Re: [PR] chore: check for circular dependencies with `cargo publish` [datafusion] via GitHub
  • Re: [PR] chore: check for circular dependencies with `cargo publish` [datafusion] via GitHub
  • Re: [PR] chore: check for circular dependencies with `cargo publish` [datafusion] via GitHub
• [PR] Deduplicate ASCII and char paths in levenshtein_distance_with_threshold [datafusion-comet] via GitHub
• [PR] docs: add a docs-review skill [datafusion-comet] via GitHub
• [PR] docs: adopt issue #4419 terminology in remaining contributor docs [datafusion-comet] via GitHub

• Earlier messages