github

Messages by Date

2026/10/19 Re: [I] perf: every native plan creates and deletes a temp directory on each Spark local disk, even when it never spills [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: do not evaluate a volatile coalesce or nvl argument twice [datafusion] via GitHub
2026/10/19 [PR] fix: write each batch's partitions in first-row order for the clustered writer [datafusion-iceberg] via GitHub
2026/10/19 Re: [PR] fix: choose the forced shuffled hash join at planning time so Spark keeps its sorts [datafusion-comet] via GitHub
2026/10/19 Re: [I] array_agg(DISTINCT x ORDER BY x) returns values in reverse order when another aggregate orders by x DESC [datafusion] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 Re: [PR] fix: cap native projection input before collect limits [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: cap native projection input before collect limits [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: support struct-typed scalar subquery results [datafusion-comet] via GitHub
2026/10/19 Re: [PR] chore: fix stddev accumulator size and resolve session libhdfs schemes once per scan rule [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: choose the forced shuffled hash join at planning time so Spark keeps its sorts [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 Re: [I] Physical CastExpr display hides nullability changes, so union coercion casts look like no-ops [datafusion] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 Re: [PR] fix: keep each native panic's backtrace with its own thread [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: default broadcast build side conversion to off and document invalid UTF-8 cases [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 Re: [PR] Show nullability of an explicit CastExpr target in its display [datafusion] via GitHub
2026/10/19 Re: [PR] fix: correlated exists/not exists subqueries hit the count bug for groupless aggregates [datafusion] via GitHub
2026/10/19 [I] Amortize state compaction in DistinctArrayAggGroupsAccumulator on EmitTo::First [datafusion] via GitHub
2026/10/19 [PR] fix: preserve Parquet column key metadata associations [datafusion] via GitHub
2026/10/19 Re: [PR] Show nullability of an explicit CastExpr target in its display [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] perf: add a GroupsAccumulator for array_agg(DISTINCT) [datafusion] via GitHub
2026/10/19 Re: [PR] docs: note that Text broadcast build sides decode invalid UTF-8 [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] fix: dispatch map lookups with normalized keys and nondeterministic null-guarded children [datafusion-comet] via GitHub
2026/10/19 Re: [PR] chore: fix stddev accumulator size and resolve session libhdfs schemes once per scan rule [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] docs: note that Text broadcast build sides decode invalid UTF-8 [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 [PR] fix: default broadcast build side conversion to off and document invalid UTF-8 cases [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: fall back when an Iceberg equality delete is keyed on a nested field [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: summarize Bloom literals in filter and projection plan displays [datafusion-comet] via GitHub
2026/10/19 Re: [PR] docs: name the invalid UTF-8 cases that 1.1.0 kept in Spark [datafusion-comet] via GitHub
2026/10/19 Re: [PR] docs: name the invalid UTF-8 cases that 1.1.0 kept in Spark [datafusion-comet] via GitHub
2026/10/19 Re: [PR] Resolve named windows referenced inside OVER (...) [datafusion] via GitHub
2026/10/19 Re: [PR] Introduce way to customize prefix of multi file outputs [datafusion] via GitHub
2026/10/19 Re: [PR] feat: Enable expressions as default value in lead/lag function [datafusion] via GitHub
2026/10/19 Re: [PR] Add transform_values UDF [datafusion] via GitHub
2026/10/19 Re: [PR] fix: union coercion coerces to string instead of number [datafusion] via GitHub
2026/10/19 Re: [PR] test (aggregation-fuzzer): exercise spilling under a bounded memory pool [datafusion] via GitHub
2026/10/19 Re: [PR] feat(pruning): prune containers through `CASE` predicates [datafusion] via GitHub
2026/10/19 Re: [PR] ci: run extended tests on aggregate and window function changes [datafusion] via GitHub
2026/10/19 Re: [PR] docs: publish the newest release at user-guide/latest and main at user-guide/dev [datafusion-comet] via GitHub
2026/10/19 Re: [PR] feat(perf): compute routing and lookup hashes once [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] fix: decode invalid UTF-8 in nested Parquet BINARY values read as strings [datafusion-comet] via GitHub
2026/10/19 [I] SQLite parser dialect returns different rows for bitwise filter than SQLite [datafusion] via GitHub
2026/10/19 [I] MySQL caret binds below multiplication, changing a DataFusion query result [datafusion-sqlparser-rs] via GitHub
2026/10/19 [PR] fix: fall back when an Iceberg equality delete is keyed on a nested field [datafusion-comet] via GitHub
2026/10/19 [PR] fix: redact Parquet key configuration Debug output [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] perf(parquet): preserve RLE dictionaries for binary_as_string scans [datafusion] via GitHub
2026/10/19 Re: [PR] feat: build multi-column null-aware NOT IN on the subquery side [datafusion] via GitHub
2026/10/19 Re: [PR] feat: build multi-column null-aware NOT IN on the subquery side [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [PR] feat: finish scheduler jobs on shutdown and unify signal handling [datafusion-ballista] via GitHub
2026/10/19 Re: [I] Crate name `datafusion-iceberg` is taken on crates.io; switch back to `iceberg-datafusion` [datafusion-iceberg] via GitHub
2026/10/19 Re: [PR] feat: txt file support [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: append sort-merge join output pairs in bulk [datafusion] via GitHub
2026/10/19 Re: [PR] feat: rewrite inner joins against a single constant row into a filter [datafusion] via GitHub
2026/10/19 Re: [PR] Feat/map sql extension types [datafusion] via GitHub
2026/10/19 Re: [I] Represent Hive/value partitioning without claiming Partitioning::Hash [datafusion] via GitHub
2026/10/19 Re: [PR] feat(perf): compute routing and lookup hashes once [datafusion] via GitHub
2026/10/19 Re: [I] Represent Hive/value partitioning without claiming Partitioning::Hash [datafusion] via GitHub
2026/10/19 Re: [PR] fix: preserve make_date overflow and skipped evaluation [datafusion-comet] via GitHub
2026/10/19 Re: [PR] docs: update committer list in governance page [datafusion] via GitHub
2026/10/19 Re: [PR] perf: load the next Parquet file's footer and page index while the current file is read [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: load the next Parquet file's footer and page index while the current file is read [datafusion-comet] via GitHub
2026/10/19 [I] store start and end bounds in Partitioning::Range [datafusion] via GitHub
2026/10/19 Re: [PR] feat(python): Add Python UDF support to Ballista Python bindings [datafusion-ballista] via GitHub
2026/10/19 Re: [PR] feat(python): Plug into DataFusion Python natively through a custom FFI query planner [datafusion-ballista] via GitHub
2026/10/19 Re: [PR] fix: handle nested RANGE CURRENT ROW peers [datafusion] via GitHub
2026/10/19 Re: [PR] fix: keep EliminateGroupByConstant from requalifying group expressions [datafusion] via GitHub
2026/10/19 Re: [PR] docs: update committer list in governance page [datafusion] via GitHub
2026/10/19 Re: [PR] refactor: Use cast preimages for cast predicate rewrites [datafusion] via GitHub
2026/10/19 Re: [PR] refactor: Use cast preimages for cast predicate rewrites [datafusion] via GitHub
2026/10/19 Re: [I] RANGE window frame boundary overflow diverges from Spark for DATE and DECIMAL ORDER BY [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: share Parquet footer and page index metadata across the tasks of a stage [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: Optimize repeated counting of set bits [datafusion] via GitHub
2026/10/19 [PR] docs: name the invalid UTF-8 cases that 1.1.0 kept in Spark [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: align Union inputs after leaf expression pushdown [datafusion] via GitHub
2026/10/19 Re: [I] `push_down_leaf_projections` fails with an ambiguous schema when a sub-query projection renames columns [datafusion] via GitHub
2026/10/19 Re: [PR] perf: append sort-merge join output pairs in bulk [datafusion] via GitHub
2026/10/19 Re: [PR] docs: update committer list in governance page [datafusion] via GitHub
2026/10/19 Re: [PR] fix: keep renamed columns intact in leaf projection pushdown [datafusion] via GitHub
2026/10/19 Re: [PR] feat: support AtLeastNNonNulls natively [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: Optimize repeated counting of set bits [datafusion] via GitHub
2026/10/19 Re: [PR] fix: evaluate the array_append item on rows whose array is NULL [datafusion-comet] via GitHub
2026/10/19 Re: [I] Supporting analytics over large amounts of pre‑partitioned data [datafusion] via GitHub
2026/10/19 Re: [PR] SQLite: Support `IN` with a table name or table-valued function [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] perf: extend fully ordered aggregation to more scalar types [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [I] Discussion: Define the Contract for Custom Physical Optimizer Pipelines [datafusion] via GitHub
2026/10/19 Re: [PR] feat: opt in to join filter pushdown through deterministic residuals [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: extend fully ordered aggregation to more scalar types [datafusion] via GitHub
2026/10/19 [PR] fix: nvl2 result type should not depend on its first argument [datafusion] via GitHub
2026/10/19 Re: [PR] perf: extend fully ordered aggregation to more scalar types [datafusion] via GitHub
2026/10/19 Re: [PR] Feat/map sql extension types [datafusion] via GitHub
2026/10/19 Re: [PR] chore(ci): bump the github-codeql group across 1 directory with 2 updates [datafusion-ballista] via GitHub
2026/10/19 [PR] chore: fix stddev accumulator size and resolve session libhdfs schemes once per scan rule [datafusion-comet] via GitHub
2026/10/19 Re: [PR] feat: write top-level Iceberg unknown columns natively [datafusion-comet] via GitHub
2026/10/19 Re: [PR] feat: drop a stream task's future in place when its stream is dropped [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 [I] Plain `SELECT` of a Parquet float column returns wrong values: NaN rows are replaced by the statistics constant when min == max [datafusion] via GitHub
2026/10/19 Re: [PR] Docs: Require a fuzz seed per bug fix in AGENTS.md [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] feat: drop a stream task's future in place when its stream is dropped [datafusion] via GitHub
2026/10/19 Re: [I] SortExec merge lookahead can retain batches without memory reservations [datafusion] via GitHub
2026/10/19 Re: [PR] fix: preserve make_date overflow and skipped evaluation [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: `AT TIME ZONE` on a timezone-aware timestamp returns a naive timestamp [datafusion] via GitHub
2026/10/19 Re: [I] Casting existing timestamp to timestamp again strips timezone information [datafusion] via GitHub
2026/10/19 Re: [PR] PostgreSQL: Parse schema-qualified keyword function calls [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] feat: run admitted local queries as one native graph [datafusion-comet] via GitHub
2026/10/19 Re: [PR] chore(deps): bump pyo3-build-config from 0.29.3 to 0.30.1 in /python [datafusion-ballista] via GitHub
2026/10/19 Re: [PR] chore(ci): bump the github-codeql group with 2 updates [datafusion-ballista] via GitHub
2026/10/19 [I] Text broadcast build sides and string min/max apply the invalid UTF-8 decode where 1.1.0 stayed on Spark [datafusion-comet] via GitHub
2026/10/19 [PR] docs: note that Text broadcast build sides decode invalid UTF-8 [datafusion-comet] via GitHub
2026/10/19 Re: [PR] feat: build multi-column null-aware NOT IN on the subquery side [datafusion] via GitHub
2026/10/19 Re: [PR] ci: run the Rust workflow for fork pull requests on the fork [datafusion] via GitHub
2026/10/19 Re: [PR] test: add NULL values to Fuzz window [datafusion] via GitHub
2026/10/19 Re: [PR] fix(functions): pass correct number_rows in gcd benchmarks [datafusion] via GitHub
2026/10/19 Re: [PR] Revert #25363 due to overlapping optimizations [datafusion] via GitHub
2026/10/19 Re: [I] gcd benchmarks pass number_rows: 0 for 100k-row inputs [datafusion] via GitHub
2026/10/19 Re: [PR] ci: run the Rust workflow for fork pull requests on the fork [datafusion] via GitHub
2026/10/19 Re: [I] Deduplicate Concat string and binary builders in datafusion-functions [datafusion] via GitHub
2026/10/19 Re: [PR] refactor: deduplicate `concat` string and binary builders [datafusion] via GitHub
2026/10/19 Re: [I] Native hash joins lose the streamed side's order when it arrives sorted from outside the native plan [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: read NOT NULL tuple elements of a multi-column NOT IN as scope keys [datafusion] via GitHub
2026/10/19 [I] Wrong results: correlated scalar subquery with nested aggregates [datafusion] via GitHub
2026/10/19 Re: [PR] ci: run the Rust workflow for fork pull requests on the fork [datafusion] via GitHub
2026/10/19 Re: [PR] fix: Only apply SingleDistinctToGroupBy rewrite when it pays (closes #25932) [datafusion] via GitHub
2026/10/19 Re: [PR] ci: run the Rust workflow for fork pull requests on the fork [datafusion] via GitHub
2026/10/19 Re: [PR] fix: keep a streamed side sorted outside the native plan in order through outer hash joins [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: Optimize repeated counting of set bits [datafusion] via GitHub
2026/10/19 Re: [PR] bench: add ASOF join benchmark with a large unfiltered right input [datafusion] via GitHub
2026/10/19 Re: [PR] perf: Optimize repeated counting of set bits [datafusion] via GitHub
2026/10/19 Re: [PR] build: remove Guava dependency [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: nvl2 result type should not depend on its first argument [datafusion] via GitHub
2026/10/19 Re: [PR] feat: support the S3A magic committer in native Parquet writes [datafusion-comet] via GitHub
2026/10/19 Re: [PR] fix: experiments with large types for aggregated values [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: extend fully ordered aggregation to more scalar types [datafusion] via GitHub
2026/10/19 Re: [PR] Partition information schema content per catalog [datafusion] via GitHub
2026/10/19 Re: [PR] feat: txt file support [datafusion-comet] via GitHub
2026/10/19 Re: [PR] perf: Optimize repeated counting of set bits [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 [PR] perf: Optimize repeated counting of set bits [datafusion] via GitHub
2026/10/19 Re: [PR] feat: decorrelate a window below a correlated equality filter [datafusion] via GitHub
2026/10/19 [PR] PostgreSQL: Parse schema-qualified keyword function calls [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] perf: extend fully ordered aggregation to more scalar types [datafusion] via GitHub
2026/10/19 Re: [PR] feat: support Spark-compatible `stack` function [datafusion] via GitHub
2026/10/19 Re: [PR] fix: reject TIMESTAMP(NANOS) Parquet columns read as timestamp [datafusion-comet] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [PR] chore(deps): bump pyo3-build-config from 0.29.3 to 0.30.1 in /python [datafusion-ballista] via GitHub
2026/10/19 [I] `COPY … PARTITIONED BY` writes partition values containing `=` unescaped (`p0=x=y`); DuckDB and Polars cannot read the dataset or silently drop the partition column [datafusion] via GitHub
2026/10/19 Re: [PR] fix: preserve Spark evaluation for next_day and levenshtein [datafusion-comet] via GitHub
2026/10/19 Re: [PR] Resolve named windows referenced inside OVER (...) [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [I] Changelog generator crashes on commits without a linked GitHub author [datafusion] via GitHub
2026/10/19 [I] Named window in `HAVING` is silently ignored and the query returns results instead of an error [datafusion] via GitHub
2026/10/19 [I] Correlated scalar subquery ignores `HAVING` that is true for empty input [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [PR] chore: allow clippy mutable_key_type on Expr hash sets in PushDownFilter (#26181) [datafusion] via GitHub
2026/10/19 Re: [PR] fix: validate parquet encoding when configured [datafusion] via GitHub
2026/10/19 Re: [PR] perf: read NOT NULL tuple elements of a multi-column NOT IN as scope keys [datafusion] via GitHub
2026/10/19 [PR] docs: publish the newest release at user-guide/latest and main at user-guide/dev [datafusion-comet] via GitHub
2026/10/19 Re: [PR] feat: build multi-column null-aware NOT IN on the subquery side [datafusion] via GitHub
2026/10/19 Re: [I] Parquet bloom filter pruning drops rows holding the other signed zero: `WHERE c = 0.0` misses `-0.0` rows (and vice versa) [datafusion] via GitHub
2026/10/19 [PR] fix: fall back to Spark for mode on FLOAT and DOUBLE before Spark 3.5.2 [datafusion-comet] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [I] Null-aware `NOT IN` hash join in `Partitioned` mode returns rows when the subquery contains NULL [datafusion] via GitHub
2026/10/19 Re: [PR] Show nullability of an explicit CastExpr target in its display [datafusion] via GitHub
2026/10/19 Re: [PR] chore: allow clippy mutable_key_type on Expr hash sets in PushDownFilter (#26181) [datafusion] via GitHub
2026/10/19 [I] Correlated subquery fails when filtering an aliased derived table on an outer column [datafusion] via GitHub
2026/10/19 Re: [PR] fix: keep file order for scans that advertise an output ordering [datafusion] via GitHub
2026/10/19 Re: [PR] fix: keep decimal and temporal types in nvl and ifnull [datafusion] via GitHub
2026/10/19 Re: [PR] Support PostgreSQL `ALTER DEFAULT PRIVILEGES` [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] fix: reset aggregate dynamic filters between recursive iterations [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [PR] Revert #25363 due to overlapping optimizations [datafusion] via GitHub
2026/10/19 Re: [PR] Accept `CREATE SEQUENCE` options in any order [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] fix: count grouped integer SUM state in the aggregate's memory reservation [datafusion-comet] via GitHub
2026/10/19 Re: [PR] Accept `CREATE SEQUENCE` options in any order [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] fix: Only apply SingleDistinctToGroupBy rewrite when it pays (closes #25932) [datafusion] via GitHub
2026/10/19 Re: [PR] doc: Document the physical optimizer contract [datafusion] via GitHub
2026/10/19 Re: [PR] fix: keep decimal and temporal types in nvl and ifnull [datafusion] via GitHub
2026/10/19 Re: [PR] Support PostgreSQL `ALTER DEFAULT PRIVILEGES` [datafusion-sqlparser-rs] via GitHub
2026/10/19 Re: [PR] fix: keep decimal and temporal types in nvl and ifnull [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [PR] feat(benchmarks): add dict_encoding_sweep harness [datafusion] via GitHub
2026/10/19 Re: [PR] Capture the `COPY ... FROM STDIN` payload verbatim [datafusion-sqlparser-rs] via GitHub
2026/10/19 [I] Correlated scalar subquery with `count(*)` returns 0 instead of NULL when `HAVING` references an outer column [datafusion] via GitHub