github

Messages by Date

2026/03/23 Re: [PR] fix: insert placeholder type inference showing wrong type when there is function wrapped placeholder (unknown type) [datafusion] via GitHub
2026/03/23 [PR] test: [DO NOT MERGE] [iceberg] replace IcebergScanExec with PlaceholderRowExec in planner.rs to get garbage data back and assess number of test failures [datafusion-comet] via GitHub
2026/03/23 Re: [PR] chore: update Iceberg Java diffs after #3739 [iceberg] [datafusion-comet] via GitHub
2026/03/23 Re: [PR] perf: Optimize `string_to_array` for scalar args [datafusion] via GitHub
2026/03/23 Re: [I] Release DataFusion `53.0.0` (Feb 2026 / Mar 2026) [datafusion] via GitHub
2026/03/23 Re: [PR] perf: Optimize `string_to_array` for scalar args [datafusion] via GitHub
2026/03/23 [PR] perf: Optimize `string_to_array` for scalar args [datafusion] via GitHub
2026/03/23 [PR] Add `arrow_try_cast` UDF [datafusion] via GitHub
2026/03/23 Re: [I] Optimize `string_to_array` for scalar args [datafusion] via GitHub
2026/03/23 [I] Optimize `string_to_array` for scalar args [datafusion] via GitHub
2026/03/23 Re: [I] Release DataFusion `53.0.0` (Feb 2026 / Mar 2026) [datafusion] via GitHub
2026/03/23 Re: [PR] fix: skip empty metadata in intersect_metadata_for_union to prevent s… [datafusion] via GitHub
2026/03/23 Re: [I] Release DataFusion `53.0.0` (Feb 2026 / Mar 2026) [datafusion] via GitHub
2026/03/23 [I] [EPIC] Experiment with some different shuffle implementations [datafusion-comet] via GitHub
2026/03/23 Re: [PR] docs: document Iceberg Spark tests in contributor guide [datafusion-comet] via GitHub
2026/03/23 Re: [I] Improve integration tests to test push scheduler mode as well [datafusion-ballista] via GitHub
2026/03/23 Re: [PR] fix: fix string to timestamp cast for UTC timestamps [datafusion-comet] via GitHub
2026/03/23 Re: [PR] [Minor] add non topk benchmarks for utf8/utf8view string aggregates [datafusion] via GitHub
2026/03/23 Re: [PR] Misc minor optimizations to query optimizer performance [datafusion] via GitHub
2026/03/23 Re: [PR] Misc minor optimizations to query optimizer performance [datafusion] via GitHub
2026/03/23 Re: [PR] Misc minor optimizations to query optimizer performance [datafusion] via GitHub
2026/03/23 Re: [PR] feat: implement PhysicalOptimizerRule in FFI crate [datafusion] via GitHub
2026/03/23 [PR] Misc minor optimizations to query optimizer performance [datafusion] via GitHub
2026/03/23 Re: [PR] fix: skip empty metadata in intersect_metadata_for_union to prevent s… [datafusion] via GitHub
2026/03/23 Re: [PR] Substrait join consumer should not merge nullability of join expressions [datafusion] via GitHub
2026/03/23 [PR] docs: document Iceberg Spark tests in contributor guide [datafusion-comet] via GitHub
2026/03/23 Re: [I] Error with union and optimize_projections: Physical input schema should be the same as the one converted from logical input schema [datafusion] via GitHub
2026/03/23 [PR] fix: skip empty metadata in intersect_metadata_for_union to prevent s… [datafusion] via GitHub
2026/03/23 Re: [I] Support columns having the same alias [datafusion] via GitHub
2026/03/23 [PR] Fix/support duplicate column names #6543 [datafusion] via GitHub
2026/03/23 [I] Unsupported table function arguments are silently dropped [datafusion] via GitHub
2026/03/23 Re: [I] Substrait join consumer produces incorrect logical plan [datafusion] via GitHub
2026/03/23 [I] Substrait join consumer produces incorrect logical plan [datafusion] via GitHub
2026/03/23 Re: [PR] feat: implement PhysicalOptimizerRule in FFI crate [datafusion] via GitHub
2026/03/23 [I] package `lz4_flex v0.12.0` in Cargo.lock is yanked [datafusion] via GitHub
2026/03/23 Re: [PR] perf: optimize scatter with type-specific specialization [datafusion] via GitHub
2026/03/23 Re: [PR] Substrait join consumer should not merge nullability of join expressions [datafusion] via GitHub
2026/03/23 Re: [PR] chore: Fix all sqllogictest dangling configs [datafusion] via GitHub
2026/03/23 Re: [PR] Fix index panic in unparser with mismatched stacked projections [datafusion] via GitHub
2026/03/23 Re: [PR] Fix index panic in unparser with mismatched stacked projections [datafusion] via GitHub
2026/03/23 [PR] Add ExpressionAnalyzer for pluggable expression-level statistics estimation [datafusion] via GitHub
2026/03/23 Re: [PR] docs: Document the TableProvider evaluation order for filter, limit and projection [datafusion] via GitHub
2026/03/23 Re: [PR] docs: Document the TableProvider evaluation order for filter, limit and projection [datafusion] via GitHub
2026/03/23 Re: [PR] [main] Update version to 52.4.0 and update changelog [datafusion] via GitHub
2026/03/23 Re: [PR] Avoid creating new RecordBatches to simplify expressions [datafusion] via GitHub
2026/03/23 Re: [PR] Avoid creating new RecordBatches to simplify expressions [datafusion] via GitHub
2026/03/23 Re: [I] Incorrectly parsed SQL query containing GROUP BY ALL and an alias in the projection [datafusion] via GitHub
2026/03/23 Re: [PR] fix(sql): handle GROUP BY ALL with aliased aggregates [datafusion] via GitHub
2026/03/23 Re: [PR] Teach row group pruning about struct field predicates [datafusion] via GitHub
2026/03/23 Re: [PR] Avoid creating new RecordBatches to simplify expressions [datafusion] via GitHub
2026/03/23 Re: [PR] feat[substrait]: translate row_count statistics via RelCommon hint [datafusion] via GitHub
2026/03/23 Re: [I] [DISCUSSION] PR Review Process / States / "How to find the PRs in the list that need review" [datafusion] via GitHub
2026/03/23 Re: [PR] Super fast extended tests and improved planning speed linux [datafusion] via GitHub
2026/03/23 Re: [PR] Blog post on writing table providers [datafusion-site] via GitHub
2026/03/23 Re: [PR] fix: set escape_char when simplifying starts_with to LIKE [datafusion] via GitHub
2026/03/23 Re: [PR] fix: set escape_char when simplifying starts_with to LIKE [datafusion] via GitHub
2026/03/23 Re: [PR] fix: preserve duplicate GROUPING SETS rows [datafusion] via GitHub
2026/03/23 Re: [PR] Avoid creating new RecordBatches to simplify expressions [datafusion] via GitHub
2026/03/23 Re: [PR] perf: remove buffer reuse and arrow_ffi_safe flag [WIP] [datafusion-comet] via GitHub
2026/03/23 Re: [PR] fix: string_to_array('', delim) returns empty array for PostgreSQL compatibility [datafusion] via GitHub
2026/03/23 [I] Port or enable DateTimeUtilsSuite timestamp format tests in Comet [datafusion-comet] via GitHub
2026/03/23 [PR] Substrait join consumer should not merge nullability of equality [datafusion] via GitHub
2026/03/23 Re: [PR] fix: add timezone and special formats support for cast string to timestamp [datafusion-comet] via GitHub
2026/03/23 Re: [I] `native_datafusion` doesn't report input metrics [datafusion-comet] via GitHub
2026/03/23 Re: [I] Pluggable expression-level statistics estimation (ExpressionAnalyzer) [datafusion] via GitHub
2026/03/23 [I] Pluggable expression-level statistics estimation (ExpressionAnalyzer) [datafusion] via GitHub
2026/03/23 Re: [PR] fix: Add schema validation for native_datafusion Parquet scan [datafusion-comet] via GitHub
2026/03/23 Re: [PR] fix: add timezone and special formats support for cast string to timestamp [datafusion-comet] via GitHub
2026/03/23 Re: [PR] Blog post on writing table providers [datafusion-site] via GitHub
2026/03/23 Re: [PR] Blog post on writing table providers [datafusion-site] via GitHub
2026/03/23 Re: [PR] Blog post on writing table providers [datafusion-site] via GitHub
2026/03/23 [I] feat: Support additional timezone offset formats in string-to-timestamp cast [datafusion-comet] via GitHub
2026/03/23 Re: [PR] Blog post on writing table providers [datafusion-site] via GitHub
2026/03/23 Re: [PR] Blog post on writing table providers [datafusion-site] via GitHub
2026/03/23 Re: [PR] Blog post on writing table providers [datafusion-site] via GitHub
2026/03/23 Re: [PR] Add a builder to `SimplifyContext` to avoid allocating default values [datafusion] via GitHub
2026/03/23 Re: [D] Q2 2026 roadmap planning [datafusion] via GitHub
2026/03/23 Re: [I] Fork DataFusion SMJ in Comet repo [datafusion-comet] via GitHub
2026/03/23 Re: [PR] [RFC] Add lambda support and array_transform udf [datafusion] via GitHub
2026/03/23 [PR] chore: update iceberg-rust diffs after #3739 [iceberg] [datafusion-comet] via GitHub
2026/03/23 Re: [PR] [RFC] Add lambda support and array_transform udf [datafusion] via GitHub
2026/03/23 [PR] WIP: fix: remove buffer reuse and arrow_ffi_safe flag [datafusion-comet] via GitHub
2026/03/23 Re: [PR] [RFC] Add lambda support and array_transform udf [datafusion] via GitHub
2026/03/23 Re: [PR] [RFC] Add lambda support and array_transform udf [datafusion] via GitHub
2026/03/23 Re: [PR] chore: Add `substr()` benchmarks, refactor [datafusion] via GitHub
2026/03/23 Re: [PR] [RFC] Add lambda support and array_transform udf [datafusion] via GitHub
2026/03/23 Re: [PR] chore: Add `substr()` benchmarks, refactor [datafusion] via GitHub
2026/03/23 Re: [PR] [RFC] Add lambda support and array_transform udf [datafusion] via GitHub
2026/03/23 Re: [PR] [RFC] Add lambda support and array_transform udf [datafusion] via GitHub
2026/03/23 Re: [PR] perf: Optimize `split_part`, support `Utf8View` [datafusion] via GitHub
2026/03/23 [PR] perf: Optimize `split_part`, support `Utf8View` [datafusion] via GitHub
2026/03/23 Re: [I] `split_part` should preserve Utf8View input [datafusion] via GitHub
2026/03/23 Re: [I] Optimize `split_part` for single-character delimiters [datafusion] via GitHub
2026/03/23 [I] Optimize `split_part` for single-character delimiters [datafusion] via GitHub
2026/03/23 Re: [PR] chore: fix allocations in schema adapter for `native_datafusion` scan [datafusion-comet] via GitHub
2026/03/23 Re: [PR] chore: cache Parquet metadata in `native_datafusion` scan [datafusion-comet] via GitHub
2026/03/23 [I] `split_part` should preserve Utf8View input [datafusion] via GitHub
2026/03/23 Re: [PR] chore: cache Parquet metadata in `native_datafusion` scan [datafusion-comet] via GitHub
2026/03/23 [I] DataFusion support for `TimestampWithOffset` [datafusion] via GitHub
2026/03/23 [PR] functions: Add dict support for get field [datafusion] via GitHub
2026/03/23 [PR] chore: update lockfile to resolve cargo audit failure [datafusion] via GitHub
2026/03/23 [I] Support dict encoded structs in `get_field` [datafusion] via GitHub
2026/03/23 Re: [PR] feat: add approx_top_k aggregate function [datafusion] via GitHub
2026/03/23 Re: [PR] chore(deps): update datafusion to 52.4.0 [iceberg] [datafusion-comet] via GitHub
2026/03/23 Re: [PR] feat: Support Spark expression window_time [datafusion-comet] via GitHub
2026/03/23 Re: [I] Refactor planner on native side to improve modularity [datafusion-comet] via GitHub
2026/03/23 Re: [PR] Add configurable UNION DISTINCT to FILTER rewrite optimization [datafusion] via GitHub
2026/03/23 Re: [I] Let partition_statistics accept pre-computed children statistics [datafusion] via GitHub
2026/03/23 Re: [PR] chore: cache Parquet metadata in `native_datafusion` scan [datafusion-comet] via GitHub
2026/03/23 Re: [PR] add first draft of wikipedia article [datafusion] via GitHub
2026/03/23 Re: [PR] chore: `native_datafusion` scan optimizations part1 [datafusion-comet] via GitHub
2026/03/23 Re: [I] Let partition_statistics accept pre-computed children statistics [datafusion] via GitHub
2026/03/23 Re: [PR] chore: [native_datafusion] replace #3311 references with specific issues in 3.5.8 diff [datafusion-comet] via GitHub
2026/03/23 Re: [PR] perf: Enable native c2r for more queries [datafusion-comet] via GitHub
2026/03/23 Re: [PR] perf: Mark more operators as FFI safe to avoid deep copies [datafusion-comet] via GitHub
2026/03/23 Re: [I] Enable native c2r for more queries [datafusion-comet] via GitHub
2026/03/23 Re: [PR] Add end-to-end Parquet tests for List and LargeList struct schema evolution [datafusion] via GitHub
2026/03/23 Re: [PR] chore(deps): update datafusion to 52.4.0 [iceberg] [datafusion-comet] via GitHub
2026/03/23 [PR] refactor: reorganize shuffle crate module structure [datafusion-comet] via GitHub
2026/03/23 Re: [PR] add first draft of wikipedia article [datafusion] via GitHub
2026/03/23 Re: [PR] Add configurable UNION DISTINCT to FILTER rewrite optimization [datafusion] via GitHub
2026/03/23 Re: [PR] add first draft of article [datafusion] via GitHub
2026/03/23 Re: [I] Fork DataFusion SMJ in Comet repo [datafusion-comet] via GitHub
2026/03/23 Re: [PR] chore: `native_datafusion` scan optimizations part1 [datafusion-comet] via GitHub
2026/03/23 Re: [PR] perf: Mark more operators as FFI safe to avoid deep copies [datafusion-comet] via GitHub
2026/03/23 Re: [PR] Refactor ordered-set aggregate Dataframe APIs to align with SQL(#18279) [datafusion] via GitHub
2026/03/23 Re: [I] Fork DataFusion SMJ in Comet repo [datafusion-comet] via GitHub
2026/03/23 [I] Fork DataFusion SMJ in Comet repo [datafusion-comet] via GitHub
2026/03/23 Re: [PR] add first draft of article [datafusion] via GitHub
2026/03/23 Re: [PR] add first draft of article [datafusion] via GitHub
2026/03/23 [I] Remove mutable buffer use from CometArrowConverters [datafusion-comet] via GitHub
2026/03/23 Re: [PR] fix: validate wrapped negation during type coercion [datafusion] via GitHub
2026/03/23 Re: [PR] perf: Improve planning time w/ global default `ConfigOptions` [datafusion] via GitHub
2026/03/23 Re: [PR] perf: Improve planning time w/ global default `ConfigOptions` [datafusion] via GitHub
2026/03/23 Re: [PR] Add a builder to `SimplifyContext` to avoid allocating default values [datafusion] via GitHub
2026/03/23 Re: [PR] perf: Improve planning time w/ global default `ConfigOptions` [datafusion] via GitHub
2026/03/23 Re: [PR] DataFrame API: allow aggregate functions in select() (#17874) [datafusion] via GitHub
2026/03/23 Re: [PR] chore: run Spark 3.4 tests with `native_datafusion` scan [datafusion-comet] via GitHub
2026/03/23 Re: [PR] chore: run Spark 3.4 tests with `native_datafusion` scan [datafusion-comet] via GitHub
2026/03/23 [PR] chore(deps): update datafusion to 52.4.0 [datafusion-comet] via GitHub
2026/03/23 Re: [PR] [Minor] add non topk benchmarks for utf8/utf8view string aggregates [datafusion] via GitHub
2026/03/23 Re: [PR] [Minor] add non topk benchmarks for utf8/utf8view string aggregates [datafusion] via GitHub
2026/03/23 Re: [PR] Support recursive schema compatibility validation for container types wrapping evolved structs [datafusion] via GitHub
2026/03/23 [PR] feat[substrait]: translate row_count statistics via RelCommon hint [datafusion] via GitHub
2026/03/23 Re: [PR] perf: default multi COUNT(DISTINCT) logical optimizer rewrite [datafusion] via GitHub
2026/03/23 Re: [PR] chore: extract shuffle module into separate crate [datafusion-comet] via GitHub
2026/03/23 Re: [PR] perf: default multi COUNT(DISTINCT) logical optimizer rewrite [datafusion] via GitHub
2026/03/23 Re: [I] Support for in-memory file format tables [datafusion] via GitHub
2026/03/23 Re: [I] TPC-DS at different scale factors [datafusion-benchmarks] via GitHub
2026/03/23 Re: [PR] feat: create a datafusion-example for in-memory file format [datafusion] via GitHub
2026/03/23 Re: [PR] feat: create a datafusion-example for in-memory file format [datafusion] via GitHub
2026/03/23 Re: [PR] feat: create a datafusion-example for in-memory file format [datafusion] via GitHub
2026/03/23 Re: [I] feat: Extend single-value NDV optimization to string types [datafusion] via GitHub
2026/03/23 Re: [I] feat: Extend single-value NDV optimization to string types [datafusion] via GitHub
2026/03/23 Re: [I] feat: Extend single-value NDV optimization to timestamp and interval types [datafusion] via GitHub
2026/03/23 Re: [PR] Basic Extension Type Registry Implementation [datafusion] via GitHub
2026/03/23 Re: [PR] Fix push_down_filter for children with non-empty fetch fields [datafusion] via GitHub
2026/03/23 Re: [PR] perf: Improve planning time w/ global default `ConfigOptions` [datafusion] via GitHub
2026/03/23 Re: [PR] Fix push_down_filter for children with non-empty fetch fields [datafusion] via GitHub
2026/03/23 Re: [I] feat: Extend single-value NDV optimization to string and non-numeric types [datafusion] via GitHub
2026/03/23 Re: [PR] feat: Set NDV to Exact(1) for numeric equality filter predicates [datafusion] via GitHub
2026/03/23 Re: [I] TPC-DS at different scale factors [datafusion-benchmarks] via GitHub
2026/03/23 Re: [I] TPC-DS at different scale factors [datafusion-benchmarks] via GitHub
2026/03/23 Re: [PR] feat: Set NDV to Exact(1) for numeric equality filter predicates [datafusion] via GitHub
2026/03/23 [I] feat: Extend single-value NDV optimization to timestamp and interval types [datafusion] via GitHub
2026/03/23 Re: [I] feat: Extend single-value NDV optimization to string and non-numeric types [datafusion] via GitHub
2026/03/23 Re: [PR] feat: create a datafusion-example for in-memory file format [datafusion] via GitHub
2026/03/23 Re: [PR] perf: default multi COUNT(DISTINCT) logical optimizer rewrite [datafusion] via GitHub
2026/03/23 Re: [PR] feat: Set NDV to Exact(1) for numeric equality filter predicates [datafusion] via GitHub
2026/03/23 Re: [PR] feat(stats): Set distinct_count to Exact(1) when filter narrows column to single value [datafusion] via GitHub
2026/03/23 [PR] feat: add support for parquet content defined chunking options [datafusion] via GitHub
2026/03/23 Re: [I] EPIC: Making use of NDVs (number of distinct values) in DataFusion [datafusion] via GitHub
2026/03/23 Re: [PR] feat(stats): Set distinct_count to Exact(1) when filter narrows column to single value [datafusion] via GitHub
2026/03/23 [I] feat: Extend single-value NDV optimization to string and non-numeric types [datafusion] via GitHub
2026/03/23 Re: [PR] fix: handle inf/-inf in ShimSparkErrorConverter cast overflow [datafusion-comet] via GitHub
2026/03/23 [PR] fix: handle inf/-inf in ShimSparkErrorConverter cast overflow [datafusion-comet] via GitHub
2026/03/23 [I] CastOverFlow conversion throws NumberFormatException for inf/-inf in ShimSparkErrorConverter (Spark 3.4/3.5/4.0) [datafusion-comet] via GitHub
2026/03/23 Re: [PR] ci: pin third-party actions to Apache-approved SHAs [datafusion-ballista] via GitHub
2026/03/23 Re: [PR] ci: pin third-party actions to Apache-approved SHAs [datafusion-ballista] via GitHub
2026/03/23 Re: [PR] Fix push_down_filter for children with non-empty fetch fields [datafusion] via GitHub
2026/03/23 Re: [I] Query execution time difference between deltatable QueryBuilder and using DataFusion directly. [datafusion-python] via GitHub
2026/03/23 Re: [PR] DataFrame API: allow aggregate functions in select() (#17874) [datafusion] via GitHub
2026/03/23 Re: [PR] Disallow order by within ordered-set aggregate functions argument lists [datafusion] via GitHub
2026/03/23 Re: [PR] Refactor percentile UDFs to use TypeSignature API [datafusion] via GitHub
2026/03/23 Re: [PR] feat: expose comet metrics through Sparks external monitoring system [datafusion-comet] via GitHub
2026/03/23 Re: [PR] Agg bench [datafusion] via GitHub
2026/03/23 Re: [PR] fix: native error message not propagated to SparkException on empty errorClass [datafusion-comet] via GitHub
2026/03/23 Re: [I] User annotations in ExecutionPlan [datafusion] via GitHub
2026/03/23 Re: [I] User annotations in ExecutionPlan [datafusion] via GitHub
2026/03/23 Re: [PR] ci: pin third-party actions to Apache-approved SHAs [datafusion-ballista] via GitHub
2026/03/23 Re: [PR] chore(deps): bump rustls-webpki from 0.103.9 to 0.103.10 [datafusion-ballista] via GitHub
2026/03/22 Re: [PR] ci: pin third-party actions to Apache-approved SHAs [datafusion-ballista] via GitHub
2026/03/22 Re: [PR] ci: pin third-party actions to Apache-approved SHAs [datafusion-ballista] via GitHub
2026/03/22 [PR] chore(deps): bump rustls-webpki from 0.103.9 to 0.103.10 [datafusion-ballista] via GitHub
2026/03/22 Re: [PR] chore(deps): bump github/codeql-action from 4.33.0 to 4.34.1 [datafusion-ballista] via GitHub
2026/03/22 Re: [PR] feat: create a datafusion-example for in-memory file format [datafusion] via GitHub
2026/03/22 Re: [I] [EPIC] Migrate to functions in `datafusion-spark` crate [datafusion-comet] via GitHub
2026/03/22 Re: [PR] perf: Optimize `array_min`, `array_max` for arrays of primitive types [datafusion] via GitHub
2026/03/22 Re: [PR] perf: Optimize `array_min`, `array_max` for arrays of primitive types [datafusion] via GitHub
2026/03/22 Re: [PR] perf: Optimize `array_min`, `array_max` for arrays of primitive types [datafusion] via GitHub