github  

Messages by Date

• 2026/01/21 [PR] feat: Coalesce small batches before shuffle write for improved efficiency [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] feat: support pushdown alias on dynamic filter with `ProjectionExec` [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: support pushdown alias on dynamic filter with `ProjectionExec` [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support left expression [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] fix: increase ROUND decimal precision to prevent overflow truncation [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix struct casts to align fields by name (prevent positional mis-casts) [datafusion] via GitHub
• 2026/01/21 [PR] fix: respect DataFrameWriteOptions::with_single_file_output for paths without extensions [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix DELETE/U{DATE filter extraction when predicates are pushed down into TableScan [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support planning subqueries with OuterReferenceColumn belongs to non-adjacent outer relations Cleanup [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support planning subqueries with OuterReferenceColumn belongs to non-adjacent outer relations Cleanup [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support planning subqueries with OuterReferenceColumn belongs to non-adjacent outer relations Cleanup [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support planning subqueries with OuterReferenceColumn belongs to non-adjacent outer relations Cleanup [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support planning subqueries with OuterReferenceColumn belongs to non-adjacent outer relations Cleanup [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support planning subqueries with OuterReferenceColumn belongs to non-adjacent outer relations Cleanup [datafusion] via GitHub
• 2026/01/21 [PR] Plann recursive subquery cleanup [datafusion] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix DELETE/U{DATE filter extraction when predicates are pushed down into TableScan [datafusion] via GitHub
• 2026/01/21 Re: [PR] Feat: to_csv [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 Re: [PR] docs: Add common pitfalls and improve PR checklist in development guide [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 Re: [I] to_csv: Handle edge cases found during fuzz testing [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 Re: [PR] Feat: to_csv [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] feat: [iceberg] Pass table master key ID to native scan [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] feat: New ballista python interface [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] perf: [shuffle] extend field-major processing to nested struct fields [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] fix: increase ROUND decimal precision to prevent overflow truncation [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] information_schema: use return_field_from_args for scalar UDFs [datafusion] via GitHub
• 2026/01/21 Re: [I] Regression: `DataFrameWriteOptions::with_single_file_output` produces a directory [datafusion] via GitHub
• 2026/01/21 Re: [I] Regression: `DataFrameWriteOptions::with_single_file_output` produces a directory [datafusion] via GitHub
• 2026/01/21 Re: [PR] Remove UDAF manual Debug impls and simplify signatures [datafusion] via GitHub
• 2026/01/21 Re: [PR] fix: Correct array_contains behavior for Spark-style null semantics [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] perf: extend field-major processing to nested struct fields [datafusion-comet] via GitHub
• 2026/01/21 Re: [I] perf: extend field-major processing to nested struct fields [datafusion-comet] via GitHub
• 2026/01/21 [PR] perf: extend field-major processing to nested struct fields [datafusion-comet] via GitHub
• 2026/01/21 Re: [I] perf: extend field-major processing to nested struct fields [datafusion-comet] via GitHub
• 2026/01/21 Re: [I] perf: extend field-major processing to nested struct fields [datafusion-comet] via GitHub
• 2026/01/21 Re: [I] to_csv: Handle edge cases found during fuzz testing [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 [I] to_csv: Handle edge cases found during fuzz testing [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] feat: New ballista python interface [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 Re: [PR] Feat: to_csv [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] Feat: to_csv [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] Automatically generate examples documentation adv (#19294) [datafusion] via GitHub
• 2026/01/21 Re: [PR] Feat: to_csv [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] Feat: to_csv [datafusion-comet] via GitHub
• 2026/01/21 Re: [I] [Incompatibility] Document array_distinct behavior differences: element ordering [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] feat(datafusion-spark): implement spark compatible `unhex` function [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/21 Re: [I] Ballista Python Issue(s) [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] feat: New ballista python interface [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] Support API for "pre-image" for pruning predicate evaluation [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: New ballista python interface [datafusion-ballista] via GitHub
• 2026/01/21 [PR] docs: Add common pitfalls and improve PR checklist in development guide [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] feat(datafusion-spark): implement spark compatible `unhex` function [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Add sort-based shuffle implementation [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] feat: Add sort-based shuffle implementation [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/21 Re: [I] Investigate use of comet shuffle [datafusion-ballista] via GitHub
• 2026/01/21 Re: [I] make DefaultLogicalExtensionCodec support serialisation of build in file formats [datafusion] via GitHub
• 2026/01/21 [I] Improve filter push-down [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Support left expression [datafusion-comet] via GitHub
• 2026/01/21 Re: [I] [Incompatibility] Document array_distinct behavior differences: element ordering [datafusion-comet] via GitHub
• 2026/01/21 Re: [PR] Wrap immutable plan parts into Arc [datafusion] via GitHub
• 2026/01/21 Re: [PR] Wrap immutable plan parts into Arc [datafusion] via GitHub
• 2026/01/21 Re: [I] make DefaultLogicalExtensionCodec support serialisation of build in file formats [datafusion] via GitHub
• 2026/01/21 Re: [PR] perf: Optimize scalar fast path for iszero [datafusion] via GitHub
• 2026/01/21 Re: [PR] perf: Optimize scalar fast path for iszero [datafusion] via GitHub
• 2026/01/21 Re: [I] make DefaultLogicalExtensionCodec support serialisation of build in file formats [datafusion] via GitHub
• 2026/01/21 [I] bug: Disable `DataFrame.cache()` for ballista [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] Wrap immutable plan parts into Arc [datafusion] via GitHub
• 2026/01/21 [PR] chore(deps): bump wasm-bindgen-test from 0.3.56 to 0.3.58 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump wasm-bindgen-test from 0.3.56 to 0.3.58 [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump chrono from 0.4.42 to 0.4.43 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump chrono from 0.4.42 to 0.4.43 [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump thiserror from 2.0.17 to 2.0.18 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump thiserror from 2.0.17 to 2.0.18 [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump insta from 1.46.0 to 1.46.1 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump insta from 1.46.0 to 1.46.1 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump object_store from 0.12.4 to 0.13.0 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump object_store from 0.12.4 to 0.13.0 [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump object_store from 0.12.4 to 0.13.1 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump object_store from 0.12.4 to 0.13.1 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump tokio-postgres from 0.7.15 to 0.7.16 [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump tokio-postgres from 0.7.15 to 0.7.16 [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump postgres-types from 0.2.11 to 0.2.12 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump postgres-types from 0.2.11 to 0.2.12 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump setuptools from 80.9.0 to 80.10.1 in /docs [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump myst-parser from 4.0.1 to 5.0.0 in /docs [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] Add Parquet read pruning configuration for max elements in inList [datafusion] via GitHub
• 2026/01/21 [PR] chore(deps): bump setuptools from 80.9.0 to 80.10.1 in /docs [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump myst-parser from 4.0.1 to 5.0.0 in /docs [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump taiki-e/install-action from 2.66.2 to 2.67.2 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump taiki-e/install-action from 2.66.2 to 2.67.0 [datafusion-sandbox] via GitHub
• 2026/01/21 [PR] chore(deps): bump taiki-e/install-action from 2.66.2 to 2.67.2 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] chore(deps): bump taiki-e/install-action from 2.66.2 to 2.67.0 [datafusion-sandbox] via GitHub
• 2026/01/21 Re: [PR] Add Parquet read pruning configuration for max elements in inList [datafusion] via GitHub
• 2026/01/21 Re: [I] Config the length of list when using In_list on parquet, rather than a const of 20. [datafusion] via GitHub
• 2026/01/21 [PR] Add Parquet read pruning configuration for max elements in inList [datafusion] via GitHub
• 2026/01/21 [PR] fix: change token consumption to pick to test on EOF in parser [datafusion] via GitHub
• 2026/01/21 Re: [I] API to register behavior for Extension Types [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix/parquet opener page index policy [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix/parquet opener page index policy [datafusion] via GitHub
• 2026/01/21 Re: [PR] [DRAFT] Extension Type Registry Draft [datafusion] via GitHub
• 2026/01/21 Re: [PR] [DRAFT] Extension Type Registry Draft [datafusion] via GitHub
• 2026/01/21 Re: [PR] perf: Optimize scalar fast path for iszero [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix/parquet opener page index policy [datafusion] via GitHub
• 2026/01/21 Re: [PR] fix: increase ROUND decimal precision to prevent overflow truncation [datafusion] via GitHub
• 2026/01/21 Re: [I] Investigate use of `DynamicFilters` in ballista [datafusion-ballista] via GitHub
• 2026/01/21 [PR] fix: increase ROUND decimal precision to prevent overflow truncation [datafusion] via GitHub
• 2026/01/21 Re: [PR] information_schema: use return_field_from_args for scalar UDFs [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix/parquet opener page index policy [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix/parquet opener page index policy [datafusion] via GitHub
• 2026/01/21 Re: [PR] Fix/parquet opener page index policy [datafusion] via GitHub
• 2026/01/21 [PR] export `SessionState::register_catalog_list(...)` [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [I] I would like to be able to view the explain output for a query in the UI [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [I] [Problem] How to deploy multiple schedulers on standalone mode but not docker [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] chore: update datafusion to 52.0 [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat: Improve fetch partition performance, support skip validation arrow ipc files [datafusion-ballista] via GitHub
• 2026/01/21 Re: [PR] feat: Improve fetch partition performance, support skip validation arrow ipc files [datafusion-ballista] via GitHub
• 2026/01/21 Re: [I] Config the length of list when using In_list on parquet, rather than a const of 20. [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] Support JSON arrays reader/parse for datafusion [datafusion] via GitHub
• 2026/01/21 [PR] Support JSON arrays reader/parse for datafusion [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 [PR] chore(deps): bump taiki-e/install-action from 2.66.7 to 2.67.2 [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/21 Re: [PR] Avoid repartition in build side [datafusion] via GitHub
• 2026/01/20 Re: [I] Investigate use of `DynamicFilters` in ballista [datafusion-ballista] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 [PR] fix: union should retrun error instead of panic when input schema's len different [datafusion] via GitHub
• 2026/01/20 Re: [PR] perf: Optimize scalar fast path for iszero [datafusion] via GitHub
• 2026/01/20 Re: [I] [Feature] Support Spark expression: last_day [datafusion-comet] via GitHub
• 2026/01/20 Re: [PR] Allow struct field access projections to be pushed down into scans [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: add support for last_day expression [datafusion-comet] via GitHub
• 2026/01/20 Re: [PR] feat: add `LogicalPlanBuilderExt` trait to move some DataFrame convenience methods into builder [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: Add Spark-compatible `xxhash64` and `murmur3` hash functions [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/20 Re: [I] `round` decimal incorrect result [datafusion] via GitHub
• 2026/01/20 Re: [I] `round` decimal incorrect result [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 Re: [PR] Fix struct casts to align fields by name (prevent positional mis-casts) [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: support Spark-compatible abs math function part 2 - ANSI mode [datafusion] via GitHub
• 2026/01/20 Re: [PR] perf: Optimize contains expression with SIMD-based scalar pattern sea… [datafusion-comet] via GitHub
• 2026/01/20 [I] `round` decimal incorrect result [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 [I] Support JSON arrays reader/parse for datafusion [datafusion] via GitHub
• 2026/01/20 Re: [I] Comet writer to support nested types [datafusion-comet] via GitHub
• 2026/01/20 Re: [PR] feat: [EXPERIMENTAL] direct native shuffle execution optimization [datafusion-comet] via GitHub
• 2026/01/20 Re: [I] Comet writer to support nested types [datafusion-comet] via GitHub
• 2026/01/20 Re: [I] Comet writer to support nested types [datafusion-comet] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 [PR] perf: Optimize scalar fast path for iszero [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 Re: [PR] feat: Expose `DefaultPhysicalPlanner::create_project_physical_exec` [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: Expose `DefaultPhysicalPlanner::create_project_physical_exec` [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 Re: [PR] feat: Add batch coalescing ability to shuffle reader exec [datafusion-ballista] via GitHub
• 2026/01/20 Re: [PR] feat: Add support for round-robin partitioning in native shuffle [datafusion-comet] via GitHub
• 2026/01/20 Re: [PR] Include license and notice files in more crates [datafusion] via GitHub
• 2026/01/20 Re: [PR] Include license and notice files in more crates [datafusion] via GitHub
• 2026/01/20 Re: [PR] feat: Add support for `unix_timestamp` function [datafusion-comet] via GitHub
• 2026/01/20 Re: [PR] feat(spark): add spark random functions [datafusion] via GitHub
• 2026/01/20 Re: [PR] chore(deps): bump thiserror from 2.0.17 to 2.0.18 [datafusion] via GitHub
• 2026/01/20 Re: [PR] Remove UDAF manual Debug impls and simplify signatures [datafusion] via GitHub
• 2026/01/20 Re: [PR] Remove UDAF manual Debug impls and simplify signatures [datafusion] via GitHub
• 2026/01/20 Re: [PR] Remove UDAF manual Debug impls and simplify signatures [datafusion] via GitHub
• 2026/01/20 Re: [PR] Feat : added truncate table support [datafusion] via GitHub
• 2026/01/20 Re: [PR] Feat : added truncate table support [datafusion] via GitHub
• 2026/01/20 Re: [PR] test(wasmtest): enable compression feature for wasm build [datafusion] via GitHub
• 2026/01/20 Re: [PR] perf: Optimize scalar performance for cot [datafusion] via GitHub
• 2026/01/20 Re: [PR] perf: Optimize scalar performance for cot [datafusion] via GitHub
• 2026/01/20 Re: [PR] test(wasmtest): enable compression feature for wasm build [datafusion] via GitHub
• 2026/01/20 Re: [PR] test(wasmtest): enable compression feature for wasm build [datafusion] via GitHub

• Earlier messages
• Later messages