Messages by Thread
-
Re: [I] Propagate window ranking statistics into rank filters [datafusion]
mohitgurav20 (via GitHub) via github
-
[PR] feat: add Spark-compatible array_position [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] fix: split_part returns NULL for position 0 when every string in the batch is NULL [datafusion]
sohailshk (via GitHub) via github
-
[PR] style: run cargo fmt --all [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: generate the DataFusion Distributed comparison results from the published JSON [datafusion-ballista]
NoahKusaba (via GitHub) via github
-
[PR] docs: flesh out top-level README [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] fix: count early emitted groups in the partial aggregation skip probe [datafusion]
comphead (via GitHub) via github
-
[I] Switch to Hawkeye instead of RAT [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Partial aggregation stops skipping after early emits under memory pressure [datafusion]
comphead (via GitHub) via github
-
Re: [PR] fix: Unnest must not keep its input's uniqueness [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [I] [EPIC] Native DataSketches: theta, KLL, frequent items and tuple sketches [datafusion-comet]
cboumalh (via GitHub) via github
-
Re: [PR] feat: protobuf serialization for the materialized CTE plan nodes [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] feat: decide automatically when to materialize a CTE [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] feat: push filters that all references share into the body of a materialized CTE [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] Avoid concatenating record batches in joins [datafusion]
github-actions[bot] (via GitHub) via github
-
Re: [PR] fix: reject GROUPING masks wider than 64 bits [datafusion]
github-actions[bot] (via GitHub) via github
-
[PR] fix: compact over-fragmented string/binary view columns in hash join build [datafusion]
osscm (via GitHub) via github
-
[PR] fix: return an error for out-of-bounds Parquet protobuf projection indices [datafusion]
rxdrccq (via GitHub) via github
-
Re: [PR] chore(deps): bump swatinem/rust-cache from 2.9.2 to 2.9.3 in /.github/actions/setup-rust in the github-actions group across 1 directory [datafusion-iceberg]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump rustls from 0.23.45 to 0.23.46 [datafusion-iceberg]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump datafusion-sqllogictest from 55.0.0 to 55.2.0 [datafusion-iceberg]
comphead (via GitHub) via github
-
Re: [PR] chore(deps): bump datafusion-cli from 55.0.0 to 55.2.0 [datafusion-iceberg]
comphead (via GitHub) via github
-
[PR] fix: preserve common equivalence classes in union output (#26625) [datafusion]
galaxytemple (via GitHub) via github
-
Re: [PR] docs: add AI-assisted contributions page to the contributor guide [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] feat: support kurtosis aggregate [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] test: extend C2R and R2C microbenchmarks to cover nested types [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] Fix ClickHouse numeric roundtrip test without bigdecimal [datafusion-sqlparser-rs]
lovasoa (via GitHub) via github
-
Re: [PR] chore: fix compiler warnings in the spark module [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] fix: fall back to Spark for mode on FLOAT and DOUBLE before Spark 3.5.2 [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] docs: list contrib/delta-spark/pom.xml in the version bump and add a dependency refresh step [datafusion-comet]
andygrove (via GitHub) via github
-
Re: [PR] fix: run flatten natively on arrays of binary and name the expression in fallback reasons [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] Preserve quotes in named placeholders [datafusion-sqlparser-rs]
lovasoa (via GitHub) via github
-
Re: [PR] docs: describe the long-lived branch for upgrading DataFusion [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] docs: add per-function documentation template with sha2 and substring examples [datafusion-spark]
andygrove (via GitHub) via github
-
Re: [PR] docs: explain the Enable CI on your fork check in the contributor guide [datafusion-comet]
andygrove (via GitHub) via github
-
[PR] fix: don't double count column join keys in SortMergeJoinExec buffered batch reservation [datafusion]
Kristofferjoha (via GitHub) via github
-
Re: [PR] Generic: Disallow quoted identifiers in colon and at-sign placeholders [datafusion-sqlparser-rs]
lovasoa (via GitHub) via github
-
[I] [EPIC] Finish moving datafusion-spark into this repository [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: improve crate README and API docs for crates.io and docs.rs [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Epic: Document Spark-specific behavior for every expression [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] test: add an SQL reproducer for the canceled hash join partition hang [datafusion]
adriangb (via GitHub) via github
-
Re: [PR] fix: preserve filter semantics for casts and negation [datafusion-iceberg]
debugmiller (via GitHub) via github
-
[PR] chore: add a manual PySpark runner for the Spark sqllogictest files [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] PostgreSQL: Support `ALTER EXTENSION ... UPDATE` [datafusion-sqlparser-rs]
LucaCappelletti94 (via GitHub) via github
-
[PR] chore: move audit-datafusion-spark-expression skill to datafusion-spark repo [datafusion]
andygrove (via GitHub) via github
-
[PR] ci: add cargo fmt and clippy workflow [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: add audit-datafusion-spark-expression agent skill and AGENTS.md [datafusion-spark]
andygrove (via GitHub) via github
-
Re: [I] perf: a shuffle over a native plan takes the JVM row shuffle for round-robin and nested hash partitioning [datafusion-comet]
JonSnow1807 (via GitHub) via github
-
[PR] test: run sqllogictest files in CI [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] fix: bound aggregate spill batches by the memory of the first spill [datafusion]
adriangb (via GitHub) via github
-
[PR] ci: add Apache RAT license header check [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] docs: add README [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Re-apply apache/datafusion#26703 (dictionary values compaction in hex) once DataFusion 56 crates are released [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Support Spark-version-specific expectations in datafusion-spark sqllogictest files [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] encode accepts charsets and unmappable characters that Spark 4 rejects [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] / on integers returns an integer in Spark SQL, Spark always returns a DOUBLE [datafusion-spark]
andygrove (via GitHub) via github
-
[PR] chore: add top-level workspace Cargo.toml [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] last_day, monthname, weekday, round and unbase64 reject arguments that Spark implicitly casts [datafusion-spark]
comphead (via GitHub) via github
-
[I] Add Spark-compatible AtLeastNNonNulls physical expression [datafusion-spark]
rich7420 (via GitHub) via github
-
[I] [Bug] round on a DECIMAL keeps the input type, Spark reduces the scale of the result [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] pmod and mod report Arrow's divide-by-zero message instead of Spark's REMAINDER_BY_ZERO text [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Spark aggregate functions do not report distinct_handling [datafusion-spark]
mkleen (via GitHub) via github
-
[I] Spark `negative` returns wrong results for decimal columns [datafusion-spark]
neilconway (via GitHub) via github
-
[I] [Bug] parse_url raises on a malformed URL when ANSI mode is off, Spark returns NULL [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] unbase64 rejects input that Spark's MIME decoder accepts [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] trunc and date_trunc handle unsupported, NULL and non-literal formats differently from Spark [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] pmod rejects string arguments that Spark implicitly casts to a numeric type [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Spark make_dt_interval/make_interval return NULL on overflow instead of erroring [datafusion-spark]
YutaLin (via GitHub) via github
-
[I] Spark `xxhash64` hashes the raw bits of a NaN instead of the canonical NaN [datafusion-spark]
andygrove (via GitHub) via github
-
[I] bug: `SparkCollectList`/`SparkCollectSet` declare nullable list elements, diverging from Spark's `containsNull = false` [datafusion-spark]
peterxcli (via GitHub) via github
-
[I] [Bug] pow differs from Spark for -0.0, NaN and infinite exponents [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] format_string prints the unscaled value for %s of a DECIMAL and strips trailing zeros for %g [datafusion-spark]
comphead (via GitHub) via github
-
[I] Support 2-argument ceil(decimal, scale) for Spark [datafusion-spark]
diegoQuinas (via GitHub) via github
-
[I] [Bug] spark factorial: BIGINT overflow should wrap in non-ANSI mode and raise CAST_OVERFLOW in ANSI mode, as in Spark [datafusion-spark]
ShayanGho (via GitHub) via github
-
[I] [Bug] date_part('SECOND', ts) drops the fractional seconds, Spark returns decimal(8,6) [datafusion-spark]
comphead (via GitHub) via github
-
[I] [Bug] atan2 does not normalize -0.0 the way Spark does [datafusion-spark]
comphead (via GitHub) via github
-
[I] spark: array_contains compares floats by bits, where Spark treats -0.0 as 0.0 and all NaNs as equal [datafusion-spark]
zhangfengcdt (via GitHub) via github
-
[I] [Bug] spark factorial rejects STRING, DECIMAL and floating-point inputs that Spark implicitly casts to INT [datafusion-spark]
ShayanGho (via GitHub) via github
-
[I] Some `datafusion-spark` expressions are missing the physical implementation [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [Bug] next_day cross-version divergence: ANSI default flip and error class change between Spark 3.5 and 4.x [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Extend `datafusion-spark` `sequence` function [datafusion-spark]
erenavsarogullari (via GitHub) via github
-
[I] Spark `round()` on floating-point types diverges from Spark HALF_UP semantics [datafusion-spark]
sjhddh (via GitHub) via github
-
[I] perf: Adopt bulk-NULL builders and NullBuffer::union_many in datafusion-spark [datafusion-spark]
mbutrovich (via GitHub) via github
-
[I] Add Spark-compatible Parquet reader [datafusion-spark]
andygrove (via GitHub) via github
-
[I] bug: datafusion-spark format_string %t timestamp specifiers do not match Spark behavior [datafusion-spark]
andygrove (via GitHub) via github
-
[I] [datafusion-spark] Support year-month interval and day-time interval in spark sqllogictest [datafusion-spark]
hsiang-c (via GitHub) via github
-
[I] Introduce version-specific behavior in Spark expressions [datafusion-spark]
andygrove (via GitHub) via github
-
[I] Support 2-argument ceil(value, scale) for Spark [datafusion-spark]
comphead (via GitHub) via github
-
[I] spark: introduce Spark `arrays_zip` [datafusion-spark]
comphead (via GitHub) via github
-
[I] feat: Implement `datafusion-spark` `sequence` function [datafusion-spark]
erenavsarogullari (via GitHub) via github
-
[I] Support ANSI mode for `negate` function [datafusion-spark]
comphead (via GitHub) via github
-
[I] [EPIC] Complete `datafusion-spark` Spark Compatible Functions [datafusion-spark]
alamb (via GitHub) via github
-
[I] [datafusion-spark] Implement `map` function [datafusion-spark]
peterxcli (via GitHub) via github
-
[I] [datafusion-spark] implement spark random functions [datafusion-spark]
cht42 (via GitHub) via github
-
[I] feat: Support test spark runner in `datafusion-spark` for slt tests [datafusion-spark]
comphead (via GitHub) via github
-
[I] [datafusion-spark] Optimize hex function [datafusion-spark]
andygrove (via GitHub) via github
-
[I] regexp_extract func from Spark [datafusion-spark]
SKY-ALIN (via GitHub) via github
-
[I] Spark-compatible CAST operation [datafusion-spark]
Blizzara (via GitHub) via github
-
[I] EPIC: fix nullability report for spark expression [datafusion-spark]
rluvaton (via GitHub) via github
-
[I] spark `make_interval` need to have custom nullability [datafusion-spark]
rluvaton (via GitHub) via github
-
Re: [I] Static planner drops a RepartitionExec with range partitioning instead of planning a range shuffle [datafusion-ballista]
andygrove (via GitHub) via github
-
Re: [PR] feat: admit every array and map type in Spark-to-Comet conversion [datafusion-comet]
andygrove (via GitHub) via github
-
[I] [feature request] PostgreSQL: FOR NO KEY UPDATE / FOR KEY SHARE, PREPARE TRANSACTION family and DO blocks have no AST production [datafusion-sqlparser-rs]
putao520 (via GitHub) via github
-
[PR] fix: fail the task when Spark throws during a native memory request [datafusion-comet]
JonSnow1807 (via GitHub) via github
-
[I] Move `SparkOptions` and `enable_ansi_mode` from `datafusion-common` to `datafusion-spark` [datafusion]
andygrove (via GitHub) via github
-
[PR] Use narrow dictionary keys for small Parquet row groups [datafusion]
Rich-T-kid (via GitHub) via github
-
[PR] Compact dictionary group keys after filters [datafusion]
Rich-T-kid (via GitHub) via github
-
[PR] Cache dictionary translations for hash joins [datafusion]
Rich-T-kid (via GitHub) via github