issues  

Messages by Date

• 2026/11/02 [jira] [Commented] (SPARK-60809) DPP and runtime bloom filters can fail a query by evaluating a throwable pruning key on partitions that the data filters exclude Peter Toth (Jira) via issues
• 2026/11/02 [jira] [Resolved] (SPARK-60803) Fix auto-filled DSv2 generated columns reading a struct field before the store assignment cast Dongjoon Hyun (Jira) via issues
• 2026/11/02 [jira] [Resolved] (SPARK-59695) SCD1 Ignore-null support; Introduce version map in `cdc_metadata` Jose Torres (Jira) via issues
• 2026/11/02 [jira] [Resolved] (SPARK-60801) Fix wrong results by reading the Hive default partition as NULL Dongjoon Hyun (Jira) via issues
• 2026/11/02 [jira] [Updated] (SPARK-60749) Do not reorder associative operators across different evaluation modes ASF GitHub Bot (Jira) via issues
• 2026/11/02 [jira] [Updated] (SPARK-60810) Keep CHAR column statistics through read-side padding Yang Jie (Jira) via issues
• 2026/11/02 [jira] [Updated] (SPARK-60808) Runtime bloom filter built from a non-deterministic creation side can drop join rows Peter Toth (Jira) via issues
• 2026/11/02 [jira] [Created] (SPARK-60809) DPP and runtime bloom filters can fail a query by evaluating a throwable pruning key on partitions that the data filters exclude Peter Toth (Jira) via issues
• 2026/11/02 [jira] [Updated] (SPARK-60807) Restore offloaded ML model summaries during fetch Ruifeng Zheng (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60807) Restore offloaded ML model summaries during fetch Ruifeng Zheng (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60795) pgrade `fabric8` to 7.9.0 and update CRDs for K8s 1.37 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60806) CREATE FUNCTION should reject only the temporary functions a permanent function's body actually calls Ganesha S (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60806) CREATE FUNCTION should reject only the temporary functions a permanent function's body actually calls Ganesha S (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60805) CREATE FUNCTION rejects function bodies that call system- or catalog-qualified functions Ganesha S (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60804) Fix off-by-one error in Kubernetes executor pod allocation maximum ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60804) Fix off-by-one error in Kubernetes executor pod allocation maximum Tongwei (Jira) via issues
• 2026/11/01 [jira] [Resolved] (SPARK-60328) HiveDDLSuite SPARK-34261 test fails depending on test order Kousuke Saruta (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60328) HiveDDLSuite SPARK-34261 test fails depending on test order Kousuke Saruta (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60328) HiveDDLSuite SPARK-34261 test fails depending on test order Kousuke Saruta (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60610) FileSourceScanExec.bucketedScan re-reads spark.sql.sources.bucketing.enabled on the copy made at stage creation ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60802) Upgrade `Gradle` to 9.8.2 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60803) Fix auto-filled DSv2 generated columns reading a struct field before the store assignment cast Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60633) Do not push a throwable filter condition through a unary operator ahead of the conditions written before it L. C. Hsieh (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60633) Do not push a throwable filter condition through a unary operator ahead of the conditions written before it L. C. Hsieh (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60633) Do not push a throwable filter condition through a unary operator ahead of the conditions written before it L. C. Hsieh (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60633) Do not push a throwable filter condition through a unary operator ahead of the conditions written before it L. C. Hsieh (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60656) pandas-on-Spark np.maximum fails to propagate a missing operand generated by log ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60796) Fix to treat the default partition name as null ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60780) Report subqueries in table OPTIONS as non-constant instead of an internal error Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60800) Reject aggregate and window functions in DSv2 CHECK constraints ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60799) Upgrade Jackson to 2.22.4 ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60801) Fix wrong results by reading the Hive default partition as NULL Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Commented] (SPARK-60646) pandas-on-Spark Series.fillna rejects a Series fill value from the same DataFrame Ramesh Thamizhselvan (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60799) Upgrade Jackson to 2.22.4 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Resolved] (SPARK-60798) Upgrade Jackson to 2.22.4 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60803) Fix auto-filled DSv2 generated columns reading a struct field before the store assignment cast Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60803) Fix auto-filled DSv2 generated columns reading a struct field before the store assignment cast Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60803) Fix auto-filled DSv2 generated columns reading a struct field before the store assignment cast Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60796) Fix `HiveTableScanExec.prunePartitions` to treat the default partition name as null Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60801) Fix wrong results by reading the Hive default partition as NULL Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60800) Reject aggregate and window functions in DSv2 CHECK constraints Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60797) Fix wrong decimal partition values when the scale differs from the schema Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60797) Fix wrong decimal partition values when the scale differs from the schema Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60797) Fix wrong decimal partition values when the scale differs from the schema Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60798) Upgrade Jackson to 2.22.4 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60797) Fix wrong decimal partition values when the scale differs from the schema Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60796) Fix `HiveTableScanExec.prunePartitions` to treat the default partition name as null Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60796) Fix to treat the default partition name as null Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60796) Fix to treat the default partition name as null Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60796) Fix to treat the default partition name as null Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60796) Fix to treat the default partition name as null Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60788) Parquet nested schema pruning can misread two-level LISTs and return values for missing field IDs Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60779) Shrink zstd output buffers to reduce direct memory held by Arrow batches Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60791) ORC V2 returns the wrong nested field when pruning under positional schema evolution Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60792) ORC V1 validates a pruned TIMESTAMP_NTZ field against the wrong physical field Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60795) pgrade `fabric8` to 7.9.0 and update CRDs for K8s 1.37 ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60795) pgrade `fabric8` to 7.9.0 and update CRDs for K8s 1.37 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60788) Parquet nested schema pruning can misread two-level LISTs and return values for missing field IDs ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Assigned] (SPARK-60793) Upgrade Spark to 4.3.0 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Resolved] (SPARK-60793) Upgrade Spark to 4.3.0 Dongjoon Hyun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60793) Upgrade Spark to 4.3.0 ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60791) ORC V2 returns the wrong nested field when pruning under positional schema evolution Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60790) Nested schema pruning rejects nonempty column defaults when reading older Parquet files Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60789) Nested Dataset projections can return a sibling field or fail under case-insensitive analysis Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60792) ORC V1 validates a pruned TIMESTAMP_NTZ field against the wrong physical field Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60789) Nested Dataset projections can return a sibling field or fail under case-insensitive analysis Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60791) ORC V2 returns the wrong nested field when pruning under positional schema evolution Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60789) Nested Dataset projections can return a sibling field or fail under case-insensitive analysis Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60788) Parquet nested schema pruning can misread two-level LISTs and return values for missing field IDs Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60792) ORC V1 validates a pruned TIMESTAMP_NTZ field against the wrong physical field Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60792) ORC V1 validates a pruned TIMESTAMP_NTZ field against the wrong physical field Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60790) Nested schema pruning rejects nonempty column defaults when reading older Parquet files Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60788) Parquet nested schema pruning can misread two-level LISTs and return values for missing field IDs Chao Sun (Jira) via issues
• 2026/11/01 [jira] [Commented] (SPARK-60785) get_json_object returns the string 'null' instead of NULL when an array index path reaches a JSON null Vangelis Nikolopoulos (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60702) Don't skip a runtime bloom filter for a DPP filter that physical planning drops Peter Toth (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60785) get_json_object returns the string 'null' instead of NULL when an array index path reaches a JSON null ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60787) CHECK constraints checked through predicateSql resolve a function name without parentheses to a column added later Yang Jie (Jira) via issues
• 2026/11/01 [jira] [Updated] (SPARK-60775) getOrCreate for Dataset / DataFrame to allow to resuming after a failed stage ASF GitHub Bot (Jira) via issues
• 2026/11/01 [jira] [Created] (SPARK-60786) Pass integral, floating, date and timestamp literals to generated classes by reference, so a new value does not recompile Max Gekk (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60778) [K8S] ExecutorPodsAllocator can reuse a PVC still mounted by a live executor when no new snapshot arrives in an allocation round Guang Yang (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60783) A V2 ScalarFunction that inherits produceResult or invoke from a base class fails with SCALAR_FUNCTION_NOT_FULLY_IMPLEMENTED Anil K (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60783) A V2 ScalarFunction that inherits produceResult or invoke from a base class fails with SCALAR_FUNCTION_NOT_FULLY_IMPLEMENTED Anil K (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60632) LIKE/RLIKE expensive heuristic checks the wrong operand and loses filter pushdown L. C. Hsieh (Jira) via issues
• 2026/10/31 [jira] [Assigned] (SPARK-60607) Decode Arrow day-time intervals as timedelta in the Rust Spark Connect client DB Tsai (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60778) [K8S] ExecutorPodsAllocator can reuse a PVC still mounted by a live executor when no new snapshot arrives in an allocation round ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60781) Reject subqueries in CHECK constraint conditions ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Assigned] (SPARK-60777) Reject user-defined functions in DSv2 CHECK constraints Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60779) Shrink zstd output buffers to reduce direct memory held by Arrow batches ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60776) Fix Arrow memory leak when compressing a record batch fails Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60785) get_json_object returns the string 'null' instead of NULL when an array index path reaches a JSON null Yaoxuan Wu (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60784) Structured Streaming: dropDuplicates / distinct after an aggregation in Complete output mode drops groups from later micro-batches Yaoxuan Wu (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60782) Pandas and Arrow cogroups pair groups wrongly when the two sides' grouping keys have different types Anil K (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60632) LIKE/RLIKE expensive heuristic checks the wrong operand and loses filter pushdown L. C. Hsieh (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60782) Pandas and Arrow cogroups pair groups wrongly when the two sides' grouping keys have different types Anil K (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60632) LIKE/RLIKE expensive heuristic checks the wrong operand and loses filter pushdown L. C. Hsieh (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60607) Decode Arrow day-time intervals as timedelta in the Rust Spark Connect client DB Tsai (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60777) Reject user-defined functions in DSv2 CHECK constraints Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60781) Reject subqueries in CHECK constraint conditions Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60779) Shrink zstd output buffers to reduce direct memory held by Arrow batches Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60780) Report subqueries in table OPTIONS as non-constant instead of an internal error Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60777) Reject user-defined functions in DSv2 CHECK constraints Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Assigned] (SPARK-60776) Fix Arrow memory leak when compressing a record batch fails Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60777) Reject user-defined functions in DSv2 CHECK constraints ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60776) Fix Arrow memory leak when compressing a record batch fails ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-48575) spark.history.fs.update.interval calling too many directory pollings when spark log dir contains many sparkEvent apps ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60776) Fix Arrow memory leak when compressing a record batch fails Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60764) Do not embed constraint text in the generated code of DSv2 CheckInvariant Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60547) createDataFrame with TimeType(p) keeps more than p fractional digits, so equal TIME(p) values compare different ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60707) Arrow's ZstdCompressionCodec writes up to 8 bytes past its output buffer when Spark compresses Arrow batches with zstd Peter Toth (Jira) via issues
• 2026/10/31 [jira] [Assigned] (SPARK-60707) Arrow's ZstdCompressionCodec writes up to 8 bytes past its output buffer when Spark compresses Arrow batches with zstd Peter Toth (Jira) via issues
• 2026/10/31 [jira] [Commented] (SPARK-60775) getOrCreate for Dataset / DataFrame to allow to resuming after a failed stage Amogh Desai (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60775) getOrCreate for Dataset / DataFrame to allow to resuming after a failed stage Amogh Desai (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60198) Document the transpilers hook's runtime contract ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Assigned] (SPARK-60762) Pass ScalaUDF error message parameters to generated code as references Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60762) Pass ScalaUDF error message parameters to generated code as references Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60760) Use constant names for lambda variable references in higher-order function codegen Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Assigned] (SPARK-60760) Use constant names for lambda variable references in higher-order function codegen Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-59992) element_at and array index are wrongly non-nullable under ANSI mode when the index is nullable Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60329) Whole-stage codegen of a filter checks a plain-column IS NOT NULL later than its position in the condition ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60755) Fix codegen compilation failure of `element_at` and array index when the result is not nullable Dongjoon Hyun (Jira) via issues
• 2026/10/31 [jira] [Created] (SPARK-60774) Common subexpression first referenced in a conditional branch of a predicate's conjunct is evaluated before the conjunct Max Gekk (Jira) via issues
• 2026/10/31 [jira] [Updated] (SPARK-60332) Filter with whole-stage codegen off evaluates a common subexpression of later conjuncts before an earlier FALSE conjunct ASF GitHub Bot (Jira) via issues
• 2026/10/31 [jira] [Assigned] (SPARK-60222) Keep task completion listeners on the completing thread when another thread invokes listeners L. C. Hsieh (Jira) via issues
• 2026/10/31 [jira] [Resolved] (SPARK-60222) Keep task completion listeners on the completing thread when another thread invokes listeners L. C. Hsieh (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60773) Make server-side Maven resolution opt-in in Spark Connect ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60773) Make server-side Maven resolution opt-in in Spark Connect Qianlan Chen (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60773) Make server-side Maven resolution opt-in in Spark Connect Qianlan Chen (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60772) Accept inferred signed-int64 NumPy ndarray input in Spark Connect Rust DB Tsai (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60650) pandas-on-Spark named size aggregation is mapped to SQL size and fails on an integer column ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-55014) Split projection for expensive filters Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-55014) Split projection for expensive filters Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-55014) Split projection for expensive filters Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60771) Avoid generic scalar probes for exact Python datetime input in Spark Connect Rust DB Tsai (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60770) Add AvailableNow SQL golden test coverage for Structured Streaming Siying Dong (Jira) via issues
• 2026/10/30 [jira] [Assigned] (SPARK-60672) Fix error offsets to use proepr codepoints Wenchen Fan (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-60672) Fix error offsets to use proepr codepoints Wenchen Fan (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60672) Fix error offsets to use proepr codepoints Wenchen Fan (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60769) Read Maven resolution settings from session configuration Qianlan Chen (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60769) Read Maven resolution settings from session configuration Qianlan Chen (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-60188) Warn on unknown variety names in `pyTranspilers` Holden Karau (Jira) via issues
• 2026/10/30 [jira] [Assigned] (SPARK-60188) Warn on unknown variety names in `pyTranspilers` Holden Karau (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-60150) A filter pushed below a DISTINCT on a float key returns a row that fails the predicate Holden Karau (Jira) via issues
• 2026/10/30 [jira] [Assigned] (SPARK-58628) Transpilation: Avoid adding None/null checks with raises on non-nullable fields Holden Karau (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-58628) Transpilation: Avoid adding None/null checks with raises on non-nullable fields Holden Karau (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-59546) Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XM Holden Karau (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60767) Flush Python worker init responses for initialization timing ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Assigned] (SPARK-59546) Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XM Holden Karau (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-60420) Add JDBC options to control Oracle TimestampNTZ mapping and wall-clock conversion separately Uroš Bojanić (Jira) via issues
• 2026/10/30 [jira] [Assigned] (SPARK-60420) Add JDBC options to control Oracle TimestampNTZ mapping and wall-clock conversion separately Uroš Bojanić (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60768) Skip nested schema pruning in DSv2 column pruning when no nested field is requested ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60767) Flush Python worker init responses for initialization timing Haotian Sun (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60768) Skip nested schema pruning in DSv2 column pruning when no nested field is requested Yuchuan Huang (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-56754) Prepare Apache Spark 4.3.0 Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60745) Avoid row materialization for Arrow-backed pandas string input in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60727) Use Arrow columns for supported pandas float64 input in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60766) Prune nested fields through dynamic array indices and Map keys ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60766) Prune nested fields through dynamic array indices and Map keys Chao Sun (Jira) via issues
• 2026/10/30 [jira] [Assigned] (SPARK-60468) Only treat leading SPARK-XXXXX tags as JIRA IDs in merge_spark_pr.py Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-37019) Add Codegen support to array higher-order-functions Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60765) SPIP: Extend DSv2 push-down with join, set operation, and window function support Jing Zhan (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60765) SPIP: Extend DSv2 push-down with join, set operation, and window function support Jing Zhan (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60757) Do not apply a writer's session settings to the generation expression of a generated column Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60765) SPIP: Extend DSv2 push-down with join, set operation, and window function support Jing Zhan (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60765) SPIP: Extend DSv2 push-down with join, set operation, and window function support Jing Zhan (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60746) Interval division by -1 overflow raises different errors in interpreted and generated code Max Gekk (Jira)
• 2026/10/30 [jira] [Assigned] (SPARK-60757) Do not apply a writer's session settings to the generation expression of a generated column Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60696) Accept scientific notation Decimal input in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/30 [jira] [Created] (SPARK-60748) Extract shared CREATE VIEW analysis helpers Jira
• 2026/10/30 [jira] [Updated] (SPARK-59948) Strip aliases from a DSv2 reported ordering on a nested field Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60720) Use Arrow columns for supported pandas string input in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/30 [jira] [Assigned] (SPARK-60764) Do not embed constraint text in the generated code of DSv2 CheckInvariant Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60764) Do not embed constraint text in the generated code of DSv2 CheckInvariant ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60764) Do not embed constraint text in the generated code of DSv2 CheckInvariant Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Resolved] (SPARK-60392) Whole-stage codegen off evaluates a subexpression shared by filter conjuncts before the condition, so a conjunct after a FALSE one can raise Max Gekk (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60265) Add optional size-based packing for DataSource V2 batch scans Rakesh Kumar (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60763) Add migration note for the V2 scan grouping change in Spark 4.2 Rakesh Kumar (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60763) Add migration note for the V2 scan grouping change in Spark 4.2 ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60762) Pass ScalaUDF error message parameters to generated code as references ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60762) Pass ScalaUDF error message parameters to generated code as references Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60760) Use constant names for lambda variable references in higher-order function codegen ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60761) Spark Connect DataFrame.withColumns({}) fails with an empty AssertionError, while classic returns the DataFrame unchanged ASF GitHub Bot (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60743) make_timestamp silently wraps an out-of-range seconds value ASF GitHub Bot (Jira)
• 2026/10/30 [jira] [Created] (SPARK-60761) Spark Connect DataFrame.withColumns({}) fails with an empty AssertionError, while classic returns the DataFrame unchanged Shuheng Ma (Jira) via issues
• 2026/10/30 [jira] [Created] (SPARK-60760) Use constant names for lambda variable references in higher-order function codegen Dongjoon Hyun (Jira) via issues
• 2026/10/30 [jira] [Updated] (SPARK-60757) Do not apply a writer's session settings to the generation expression of a generated column Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Commented] (SPARK-60644) Dedup within watermark incremental cleanup Amir Shenavandeh (Jira)
• 2026/10/30 [jira] [Created] (SPARK-60756) SQLAppStatusListener.onJobStart forces synchronous kvstore write during history replay, causing O(J^2) replay cost Yuqin Luo (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60718) Check whether an expression accepts an indeterminate collation before typing its children Gengliang Wang (Jira)
• 2026/10/30 [jira] [Resolved] (SPARK-60718) Check whether an expression accepts an indeterminate collation before typing its children Gengliang Wang (Jira)
• 2026/10/30 [jira] [Assigned] (SPARK-60718) Check whether an expression accepts an indeterminate collation before typing its children Gengliang Wang (Jira)
• 2026/10/30 [jira] [Commented] (SPARK-60756) SQLAppStatusListener.onJobStart forces synchronous kvstore write during history replay, causing O(J^2) replay cost Yuqin Luo (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60759) SQLAppStatusListener.aggregateMetrics has O(N^2) cost when merging driver accumulator updates ASF GitHub Bot (Jira)
• 2026/10/30 [jira] [Assigned] (SPARK-56754) Prepare Apache Spark 4.3.0 Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60759) SQLAppStatusListener.aggregateMetrics has O(N^2) cost when merging driver accumulator updates Yuqin Luo (Jira)
• 2026/10/30 [jira] [Created] (SPARK-60759) SQLAppStatusListener.aggregateMetrics has O(N^2) cost when merging driver accumulator updates Yuqin Luo (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-57644) Support Generating values and constraints for DSV2 Generated Column Expressions Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Created] (SPARK-60758) Require the same broadcast mode when a DPP filter reuses a broadcast without AQE Peter Toth (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60757) Do not apply a writer's session settings to the generation expression of a generated column ASF GitHub Bot (Jira)
• 2026/10/30 [jira] [Updated] (SPARK-60757) Do not apply a writer's session settings to the generation expression of a generated column Dongjoon Hyun (Jira)
• 2026/10/30 [jira] [Created] (SPARK-60757) Do not apply a writer's session settings to the generation expression of a generated column Dongjoon Hyun (Jira)

• Earlier messages
• Later messages