issues

Messages by Date

2026/08/02 [jira] [Updated] (SPARK-58507) ClosureCleaner's indylambda path repeats expensive work on every clean() call ASF GitHub Bot (Jira)
2026/08/02 [jira] [Assigned] (SPARK-58507) ClosureCleaner's indylambda path repeats expensive work on every clean() call Josh Rosen (Jira)
2026/08/02 [jira] [Created] (SPARK-58507) ClosureCleaner's indylambda path repeats expensive work on every clean() call Josh Rosen (Jira)
2026/08/02 [jira] [Updated] (SPARK-58502) Make in-limit SQL test deterministic ASF GitHub Bot (Jira)
2026/08/02 [jira] [Updated] (SPARK-58505) Attach per-consumer memory breakdown to UNABLE_TO_ACQUIRE_MEMORY task errors ASF GitHub Bot (Jira)
2026/08/02 [jira] [Updated] (SPARK-58506) Assert Spark's own error contract in codegen compile failure tests ASF GitHub Bot (Jira)
2026/08/02 [jira] [Created] (SPARK-58506) Assert Spark's own error contract in codegen compile failure tests Yang Jie (Jira)
2026/08/02 [jira] [Updated] (SPARK-58505) Attach per-consumer memory breakdown to UNABLE_TO_ACQUIRE_MEMORY task errors Ganesha S (Jira)
2026/08/02 [jira] [Updated] (SPARK-58505) Attach per-consumer memory breakdown to UNABLE_TO_ACQUIRE_MEMORY task errors Ganesha S (Jira)
2026/08/02 [jira] [Created] (SPARK-58505) Attach per-consumer memory breakdown to UNABLE_TO_ACQUIRE_MEMORY task errors Ganesha S (Jira)
2026/08/02 [jira] [Updated] (SPARK-58504) Make FileTokenIngestor cache thread-safe ASF GitHub Bot (Jira)
2026/08/02 [jira] [Created] (SPARK-58504) Make FileTokenIngestor cache thread-safe Wenchen Fan (Jira)
2026/08/02 [jira] [Resolved] (SPARK-58454) Fully decouple pipelined shuffles from the MapOutputTracker- #57646 Wenchen Fan (Jira)
2026/08/02 [jira] [Assigned] (SPARK-58454) Fully decouple pipelined shuffles from the MapOutputTracker- #57646 Wenchen Fan (Jira)
2026/08/02 [jira] [Assigned] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window Jira
2026/08/02 [jira] [Resolved] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window Jira
2026/08/02 [jira] [Updated] (SPARK-58154) Several expressions hold shared mutable state that is unprotected by the stateful-expression mechanism, corrupting results under concurrent evaluation Josh Rosen (Jira)
2026/08/02 [jira] [Updated] (SPARK-58383) ReplaceExceptWithFilter binds the RHS filter by column name, returning wrong EXCEPT results when an LHS alias reuses a base column name Josh Rosen (Jira)
2026/08/02 [jira] [Updated] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window Josh Rosen (Jira)
2026/08/02 [jira] [Resolved] (SPARK-58348) Move PySpark error doc header into global variable Jira
2026/08/02 [jira] [Assigned] (SPARK-58348) Move PySpark error doc header into global variable Jira
2026/08/02 [jira] [Assigned] (SPARK-57841) Add cross-precision and nested test coverage for nanosecond-precision timestamps Jira
2026/08/02 [jira] [Resolved] (SPARK-57841) Add cross-precision and nested test coverage for nanosecond-precision timestamps Jira
2026/08/02 [jira] [Resolved] (SPARK-58459) Remove branch-specific logic from build_main Jira
2026/08/02 [jira] [Assigned] (SPARK-58459) Remove branch-specific logic from build_main Jira
2026/08/02 [jira] [Resolved] (SPARK-57161) Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect Jira
2026/08/02 [jira] [Assigned] (SPARK-57161) Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect Jira
2026/08/02 [jira] [Assigned] (SPARK-57835) Define read behavior for persisted nanosecond-typed tables when the preview flag is off Jira
2026/08/02 [jira] [Resolved] (SPARK-57835) Define read behavior for persisted nanosecond-typed tables when the preview flag is off Jira
2026/08/02 [jira] [Updated] (SPARK-58486) InjectRuntimeFilter builds runtime bloom filters with collation-agnostic XxHash64, silently dropping join rows when a collated equi-join key is a non-attribute expression ASF GitHub Bot (Jira)
2026/08/02 [jira] [Updated] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window ASF GitHub Bot (Jira)
2026/08/02 [jira] [Updated] (SPARK-58420) COUNT(DISTINCT ...) does not sort maps in the argument trees Vladimir Golubev (Jira)
2026/08/02 [jira] [Updated] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window Vladimir Golubev (Jira)
2026/08/02 [jira] [Created] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window Vladimir Golubev (Jira)
2026/08/02 [jira] [Updated] (SPARK-58502) Make in-limit SQL test deterministic Vladimir Golubev (Jira)
2026/08/02 [jira] [Created] (SPARK-58502) Make in-limit SQL test deterministic Vladimir Golubev (Jira)
2026/08/02 [jira] [Updated] (SPARK-58501) [SQL] Eliminate redundant subexpression evaluation across Expand branches in whole-stage codegen ASF GitHub Bot (Jira)
2026/08/02 [jira] [Created] (SPARK-58501) [SQL] Eliminate redundant subexpression evaluation across Expand branches in whole-stage codegen James Xu (Jira)
2026/08/02 [jira] [Resolved] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI Kousuke Saruta (Jira)
2026/08/02 [jira] [Assigned] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI Kousuke Saruta (Jira)
2026/08/02 [jira] [Updated] (SPARK-58500) Accept a single tuple of column names in DataFrame.describe and selectExpr ASF GitHub Bot (Jira)
2026/08/02 [jira] [Created] (SPARK-58500) Accept a single tuple of column names in DataFrame.describe and selectExpr Haotian Sun (Jira)
2026/08/01 [jira] [Created] (SPARK-58499) Support hostNetwork mode for kubernetes Chenyu Zheng (Jira)
2026/08/01 [jira] [Resolved] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet Dongjoon Hyun (Jira)
2026/08/01 [jira] [Assigned] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet Dongjoon Hyun (Jira)
2026/08/01 [jira] [Resolved] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Assigned] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Updated] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString` ASF GitHub Bot (Jira)
2026/08/01 [jira] [Created] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Resolved] (SPARK-58497) Support `createDataFrame` in `SparkSession` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Assigned] (SPARK-58496) Support field-name-based access in `Row` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Resolved] (SPARK-58496) Support field-name-based access in `Row` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Assigned] (SPARK-58497) Support `createDataFrame` in `SparkSession` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Updated] (SPARK-58482) Filtering a cached table for NaN values returns incorrect results: cached-batch pruning compares under a different ordering than the statistics were built with ASF GitHub Bot (Jira)
2026/08/01 [jira] [Updated] (SPARK-58497) Support `createDataFrame` in `SparkSession` ASF GitHub Bot (Jira)
2026/08/01 [jira] [Created] (SPARK-58497) Support `createDataFrame` in `SparkSession` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Updated] (SPARK-58496) Support field-name-based access in `Row` ASF GitHub Bot (Jira)
2026/08/01 [jira] [Created] (SPARK-58496) Support field-name-based access in `Row` Dongjoon Hyun (Jira)
2026/08/01 [jira] [Updated] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet ASF GitHub Bot (Jira)
2026/08/01 [jira] [Created] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet Dongjoon Hyun (Jira)
2026/08/01 [jira] [Resolved] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0 Dongjoon Hyun (Jira)
2026/08/01 [jira] [Assigned] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0 Dongjoon Hyun (Jira)
2026/08/01 [jira] [Updated] (SPARK-57835) Define read behavior for persisted nanosecond-typed tables when the preview flag is off ASF GitHub Bot (Jira)
2026/08/01 [jira] [Updated] (SPARK-57161) Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect ASF GitHub Bot (Jira)
2026/08/01 [jira] [Updated] (SPARK-57460) Support nanosecond-precision timestamp types in the JDBC datasource ASF GitHub Bot (Jira)
2026/08/01 [jira] [Updated] (SPARK-57837) Support the precision argument in current_timestamp(p) and localtimestamp(p) ASF GitHub Bot (Jira)
2026/08/01 [jira] [Updated] (SPARK-58471) Improve TrainValidationSplitModel size estimation ASF GitHub Bot (Jira)
2026/08/01 [jira] [Resolved] (SPARK-57897) Create connector/credential-aws module Kousuke Saruta (Jira)
2026/08/01 [jira] [Assigned] (SPARK-57897) Create connector/credential-aws module Kousuke Saruta (Jira)
2026/07/31 [jira] [Updated] (SPARK-58443) Wrong results or exception in instr and substring_index for an Int.MinValue position or count Eric Yang (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58437) Fix invalid Java constructs in generated code that Janino tolerates Yang Jie (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58391) Validate AutoCDC sequencing, track-history, and delete-condition drift across incremental runs Szehon Ho (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58391) Validate AutoCDC sequencing, track-history, and delete-condition drift across incremental runs Szehon Ho (Jira)
2026/07/31 [jira] [Created] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0 Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0 ASF GitHub Bot (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58493) Support collection functions in `CollectionFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58493) Support collection functions in `CollectionFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Commented] (SPARK-58455) SPIP: Spark Connect Gateway — Session Affinity, Auth, and Multi-Tenancy for Spark Connect Servers Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58493) Support collection functions in `CollectionFunctions` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58493) Support collection functions in `CollectionFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58491) Support `expr` in `Functions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58491) Support `expr` in `Functions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58488) Fix type annotations for varargs methods that also accept a single sequence Haotian Sun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58488) Fix type annotations for varargs methods that also accept a single sequence ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58488) Fix type annotations for DataFrameWriter and DataStreamWriter partitionBy/clusterBy/bucketBy/sortBy Haotian Sun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58491) Support `expr` in `Functions` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58491) Support `expr` in `Functions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58490) Support collection functions in `CollectionFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58490) Support collection functions in `CollectionFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58489) Support datetime functions in `DateTimeFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58489) Support datetime functions in `DateTimeFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-56498) Implement decoupled state store maintenance Anish Shrigondekar (Jira)
2026/07/31 [jira] [Assigned] (SPARK-56498) Implement decoupled state store maintenance Anish Shrigondekar (Jira)
2026/07/31 [jira] [Updated] (SPARK-58490) Support collection functions in `CollectionFunctions` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58490) Support collection functions in `CollectionFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58489) Support datetime functions in `DateTimeFunctions` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58489) Support datetime functions in `DateTimeFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58483) Support string functions in `StringFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58483) Support string functions in `StringFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Created] (SPARK-58488) Fix type annotations for varargs methods that also accept a single sequence Haotian Sun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) "Pandas UDFs and Arrow-enabled toPandas() silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) Pandas UDFs and Arrow-enabled toPandas() silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) When Arrow execution is enabled, toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Created] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64 Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58482) Filtering a cached table for NaN values returns incorrect results: cached-batch pruning compares under a different ordering than the statistics were built with Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58443) Wrong results in instr and substring_index for an Int.MinValue position or count Eric Yang (Jira)
2026/07/31 [jira] [Updated] (SPARK-58443) Wrong results in instr and substring_index for an Int.MinValue position or count Eric Yang (Jira)
2026/07/31 [jira] [Created] (SPARK-58486) InjectRuntimeFilter builds runtime bloom filters with collation-agnostic XxHash64, silently dropping join rows when a collated equi-join key is a non-attribute expression Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58484) CSV scan fails with ArrayIndexOutOfBoundsException when a pushed filter has no column references and the required schema is empty Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58478) SCD1 AutoCDC rejects dropping a nested struct/array field but accepts dropping a top-level column Andreas Neumann (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58418) SCD2 AutoCDC fails with NUM_COLUMNS_MISMATCH when a flow narrower than the evolved target reconciles Szehon Ho (Jira)
2026/07/31 [jira] [Updated] (SPARK-58484) CSV scan fails with ArrayIndexOutOfBoundsException when a pushed filter has no column references and the required schema is empty Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58418) SCD2 AutoCDC fails with NUM_COLUMNS_MISMATCH when a flow narrower than the evolved target reconciles Szehon Ho (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58418) SCD2 AutoCDC fails with NUM_COLUMNS_MISMATCH when a flow narrower than the evolved target reconciles Szehon Ho (Jira)
2026/07/31 [jira] [Updated] (SPARK-58485) Broadcast hash join fails with "Subquery has not finished" when the join key contains an uncorrelated scalar subquery Josh Rosen (Jira)
2026/07/31 [jira] [Created] (SPARK-58485) Broadcast hash join fails with "Subquery has not finished" when the join key > contains an uncorrelated scalar subquery Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58485) Broadcast hash join fails with "Subquery has not finished" when the join key contains an uncorrelated scalar subquery Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58482) Filtering a cached tables for NaN values returns incorrect results: cached-batch pruning compares under a different ordering than the statistics were built with Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58484) CSV scan fails with ArrayIndexOutOfBoundsException when a pushed filter has no column references and the required schema is empty Josh Rosen (Jira)
2026/07/31 [jira] [Created] (SPARK-58484) CSV scan fails with ArrayIndexOutOfBoundsException when a pushed filter has no column references and the required schema is empty Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58483) Support string functions in `StringFunctions` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58483) Support string functions in `StringFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Created] (SPARK-58482) Filtering a cached tables for NaN values returns incorrect results: cached-batch pruning compares under a different ordering than the statistics were built with Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58481) InSubqueryExec declares incorrect nullability, which can cause incorrect query results Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58481) InSubqueryExec declares incorrect nullability, which can cause incorrect query results Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58481) FULL OUTER JOIN with a NOT IN subquery condition returns the cross product Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58481) FULL OUTER JOIN with a NOT IN subquery condition returns the cross product Josh Rosen (Jira)
2026/07/31 [jira] [Created] (SPARK-58481) FULL OUTER JOIN with a NOT IN subquery condition returns the cross product Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58481) FULL OUTER JOIN with a NOT IN subquery condition returns the cross product Josh Rosen (Jira)
2026/07/31 [jira] [Updated] (SPARK-58480) Coalesce input Python test files for new DF golden file suite ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58480) Coalesce input Python test files for new DF golden file suite Daniel Tenedorio (Jira)
2026/07/31 [jira] [Updated] (SPARK-45900) Expand hash functionalities from to include XXH3 ASF GitHub Bot (Jira)
2026/07/31 [jira] [Resolved] (SPARK-40259) Support Parquet DSv2 in subquery plan merge Peter Toth (Jira)
2026/07/31 [jira] [Assigned] (SPARK-40259) Support Parquet DSv2 in subquery plan merge Peter Toth (Jira)
2026/07/31 [jira] [Updated] (SPARK-58409) Add SCD2 end-to-end test suites to match SCD1 AutoCDC coverage ASF GitHub Bot (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58468) Support on-demand loading for single event logs in Spark History Server Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58468) Support on-demand loading for single event logs in Spark History Server Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58479) Support math functions in `MathFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58479) Support math functions in `MathFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58479) Support math functions in `MathFunctions` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58479) Support math functions in `MathFunctions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58478) SCD1 AutoCDC rejects dropping a nested struct/array field but accepts dropping a top-level column Andreas Neumann (Jira)
2026/07/31 [jira] [Created] (SPARK-58478) SCD1 AutoCDC rejects dropping a nested struct/array field but accepts dropping a top-level column Andreas Neumann (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58454) Fully decouple pipelined shuffles from the MapOutputTracker- #57646 ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58475) Support predicate and string methods in Column Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58475) Support predicate and string methods in Column Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58475) Support predicate and string methods in Column ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58475) Support predicate and string methods in Column Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-57823) Support ORC predicate pushdown for nanosecond-precision timestamps ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-57832) Support timestamp - timestamp subtraction for nanosecond-precision timestamps (microsecond-precision interval result) ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-57897) Create connector/credential-aws module ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Created] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column` Dongjoon Hyun (Jira)
2026/07/31 [jira] [Updated] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column` ASF GitHub Bot (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58431) SimplifyExtractValueOps folds an out-of-bounds array index to NULL under ANSI, suppressing INVALID_ARRAY_INDEX and corrupting the result's nullability Wenchen Fan (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58419) [SQL] Support ANSI SQL UNNEST in the FROM clause Wenchen Fan (Jira)
2026/07/31 [jira] [Updated] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58468) Support on-demand loading for single event logs in Spark History Server Cheng Pan (Jira)
2026/07/31 [jira] [Created] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI Kousuke Saruta (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58419) [SQL] Support ANSI SQL UNNEST in the FROM clause Wenchen Fan (Jira)
2026/07/31 [jira] [Updated] (SPARK-58468) Support on-demand loading for V1 event logs in Spark History Server ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-57894) Implement UpdateUserCredentials RPC, backend integration, and task closure delivery ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58471) Improve TrainValidationSplitModel size estimation Ruifeng Zheng (Jira)
2026/07/31 [jira] [Created] (SPARK-58471) Improve TrainValidationSplitModel size estimation Ruifeng Zheng (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58462) Exclude tuning params from CrossValidatorModel size Ruifeng Zheng (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58462) Exclude tuning params from CrossValidatorModel size Ruifeng Zheng (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58463) Close merged pull requests before posting summaries Ruifeng Zheng (Jira)
2026/07/31 [jira] [Updated] (SPARK-58470) Use native Spark expressions for NumPy trunc ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58469) Use native Spark expressions for NumPy rint ASF GitHub Bot (Jira)
2026/07/31 [jira] [Created] (SPARK-58469) Use native Spark expressions for NumPy rint Ruifeng Zheng (Jira)
2026/07/31 [jira] [Created] (SPARK-58470) Use native Spark expressions for NumPy trunc Ruifeng Zheng (Jira)
2026/07/31 [jira] [Created] (SPARK-58468) Support on-demand loading for V1 event logs in Spark History Server Cheng Pan (Jira)
2026/07/31 [jira] [Updated] (SPARK-58462) Exclude tuning params from CrossValidatorModel size ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58463) Close merged pull requests before posting summaries ASF GitHub Bot (Jira)
2026/07/31 [jira] [Updated] (SPARK-58465) Use native expressions for NumPy reciprocal of floating-point columns Ruifeng Zheng (Jira)
2026/07/31 [jira] [Updated] (SPARK-58458) No test covers the CSV record split caused by a quoted line break when multiLine is disabled ASF GitHub Bot (Jira)
2026/07/31 [jira] [Assigned] (SPARK-58460) Do not leak generated column expressions into DataFrame schemas and derived tables Wenchen Fan (Jira)
2026/07/31 [jira] [Resolved] (SPARK-58460) Do not leak generated column expressions into DataFrame schemas and derived tables Wenchen Fan (Jira)