issues  

Messages by Date

• 2026/10/29 [jira] [Updated] (SPARK-60705) Do not release the stream of a native data source while get_next runs ASF GitHub Bot (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-60704) Avoid repeated Decimal type lookup for explicit decimal local input in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/29 [jira] [Created] (SPARK-60705) Do not release the stream of a native data source while get_next runs Kousuke Saruta (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-60625) Separate session-catalog SHOW goldens from V2 catalog coverage Jira
• 2026/10/29 [jira] [Resolved] (SPARK-60625) Separate session-catalog SHOW goldens from V2 catalog coverage Jira
• 2026/10/29 [jira] [Assigned] (SPARK-60614) Share scalar SQL variable assignment helpers Jira
• 2026/10/29 [jira] [Updated] (SPARK-60699) Build Arrow columns directly for exact integer tuple input in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/29 [jira] [Created] (SPARK-60702) Don't skip a runtime bloom filter for a DPP filter that physical planning drops Peter Toth (Jira)
• 2026/10/29 [jira] [Created] (SPARK-60701) Decode owned Arrow IPC result buffers without intermediate stream copies in Spark Connect Rust DB Tsai (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-34586) Support declaring a write distribution and ordering in CREATE/REPLACE TABLE Peter Toth (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-60698) Batch Arrow input normalization configuration reads in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/29 [jira] [Created] (SPARK-60698) Batch Arrow input normalization configuration reads in Spark Connect Rust DB Tsai (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-60697) Avoid materializing DecimalTuple for exact Python Decimal input conversion ASF GitHub Bot (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-60689) Add the planning rules for external lookup join ASF GitHub Bot (Jira)
• 2026/10/29 [jira] [Created] (SPARK-60696) Accept scientific notation Decimal input in Spark Connect Rust DB Tsai (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-60695) Print schema metadata instead of executing rows in Spark Connect Rust printSchema ASF GitHub Bot (Jira)
• 2026/10/29 [jira] [Updated] (SPARK-60691) Add the EXTERNAL_LOOKUP join hint for external lookup join Jungtaek Lim (Jira)
• 2026/10/29 [jira] [Created] (SPARK-60695) Print schema metadata instead of executing rows in Spark Connect Rust printSchema DB Tsai (Jira)
• 2026/10/29 [jira] [Resolved] (SPARK-60609) Handle list returned by SimpleDataSourceStreamReader.read() in offset validation for backward compatibility Jungtaek Lim (Jira)
• 2026/10/29 [jira] [Resolved] (SPARK-60602) Do not evaluate throwable filter conditions ahead of the conditions before them when pushing filters through a projection L. C. Hsieh (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60602) Do not evaluate throwable filter conditions ahead of the conditions before them when pushing filters through a projection L. C. Hsieh (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60694) Push predicates through external lookup joins Jungtaek Lim (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60691) Add the EXTERNAL_LOOKUP join hint for external lookup join Jungtaek Lim (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60690) Execute basic stream-static external lookup joins Jungtaek Lim (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60689) Add the planning rules for external lookup join Jungtaek Lim (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60031) SPIP: External Lookup Join Jungtaek Lim (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60688) Add the DSv2 connector API for external lookup join Jungtaek Lim (Jira)
• 2026/10/28 [jira] [Commented] (SPARK-60031) SPIP: External Lookup Join Jungtaek Lim (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60687) Avoid numeric probes for exact list and tuple scalar arrays in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60686) Use columnar Arrow for supported pandas timestamp input in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60685) Avoid generic scalar probes for exact Python date inputs in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60684) Avoid numeric conversion probes for exact built-in string inputs in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60684) Avoid numeric conversion probes for exact built-in string inputs in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60685) Avoid generic scalar probes for exact Python date inputs in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60683) Defer SQL function error imports in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60683) Defer SQL function error imports in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60566) Allow to launch SparkConnectServer in KUBERNETES mode ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60680) Support positional DataFrame column indexing in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60682) Display DataFrame schema in Spark Connect Rust repr ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60681) Expose DataFrame columns in Rust client dir and IPython completions DB Tsai (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60682) Display DataFrame schema in Spark Connect Rust repr DB Tsai (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60679) Cache Spark Connect Rust session server version ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60676) Convert pandas inputs through columnar Arrow in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60680) Support positional DataFrame column indexing in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60679) Cache Spark Connect Rust session server version DB Tsai (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60668) Treat target metadata columns as outer references in the runtime group filter of DSv2 MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60668) Treat target metadata columns as outer references in the runtime group filter of DSv2 MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60678) Accept DDL return schemas for Python UDTFs in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60629) Upgrade `commons-codec` to 1.23.0 ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60676) Convert pandas inputs through columnar Arrow in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60677) Cache immutable DataFrame schemas in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60664) Remap metadata columns in runtime group filters of group-based UPDATE with subqueries Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60664) Remap metadata columns in runtime group filters of group-based UPDATE with subqueries Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60675) Support PyArrow Table input through the C Stream interface in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60675) Support PyArrow Table input through the C Stream interface in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60675) Support PyArrow Table input through the C Stream interface in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60185) Improve type annotation for SparkConnectGrpcException Tian Gao (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60637) Account for decimal coercion when deriving VALUES nullability Linhong Liu (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60479) Push down CHAR filters when read-side CHAR padding is enabled Wenchen Fan (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60640) Avoid intermediate Value clones during local Arrow input encoding in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60672) Fix error offsets to use proepr codepoints ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60661) Avoid generic type detection for exact built-in Python numbers in spark-connect-rust DB Tsai (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60627) Do not slice an Arrow batch whose slice positions overflow int in `SliceRecordsArrowOutputProcessorImpl` Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-59791) Add an option to ";clean;compile;test:compile" as part of merge_spark_pr script ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60626) Upgrade Spark to 4.2.1 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60617) Publish Apache Spark 4.0.5 to docker registry Jira
• 2026/10/28 [jira] [Assigned] (SPARK-60577) Fix `ClassCastException` of `IN` filters with scalar subqueries in V1 file source scans Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60612) Remove unnecessary dump execution in SparkAsyncProfiler Zhen Wang (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60542) Support nanosecond-precision timestamps in percentile, median, percentile_cont and percentile_disc Jira
• 2026/10/28 [jira] [Resolved] (SPARK-60639) Publish Apache Spark 4.2.1 to docker registry Szehon Ho (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-59091) Emit the NaN guard only when both equality operands can be NaN Holden Karau (Jira)
• 2026/10/28 [jira] [Reopened] (SPARK-60416) Allow Structured Streaming Coverage in SQL Tests Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60674) Convert a sort merge join to a shuffled hash join through a GroupPartitionsExec XiDuo You (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60638) Upgrade `spotless-plugin-gradle` to 8.10.4 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60002) CREATE TABLE ... ROW FORMAT DELIMITED silently discards NULL DEFINED AS Ivelin Tchangalov (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60673) Read all referenced metadata columns in DSv2 DELETE, UPDATE and MERGE ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60674) Convert a sort merge join to a shuffled hash join through a GroupPartitionsExec XiDuo You (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60642) Support collated strings in the Hive ORC data source writer Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60642) Support collated strings in the Hive ORC data source writer Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60673) Read all referenced metadata columns in DSv2 DELETE, UPDATE and MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60641) Accept Byte and Short Row values for Float and Double schemas in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-59091) Emit the NaN guard only when both equality operands can be NaN Holden Karau (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60627) Do not slice an Arrow batch whose slice positions overflow int in `SliceRecordsArrowOutputProcessorImpl` Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-34586) Support declaring a write distribution and ordering in CREATE/REPLACE TABLE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-34586) Support declaring a write distribution and ordering in CREATE/REPLACE TABLE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-34586) Support declaring a write distribution and ordering in CREATE/REPLACE TABLE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-34586) Support declaring a write distribution and ordering in CREATE/REPLACE TABLE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-34586) Support declaring a write distribution and ordering in CREATE/REPLACE TABLE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-34586) Support declaring a write distribution and ordering in CREATE/REPLACE TABLE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-59091) Emit the NaN guard only when both equality operands can be NaN Holden Karau (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60606) Build local Arrow input one column at a time in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60631) Upgrade `scala-parallel-collections` to 1.3.0 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60631) Upgrade `scala-parallel-collections` to 1.3.0 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-59059) Support per-logger log level configuration with static Spark conf Holden Karau (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60672) Fix error offsets to use proepr codepoints Serge Rielau (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60101) Support native data sources implemented in Rust or C++ Hyukjin Kwon (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60667) Do not add metadata columns to the target table of DSv2 DELETE, UPDATE and MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60155) Expand VectorUDT test coverage Tian Gao (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60101) Support native data sources implemented in Rust or C++ Hyukjin Kwon (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60101) Support native data sources implemented in Rust or C++ Hyukjin Kwon (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60590) Update webpki-roots, rustls-webpki and tokio in Cargo.lock to pick up recent RustSec advisories L. C. Hsieh (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-59059) Support per-logger log level configuration with static Spark conf Holden Karau (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60608) Apply the class allowlist to nested model readers Ruifeng Zheng (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60185) Improve type annotation for SparkConnectGrpcException Tian Gao (Jira)
• 2026/10/28 [jira] [Commented] (SPARK-60671) Merge Spark PR script should offer to raise a backport PR _or_ run clean-compile _or_ yolo Holden Karau (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60608) Apply the class allowlist to nested model readers Ruifeng Zheng (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60608) Apply the class allowlist to nested model readers Ruifeng Zheng (Jira)
• 2026/10/28 [jira] [Comment Edited] (SPARK-60671) Merge Spark PR script should offer to raise a backport PR _or_ run clean-compile _or_ yolo Holden Karau (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60670) Tolerate an unreachable ASF JIRA in the merge script Holden Karau (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60671) Merge Spark PR script should offer to raise a backport PR _or_ run clean-compile _or_ yolo Holden Karau (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60621) Add ANALYZE mode to parse_sql ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60639) Publish Apache Spark 4.2.1 to docker registry Szehon Ho (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-59985) TorchDistributor logs a TypeError instead of a warning when the log streaming server fails to start Tian Gao (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60155) Expand VectorUDT test coverage Tian Gao (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60155) Expand VectorUDT test coverage Tian Gao (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-59985) TorchDistributor logs a TypeError instead of a warning when the log streaming server fails to start Tian Gao (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60632) LIKE/RLIKE expensive heuristic checks the wrong operand and loses filter pushdown L. C. Hsieh (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60670) Tolerate an unreachable ASF JIRA in the merge script Holden Karau (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60670) Tolerate an unreachable ASF JIRA in the merge script ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60629) Upgrade `commons-codec` to 1.23.0 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60617) Publish Apache Spark 4.0.5 to docker registry Jira
• 2026/10/28 [jira] [Updated] (SPARK-59985) TorchDistributor logs a TypeError instead of a warning when the log streaming server fails to start Tian Gao (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60626) Upgrade Spark to 4.2.1 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60629) Upgrade `commons-codec` to 1.23.0 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60669) Drop Java 17 Support Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60669) Drop Java 17 Support ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60668) Treat target metadata columns as outer references in the runtime group filter of DSv2 MERGE ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60639) Publish Apache Spark 4.2.1 to docker registry Szehon Ho (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60668) Treat target metadata columns as outer references in the runtime group filter of DSv2 MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60638) Upgrade `spotless-plugin-gradle` to 8.10.4 ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60664) Remap metadata columns in runtime group filters of group-based UPDATE with subqueries ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60659) Support day-time interval inputs in the Rust Spark Connect client ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60667) Do not add metadata columns to the target table of DSv2 DELETE, UPDATE and MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60667) Do not add metadata columns to the target table of DSv2 DELETE, UPDATE and MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60667) Do not add metadata columns to the target table of DSv2 DELETE, UPDATE and MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60667) Do not add metadata columns to the target table of DSv2 DELETE, UPDATE and MERGE ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60667) Do not add metadata columns to the target table of DSv2 DELETE, UPDATE and MERGE Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60665) Respect the partitioning of an existing V1 table in `DataStreamWriter.toTable` ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60666) Dispatch Arrow decoding once per typed column in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60665) Respect the partitioning of an existing V1 table in `DataStreamWriter.toTable` Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60663) Collect detailed timing metrics for mapInPandas ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60665) Respect the partitioning of an existing V1 table in `DataStreamWriter.toTable` Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60664) Remap metadata columns in runtime group filters of group-based UPDATE with subqueries Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60663) Collect detailed timing metrics for mapInPandas Haotian Sun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60662) Share field names across local input rows in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60630) Upgrade Java Operator SDK to 5.6.3 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60656) pandas-on-Spark np.maximum fails to propagate a missing operand generated by log asddfl (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60628) Upgrade lz4-java to 1.12.1 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60606) Build local Arrow input one column at a time in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60603) Shuffle service leaks canonical local dir cache entries and canonicalizes the index path on every fetch L. C. Hsieh (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60584) unpersist() waits for unrelated cache materializations to complete Samuel Shpuntoff (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60660) Upgrade SpotBugs to 4.10.5 and `spotbugs-gradle-plugin` to 6.5.13 ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60660) Upgrade SpotBugs to 4.10.5 and `spotbugs-gradle-plugin` to 6.5.13 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60486) DSv2 file source silently drops a Python UDF filter on a partition column Szehon Ho (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60639) Publish Apache Spark 4.2.1 to docker registry Szehon Ho (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60628) Upgrade lz4-java to 1.12.1 ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60659) Support day-time interval inputs in the Rust Spark Connect client DB Tsai (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60628) Upgrade lz4-java to 1.12.1 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60643) pandas-on-Spark drop_duplicates cannot resolve a column name containing a dot asddfl (Jira)
• 2026/10/28 [jira] [Commented] (SPARK-60002) CREATE TABLE ... ROW FORMAT DELIMITED silently discards NULL DEFINED AS Ivelin Tchangalov (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60591) Ignore RUSTSEC-2026-0387 (crypto-bigint) in cargo audit and track it until a fix is reachable L. C. Hsieh (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60658) pandas-on-Spark np.floor converts negative infinity to the minimum int64 value asddfl (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60642) Support collated strings in the Hive ORC data source writer ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60657) pandas-on-Spark sum does not skip a NaN generated at runtime by cos(inf) asddfl (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60611) Add a Spark Connect programming guide ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60651) Allow decimal remainders with integral quotients wider than the math context ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60652) Refresh every matching file index in a cached plan when refreshing a path ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60655) pandas-on-Spark np.mod returns NaN for a finite value with a positive infinite divisor asddfl (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60654) pandas-on-Spark integer floor division produces float64 and breaks a subsequent np.gcd asddfl (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-59747) History Server repeatedly retries compaction of rolled event log files that contain malformed input Kousuke Saruta (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60653) pandas-on-Spark np.lcm declares a double result and fails for an int64 value above 2**53 asddfl (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60651) Allow decimal remainders with integral quotients wider than the math context Linhong Liu (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60652) Refresh every matching file index in a cached plan when refreshing a path Linhong Liu (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60649) pandas-on-Spark GroupBy.apply callback is missing the group name attribute asddfl (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60650) pandas-on-Spark named size aggregation is mapped to SQL size and fails on an integer column asddfl (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60646) pandas-on-Spark Series.fillna rejects a Series fill value from the same DataFrame asddfl (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60648) pandas-on-Spark comparison between a boolean Series and a float Series raises a SQL type error asddfl (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60647) pandas-on-Spark np.exp on a boolean Series fails with a SQL type mismatch asddfl (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60645) pandas-on-Spark Series constructor evaluates its Index argument as a boolean asddfl (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60645) pandas-on-Spark Series constructor evaluates its Index argument as a boolean asddfl (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60605) levenshtein returns a wrong value instead of NULL for a NULL threshold ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60644) Dedup within watermark incremental cleanup Boyang Jerry Peng (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60048) Remember a whole-stage codegen split decision by a key that ignores literal values ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60638) Upgrade `spotless-plugin-gradle` to 8.10.4 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60640) Avoid intermediate Value clones during local Arrow input encoding in Spark Connect Rust DB Tsai (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60642) Support collated strings in the Hive ORC data source writer Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60486) DSv2 file source silently drops a Python UDF filter on a partition column Szehon Ho (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60641) Accept Byte and Short Row values for Float and Double schemas in Spark Connect Rust ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60002) CREATE TABLE ... ROW FORMAT DELIMITED silently discards NULL DEFINED AS Ivelin Tchangalov (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60639) Publish Apache Spark 4.2.1 to docker registry ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Assigned] (SPARK-60572) Preserve NULL string day counts in date arithmetic Hyukjin Kwon (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60638) Upgrade `spotless-plugin-gradle` to 8.10.4 Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60637) Account for decimal coercion when deriving VALUES nullability ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60619) Use Apache Spark 4.0.5, 4.1.4, and 4.2.1 for integration tests Dongjoon Hyun (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60619) Use Apache Spark 4.0.5, 4.1.4, and 4.2.1 for integration tests ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60222) Keep task completion listeners on the completing thread when another thread invokes listeners L. C. Hsieh (Jira)
• 2026/10/28 [jira] [Created] (SPARK-60635) Isolate mutable number-format parsers in expression copies Linhong Liu (Jira)
• 2026/10/28 [jira] [Updated] (SPARK-60635) Isolate mutable number-format parsers in expression copies ASF GitHub Bot (Jira)
• 2026/10/28 [jira] [Resolved] (SPARK-60597) Keep the output of a top-level join on a hidden USING join key in the single-pass resolver Jira
• 2026/10/28 [jira] [Assigned] (SPARK-60597) Keep the output of a top-level join on a hidden USING join key in the single-pass resolver Jira

• Earlier messages