Messages by Date
-
2026/11/16
[jira] [Resolved] (SPARK-61607) Restrict infra image builds on ref creation
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61607) Restrict infra image builds on ref creation
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61842) Reduce branch-4.1 scheduled CI to weekly
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61842) Reduce branch-4.1 scheduled CI to weekly
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60150) A filter pushed below a DISTINCT on a float key returns a row that fails the predicate
Holden Karau (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60188) Warn on unknown variety names in `pyTranspilers`
Holden Karau (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-58780) Transpilation with multiple lambdas can hide a cartesian join
Holden Karau (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61837) Avoid per-row Python calls during result materialization
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61837) Avoid per-row Python calls during result materialization
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61837) Avoid per-row Python calls during result materialization
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61832) Change version in branch-4.x to 4.5.0
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61832) Change version in branch-4.x to 4.5.0
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61832) Change version in branch-4.x to 4.5.0
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-55220) Add a null strictness level parameter
Holden Karau (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-55220) Add a null strictness level parameter
Holden Karau (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61823) Fix query failures when a filter inferred from data constraints reads a column that can fail
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58677) Expand hash functionalities of XXH3 to better match XXHash64
Nathan Holland (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61833) Set up CI for branch-4.4
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58677) Expand hash functionalities of XXH3 to better match XXHash64
Nathan Holland (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61833) Set up CI for branch-4.4
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58677) Expand hash functionalities of XXH3 to better match XXHash64
Nathan Holland (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58677) Expand hash functionalities of XXH3 to better match XXHash64
Nathan Holland (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58677) Expand hash functionalities of XXH3 to better match XXHash64
Nathan Holland (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58677) Expand hash functionalities of XXH3 to better match XXHash64
Nathan Holland (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58677) Expand hash functionalities of XXH3 to better match XXHash64
Nathan Holland (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58928) Fix collation-aware grouping in window and aggregation operators
Vinod KC (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58928) Fix collation-aware grouping in window and aggregation operators
Vinod KC (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60885) Fix wrong results by changing `avoidDoubleFilterEval` across streaming query restarts
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61833) Set up CI for branch-4.4
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60498) Block CTE-prefixed DML and multi-insert statements in `spark.sql` of SDP
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61669) Fix CALL failing with INTERNAL_ERROR when an argument has a Python UDF or a nested IN subquery
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61841) Fix History Server attaching app UI kill/hold/resume endpoints at global paths
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61841) Fix History Server attaching app UI kill/hold/resume endpoints at global paths
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61841) Fix History Server attaching app UI kill/hold/resume endpoints at global paths
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61656) Fix CALL failing with INTERNAL_ERROR when an argument has an IN subquery
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61553) Fix CALL silently doing nothing when ProcedureCatalog.loadProcedure returns null
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61557) Fix CALL failing with IllegalArgumentException when an argument is not foldable
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60824) Fix internal error when adding a DSv2 CHECK constraint that always holds
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61839) Upgrade Checkstyle to 14.4.0
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61839) Upgrade Checkstyle to 14.4.0
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61839) Upgrade Checkstyle to 14.4.0
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61842) Reduce branch-4.1 scheduled CI to weekly
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61842) Reduce branch-4.1 scheduled CI to weekly
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60823) Fix NoSuchElementException when adding a CHECK constraint to a path
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60544) Run the dynamic partition checks before `saveAsTable` overwrite drops the existing Hive table
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61558) Fix broadcasting the large side of a join under OFFSET when the child has no row count
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61282) Add a Rust SDK for native data sources over the C ABI
Gengliang Wang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61282) Add a Rust SDK for native data sources over the C ABI
Gengliang Wang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61282) Add a Rust SDK for native data sources over the C ABI
Gengliang Wang (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61282) Add a Rust SDK for native data sources over the C ABI
Gengliang Wang (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61282) Add a Rust SDK for native data sources over the C ABI
Gengliang Wang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61460) Fix vectorized Parquet reader memory growth when a struct in an array or map has a NullType field
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61480) Fix wrong results by runtime group filtering in group-based DELETE when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61480) Fix wrong results by runtime group filtering in group-based DELETE when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61480) Fix wrong results by runtime group filtering in group-based DELETE when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61823) Fix query failures when a filter inferred from data constraints reads a column that can fail
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61823) Fix query failures when a filter inferred from data constraints reads a column that can fail
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61671) Add SparkSession.listFiles and SparkSession.listArchives for Spark Connect
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61833) Set up CI for branch-4.4
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61504) Fix wrong results by DataFrameWriterV2.overwrite when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61833) Set up CI for branch-4.4
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61834) Fix latest release branch detection in release-util.sh
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61834) Fix latest release branch detection in release-util.sh
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61784) Support configurable intermediate storage levels in GaussianMixture
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61751) Add FileType to PySpark and Spark Connect (type and schema only)
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61824) Fix INTERNAL_ERROR when the filtering side of dynamic partition pruning has a Python UDF
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61838) Reduce peak memory while collecting rows
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61838) Reduce peak memory while collecting rows
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61838) Reduce peak memory while collecting rows
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61824) Fix INTERNAL_ERROR when the filtering side of dynamic partition pruning has a Python UDF
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61824) Fix INTERNAL_ERROR when the filtering side of dynamic partition pruning has a Python UDF
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61841) Fix History Server attaching app UI kill/hold/resume endpoints at global paths
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61841) Fix History Server attaching app UI kill/hold/resume endpoints at global paths
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61403) Support external lookup joins in real-time mode
Jungtaek Lim (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61840) Fix query errors by CombineFilters merging a condition over an alias that can fail, written after a non-deterministic one, into the filter below
Kousuke Saruta (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61815) Remove unused /static/streaming handler from StreamingTab
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61815) Remove unused /static/streaming handler from StreamingTab
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61815) Remove unused /static/streaming handler from StreamingTab
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61839) Upgrade Checkstyle to 14.4.0
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61403) Support external lookup joins in real-time mode
Jungtaek Lim (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61403) Support external lookup joins in real-time mode
Jungtaek Lim (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61839) Upgrade Checkstyle to 14.4.0
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61838) Reduce peak memory while collecting rows
Lavan Vivekanandasarma (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61837) Avoid per-row Python calls during result materialization
Lavan Vivekanandasarma (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61784) Support configurable intermediate storage levels in GaussianMixture
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61784) Support configurable intermediate storage levels in GaussianMixture
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61784) Support configurable intermediate storage levels in GaussianMixture
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61784) Support configurable intermediate storage levels in GaussianMixture
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61814) Fix INTERNAL_ERROR when the creation side of a runtime bloom filter has a scalar external UDF
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-48870) spark.excludeOnFailure.killExcludedExecutors does not take effect in Spark on YARN mode.
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61814) Fix INTERNAL_ERROR when the creation side of a runtime bloom filter has a scalar external UDF
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61809) Fix the Scala structured logging check to scan Scala files
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61809) Fix the Scala structured logging check to scan Scala files
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61836) Assign names to 21 legacy parser error conditions
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61836) Assign names to 21 legacy parser error conditions
Daniel Tenedorio (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61836) Assign names to 21 legacy parser error conditions
Daniel Tenedorio (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61835) Assign human-readable names and SQLSTATEs to legacy _LEGACY_ERROR_TEMP_* error conditions
Daniel Tenedorio (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61751) Add FileType to PySpark and Spark Connect (type and schema only)
Daniel Tenedorio (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61834) Fix latest release branch detection in release-util.sh
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61833) Set up CI for branch-4.4
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61834) Fix latest release branch detection in release-util.sh
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61767) Extract the batch export of the in-process Python UDF evaluator into InProcessArrowBatchExporter
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61767) Extract the batch export of the in-process Python UDF evaluator into InProcessArrowBatchExporter
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61767) Extract the batch export of the in-process Python UDF evaluator into InProcessArrowBatchExporter
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61832) Change version in branch-4.x to 4.5.0
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61830) ConsoleProgressBar fails when COLUMNS is empty
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61819) Do not normalize conditional distinct counts with non-deterministic conditions, and read the config once
Xi Liang (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61833) Set up CI for branch-4.4
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61832) Change version in branch-4.x to 4.5.0
Yicong Huang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61831) Cast from VARIANT to a type with a non-nullable nested field reads a JSON null or missing key as 0
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61810) Fix `withFsHistoryProvider` not stopping `FsHistoryProvider`
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61810) Fix `withFsHistoryProvider` not stopping `FsHistoryProvider`
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61810) Fix `withFsHistoryProvider` not stopping `FsHistoryProvider`
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61831) Cast from VARIANT to a type with a non-nullable nested field reads a JSON null or missing key as 0
Linhong Liu (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61830) ConsoleProgressBar fails when COLUMNS is empty
Satha (Jira) via issues
-
2026/11/16
[jira] [Comment Edited] (SPARK-61689) Assign a name to the error condition _LEGACY_ERROR_TEMP_1089
Ramesh Thamizhselvan (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61811) Fix wrong results when a DPP subquery reads a DSv2 scan with a pushed LIMIT again
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61811) Fix wrong results when a DPP subquery reads a DSv2 scan with a pushed LIMIT again
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61811) Fix wrong results when a DPP subquery reads a DSv2 scan with a pushed LIMIT again
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61811) Fix wrong results when a DPP subquery reads a DSv2 scan with a pushed LIMIT again
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61829) Add tests for invalid return types of Arrow and Pandas UDF APIs
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61829) Add tests for invalid return types of Arrow and Pandas UDF APIs
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61808) Fix a failed cleanup delete hiding the submission error and skipping cleanup
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61808) Fix a failed cleanup delete hiding the submission error and skipping cleanup
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Comment Edited] (SPARK-61689) Assign a name to the error condition _LEGACY_ERROR_TEMP_1089
Ramesh Thamizhselvan (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61669) Fix CALL failing with INTERNAL_ERROR when an argument has a Python UDF or a nested IN subquery
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61575) Fix `to_time` failing on a foldable format that no row evaluates
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61664) Fix wrong results of sketch aggregates and schema_of_variant_agg over empty input in correlated scalar subqueries
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61656) Fix CALL failing with INTERNAL_ERROR when an argument has an IN subquery
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61553) Fix CALL silently doing nothing when ProcedureCatalog.loadProcedure returns null
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61557) Fix CALL failing with IllegalArgumentException when an argument is not foldable
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61574) Fix file scan failures when a scan copied by subquery reuse re-decides columnar output at execution
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61558) Fix broadcasting the large side of a join under OFFSET when the child has no row count
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61826) Projects generated by spark-pipelines init lose their tables after the run and fail the second run with LOCATION_ALREADY_EXISTS
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61816) Increase the timeout of the `sql - other tests` job to 180 minutes
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61816) Increase the timeout of the `sql - other tests` job to 180 minutes
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61825) Static or core Spark settings in a pipeline's configuration fail every flow with CANNOT_MODIFY_STATIC_CONFIG
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61828) Add observation test for more metric value types
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61828) Add observation test for more metric value types
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-46159) Improve axis parameter for DataFrame.at_time to support columns.
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61827) Add tests for DataFrameWriterV2 write modes, options and properties
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61827) Add tests for DataFrameWriterV2 write modes, options and properties
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61826) Projects generated by spark-pipelines init lose their tables after the run and fail the second run with LOCATION_ALREADY_EXISTS
Sudhanva Huruli (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61825) Static or core Spark settings in a pipeline's configuration fail every flow with CANNOT_MODIFY_STATIC_CONFIG
Sudhanva Huruli (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61824) Fix INTERNAL_ERROR when the filtering side of dynamic partition pruning has a Python UDF
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61824) Fix INTERNAL_ERROR when the filtering side of dynamic partition pruning has a Python UDF
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61823) Fix query failures when a filter inferred from data constraints reads a column that can fail
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61822) Bump master development version to 4.4.0 after cutting branch-4.3
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61819) Do not normalize conditional distinct counts with non-deterministic conditions, and read the config once
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61822) Bump master development version to 4.4.0 after cutting branch-4.3
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61822) Bump master development version to 4.4.0 after cutting branch-4.3
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61823) Fix query failures when a filter inferred from data constraints reads a column that can fail
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61822) Bump master development version to 4.4.0 after cutting branch-4.3
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61822) Bump master development version to 4.4.0 after cutting branch-4.3
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61821) spark-connect-rust connect-rust-4.4.0 release
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61822) Bump master development version to 4.4.0 after cutting branch-4.3
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61818) Fix lost reuse of identical subplans with EXISTS or IN subqueries under OR
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61820) Clarify that native data source offsets are progress boundaries, and that adjacent ranges must not repeat or skip records
Gengliang Wang (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61819) Do not normalize conditional distinct counts with non-deterministic conditions, and read the config once
Xi Liang (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61819) Do not normalize conditional distinct counts with non-deterministic conditions, and read the config once
Xi Liang (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61818) Fix lost reuse of identical subplans with EXISTS or IN subqueries under OR
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61815) Remove unused /static/streaming handler from StreamingTab
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58695) Support scalar pandas and Arrow UDFs inside higher-order function lambdas
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58695) Support scalar pandas and Arrow UDFs inside higher-order function lambdas
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61817) Accept metadata column keys in DataFrame sort-merge ASOF joins
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61817) Accept metadata column keys in DataFrame sort-merge ASOF joins
Luka Zdravic (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61550) Fix writes leaving stale or mismatched values in legacy SQL-only generated columns
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61816) Increase the timeout of the `sql - other tests` job to 180 minutes
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61816) Increase the timeout of the `sql - other tests` job to 180 minutes
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61815) Remove unused /static/streaming handler from StreamingTab
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61810) Fix `withFsHistoryProvider` not stopping `FsHistoryProvider`
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61761) Add a generic test that whole-stage codegen stages do not serialize plan nodes into tasks
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61761) Add a generic test that whole-stage codegen stages do not serialize plan nodes into tasks
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61552) Fix codegen failing on a foldable argument that no row evaluates
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61814) Fix INTERNAL_ERROR when the creation side of a runtime bloom filter has a scalar external UDF
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61814) Fix INTERNAL_ERROR when the creation side of a runtime bloom filter has a scalar external UDF
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61810) Fix `withFsHistoryProvider` not stopping `FsHistoryProvider`
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61605) Add a test for SparkSession.interruptOperation
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61605) Add a test for SparkSession.interruptOperation
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61605) Add a test for SparkSession.interruptOperation
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61605) Add a test for SparkSession.interruptOperation
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61504) Fix wrong results by DataFrameWriterV2.overwrite when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-58013) Support pandas 3 in pandas-on-Spark tests
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61504) Fix wrong results by DataFrameWriterV2.overwrite when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58013) Support pandas 3 in pandas-on-Spark tests
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-58013) Support pandas 3 in pandas-on-Spark tests
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61504) Fix wrong results by DataFrameWriterV2.overwrite when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-58013) Support pandas 3 in pandas-on-Spark tests
Tian Gao (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61809) Fix the Scala structured logging check to scan Scala files
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61809) Fix the Scala structured logging check to scan Scala files
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61678) Add single pass identifier to PATH
Daniel Tenedorio (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61678) Add single pass identifier to PATH
Serge Rielau (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61813) Revert spark.sql.legacy.prioritizeSystemCatalog to true
Serge Rielau (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61812) Storage-partitioned join passes a decimal argument of more precision than its partition transform declares, which the write path's cast can change
Anil K (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61812) Storage-partitioned join passes a decimal argument of more precision than its partition transform declares, which the write path's cast can change
Anil K (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61764) Limit the Python worker idle timeout to what fits in an Int of milliseconds
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61764) Limit the Python worker idle timeout to what fits in an Int of milliseconds
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61811) Fix wrong results when a DPP subquery reads a DSv2 scan with a pushed LIMIT again
ASF GitHub Bot (Jira) via issues