Messages by Date
-
2026/11/16
[jira] [Updated] (SPARK-61341) Wrong LIKE pattern from startswith/endswith/contains with a column argument in DSv2 sources that use V2ExpressionSQLBuilder
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61811) Fix wrong results when a DPP subquery reads a DSv2 scan with a pushed LIMIT again
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61810) Fix `withFsHistoryProvider` not stopping `FsHistoryProvider`
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61807) SDP Quickstart
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61368) kll_merge_agg without k: add a conf to take the lowest k among inputs that have started compacting
Milos Stojko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61808) Fix a failed cleanup delete hiding the submission error and skipping cleanup
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61809) Fix the Scala structured logging check to scan Scala files
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61809) Fix the Scala structured logging check to scan Scala files
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61808) Fix a failed cleanup delete hiding the submission error and skipping cleanup
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61807) SDP Quickstart
Sudhanva Huruli (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61806) Support generated column values in UPDATE and MERGE
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61806) Support generated column values in UPDATE and MERGE
Szehon Ho (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61805) Defer constant-folding failures in MERGE actions
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61805) Defer constant-folding failures in MERGE actions
Szehon Ho (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61804) Hash-based window group limit for top-1 ROW_NUMBER()
Yuming Wang (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61341) Wrong LIKE pattern from startswith/endswith/contains with a column argument in DSv2 sources that use V2ExpressionSQLBuilder
Eric Yang (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61559) Infer filters across ASOF JOIN keys
Wenchen Fan (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61559) Infer filters across ASOF JOIN keys
Wenchen Fan (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61770) Add farm_fingerprint SQL function
Wenchen Fan (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61770) Add farm_fingerprint SQL function
Wenchen Fan (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61801) GraphFrames Configuration
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61803) GraphFrames RW Embeddings and Hash2Vec
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61802) GraphFrames Random Walks API
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61800) GraphFrames GraphX adapter
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61799) GraphFrames Neighborhood Aware Label Propagation
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61798) GraphFrames BFS
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61797) GraphFrames Motifs API
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61796) GraphFrames HyperANF
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61795) GraphFrames K-Core
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61793) GraphFrames Simple Centrality Metrics
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61794) GraphFrames LONG IDs and Conversion
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61794) GraphFrames LONG Ids and Conversion
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61792) GraphFrames All Paths
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61791) GraphFrames Shortest Paths
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61790) GraphFrames Triangle Counting
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61782) GraphFrames MIS
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61789) GraphFrames Aggregate Neighbors
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61783) GraphFrames Aggregate Messages
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61781) GraphFrames Rocha-Thatte
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61780) GraphFrames Label Propagation
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61778) GraphFrames PageRank
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61788) Fix StateStoreInstanceMetricSuite depending on the state store maintenance task of an earlier test
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61787) Turn the root AGENTS.md into an index over .agents/ and add an agent docs lint
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61788) Fix StateStoreInstanceMetricSuite depending on the state store maintenance task of an earlier test
Raviston Thanasekar (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61787) Turn the root AGENTS.md into an index over .agents/ and add an agent docs lint
Wenchen Fan (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61768) DataFrame API: a column referenced inside a lambda function resolves to a same-named alias of the same select list instead of the input column
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61786) Always use the Rust protobuf runtime in pyspark.sql.connect.proto, and remove PYSPARK_CONNECT_PROTO_IMPLEMENTATION
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Comment Edited] (SPARK-61615) Correlated subquery in the FILTER clause of an aggregate function in a correlated scalar subquery fails with INTERNAL_ERROR
Shivadarshan (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61785) Support keyed layouts in the union shuffle push-down
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Comment Edited] (SPARK-61615) Correlated subquery in the FILTER clause of an aggregate function in a correlated scalar subquery fails with INTERNAL_ERROR
Shivadarshan (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61615) Correlated subquery in the FILTER clause of an aggregate function in a correlated scalar subquery fails with INTERNAL_ERROR
Shivadarshan (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-60783) A V2 ScalarFunction that inherits produceResult or invoke from a base class fails with SCALAR_FUNCTION_NOT_FULLY_IMPLEMENTED
Viacheslav Inozemtsev (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61341) Wrong LIKE pattern from startswith/endswith/contains with a column argument in DSv2 sources that use V2ExpressionSQLBuilder
Viacheslav Inozemtsev (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61786) Always use the Rust protobuf runtime in pyspark.sql.connect.proto, and remove PYSPARK_CONNECT_PROTO_IMPLEMENTATION
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61786) Always use the Rust protobuf runtime in pyspark.sql.connect.proto, and remove PYSPARK_CONNECT_PROTO_IMPLEMENTATION
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61785) Support keyed layouts in the union shuffle push-down
XiDuo You (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61746) Bring GraphFrames into Apache Spark
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61785) Support keyed layouts in the union shuffle push-down
XiDuo You (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61784) Support configurable intermediate storage levels in GaussianMixture
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61784) Support configurable intermediate storage levels in GaussianMixture
Ruifeng Zheng (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60824) Fix internal error when adding a DSv2 CHECK constraint that always holds
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61783) GraphFrames documentation
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61782) GraphFrames MIS, HyperANF
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61780) GraphFrames Pregel-based algorithms
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61781) GraphFrames GraphML algorithms
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61779) GraphFrames Connected Components
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61778) GraphFrames PySpark API + Connect
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61777) GraphFrames Pregel API
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61776) GraphFrames Core Interfaces
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61774) Add columnar scalar UDFs, evaluated by an operator that native engines can replace
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61704) Fix ConstantPropagation propagating an EqualTo with a NULL literal under a NOT
Kousuke Saruta (Jira) via issues
-
2026/11/16
[jira] [Commented] (SPARK-61746) Bring GraphFrames into Apache Spark
Sem Sinchenko (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61775) Do not wait forever for the read to end after the idle timeout killed the Python worker
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61775) Do not wait forever for the read to end after the idle timeout killed the Python worker
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61775) Do not wait forever for the read to end after the idle timeout killed the Python worker
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61774) Add columnar scalar UDFs, evaluated by an operator that native engines can replace
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Created] (SPARK-61774) Add columnar scalar UDFs, evaluated by an operator that native engines can replace
L. C. Hsieh (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61763) ORC and Hive SerDe writes keep only one entry of a MAP with DATE keys (DaysWritable does not override compareTo / equals / hashCode)
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60451) Cast.contextIndependentFoldable is true for a special datetime string cast to DATE or TIMESTAMP_NTZ
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60260) Fix wrong results when spark.sql.sources.v2.bucketing.enabled changes after a storage-partitioned join is planned
Peter Toth (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61655) Let a Rust UDF read the session's Python worker environment
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61543) JDBC pushdown renders java.time.Instant filter literals in the session time zone, so PostgreSQL returns wrong rows when spark.sql.session.timeZone differs from the JVM time zone
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61766) Match PySpark 4.3.0 in the gaps that a review of the last 200 commits found in the native ML classes, the DataFrame, the readers and the builder, and the Rust ML API
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60260) Fix wrong results when spark.sql.sources.v2.bucketing.enabled changes after a storage-partitioned join is planned
Peter Toth (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60885) Fix wrong results by changing `avoidDoubleFilterEval` across streaming query restarts
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61655) Let a Rust UDF read the session's Python worker environment
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61773) Connect through the HTTP proxy of the environment, as grpc-python does
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61655) Let a Rust UDF read the session's Python worker environment
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Assigned] (SPARK-61773) Connect through the HTTP proxy of the environment, as grpc-python does
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61773) Connect through the HTTP proxy of the environment, as grpc-python does
ASF GitHub Bot (Jira) via issues
-
2026/11/16
[jira] [Resolved] (SPARK-61755) Remove the protobuf requirement of the Python drop-in
Hyukjin Kwon (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61480) Fix wrong results by runtime group filtering in group-based DELETE when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case
Dongjoon Hyun (Jira) via issues
-
2026/11/16
[jira] [Updated] (SPARK-61460) Fix vectorized Parquet reader memory growth when a struct in an array or map has a NullType field
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61772) Read the settings of the conversions of createDataFrame in one request before it converts any data, as PySpark's does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61772) Read the settings of the conversions of createDataFrame in one request before it converts any data, as PySpark's does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61356) Fix wrong results by `UnionExec` output partitioning when a child output repeats an ExprId
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61551) Single-pass analyzer improvements
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61764) Limit the Python worker idle timeout to what fits in an Int of milliseconds
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61755) Remove the protobuf requirement of the Python drop-in
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61770) Add farm_fingerprint SQL function
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-60980) Fix query failures by `CombineFilters` when a condition that can fail follows a non-deterministic or throwable one
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61771) Raise the errors of Column.alias when the plan is built, as PySpark's ColumnAlias raises them
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61771) Raise the errors of Column.alias when the plan is built, as PySpark's ColumnAlias raises them
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-60455) ALTER TABLE ADD CONSTRAINT CHECK fails with INTERNAL_ERROR when the condition folds to a constant
Yang Jie (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-60454) ALTER TABLE ADD CONSTRAINT CHECK on a view adds the constraint to its base table
Yang Jie (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-60823) Fix NoSuchElementException when adding a CHECK constraint to a path
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61773) Connect through the HTTP proxy of the environment, as grpc-python does
Kaicheng Zhou (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61771) Raise the errors of Column.alias when the plan is built, as PySpark's ColumnAlias raises them
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61769) Make pyspark.sql.SparkSession PySpark's classic class, the builder of the Connect session PySpark Connect's, and the Connect functions of their own modules, as in PySpark
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61769) Make pyspark.sql.SparkSession PySpark's classic class, the builder of the Connect session PySpark Connect's, and the Connect functions of their own modules, as in PySpark
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61772) Read the settings of the conversions of createDataFrame in one request before it converts any data, as PySpark's does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61772) Read the settings of the conversions of createDataFrame in one request before it converts any data, as PySpark's does
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61772) Read the settings of the conversions of createDataFrame in one request before it converts any data, as PySpark's does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61769) Make pyspark.sql.SparkSession PySpark's classic class, the builder of the Connect session PySpark Connect's, and the Connect functions of their own modules, as in PySpark
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61755) Remove the protobuf requirement of the Python drop-in
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61770) Add farm_fingerprint SQL function
Ganesha S (Jira) via issues
-
2026/11/15
[jira] [Commented] (SPARK-61770) Add farm_fingerprint SQL function
Ganesha S (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61771) Raise the errors of Column.alias when the plan is built, as PySpark's ColumnAlias raises them
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61771) Raise the errors of Column.alias when the plan is built, as PySpark's ColumnAlias raises them
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61770) Add farm_fingerprint SQL function
Ganesha S (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61769) Make pyspark.sql.SparkSession PySpark's classic class, the builder of the Connect session PySpark Connect's, and the Connect functions of their own modules, as in PySpark
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61769) Make pyspark.sql.SparkSession PySpark's classic class, the builder of the Connect session PySpark Connect's, and the Connect functions of their own modules, as in PySpark
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61756) Fix the interpreted SortMergeAsOfJoinExec holding sorter memory until the task ends
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61756) Fix the interpreted SortMergeAsOfJoinExec holding sorter memory until the task ends
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61754) Avoid serializing the child plan into every task from the interpreted SortMergeAsOfJoinExec
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61754) Avoid serializing the child plan into every task from the interpreted SortMergeAsOfJoinExec
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61767) Extract the batch export of the in-process Python UDF evaluator into InProcessArrowBatchExporter
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61768) DataFrame API: a column referenced inside a lambda function resolves to a same-named alias of the same select list instead of the input column
Yaoxuan Wu (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61767) Extract the batch export of the in-process Python UDF evaluator into InProcessArrowBatchExporter
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61767) Extract the batch export of the in-process Python UDF evaluator into InProcessArrowBatchExporter
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61760) Read the params of the object of a native ML writer at its save, as PySpark's RemoteMLWriter does
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61766) Match PySpark 4.3.0 in the gaps that a review of the last 200 commits found in the native ML classes, the DataFrame, the readers and the builder, and the Rust ML API
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61752) Keep the params of the native ML classes in PySpark's own param maps, of PySpark's own Params API
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61766) Match PySpark 4.3.0 in the gaps that a review of the last 200 commits found in the native ML classes, the DataFrame, the readers and the builder, and the Rust ML API
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61766) Match PySpark 4.3.0 in the gaps that a review of the last 200 commits found in the native ML classes, the DataFrame, the readers and the builder, and the Rust ML API
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61766) Match PySpark 4.3.0 in the gaps that a review of the last 200 commits found in the native ML classes, the DataFrame, the readers and the builder, and the Rust ML API
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61758) Fix the PySpark differences that the review of the last 200 commits found in the types, Columns, windows, table arguments, UDF arguments and copies of the Python client, and the gaps of its CI
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61765) Report the Python worker idle timeout when the read from the killed worker fails
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61765) Report the Python worker idle timeout when the read from the killed worker fails
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61765) Report the Python worker idle timeout when the read from the killed worker fails
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61760) Read the params of the object of a native ML writer at its save, as PySpark's RemoteMLWriter does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61759) Make the native ML summaries subclasses of the summaries of their PySpark bases, of PySpark's metaclass, and construct them as PySpark's JavaWrapper
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61762) Re-export PySpark's readers and writers of the Python format in the native ML modules
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61762) Re-export PySpark's readers and writers of the Python format in the native ML modules
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61760) Read the params of the object of a native ML writer at its save, as PySpark's RemoteMLWriter does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61759) Make the native ML summaries subclasses of the summaries of their PySpark bases, of PySpark's metaclass, and construct them as PySpark's JavaWrapper
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61758) Fix the PySpark differences that the review of the last 200 commits found in the types, Columns, windows, table arguments, UDF arguments and copies of the Python client, and the gaps of its CI
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61757) Refuse the releases of executions once the interpreter has begun to shut down, as PySpark's release pool does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61757) Refuse the releases of executions once the interpreter has begun to shut down, as PySpark's release pool does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61762) Re-export PySpark's readers and writers of the Python format in the native ML modules
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61759) Make the native ML summaries subclasses of the summaries of their PySpark bases, of PySpark's metaclass, and construct them as PySpark's JavaWrapper
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61764) Fix Int overflow in the socket read timeout for the Python worker idle timeout in pipelined mode
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61764) Fix Int overflow in the socket read timeout for the Python worker idle timeout in pipelined mode
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61764) Fix Int overflow in the socket read timeout for the Python worker idle timeout in pipelined mode
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61763) ORC and Hive SerDe writes keep only one entry of a MAP with DATE keys (DaysWritable does not override compareTo / equals / hashCode)
Yaoxuan Wu (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61762) Re-export PySpark's readers and writers of the Python format in the native ML modules
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61762) Re-export PySpark's readers and writers of the Python format in the native ML modules
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61761) Add a generic test that whole-stage codegen stages do not serialize plan nodes into tasks
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61757) Refuse the releases of executions once the interpreter has begun to shut down, as PySpark's release pool does
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61753) Clean the ML cache of a session that is not stopped at exit, and release it there with SPARK_CONNECT_RELEASE_SESSION_ON_EXIT, as PySpark's client does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61753) Clean the ML cache of a session that is not stopped at exit, and release it there with SPARK_CONNECT_RELEASE_SESSION_ON_EXIT, as PySpark's client does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61752) Keep the params of the native ML classes in PySpark's own param maps, of PySpark's own Params API
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61752) Keep the params of the native ML classes in PySpark's own param maps, of PySpark's own Params API
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61761) Add a generic test that whole-stage codegen stages do not serialize plan nodes into tasks
L. C. Hsieh (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61758) Fix the PySpark differences that the review of the last 200 commits found in the types, Columns, windows, table arguments, UDF arguments and copies of the Python client, and the gaps of its CI
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61760) Read the params of the object of a native ML writer at its save, as PySpark's RemoteMLWriter does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61760) Read the params of the object of a native ML writer at its save, as PySpark's RemoteMLWriter does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61752) Keep the params of the native ML classes in PySpark's own param maps, of PySpark's own Params API
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61759) Make the native ML summaries subclasses of the summaries of their PySpark bases, of PySpark's metaclass, and construct them as PySpark's JavaWrapper
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61759) Make the native ML summaries subclasses of the summaries of their PySpark bases, of PySpark's metaclass, and construct them as PySpark's JavaWrapper
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61758) Fix the PySpark differences that the review of the last 200 commits found in the types, Columns, windows, table arguments, UDF arguments and copies of the Python client, and the gaps of its CI
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61755) Remove the protobuf requirement of the Python drop-in
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61758) Fix the PySpark differences that the review of the last 200 commits found in the types, Columns, windows, table arguments, UDF arguments and copies of the Python client, and the gaps of its CI
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61757) Refuse the releases of executions once the interpreter has begun to shut down, as PySpark's release pool does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61757) Refuse the releases of executions once the interpreter has begun to shut down, as PySpark's release pool does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61756) Fix the interpreted SortMergeAsOfJoinExec holding sorter memory until the task ends
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61756) Fix the interpreted SortMergeAsOfJoinExec holding sorter memory until the task ends
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61755) Remove the protobuf requirement of the Python drop-in
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61754) Avoid serializing the child plan into every task from the interpreted SortMergeAsOfJoinExec
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61754) Avoid serializing the child plan into every task from the interpreted SortMergeAsOfJoinExec
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61752) Keep the params of the native ML classes in PySpark's own param maps, of PySpark's own Params API
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61753) Clean the ML cache of a session that is not stopped at exit, and release it there with SPARK_CONNECT_RELEASE_SESSION_ON_EXIT, as PySpark's client does
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61753) Clean the ML cache of a session that is not stopped at exit, and release it there with SPARK_CONNECT_RELEASE_SESSION_ON_EXIT, as PySpark's client does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61723) Avoid quadratic time when rewriting DSv2 DELETE, UPDATE and MERGE on wide tables
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61723) Avoid quadratic time when rewriting DSv2 DELETE, UPDATE and MERGE on wide tables
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Created] (SPARK-61753) Clean the ML cache of a session that is not stopped at exit, and release it there with SPARK_CONNECT_RELEASE_SESSION_ON_EXIT, as PySpark's client does
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61723) Avoid quadratic time when rewriting DSv2 DELETE, UPDATE and MERGE on wide tables
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61723) Avoid quadratic time when rewriting DSv2 DELETE, UPDATE and MERGE on wide tables
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Updated] (SPARK-61301) Improve the FILE type error messages and their builders
ASF GitHub Bot (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61725) Fix wrong results by DSv2 MERGE that references metadata columns on tables accepting any schema
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61725) Fix wrong results by DSv2 MERGE that references metadata columns on tables accepting any schema
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61749) Take the paths of the saves and loads of the native ML classes as PySpark does, and read the JVM class of a subclass's name
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61748) Construct, fit and copy a Python subclass of the native ML classes as a subclass of PySpark's classes
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61749) Take the paths of the saves and loads of the native ML classes as PySpark does, and read the JVM class of a subclass's name
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-61724) Fix CBO failing on analyzed `TIMESTAMP_NTZ`, `TIME` and ANSI interval columns
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61724) Fix CBO failing on analyzed `TIMESTAMP_NTZ`, `TIME` and ANSI interval columns
Dongjoon Hyun (Jira) via issues
-
2026/11/15
[jira] [Assigned] (SPARK-61748) Construct, fit and copy a Python subclass of the native ML classes as a subclass of PySpark's classes
Hyukjin Kwon (Jira) via issues
-
2026/11/15
[jira] [Resolved] (SPARK-60848) Regenerate benchmark results after bumping the minimum Java to 21
Dongjoon Hyun (Jira) via issues