Messages by Date
-
2026/11/11
[jira] [Updated] (SPARK-60904) Preserve the output partitioning of shuffled FULL OUTER joins
XiDuo You (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61445) Pass through only the required child columns in Python UDF evaluation and return Python results directly in columnar mode
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61427) Consolidate VALUE_ALLOWED into VALUE_NOT_ALLOWED in PySpark
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Closed] (SPARK-61427) Consolidate VALUE_ALLOWED into VALUE_NOT_ALLOWED in PySpark
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61445) Pass through only the required child columns in Python UDF evaluation and return Python results directly in columnar mode
L. C. Hsieh (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61211) UnionExec reports a wrong output partitioning when a child's partitioning references an attribute that does not map to the union output
XiDuo You (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61444) Correlated scalar subquery fails during optimization when its result on zero rows fails to evaluate
Raviston Thanasekar (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61211) UnionExec reports a wrong output partitioning when a child's partitioning references an attribute that does not map to the union output
XiDuo You (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61444) Correlated scalar subquery fails during optimization when its result on zero rows fails to evaluate
Raviston Thanasekar (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61440) Make the retries of the calls of the Spark Connect Rust client in one place, and do not panic on a stream deadline too far to be a time
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61444) Correlated scalar subquery fails during optimization when its result on zero rows fails to evaluate
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61432) Add LICENSE-binary and NOTICE-binary for the convenience binaries
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61439) Raise INTERVAL_ARITHMETIC_OVERFLOW with a query context for an overflowing interval multiplication
Max Gekk (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61441) Make the state lock of the streaming listener bus poison-tolerant and drop listeners outside it in Spark Connect Rust
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61443) Fix the races of the progress handlers and streaming listeners, and the swallowed errors of the error conversion, of the Python client of Spark Connect Rust
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61442) Parse the atomic and parameterized type strings of JSON and of DDL with one parser in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61442) Parse the atomic and parameterized type strings of JSON and of DDL with one parser in Spark Connect Rust
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61443) Fix the races of the progress handlers and streaming listeners, and the swallowed errors of the error conversion, of the Python client of Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61442) Parse the atomic and parameterized type strings of JSON and of DDL with one parser in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61441) Make the state lock of the streaming listener bus poison-tolerant and drop listeners outside it in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61440) Make the retries of the calls of the Spark Connect Rust client in one place, and do not panic on a stream deadline too far to be a time
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61440) Make the retries of the calls of the Spark Connect Rust client in one place, and do not panic on a stream deadline too far to be a time
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61441) Make the state lock of the streaming listener bus poison-tolerant and drop listeners outside it in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61439) Raise INTERVAL_ARITHMETIC_OVERFLOW with a query context for an overflowing interval multiplication
Max Gekk (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-60325) Remove the holding of input batches from columnar Python UDFs
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-60325) Remove the holding of input batches from columnar Python UDFs
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61438) Fix query errors and wrong results by ConstantPropagation when a propagated equality is NULL on a row
Kousuke Saruta (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-60730) Do not push filter conditions that can fail ahead of the expensive conditions before them
Kousuke Saruta (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61437) Fix query errors by ConstantPropagation removing a filter condition before one over an alias that can fail
Kousuke Saruta (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61354) Fix ConstantPropagation moving an equality ahead of the conditions written before it
Kousuke Saruta (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61211) UnionExec reports a wrong output partitioning when a child's partitioning references an attribute that does not map to the union output
XiDuo You (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61406) Enable in tests
Dongjoon Hyun (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61406) Enable in tests
Dongjoon Hyun (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61406) Enable `spark.sql.optimizer.datasourceV2JoinPushdown` in tests
Dongjoon Hyun (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61406) [SPARK-61406][SQL] Enable `spark.sql.optimizer.datasourceV2JoinPushdown` in tests
Dongjoon Hyun (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61431) Share the loopback service and the session and golden helpers of the Rust integration tests in a common module of each crate
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61421) Bring python/tests and the hand-written pyspark shim under the ruff lint gate in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61421) Bring python/tests and the hand-written pyspark shim under the ruff lint gate in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61430) Make the request structure tests of the Spark Connect Rust client send and assert their requests
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61430) Make the request structure tests of the Spark Connect Rust client send and assert their requests
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61431) Share the loopback service and the session and golden helpers of the Rust integration tests in a common module of each crate
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61429) Share the argument-error and option helpers of the PyO3 wrappers of Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61429) Share the argument-error and option helpers of the PyO3 wrappers of Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61027) Extract shared DDL and DML analysis helpers
Uroš Bojanić (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61027) Extract shared DDL and DML analysis helpers
Uroš Bojanić (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61436) Quote literal column names when ignoring column order in assertDataFrameEqual
Yingxuan Li (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61433) Add missing timeouts to scheduled GitHub Actions jobs
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61434) Raise the error of a converter before that of PyArrow in createDataFrame of local rows, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61434) Raise the error of a converter before that of PyArrow in createDataFrame of local rows, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61435) Send the bytes() of a bytes or bytearray subclass in a binary column of createDataFrame in the Python client, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61435) Send the bytes() of a bytes or bytearray subclass in a binary column of createDataFrame in the Python client, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61433) Add missing timeouts to scheduled GitHub Actions jobs
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Commented] (SPARK-61412) Send the user agent as client_type on the execute, analyze, config, interrupt, release and error-detail requests, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61412) Send the user agent as client_type on the execute, analyze, config, interrupt, release and error-detail requests, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61383) Use reserved example domains in documentation
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61383) Use reserved example domains in documentation
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61383) Use reserved example domains in documentation
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-60294) Python UDFs fail or return wrong results on Arrow-backed input whose source reuses its vectors
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-60294) Python UDFs fail or return wrong results on Arrow-backed input whose source reuses its vectors
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61432) Add LICENSE-binary and NOTICE-binary for the convenience binaries
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61431) Share the loopback service and the session and golden helpers of the Rust integration tests in a common module of each crate
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61431) Share the loopback service and the session and golden helpers of the Rust integration tests in a common module of each crate
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61431) Share the loopback service and the session and golden helpers of the Rust integration tests in a common module of each crate
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61420) Enforce coverage floors in the Coverage workflow, and remove the Rust checks job that duplicates rust.yml
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61420) Enforce coverage floors in the Coverage workflow, and remove the Rust checks job that duplicates rust.yml
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61423) Reject an out-of-range decimal precision or scale when converting to Arrow instead of wrapping it, in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61425) Frame artifact uploads in one place and reject a chunked artifact that changed size during its upload
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61424) Fail to connect on metadata that cannot be a gRPC header instead of dropping it
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61425) Frame artifact uploads in one place and reject a chunked artifact that changed size during its upload
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61424) Fail to connect on metadata that cannot be a gRPC header instead of dropping it
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61423) Reject an out-of-range decimal precision or scale when converting to Arrow instead of wrapping it, in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61422) Make the generated function dispatch and wrappers of spark-connect-rust reproducible from their generator, and check them in CI
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61422) Make the generated function dispatch and wrappers of spark-connect-rust reproducible from their generator, and check them in CI
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61430) Make the request structure tests of the Spark Connect Rust client send and assert their requests
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61430) Make the request structure tests of the Spark Connect Rust client send and assert their requests
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61430) Make the request structure tests of the Spark Connect Rust client send and assert their requests
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61428) Support native RandomForestRegressor training and prediction
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61429) Share the argument-error and option helpers of the PyO3 wrappers of Spark Connect Rust
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61429) Share the argument-error and option helpers of the PyO3 wrappers of Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61429) Share the argument-error and option helpers of the PyO3 wrappers of Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61428) Support native RandomForestRegressor training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61428) Support native RandomForestRegressor training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61427) Consolidate VALUE_ALLOWED into VALUE_NOT_ALLOWED in PySpark
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61427) Consolidate VALUE_ALLOWED into VALUE_NOT_ALLOWED in PySpark
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61426) Check the observed metrics of only the Observations of the executed plan, keep the metrics of earlier actions, and raise for nested unconvertible metrics, in the Python client as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-33552) Accessibility: in spark history server page, The <html> element does not have a lang attribute, user depending on Assistive Technology get affected as lang attribute.
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61426) Check the observed metrics of only the Observations of the executed plan, keep the metrics of earlier actions, and raise for nested unconvertible metrics, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61426) Check the observed metrics of only the Observations of the executed plan, keep the metrics of earlier actions, and raise for nested unconvertible metrics, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61425) Frame artifact uploads in one place and reject a chunked artifact that changed size during its upload
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61270) Fix wrong condition text in GroupState.setTimeoutTimestamp error
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61418) Make VariantVal, Geometry and Geography PySpark's plain classes in the Python client, whose attributes are instance attributes as given and which are freed with their values
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61425) Frame artifact uploads in one place and reject a chunked artifact that changed size during its upload
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61423) Reject an out-of-range decimal precision or scale when converting to Arrow instead of wrapping it, in Spark Connect Rust
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61424) Fail to connect on metadata that cannot be a gRPC header instead of dropping it
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61425) Frame artifact uploads in one place and reject a chunked artifact that changed size during its upload
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61424) Fail to connect on metadata that cannot be a gRPC header instead of dropping it
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61424) Fail to connect on metadata that cannot be a gRPC header instead of dropping it
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61418) Make VariantVal, Geometry and Geography PySpark's plain classes in the Python client, whose attributes are instance attributes as given and which are freed with their values
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61423) Reject an out-of-range decimal precision or scale when converting to Arrow instead of wrapping it, in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61423) Reject an out-of-range decimal precision or scale when converting to Arrow instead of wrapping it, in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61422) Make the generated function dispatch and wrappers of spark-connect-rust reproducible from their generator, and check them in CI
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61420) Enforce coverage floors in the Coverage workflow, and remove the Rust checks job that duplicates rust.yml
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61422) Make the generated function dispatch and wrappers of spark-connect-rust reproducible from their generator, and check them in CI
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61422) Make the generated function dispatch and wrappers of spark-connect-rust reproducible from their generator, and check them in CI
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61421) Bring python/tests and the hand-written pyspark shim under the ruff lint gate in Spark Connect Rust
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61420) Enforce coverage floors in the Coverage workflow, and remove the Rust checks job that duplicates rust.yml
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61421) Bring python/tests and the hand-written pyspark shim under the ruff lint gate in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61421) Bring python/tests and the hand-written pyspark shim under the ruff lint gate in Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61420) Enforce coverage floors in the Coverage workflow, and remove the Rust checks job that duplicates rust.yml
L. C. Hsieh (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-48995) Column.endswith(None) occasionally causes NPE
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61201) Add whole-stage codegen to the sort-merge ASOF join
Wenchen Fan (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61409) Raise PySpark's errors for a list among the columns of repartition, a ternary pow and an argument of Connect's _to_col that is not a column, and warn of a Column key in getItem, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61201) Add whole-stage codegen to the sort-merge ASOF join
Wenchen Fan (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61416) Raise RecursionError for the expressions of merges, writeTo, function registrations, AutoCDC flows and pickled Columns too deep to send, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61409) Raise PySpark's errors for a list among the columns of repartition, a ternary pow and an argument of Connect's _to_col that is not a column, and warn of a Column key in getItem, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61416) Raise RecursionError for the expressions of merges, writeTo, function registrations, AutoCDC flows and pickled Columns too deep to send, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61415) Back off and bound the reattaches of a result stream that keeps failing, and raise NO_ACTIVE_SESSION when the plan compression lookup closed the client, in Spark Connect Rust as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61415) Back off and bound the reattaches of a result stream that keeps failing, and raise NO_ACTIVE_SESSION when the plan compression lookup closed the client, in Spark Connect Rust as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61361) Support configurable intermediate storage levels in tree estimators
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61361) Support configurable intermediate storage levels in tree estimators
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61361) Support configurable intermediate storage levels in tree estimators
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61360) Fix DateOffset imports with pandas 3.1
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61417) Fix review findings: Spark's ML column defaults, the multiclass metric, the depth of a cross-session transform, empty observe, done-call errors over batch errors, and unencodable option strings
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61360) Fix DateOffset imports with pandas 3.1
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61360) Fix DateOffset imports with pandas 3.1
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61360) Fix DateOffset imports with pandas 3.1
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61404) Add ai_query for remote model inference in PySpark
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61327) Install PyArrow in the Python 3.15 CI image
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61327) Install PyArrow in the Python 3.15 CI image
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61327) Install PyArrow in the Python 3.15 CI image
Ruifeng Zheng (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61419) from_avro/schema_of_avro can corrupt a shared options map when the plan is canonicalized concurrently
Lihang Shen (Jira) via issues
-
2026/11/10
[jira] [Commented] (SPARK-61419) from_avro/schema_of_avro can corrupt a shared options map when the plan is canonicalized concurrently
Lihang Shen (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61419) from_avro/schema_of_avro can corrupt a shared options map when the plan is canonicalized concurrently
Lihang Shen (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61400) Clone the request of a deep plan on a grown stack, so that a deep plan or expression does not crash a thread with a small stack, in Spark Connect Rust
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61399) Raise in fit of the native Pipeline and CrossValidator instead of returning a model that the server cannot use
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61399) Raise in fit of the native Pipeline and CrossValidator instead of returning a model that the server cannot use
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61400) Clone the request of a deep plan on a grown stack, so that a deep plan or expression does not crash a thread with a small stack, in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61397) Raise SparkConnectException for a malformed chunked Arrow batch, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61397) Raise SparkConnectException for a malformed chunked Arrow batch, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61343) Remove type: [arg-type] in pyspark.sql.connect.session
JyunSheng Kao (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61391) Send an explicit None param as a null literal, and raise CANNOT_INFER_ARRAY_ELEMENT_TYPE for an empty list param, in the native ML classes of the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61391) Send an explicit None param as a null literal, and raise CANNOT_INFER_ARRAY_ELEMENT_TYPE for an empty list param, in the native ML classes of the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Commented] (SPARK-61343) Remove type: [arg-type] in pyspark.sql.connect.session
JyunSheng Kao (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-60673) Read all referenced metadata columns in DSv2 DELETE, UPDATE and MERGE
Dongjoon Hyun (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61418) Make VariantVal, Geometry and Geography PySpark's plain classes in the Python client, whose attributes are instance attributes as given and which are freed with their values
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61418) Make VariantVal, Geometry and Geography PySpark's plain classes in the Python client, whose attributes are instance attributes as given and which are freed with their values
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61418) Make VariantVal, Geometry and Geography PySpark's plain classes in the Python client, whose attributes are instance attributes as given and which are freed with their values
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61417) Fix review findings: Spark's ML column defaults, the multiclass metric, the depth of a cross-session transform, empty observe, done-call errors over batch errors, and unencodable option strings
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61417) Fix review findings: Spark's ML column defaults, the multiclass metric, the depth of a cross-session transform, empty observe, done-call errors over batch errors, and unencodable option strings
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61396) Accept a float or str seed in randomSplit of the Python client, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61394) Reject a bool or out-of-range thresh in dropna as PySpark does, and name VariantVal in the error of a pivot value
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61396) Accept a float or str seed in randomSplit of the Python client, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61394) Reject a bool or out-of-range thresh in dropna as PySpark does, and name VariantVal in the error of a pivot value
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61398) Keep the replaced error as the context of the done error of a progress handler, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61398) Keep the replaced error as the context of the done error of a progress handler, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61416) Raise RecursionError for the expressions of merges, writeTo, function registrations, AutoCDC flows and pickled Columns too deep to send, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61293) Fix a race between profile result merges and spark.profile.clear() in classic PySpark
Tian Gao (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61293) Fix a race between profile result merges and spark.profile.clear() in classic PySpark
Tian Gao (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61293) Fix a race between profile result merges and spark.profile.clear() in classic PySpark
Tian Gao (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61407) Let Ctrl-C end a call that waits for an unreachable or retrying server, in the Python client as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-60893) Keep the import caches of Spark's own zip archives when Python workers invalidate import caches
Tian Gao (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61399) Raise in fit of the native Pipeline and CrossValidator instead of returning a model that the server cannot use
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-60893) Keep the import caches of Spark's own zip archives when Python workers invalidate import caches
Tian Gao (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-60893) Keep the import caches of Spark's own zip archives when Python workers invalidate import caches
Tian Gao (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61416) Raise RecursionError for the expressions of merges, writeTo, function registrations, AutoCDC flows and pickled Columns too deep to send, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61416) Raise RecursionError for the expressions of merges, writeTo, function registrations, AutoCDC flows and pickled Columns too deep to send, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61392) Report the invalid string, not a binary value, in the UnicodeDecodeError of a result in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61388) Interrupt only the execution that an interrupted call waits for, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61393) Accept the values that PySpark accepts in the list arguments of the Column methods, and raise RecursionError for a deep list, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61392) Report the invalid string, not a binary value, in the UnicodeDecodeError of a result in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61393) Accept the values that PySpark accepts in the list arguments of the Column methods, and raise RecursionError for a deep list, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61388) Interrupt only the execution that an interrupted call waits for, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61409) Raise PySpark's errors for a list among the columns of repartition, a ternary pow and an argument of Connect's _to_col that is not a column, and warn of a Column key in getItem, in the Python client
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Comment Edited] (SPARK-61341) Wrong LIKE pattern from startswith/endswith/contains with a column argument in DSv2 sources that use V2ExpressionSQLBuilder
Eric Yang (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61390) Use the default retry policy of PySpark in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61390) Use the default retry policy of PySpark in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61389) Parse the port of the connection string as urllib does, and raise the builtin ValueError for a bad port or keepalive value, as PySpark does, in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61389) Parse the port of the connection string as urllib does, and raise the builtin ValueError for a bad port or keepalive value, as PySpark does, in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61415) Back off and bound the reattaches of a result stream that keeps failing, and raise NO_ACTIVE_SESSION when the plan compression lookup closed the client, in Spark Connect Rust as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61415) Back off and bound the reattaches of a result stream that keeps failing, and raise NO_ACTIVE_SESSION when the plan compression lookup closed the client, in Spark Connect Rust as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61391) Send an explicit None param as a null literal, and raise CANNOT_INFER_ARRAY_ELEMENT_TYPE for an empty list param, in the native ML classes of the Python client as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61415) Back off and bound the reattaches of a result stream that keeps failing, and raise NO_ACTIVE_SESSION when the plan compression lookup closed the client, in Spark Connect Rust as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61405) Draw a seed of the client for sample_by without one, take PySpark's strata types, and fill the columns of a map in fillna_value, in the Rust API as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61405) Draw a seed of the client for sample_by without one, take PySpark's strata types, and fill the columns of a map in fillna_value, in the Rust API as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Resolved] (SPARK-61402) Pickle VariantVal, Geometry and Geography as PySpark's plain classes in the Python client, so that the server's Python workers load them
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61412) Send the user agent as client_type on the execute, analyze, config, interrupt, release and error-detail requests, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61412) Send the user agent as client_type on the execute, analyze, config, interrupt, release and error-detail requests, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61413) Return a generator from DataFrame.toLocalIterator in the Python client, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61414) Send a limit of one row over an empty projection in DataFrame::is_empty of the Rust API, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61411) Retry the errors that carry a RetryInfo, after the delay the server asks for, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61410) Raise NO_ACTIVE_SESSION from the first call after the server-side session changed, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61414) Send a limit of one row over an empty projection in DataFrame::is_empty of the Rust API, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61410) Raise NO_ACTIVE_SESSION from the first call after the server-side session changed, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Assigned] (SPARK-61402) Pickle VariantVal, Geometry and Geography as PySpark's plain classes in the Python client, so that the server's Python workers load them
Hyukjin Kwon (Jira) via issues
-
2026/11/10
[jira] [Created] (SPARK-61413) Return a generator from DataFrame.toLocalIterator in the Python client, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61411) Retry the errors that carry a RetryInfo, after the delay the server asks for, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61396) Accept a float or str seed in randomSplit of the Python client, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61398) Keep the replaced error as the context of the done error of a progress handler, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61394) Reject a bool or out-of-range thresh in dropna as PySpark does, and name VariantVal in the error of a pivot value
ASF GitHub Bot (Jira) via issues
-
2026/11/10
[jira] [Updated] (SPARK-61397) Raise SparkConnectException for a malformed chunked Arrow batch, as PySpark does
ASF GitHub Bot (Jira) via issues