Messages by Date
-
2026/11/11
[jira] [Assigned] (SPARK-61485) Pickle the methods of Row, VariantVal, Geometry and Geography by reference to pyspark.sql.types, and read an Arrow stream of one schema in the invalid-UTF-8 scan
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61417) Fix review findings: Spark's ML column defaults, the multiclass metric, the depth of a cross-session transform, empty observe, done-call errors over batch errors, and unencodable option strings
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61485) Pickle the methods of Row, VariantVal, Geometry and Geography by reference to pyspark.sql.types, and read an Arrow stream of one schema in the invalid-UTF-8 scan
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61417) Fix review findings: Spark's ML column defaults, the multiclass metric, the depth of a cross-session transform, empty observe, done-call errors over batch errors, and unencodable option strings
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61490) Release the instance dict of the Python client's PyO3 classes when they are freed, which PyO3 0.28 keeps
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61486) Add a generated visualization of the scheduled CI workflows
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61470) Let Ctrl-C end every call of the Python client that waits for the server, and raise the error of a failed interrupt, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61490) Release the instance dict of the Python client's PyO3 classes when they are freed, which PyO3 0.28 keeps
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61490) Release the instance dict of the Python client's PyO3 classes when they are freed, which PyO3 0.28 keeps
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61473) Raise PySpark's errors for the operands that Column operators and methods do not take, in the Python client
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61489) Correlated subquery on a field of an outer struct/variant column keys the correlation on the whole column: a join condition on the field fails with INTERNAL_ERROR and an equality on the field is decorrelated through a domain join on the entire struct
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61488) Upgrade Gradle to 9.9.1
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61489) Correlated subquery on a field of an outer struct/variant column keys the correlation on the whole column: a join condition on the field fails with INTERNAL_ERROR and an equality on the field is decorrelated through a domain join on the entire struct
Avery Qi (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61488) Upgrade Gradle to 9.9.1
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61322) Fail the stage with a clear error when a serialized task exceeds the JVM array size limit
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61322) Fail the stage with a clear error when a serialized task exceeds the JVM array size limit
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61486) Add a generated visualization of the scheduled CI workflows
Tian Gao (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61487) Truncate lineage during snapshot load
Gurpreet Nanda (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61471) Test that a deep plan over a deep expression is analyzed from a thread with a small stack
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61475) Send a bytes option of createTable and a bool option of the streaming reader as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61485) Pickle the methods of Row, VariantVal, Geometry and Geography by reference to pyspark.sql.types, and read an Arrow stream of one schema in the invalid-UTF-8 scan
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61477) Raise NOT_IMPLEMENTED from the native Pipeline.fit of no stages, and correct the seed and label docs of the native tree classifiers
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61377) Compute each input column only before the first condition reading it in the subexpression elimination path of FilterExec
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61435) Send the bytes() of a bytes or bytearray subclass in a binary column of createDataFrame in the Python client, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61435) Send the bytes() of a bytes or bytearray subclass in a binary column of createDataFrame in the Python client, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61410) Raise NO_ACTIVE_SESSION from the first call after the server-side session changed, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61413) Return a generator from DataFrame.toLocalIterator in the Python client, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61413) Return a generator from DataFrame.toLocalIterator in the Python client, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61414) Send a limit of one row over an empty projection in DataFrame::is_empty of the Rust API, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61414) Send a limit of one row over an empty projection in DataFrame::is_empty of the Rust API, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61410) Raise NO_ACTIVE_SESSION from the first call after the server-side session changed, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61469) Drive the future of a blocking call from the heap in Spark Connect Rust, so that a request does not overflow a small stack of the calling thread
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61469) Drive the future of a blocking call from the heap in Spark Connect Rust, so that a request does not overflow a small stack of the calling thread
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61472) Parse the host and port of a Spark Connect URL as urllib does, and raise SparkConnectException for a too long user_agent
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61485) Pickle the methods of Row, VariantVal, Geometry and Geography by reference to pyspark.sql.types, and read an Arrow stream of one schema in the invalid-UTF-8 scan
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61471) Test that a deep plan over a deep expression is analyzed from a thread with a small stack
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61485) Pickle the methods of Row, VariantVal, Geometry and Geography by reference to pyspark.sql.types, and read an Arrow stream of one schema in the invalid-UTF-8 scan
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61484) Correlated subqueries over a ROLLUP/CUBE/GROUPING SETS grouping key keep referencing the pre-Expand attribute, returning wrong results in super-aggregate rows and failing in HAVING
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61484) Correlated subqueries over a ROLLUP/CUBE/GROUPING SETS grouping key keep referencing the pre-Expand attribute, returning wrong results in super-aggregate rows and failing in HAVING
Avery Qi (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61484) Correlated subqueries over a ROLLUP/CUBE/GROUPING SETS grouping key keep referencing the pre-Expand attribute, returning wrong results in super-aggregate rows and failing in HAVING
Avery Qi (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61474) Raise PySpark's errors for the seeds of randomSplit, sample and sampleBy that PySpark cannot send
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61483) Send the bytes of binary literal subclasses, corr and cov without a limit, and check the Arrow schema of createDataFrame depth first, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61483) Send the bytes of binary literal subclasses, corr and cov without a limit, and check the Arrow schema of createDataFrame depth first, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61480) Fix wrong results by runtime group filtering in group-based DELETE when the condition uses a CHAR column
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61482) Evaluate only aggregate functions on zero rows when DecorrelateInnerQuery handles the COUNT bug
Kousuke Saruta (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61432) Add LICENSE-binary and NOTICE-binary for the convenience binaries
L. C. Hsieh (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61476) Unpack only a list in TableArg.partitionBy and orderBy, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61481) Let a second stop() release the session after an interrupted one, and let a signal end the waits of the streaming listener bus, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61481) Let a second stop() release the session after an interrupted one, and let a signal end the waits of the streaming listener bus, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-60950) MapOutputTrackerMaster never replies to a map output status request whose handler throws
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-60950) MapOutputTrackerMaster never replies to a map output status request whose handler throws
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61480) Fix wrong results by runtime group filtering in group-based DELETE when the condition uses a CHAR column
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-60769) Read Maven resolution settings from session configuration
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-60769) Read Maven resolution settings from session configuration
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61479) Fix wrong results by DSv2 UPDATE and MERGE when CHAR values are stored without padding
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61479) Fix wrong results by DSv2 UPDATE and MERGE when CHAR values are stored without padding
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61478) Raise the done error of a progress handler over a decode error of the results, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61475) Send a bytes option of createTable and a bool option of the streaming reader as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61478) Raise the done error of a progress handler over a decode error of the results, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61475) Send a bytes option of createTable and a bool option of the streaming reader as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61477) Raise NOT_IMPLEMENTED from the native Pipeline.fit of no stages, and correct the seed and label docs of the native tree classifiers
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61476) Unpack only a list in TableArg.partitionBy and orderBy, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61477) Raise NOT_IMPLEMENTED from the native Pipeline.fit of no stages, and correct the seed and label docs of the native tree classifiers
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61474) Raise PySpark's errors for the seeds of randomSplit, sample and sampleBy that PySpark cannot send
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61476) Unpack only a list in TableArg.partitionBy and orderBy, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61474) Raise PySpark's errors for the seeds of randomSplit, sample and sampleBy that PySpark cannot send
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61473) Raise PySpark's errors for the operands that Column operators and methods do not take, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61471) Keep the whole request of a deep analysis on a grown stack, so that a deep plan with a deep expression does not crash a thread with a small stack
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61478) Raise the done error of a progress handler over a decode error of the results, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61476) Unpack only a list in TableArg.partitionBy and orderBy, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61470) Let Ctrl-C end every call of the Python client that waits for the server, and raise the error of a failed interrupt, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61473) Raise PySpark's errors for the operands that Column operators and methods do not take, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61470) Let Ctrl-C end every call of the Python client that waits for the server, and raise the error of a failed interrupt, as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61471) Keep the whole request of a deep analysis on a grown stack, so that a deep plan with a deep expression does not crash a thread with a small stack
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61472) Parse the host and port of a Spark Connect URL as urllib does, and raise SparkConnectException for a too long user_agent
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61472) Parse the host and port of a Spark Connect URL as urllib does, and raise SparkConnectException for a too long user_agent
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61469) Drive the future of a blocking call from the heap in Spark Connect Rust, so that a request does not overflow a small stack of the calling thread
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61469) Drive the future of a blocking call from the heap in Spark Connect Rust, so that a request does not overflow a small stack of the calling thread
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61469) Drive the future of a blocking call from the heap in Spark Connect Rust, so that a request does not overflow a small stack of the calling thread
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61443) Fix the races of the progress handlers and streaming listeners, and the swallowed errors of the error conversion, of the Python client of Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61443) Fix the races of the progress handlers and streaming listeners, and the swallowed errors of the error conversion, of the Python client of Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61457) Improve Python Column access performance with PyO3 frozen
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61457) Improve Python Column access performance with PyO3 frozen
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61452) Cache Python datetime and decimal objects when collecting rows
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61452) Cache Python datetime and decimal objects when collecting rows
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61442) Parse the atomic and parameterized type strings of JSON and of DDL with one parser in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61442) Parse the atomic and parameterized type strings of JSON and of DDL with one parser in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61441) Make the state lock of the streaming listener bus poison-tolerant and drop listeners outside it in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61441) Make the state lock of the streaming listener bus poison-tolerant and drop listeners outside it in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61461) Fix internal error when deleting from a DSv2 table with a CHAR column without row-level operation support
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61461) Fix internal error when deleting from a DSv2 table with a CHAR column without row-level operation support
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61296) Return CollectLimitExec gather results in partition order
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61419) from_avro/schema_of_avro can corrupt a shared options map when the plan is canonicalized concurrently
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61395) Pickle VariantVal as PySpark does, and let its value and metadata be set, in the Python client
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61407) Let Ctrl-C end a call that waits for an unreachable or retrying server, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61400) Clone the request of a deep plan on a grown stack, so that a deep plan or expression does not crash a thread with a small stack, in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61400) Clone the request of a deep plan on a grown stack, so that a deep plan or expression does not crash a thread with a small stack, in Spark Connect Rust
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61407) Let Ctrl-C end a call that waits for an unreachable or retrying server, in the Python client as PySpark does
Hyukjin Kwon (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61437) Fix query errors by ConstantPropagation judging filter conditions over the aliases of a projection below as they are
Kousuke Saruta (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61354) Fix ConstantPropagation changing the rows a non-deterministic condition sees
Kousuke Saruta (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61296) Return CollectLimitExec gather results in partition order
Utkarsh Bajaj (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61296) Return CollectLimitExec gather results in partition order
Utkarsh Bajaj (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61276) Add GAP FILL relation operator
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61468) Reduce PR labeler delays
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-60731) Do not compute an expensive alias ahead of the filter conditions written before it when splitting a projection
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61468) Reduce PR labeler delays
Nicholas Chammas (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61468) Reduce PR labeler delays
Nicholas Chammas (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61460) Fix vectorized Parquet reader memory growth when a struct in an array or map has a NullType field
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61460) Fix vectorized Parquet reader memory growth when a struct in an array or map has a NullType field
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61283) Run the tests of the Rust SDK for native data sources in CI
Gengliang Wang (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61445) Pass through only the required child columns in Python UDF evaluation and return Python results directly in columnar mode
L. C. Hsieh (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61445) Pass through only the required child columns in Python UDF evaluation and return Python results directly in columnar mode
L. C. Hsieh (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61435) Send the bytes() of a bytes or bytearray subclass in a binary column of createDataFrame in the Python client, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61466) Add native scalar functions: the C interface spark_udf.h and USING PACKAGE
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61467) SupportQueryContext.copyTagsFrom overwrites the query context of an expression shared with other plans
Max Gekk (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61467) SupportQueryContext.copyTagsFrom overwrites the query context of an expression shared with other plans
Max Gekk (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61466) Add native scalar functions: the C interface spark_udf.h and USING PACKAGE
Tim Meehan (Jira) via issues
-
2026/11/11
[jira] [Commented] (SPARK-60782) Pandas and Arrow cogroups pair groups wrongly when the two sides' grouping keys have different types
Anil K (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61463) ORC filter pushdown skips matching rows for TIMESTAMP values in the repeated hour at the end of daylight saving time
Raviston Thanasekar (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61434) Raise the error of a converter before that of PyArrow in createDataFrame of local rows, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61444) Keep the result on zero rows of a correlated subquery as an expression if it fails to fold
Raviston Thanasekar (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61465) Avoid map-output epoch bump on an empty host cleanup when all shuffles are reliably stored and push-based shuffle is on
Venkata krishnan Sowrirajan (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61464) Fix `ClassCastException` in classic `approxQuantile` with int probabilities
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61464) Fix `ClassCastException` in classic `approxQuantile` with int probabilities
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61462) Fix silent under-delete in DELETE-only MERGE and metadata-only DELETE when CHAR values are stored without padding
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61413) Return a generator from DataFrame.toLocalIterator in the Python client, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61275) Fix wrong error type for out-of-range approxQuantile probabilities
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61275) Fix wrong error type for out-of-range approxQuantile probabilities
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61275) Fix wrong error type for out-of-range approxQuantile probabilities
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61462) Fix silent under-delete in DELETE-only MERGE and metadata-only DELETE when CHAR values are stored without padding
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61462) Fix silent under-delete in DELETE-only MERGE and metadata-only DELETE when CHAR values are stored without padding
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61462) Fix silent under-delete in DELETE-only MERGE and metadata-only DELETE when CHAR values are stored without padding
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61461) Fix internal error when deleting from a DSv2 table with a CHAR column without row-level operation support
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61461) Fix internal error when deleting from a DSv2 table with a CHAR column without row-level operation support
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-30628) File source V2: Support partition pruning with subqueries
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61460) Fix vectorized Parquet reader memory growth when a struct in an array or map has a NullType field
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61446) Remove per-shard compilation fallback in Maven and hosted Python CI
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61460) Fix vectorized Parquet reader memory growth when a struct in an array or map has a NullType field
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-30628) File source V2: Support partition pruning with subqueries
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-30628) File source V2: Support partition pruning with subqueries
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61211) UnionExec reports a wrong output partitioning when a child's partitioning references an attribute that does not map to the union output
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61211) UnionExec reports a wrong output partitioning when a child's partitioning references an attribute that does not map to the union output
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61211) UnionExec reports a wrong output partitioning when a child's partitioning references an attribute that does not map to the union output
Dongjoon Hyun (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61459) GeneratePredicate skips FilterExec's CSE gate: a filter raises only with whole-stage codegen off
Max Gekk (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61414) Send a limit of one row over an empty projection in DataFrame::is_empty of the Rust API, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-60032) ALTER TABLE ADD CONSTRAINT builds the stored CHECK predicate from the optimized expression, freezing current_timestamp()
Yang Jie (Jira) via issues
-
2026/11/11
[jira] [Commented] (SPARK-61412) Send the user agent as client_type on the execute, analyze, config, interrupt, release and error-detail requests, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/11
[jira] [Commented] (SPARK-61411) Retry the errors that carry a RetryInfo, after the delay the server asks for, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61411) Retry the errors that carry a RetryInfo, after the delay the server asks for, as PySpark does
Tim Meehan (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61458) Reuse post-merge documentation artifacts for GitHub Pages
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61458) Reuse post-merge documentation artifacts for GitHub Pages
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61458) Reuse post-merge documentation artifacts for GitHub Pages
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61354) Fix ConstantPropagation moving an equality ahead of the conditions written before it
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61410) Raise NO_ACTIVE_SESSION from the first call after the server-side session changed, as PySpark does
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61450) Support native DecisionTreeClassifier training and prediction
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61458) Reuse post-merge documentation artifacts for GitHub Pages
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-60615) Restore PR labeler (without `pull_request_target`)
Nicholas Chammas (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61458) Reuse post-merge documentation artifacts for GitHub Pages
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-60615) Restore PR labeler (without `pull_request_target`)
Nicholas Chammas (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61455) Python worker drops exception when message contains lone surrogate
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61458) Reuse post-merge documentation artifacts for GitHub Pages
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61458) Reuse post-merge documentation artifacts for GitHub Pages
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61457) Improve Python Column access performance with PyO3 frozen
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61456) Support configurable intermediate storage levels in regression estimators
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-58514) Restore NumPy log2 mapping with a native Spark function
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61457) Improve Python Column access performance with PyO3 frozen
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61354) Fix ConstantPropagation changing what the conditions written before an equality see
Kousuke Saruta (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61457) Improve Python Column access performance with PyO3 frozen
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61456) Support configurable intermediate storage levels in regression estimators
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61455) ython worker drops exception when message contains lone surrogate
Craiu Constantin-Tiberiu (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61455) Python worker drops exception when message contains lone surrogate
Craiu Constantin-Tiberiu (Jira) via issues
-
2026/11/11
[jira] [Commented] (SPARK-61454) SPIP: Extend Real-Time Mode to Distributed Batch SQL and DataFrame Queries
Jungtaek Lim (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61453) Support native DecisionTreeRegressor training and prediction
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61454) SPIP: Extend Real-Time Mode to Distributed Batch SQL and DataFrame Queries
Ferdinand Xu (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61454) SPIP: Extend Real-Time Mode to Distributed Batch SQL and DataFrame Queries
Ferdinand Xu (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61453) Support native DecisionTreeRegressor training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61453) Support native DecisionTreeRegressor training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61450) Support native DecisionTreeClassifier training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-59728) Keep canonical JSON_ARRAY SQL on the direct grammar path
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61452) Cache Python datetime and decimal objects when collecting rows
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61452) Cache Python datetime and decimal objects when collecting rows
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61452) Cache Python datetime and decimal objects when collecting rows
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-59244) Wrap foldable path-expression evaluation in JSON path function builders to emit a clean analysis error
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-60761) Spark Connect DataFrame.withColumns({}) fails with an empty AssertionError, while classic returns the DataFrame unchanged
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-60761) Spark Connect DataFrame.withColumns({}) fails with an empty AssertionError, while classic returns the DataFrame unchanged
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61451) Inconsistent default for whether arrow is used in UDFs
Thomas Newton (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61451) Inconsistent default for whether arrow is used in UDFs
Thomas Newton (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61450) Support native DecisionTreeClassifier training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61450) Support native DecisionTreeClassifier training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-61428) Support native RandomForestRegressor training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-61428) Support native RandomForestRegressor training and prediction
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61449) Start V4 stream-stream join eviction scans after the previous cutoff when the eviction column is not late-filtered
Jungtaek Lim (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61448) Bound stream-stream join state by a window key over the first watermarked column in legacy mode
Jungtaek Lim (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61443) Fix the races of the progress handlers and streaming listeners, and the swallowed errors of the error conversion, of the Python client of Spark Connect Rust
L. C. Hsieh (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-61447) Avoid exponential planning cost for nested dynamic pruning subqueries with AQE
ASF GitHub Bot (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61447) Avoid exponential planning cost for nested dynamic pruning subqueries with AQE
Hemanth Boyina (Jira) via issues
-
2026/11/11
[jira] [Created] (SPARK-61446) Remove per-shard compilation fallback in Maven and hosted Python CI
Ruifeng Zheng (Jira) via issues
-
2026/11/11
[jira] [Assigned] (SPARK-60904) Preserve the output partitioning of shuffled FULL OUTER joins
XiDuo You (Jira) via issues
-
2026/11/11
[jira] [Resolved] (SPARK-60904) Preserve the output partitioning of shuffled FULL OUTER joins
XiDuo You (Jira) via issues
-
2026/11/11
[jira] [Updated] (SPARK-60904) Preserve the output partitioning of shuffled FULL OUTER joins
XiDuo You (Jira) via issues