issues  

Messages by Date

• 2026/11/06 [jira] [Resolved] (SPARK-60862) Watermark propagation through reused exchanges uses zero watermark Jungtaek Lim (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60675) Support PyArrow Table input through the C Stream interface in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60780) Report subqueries in table OPTIONS as non-constant instead of an internal error ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60994) Type a decimal literal of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60985) Fix query failures when a filter inferred from data constraints can fail ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60959) Keep the values of a collected Row, and compare and pickle VariantVal, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60812) Support predicate DELETE for the built-in JDBC V2 catalog ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60902) Apply column-name lists and pandas columns in Spark Connect Rust createDataFrame as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61020) Ensure that every ignore/test pattern matches a repo file Nicholas Chammas (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60834) Run master post-merge builds every ten commits Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60961) Raise SparkConnectGrpcException for gRPC errors without server details in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61028) Name the column of GroupedData.count, aggregate every numeric column by default, and take a dict in DataFrame.agg, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61028) Name the column of GroupedData.count, aggregate every numeric column by default, and take a dict in DataFrame.agg, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-60326) ORC filter pushdown drops rows for TIMESTAMP literals with sub-millisecond digits sepuri sai krishna (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60893) Skip zip archives present at Python worker startup when invalidating import caches Tian Gao (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60981) Alias a Column with several names, and with metadata of any JSON values, in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60834) Run master post-merge builds every ten commits Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60891) Upgrade `MySQL` JDBC driver to `26.10.0` Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61027) Extract shared DDL and DML analysis helpers Vladan Vasić (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60867) Run the GitHub Pages deployment daily instead of on every master push Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60861) Adding a window expression changes HAVING name resolution for a same-named grouping column ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61006) Pass the named arguments of Python UDF and UDTF calls of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61007) Support the subquery expressions of scalar, exists, isin and asTable of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60975) Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61007) Support the subquery expressions of scalar, exists, isin and asTable of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-57421) Support @-syntax version time travel on table name Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61023) Take the arguments of dropna, na.drop, fillna, describe, corr and approxQuantile in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60946) Send user-defined, VARIANT, GEOMETRY and GEOGRAPHY values in createDataFrame, and collect spatial values, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61025) Log a task failure before its task listeners run ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60949) Access struct fields as attributes of a Column, and slice a Column, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60855) Remove the Spark JAR from the Python worker PYTHONPATH ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61023) Take the arguments of dropna, na.drop, fillna, describe, corr and approxQuantile in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60661) Avoid generic detection for exact built-in numbers in Spark Connect Rust DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61025) Log a task failure before its task listeners run Pratham Manja (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61024) Raise the errors of PySpark for the arguments of DataFrame methods in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61026) Take the positional fraction and seed of sample, the ordinals of sort and groupBy, the Columns of drop and the list of selectExpr in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61026) Take the positional fraction and seed of sample, the ordinals of sort and groupBy, the Columns of drop and the list of selectExpr in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61023) Take the arguments of dropna, na.drop, fillna, describe, corr and approxQuantile in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60946) Send user-defined, VARIANT, GEOMETRY and GEOGRAPHY values in createDataFrame, and collect spatial values, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61024) Raise the NOT_EXPECTED_TYPE errors of PySpark for the arguments of DataFrame methods in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60965) Make code for excluding tables from shared relation cache generic Anton Okolnychyi (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61015) Take the arguments of unpivot, melt and replace in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61024) Raise the NOT_EXPECTED_TYPE errors of PySpark for the arguments of DataFrame methods in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61018) Name the UDFs of mapInPandas, mapInArrow, applyInPandas, applyInArrow and applyInPandasWithState after their functions in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60716) Use Arrow columns for supported pandas date input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60661) Avoid generic detection for exact built-in numbers in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61007) Support the subquery expressions of scalar, exists, isin and asTable of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61007) Support the subquery expressions of scalar, exists, isin and asTable of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61021) Add proper test files for sparktestsupport Nicholas Chammas (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61003) Register UDTFs on the server with spark.udtf.register of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61020) Ensure that every ignore/test pattern matches a repo file Nicholas Chammas (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60947) Send TIME values and parse the TIME type of DDL schemas in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61019) Print the plans of explain and StreamingQuery.explain with Python's print, and raise the errors of explain, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60641) Accept Byte and Short Row values for Float and Double schemas in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61018) Name the UDFs of mapInPandas, mapInArrow, applyInPandas, applyInArrow and applyInPandasWithState after their functions in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61019) Print the plans of explain and StreamingQuery.explain with Python's print, and raise the errors of explain, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60962) Pickle user-defined types as Python objects, and make them of arguments, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60962) Pickle user-defined types as Python objects, and make them of arguments, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60934) [SQL] Treat seedless TABLESAMPLE and aes_encrypt without an IV as non-deterministic ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61006) Pass the arguments of Python UDF and UDTF calls of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61012) Sample by the fractions of sampleBy, and take a Column, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60997) Apply the per-RPC deadlines of PySpark Connect in the Rust client, and reattach an execution past its deadline Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60994) Type a decimal literal of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61015) Take the arguments of unpivot, melt and replace in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61010) Fit native Rust LogisticRegression and predict with its cached model ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61007) Support the subquery expressions of scalar, exists, isin and asTable of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61013) Set the results of the Observations of observe in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61012) Sample by the fractions of sampleBy, and take a Column, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61014) Run foreach and foreachPartition, and return the DataFrame of toJSON, in the Python client as PySpark Connect does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60808) Runtime bloom filter built from a non-deterministic creation side can drop join rows ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60946) Send user-defined, VARIANT, GEOMETRY and GEOGRAPHY values in createDataFrame, and collect spatial values, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-59589) Hand Expand's varying output columns to the consumer as globals Yang Jie (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60727) Use Arrow columns for supported pandas float64 input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61009) RANGE window frames over integral columns return wrong results when the offset or the frame bound does not fit in the column type ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61010) Fit native Rust LogisticRegression and predict with its cached model Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61010) Fit native Rust LogisticRegression and predict with its cached model Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60998) LongToUnsafeRowMap reserves a full page (up to 64 MiB) of execution memory per map, causing OOM with many shuffled hash joins in one task L. C. Hsieh (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60947) Send TIME values and parse the TIME type of DDL schemas in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60666) Dispatch Arrow result decoding once per typed column in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61005) Create the UDFs of udf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60685) Avoid generic scalar probes for exact Python date inputs in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60686) Use columnar Arrow for supported pandas timestamp input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60975) Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60999) Create the UDTFs of udtf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60999) Create the UDTFs of udtf and arrow_udtf of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60974) Accept a DDL string schema in mapInPandas, applyInPandas and the other map functions in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61005) Create the UDFs of udf of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61006) Pass the arguments of Python UDF and UDTF calls of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61006) Pass the named arguments of Python UDF and UDTF calls of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60640) Avoid intermediate Value clones during local Arrow input encoding in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60659) Support day-time interval inputs in the Rust Spark Connect client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60659) Support day-time interval inputs in the Rust Spark Connect client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61004) Extract shared SHOW command analysis helpers ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60964) Retry each reattach, and release executions that fail at once, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60995) Check the arguments of when, bucket, pandas_udf, arrow_udf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60859) Show KeyedPartitioning partition keys in plan strings XiDuo You (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60687) Avoid numeric probes for exact list and tuple scalar arrays in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60964) Retry each reattach, and release executions that fail at once, in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60859) Show KeyedPartitioning partition keys in plan strings XiDuo You (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60741) Keep the build side's keyed partitioning in the dynamic partition pruning subquery XiDuo You (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60577) Fix `ClassCastException` of `IN` filters with scalar subqueries in V1 file source scans Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60699) Build Arrow columns directly for exact integer tuple input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60960) Keep executionInfo per DataFrame, and the operation id of every ExecutePlan error, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60666) Dispatch Arrow result decoding once per typed column in Spark Connect Rust ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60567) Keep running task interrupt listeners if logging a listener failure throws Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61002) CBO estimates an equi-join as empty when a join key has no min/max ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61002) CBO estimates an equi-join as empty when a join key has no min/max Yang Jie (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60943) Fix wrong results when a cast from `DECIMAL(19, 0)` to `BIGINT` overflows Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60985) Fix query failures when a filter inferred from data constraints can fail Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60980) Fix query failures by `CombineFilters` when a condition that can fail follows a non-deterministic or throwable one Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60999) Create the UDTFs of udtf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60680) Support positional DataFrame column indexing in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60682) Display DataFrame schema in Spark Connect Rust repr Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60698) Batch Arrow input normalization configuration reads in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60681) Expose DataFrame columns in Rust client dir and IPython completions Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-58612) [SQL] Handle archive recursion for nested archives Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60058) Support Z85 encoding and decoding for variant data in from_json and to_json expressiosn Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60528) Fix `ExpressionEncoder` assertion failure on nested empty structs Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60993) Send the optional arguments of the SQL functions of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60973) Remove unused from Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60996) Upgrade Netty to 4.2.20.Final ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60986) Take datetime.timedelta values in lit() and createDataFrame in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60996) Upgrade Netty to 4.2.20.Final Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60995) Check the arguments of when, bucket, pandas_udf, arrow_udf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60994) Type a decimal literal of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60987) Fix `NoClassDefFoundError` when running Kafka benchmarks in the benchmark workflow Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60987) Fix `NoClassDefFoundError` when running Kafka benchmarks in the benchmark workflow ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60991) Show a DataFrame as the server formats it, with truncate and vertical, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60954) Type and convert all-null, Decimal and map columns of pandas input in Spark Connect Rust createDataFrame as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60966) Cover reattachable execution cleanup over gRPC in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60972) Simplify DataFrameReader plan construction Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60953) Render regexp_replace and instr columns in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60959) Keep the values of a collected Row, and compare and pickle VariantVal, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60959) Keep the values of a collected Row, and compare and pickle VariantVal, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60990) Sort nulls first in Window.orderBy of a column in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60983) Fix query errors by ConstantPropagation when a constant is substituted into an expression that can fail ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60948) Render Column reprs in Spark Connect Rust as PySpark Connect does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60984) Fix `HighlyCompressedMapStatusBenchmark` failure when `mockito` is not on the classpath Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60982) Build an array of a list or a NumPy array in lit() in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60970) Use `Cast.canUpCast` for the nullability of `try_cast` from decimal to integral types Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60990) Sort nulls first in Window.orderBy of a column in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60973) Remove unused `VariableAssignmentUtils` from `sql/core` Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60990) Sort nulls first in Window.orderBy of a column in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60981) Alias a Column with several names, and with metadata of any JSON values, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60981) Alias a Column with several names, and with metadata of any JSON values, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60955) Make pyspark.ml.functions vector_to_array and array_to_vector work in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60988) Optimize DISTINCT window aggregate execution Mingliang Zhu (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60949) Access struct fields as attributes of a Column, and slice a Column, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60949) Access struct fields as attributes of a Column, and slice a Column, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60975) Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60662) Share field names across pandas input rows in Spark Connect Rust DB Tsai (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60666) Dispatch Arrow result decoding once per typed column in Spark Connect Rust DB Tsai (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60969) Keep pulling up correlated equalities on a cast from a scale-0 decimal to an integral type Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60985) Do not infer filters that can fail from data constraints Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-59614) Compile the AS-OF join as-of/residual conditions to a Predicate Wenchen Fan (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60984) Fix `HighlyCompressedMapStatusBenchmark` failure when `mockito` is not on the classpath Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60932) Fix npm vulnerabilities in dev and ui-test Yang Jie (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60952) Send the optional arguments of hmac, variant_set, vector_norm and counter_diff in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Resolved] (SPARK-60957) Import pyspark.sql.conversion, and PandasUDFType from pyspark.sql.functions, in Spark Connect Rust as in PySpark Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60932) Fix npm vulnerabilities in dev and ui-test Yang Jie (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60932) Fix npm vulnerabilities in dev and ui-test Yang Jie (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60980) Fix query failures by `CombineFilters` when a condition that can fail follows a non-deterministic or throwable one Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60958) Accept url in SparkSession.builder.remote() in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60977) Export StatefulProcessor and TwsTester from pyspark.sql.streaming in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60977) Export StatefulProcessor and TwsTester from pyspark.sql.streaming in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60974) Accept a DDL string schema in mapInPandas, applyInPandas and the other map functions in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60977) Export StatefulProcessor and TwsTester from pyspark.sql.streaming in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60973) Remove unused `VariableAssignmentUtils` from `sql/core` Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60975) Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60972) Simplify DataFrameReader plan construction Ruifeng Zheng (Jira) via issues
• 2026/11/05 [jira] [Created] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60953) Render regexp_replace and instr columns in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Assigned] (SPARK-60969) Keep pulling up correlated equalities on a cast from a scale-0 decimal to an integral type Dongjoon Hyun (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60970) Use `Cast.canUpCast` for the nullability of `try_cast` from decimal to integral types ASF GitHub Bot (Jira) via issues
• 2026/11/05 [jira] [Updated] (SPARK-60954) Type and convert all-null, Decimal and map columns of pandas input in Spark Connect Rust createDataFrame as PySpark does ASF GitHub Bot (Jira) via issues

• Earlier messages
• Later messages