issues  

Messages by Date

• 2026/11/06 [jira] [Updated] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61087) to_time, try_to_time and time_from_seconds return TIME(6) values with more than 6 fractional digits Joel Robin (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61067) Keep the tags of a session per thread in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61086) Set the options on SparkSession.Builder and return it, validate its startup URLs, and name its class Builder, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60745) Avoid row materialization for Arrow-backed pandas string input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60697) Avoid materializing DecimalTuple for exact Python Decimal input conversion Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61057) Take the arguments of DataStreamReader in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61083) Raise the errors of PySpark for the tags, the table name, the paths of copyFromLocalToFs and the JVM attributes of a session in the Python client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61086) Set the options on SparkSession.Builder and return it, validate its startup URLs, and name its class Builder, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61080) Expose the attributes of the data types, typeName as a classmethod, and the singleton types in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61079) Convert pandas input with an explicit schema as PySpark's Arrow conversion does in createDataFrame of the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61055) Return the status and the exception of a StreamingQuery, and check the timeouts of its waits, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61082) Fix UnsafeHashedRelation build failure when many small relations are alive in one task ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61085) Collect the results of the UDF profilers, and show them with spark.profile, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61079) Convert pandas input with an explicit schema as PySpark's Arrow conversion does in createDataFrame of the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61085) Collect the results of the UDF profilers, and show them with spark.profile, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61077) Support native LinearSVC training and prediction in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61084) Register progress handlers, and call them with the progress of each execution, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61086) Validate the startup URLs of SparkSession.Builder, and name its class Builder, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60621) Add ANALYZE mode to parse_sql Daniel Tenedorio (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61077) Support native LinearSVC training and prediction in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61082) Fix UnsafeHashedRelation build failure when many small relations are alive in one task Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61044) Send the frame boundaries of rowsBetween and rangeBetween, and check the columns of Window, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61073) Raise KEY_NOT_EXISTS for a missing field of a StructType, and parse the JSON type of StructType.add, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61040) Parse the DDL strings of DataType.fromDDL and of the return types of UDFs on the server in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61057) Take the arguments of DataStreamReader in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-59089) Recover FloatType columns for the transpiler by widening operands to double Monica G (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-55208) Collect Spark UDFS for transpilation coverage Monica G (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61069) Collect TIMESTAMP_NTZ values, distant timestamps and year-month intervals in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61066) Raise the errors of join types and dict aggregations, and return the status of a streaming query, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61073) Raise KEY_NOT_EXISTS for a missing field of a StructType, and parse the JSON type of StructType.add, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-55211) Create an optimizer rule to choose when to use transpiled Monica G (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61067) Keep the tags of a session per thread in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60974) Accept a DDL string schema in mapInPandas, applyInPandas and the other map functions in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61067) Keep the tags of a session per thread in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61060) Vendor pyspark.conf and pyspark.taskcontext, and export the names of pyspark, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61060) Vendor pyspark.conf and pyspark.taskcontext, and export the names of pyspark, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60915) Send the call sites of DataFrame API calls in Spark Connect Rust, so that errors carry DataFrame query contexts as in PySpark Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61072) Convert a schema to DDL on the server in StructType.toDDL in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61074) Write and read the collations of string fields in the metadata of the JSON of a StructType, and order the keys of jsonValue, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60808) Runtime bloom filter built from a non-deterministic creation side can drop join rows Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-60808) Runtime bloom filter built from a non-deterministic creation side can drop join rows Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61066) Raise the errors of join types and dict aggregations, and return the status of a streaming query, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61080) Expose the attributes of the data types, and typeName as a classmethod, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60808) Runtime bloom filter built from a non-deterministic creation side can drop join rows Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60808) Runtime bloom filter built from a non-deterministic creation side can drop join rows Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61080) Expose the attributes of the data types, and typeName as a classmethod, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61078) Skip the throwaway allocations in 's deserialization constructor Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61076) Accept intermediate storage level keyword arguments in PySpark KMeans ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60985) Fix query failures when a filter inferred from data constraints can fail Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61061) Add InheritableThread and inheritable_thread_target, which inherit the tags of the session, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61052) Release the GIL across the requests of the writers, the catalog and the streaming queries in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60886) Raise VARIANT_SIZE_LIMIT when a cast to variant exceeds the size limit ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61074) Write and read the collations of string fields in the metadata of the JSON of a StructType, and order the keys of jsonValue, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61077) Support native LinearSVC training and prediction in the Rust client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60961) Raise SparkConnectGrpcException for gRPC errors without server details in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61078) Skip the throwaway allocations in 's deserialization constructor ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61074) Write the collations of string fields in the metadata of the JSON of a StructType in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61079) Convert pandas input with an explicit schema as PySpark's Arrow conversion does in createDataFrame of the Rust client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61054) Take the arguments of spark.range and of the table-valued functions of spark.tvf in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61073) Raise KEY_NOT_EXISTS for a missing field of a StructType, and parse the JSON type of StructType.add, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61054) Take the arguments of spark.range and of the table-valued functions of spark.tvf in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61058) Take the arguments of queryName, partitionBy and clusterBy of DataStreamWriter in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61077) Support native LinearSVC training and prediction in the Rust client Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61070) Stream the chunks of artifact uploads, and refuse class files in addArtifacts, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61068) Raise ST_INVALID_SRID_VALUE for spatial values of SRIDs their type does not take in createDataFrame in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61068) Raise ST_INVALID_SRID_VALUE for spatial values of SRIDs their type does not take in createDataFrame in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61063) Take NumPy arrays, ints for dates and nested duplicate field names in createDataFrame of local rows in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61069) Collect TIMESTAMP_NTZ values, distant timestamps and year-month intervals in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61071) Type pandas columns of Decimals and other values as PySpark does in createDataFrame of the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61060) Vendor pyspark.conf and pyspark.taskcontext, and export the names of pyspark, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61063) Take NumPy arrays, ints for dates and nested duplicate field names in createDataFrame of local rows in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61076) Accept intermediate storage level keyword arguments in PySpark KMeans Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61055) Return the status and the exception of a StreamingQuery, and check the timeouts of its waits, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61065) Export the names of PySpark from pyspark.sql.functions, and type the literals of NumPy scalars, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61056) Send the function of DataStreamWriter.foreach in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60983) Fix query errors by ConstantPropagation when a constant is substituted into an expression that can fail Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60882) Accept more expressions that can not fail in `ExprUtils.canEvaluateUnconditionally` ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61053) Take the arguments of overwrite, partitionedBy and tableProperty of DataFrameWriterV2 in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61065) Export the names of PySpark from pyspark.sql.functions, and type the literals of NumPy scalars, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61049) Expose the df of df.na and df.stat in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61041) Raise SESSION_NOT_SAME for the DataFrames of other sessions in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60998) LongToUnsafeRowMap reserves a full page (up to 64 MiB) of execution memory per map, causing OOM with many shuffled hash joins in one task Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61057) Take the arguments of DataStreamReader in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61047) Warn the warnings of the server in spark.conf.set and unset, and take the arguments of get and set, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61074) Write the collations of string fields in the metadata of the JSON of a StructType in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61048) Expose the sparkSession of spark.udf, and send the return type of registerJavaFunction, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61058) Take the arguments of queryName, partitionBy and clusterBy of DataStreamWriter in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61047) Warn the warnings of the server in spark.conf.set and unset, and take the arguments of get and set, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61053) Take the arguments of overwrite, partitionedBy and tableProperty of DataFrameWriterV2 in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61031) Take the arguments of the readers, the writer and the catalog, and create the tables of createTable on the call, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61048) Expose the sparkSession of spark.udf, and send the return type of registerJavaFunction, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61040) Parse the DDL strings of DataType.fromDDL and of the return types of UDFs on the server in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61041) Raise SESSION_NOT_SAME for the DataFrames of other sessions in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60963) Retry the cache upload of large local relations in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61064) Reattach and raise DEADLINE_EXCEEDED when a per-RPC deadline passes before the response headers in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61062) Upload large local relations of createDataFrame at the cache threshold in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61064) Reattach and raise DEADLINE_EXCEEDED when a per-RPC deadline passes before the response headers in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61073) Raise KEY_NOT_EXISTS for a missing field of a StructType, and parse the JSON type of StructType.add, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61072) Convert a schema to DDL on the server in StructType.toDDL in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61072) Convert a schema to DDL on the server in StructType.toDDL in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61073) Raise KEY_NOT_EXISTS for a missing field of a StructType, and parse the JSON type of StructType.add, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61075) Convert values in toInternal and fromInternal of data types in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60742) Build SQL function exports in linear time in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61063) Take NumPy arrays, ints for dates and nested duplicate field names in createDataFrame of local rows in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61071) Type pandas columns of Decimals and other values as PySpark does in createDataFrame of the Rust client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61071) Type pandas columns of Decimals and other values as PySpark does in createDataFrame of the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61045) Take the arguments of colRegex, metadataColumn, where and transpose in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61045) Take the arguments of colRegex, metadataColumn, where and transpose in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61044) Send the frame boundaries of rowsBetween and rangeBetween, and check the columns of Window, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61046) Pivot only a groupBy, and raise the errors of the arguments of pivot, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61046) Pivot only a groupBy, and raise the errors of the arguments of pivot, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61070) Stream the chunks of artifact uploads, and refuse class files in addArtifacts, in the Rust client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61070) Stream the chunks of artifact uploads, and refuse class files in addArtifacts, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60989) Populate configured user context on typed requests in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60989) Populate configured user context on typed requests in Spark Connect Rust DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61069) Collect TIMESTAMP_NTZ values, distant timestamps and year-month intervals in the Rust client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61068) Raise ST_INVALID_SRID_VALUE for spatial values of SRIDs their type does not take in createDataFrame in the Rust client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61068) Raise ST_INVALID_SRID_VALUE for spatial values of SRIDs their type does not take in createDataFrame in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61043) Take the arguments of count and sum_distinct, and warn of sumDistinct, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60666) Dispatch Arrow result decoding once per typed column in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60621) Add ANALYZE mode to parse_sql Daniel Tenedorio (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60621) Add ANALYZE mode to parse_sql Daniel Tenedorio (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61067) Keep the tags of a session per thread in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61063) Take NumPy arrays, ints for dates and nested duplicate field names in createDataFrame of local rows in the Rust client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61065) Export the names of PySpark from pyspark.sql.functions, and type the literals of NumPy scalars, in the Rust client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61064) Reattach and raise DEADLINE_EXCEEDED when a per-RPC deadline passes before the response headers in the Rust client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61065) Export the names of PySpark from pyspark.sql.functions, and type the literals of NumPy scalars, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61064) Reattach and raise DEADLINE_EXCEEDED when a per-RPC deadline passes before the response headers in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61062) Upload large local relations of createDataFrame at the cache threshold in the Rust client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61061) Add InheritableThread and inheritable_thread_target, which inherit the tags of the session, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61062) Upload large local relations of createDataFrame at the cache threshold in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61061) Add InheritableThread and inheritable_thread_target, which inherit the tags of the session, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61060) Vendor pyspark.conf and pyspark.taskcontext, and export the names of pyspark, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61051) Fix LongHashedRelation build failure when the dense key array does not fit in execution memory Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61052) Release the GIL across the requests of the writers, the catalog and the streaming queries in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61053) Take the arguments of overwrite, partitionedBy and tableProperty of DataFrameWriterV2 in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61054) Take the arguments of spark.range and of the table-valued functions of spark.tvf in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60696) Accept scientific notation Decimal input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60194) Improve type annotation for StreamingQueryListener sessions Tian Gao (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60993) Send the optional arguments of the SQL functions of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61045) Take the arguments of colRegex, metadataColumn, where and transpose in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61018) Name the UDFs of mapInPandas, mapInArrow, applyInPandas, applyInArrow and applyInPandasWithState after their functions in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61039) Send the eager and storageLevel of checkpoint and localCheckpoint in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60868) Fix ConstantFolding dropping LEGACY cast errors when the session has ANSI mode off Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60986) Take datetime.timedelta values in lit() and createDataFrame in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61016) Move post-merge CI sampling into the merge script Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60917) Reduce cached artifact upload copies and accelerate SHA-256 in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60898) Keep plan IDs stable across re-executions in Spark Connect Rust to reuse the server plan cache Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60807) Restore offloaded ML model summaries during fetch Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60862) Watermark propagation through reused exchanges uses zero watermark ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60957) Import pyspark.sql.conversion, and PandasUDFType from pyspark.sql.functions, in Spark Connect Rust as in PySpark Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60877) Add `gridTest` and `namedGridTest` to `SparkFunSuite` Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60873) HAVING is applied between nested window operations instead of before both Nick Young (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61049) Expose the df of df.na and df.stat in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60907) Send reader schemas in Spark Connect Rust as PySpark does, and accept a StructType in schema() Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61048) Expose the sparkSession of spark.udf, and send the return type of registerJavaFunction, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61013) Set the results of the Observations of observe in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61047) Warn the warnings of the server in spark.conf.set and unset, and take the arguments of get and set, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61013) Set the results of the Observations of observe in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61037) Group by the grouping columns of groupingSets in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61042) Return the DataFrame itself from persist, cache and unpersist in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61042) Return the DataFrame itself from persist, cache and unpersist in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61043) Take the arguments of count and sum_distinct, and warn of sumDistinct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-59305) Track Apache Spark 4.3.0: retarget CI to the RC, re-vendor upstream, and close 4.3.0 client gaps Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61043) Take the arguments of count and sum_distinct, and warn of sumDistinct, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60741) Keep the build side's keyed partitioning in the dynamic partition pruning subquery XiDuo You (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60876) Keep the CHAR/VARCHAR metadata of an aliased outer reference Stevo Mitric (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60907) Send reader schemas in Spark Connect Rust as PySpark does, and accept a StructType in schema() Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60989) Populate configured user context on typed requests in Spark Connect Rust ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61037) Group by the grouping columns of groupingSets in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60922) Construct GeometryType and GeographyType in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-59011) Series.rank with method='first' and ascending=False gives wrong ranks for tied values Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60719) Upgrade the minimum version of grpcio to 1.84.1 Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60958) Accept url in SparkSession.builder.remote() in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-59970) Persistent SQL function accepts a temporary variable read through an IDENTIFIER clause Wenchen Fan (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61053) Take the arguments of overwrite, partitionedBy and tableProperty of DataFrameWriterV2 in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60679) Cache Spark Connect Rust session server version Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60956) Upload the jars, Python files and archives of addArtifacts in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60834) Run master post-merge builds every ten commits Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60984) Fix `HighlyCompressedMapStatusBenchmark` failure when `mockito` is not on the classpath Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-59011) Series.rank with method='first' and ascending=False gives wrong ranks for tied values Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60924) Use GraphQL to count commits for post-merge CI sampling Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61004) Extract shared SHOW command analysis helpers Vladan Vasić (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60877) Add `gridTest` and `namedGridTest` to `SparkFunSuite` Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61037) Group by the grouping columns of groupingSets in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60991) Show a DataFrame as the server formats it, with truncate and vertical, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60183) Improve type annotation for pandas-on-Spark datetime callbacks Tian Gao (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60820) Fix ConstantFolding dropping ANSI cast errors when the session has ANSI mode off Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60957) Import pyspark.sql.conversion, and PandasUDFType from pyspark.sql.functions, in Spark Connect Rust as in PySpark ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60998) LongToUnsafeRowMap reserves a full page (up to 64 MiB) of execution memory per map, causing OOM with many shuffled hash joins in one task ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-60926) Push the filters of streaming queries down to the scans of Data Source V2 streaming sources Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60991) Show a DataFrame as the server formats it, with truncate and vertical, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60984) Fix `HighlyCompressedMapStatusBenchmark` failure when `mockito` is not on the classpath ASF GitHub Bot (Jira) via issues

• Earlier messages
• Later messages