issues  

Messages by Date

• 2026/11/07 [jira] [Created] (SPARK-61124) Check the arguments of nearestByJoin, and take them, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61123) Take a Python Enum as the literal of its value in lit, Column operators and functions, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61116) Port the Read, Range and SQL plans, Column.to_plan, and the type and conversion helpers of the connect import path, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61121) Take a float frame bound past its threshold as unbounded in rowsBetween and rangeBetween, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61120) Add DataFrame._session, SparkSession._client and the results of execute_command that vendored modules read, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61115) Add the module-level names and the connect modules that the Python client lacks, as PySpark 4.3.0 has them Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61115) Add the module-level names and the connect modules that the Python client lacks, as PySpark 4.3.0 has them Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61106) Convert the values of local rows of a schema, and raise their errors, as PyArrow does in createDataFrame in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61119) Set the element type of the array literals of the Rust core, as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61119) Set the element type of the array literals of the Rust core, as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61117) Call the hooks of SparkSession.Hook before each execution, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61101) Validate the save mode of DataFrameWriter, and the arguments of DataFrameReader, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-60123) Reading ORC tables with collated STRING columns fails ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61111) Support the ML API of pyspark.ml, of estimators, models, pipelines and evaluators on the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61111) Support the ML API of pyspark.ml, of estimators, models, pipelines and evaluators on the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61117) Call the hooks of SparkSession.Hook before each execution, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61118) Add the CLI modules of pyspark.pipelines, in the Python client as PySpark has them Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61114) Run the full matrix in sampled post-merge CI Ruifeng Zheng (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61113) Add DataFrame.__arrow_c_stream__, the Arrow C stream of a DataFrame, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61116) Port the Read, Range and SQL plans, Column.to_plan, and the type and conversion helpers of the connect import path, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61114) Run the full matrix in sampled post-merge CI ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61107) Cast the table of toArrow to the Arrow schema of the DataFrame in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61076) Accept intermediate storage level keyword arguments in PySpark KMeans Ruifeng Zheng (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61017) Support configurable intermediate storage levels in iterative classifiers Ruifeng Zheng (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61017) Support configurable intermediate storage levels in iterative classifiers Ruifeng Zheng (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61017) Support configurable intermediate storage levels in iterative classifiers Ruifeng Zheng (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61076) Accept intermediate storage level keyword arguments in PySpark KMeans Ruifeng Zheng (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61091) Return the NamedTuples of pyspark.sql.catalog from Catalog, and register functions with registerFunction, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61112) Run the doctests of `dev/` scripts in the linter job Kousuke Saruta (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61107) Cast the table of toArrow to the Arrow schema of the DataFrame in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-60871) Keep the collation of a collated variant_get target type in comparisons Stevo Mitric (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61031) Take the arguments of the readers, the writer and the catalog, and create the tables of createTable on the call, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61111) Support the ML API of pyspark.ml, of estimators, models, pipelines and evaluators on the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61107) Cast the table of toArrow to the Arrow schema of the DataFrame in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61106) Convert the values of local rows of a schema, and raise their errors, as PyArrow does in createDataFrame in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61108) Name the nested fields of collected rows by the schema, and raise for calendar intervals in collect, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61106) Convert the values of local rows of a schema, and raise their errors, as PyArrow does in createDataFrame in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61083) Raise the errors of PySpark for the tags, the table name, the paths of copyFromLocalToFs and the JVM attributes of a session in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61111) Support the ML API of pyspark.ml, of estimators, models, pipelines and evaluators on the server, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61110) Add DataFrame._repr_html_, the HTML table of eager evaluation in notebooks, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61078) Skip the throwaway allocations in 's deserialization constructor Dongjoon Hyun (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61090) Harden reattach cleanup regression tests in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61090) Harden reattach cleanup regression tests in Spark Connect Rust ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61090) Harden reattach cleanup regression tests in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61109) Merged LIMIT and OFFSET values can overflow Int in the optimizer, so valid queries fail or return wrong rows ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61110) Add DataFrame._repr_html_, the HTML table of eager evaluation in notebooks, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61109) Merged LIMIT and OFFSET values can overflow Int in the optimizer, so valid queries fail or return wrong rows Norio Akagi (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61109) Merged LIMIT and OFFSET values can overflow Int in the optimizer, so valid queries fail or return wrong rows Norio Akagi (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61106) Convert the values of local rows of a schema, and raise their errors, as PyArrow does in createDataFrame in the Python client ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61103) Create a DataFrame of a numpy array in createDataFrame in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61103) Create a DataFrame of a numpy array in createDataFrame in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61106) Convert the values of local rows of a schema, and raise their errors, as PyArrow does in createDataFrame in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61103) Create a DataFrame of a numpy array in createDataFrame in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61101) Validate the save mode of DataFrameWriter, and the arguments of DataFrameReader, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61093) Raise the errors of PySpark of Column.try_cast, and of Column.isin of a tuple, in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61107) Cast the table of toArrow to the Arrow schema of the DataFrame in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61033) Fix query errors by ConstantPropagation when a rewritten operand of AND, OR, COALESCE or IN guards an expression that can fail Dongjoon Hyun (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61107) Cast the table of toArrow to the Arrow schema of the DataFrame in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61108) Name the nested fields of collected rows by the schema, and raise for calendar intervals in collect, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61108) Name the nested fields of collected rows by the schema, and raise for calendar intervals in collect, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61037) Group by the grouping columns of groupingSets in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Resolved] (SPARK-61010) Fit native Rust LogisticRegression and predict with its cached model Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61106) Convert the values of local rows of a schema, and raise their errors, as PyArrow does in createDataFrame in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61103) Create a DataFrame of a numpy array in createDataFrame in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61089) Allow UDTF AnalyzeResult subclasses in the Rust Python client DB Tsai (Jira) via issues
• 2026/11/07 [jira] [Updated] (SPARK-61046) Pivot only a groupBy, and raise the errors of the arguments of pivot, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61095) Add the modules geo_utils, sql_formatter, table_arg and tvf_argument of pyspark.sql in the Python client as the PySpark client has them Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Created] (SPARK-61104) Convert pandas input without a schema as PySpark's Arrow conversion does in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61096) Represent GroupedData by its grouping expressions, the types of its DataFrame and its type in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/07 [jira] [Assigned] (SPARK-61095) Add the modules geo_utils, sql_formatter, table_arg and tvf_argument of pyspark.sql in the Python client as the PySpark client has them Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61094) Add UnparsedDataType of pyspark.sql.connect.types, the returnType of a UDTF of a DDL string, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61096) Represent GroupedData by its grouping expressions, the types of its DataFrame and its type in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61094) Add UnparsedDataType of pyspark.sql.connect.types, the returnType of a UDTF of a DDL string, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60911) Raise server errors in Spark Connect Rust with the exception class and details PySpark gives Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61105) Upgrade docker images to Apache Spark 4.3.0, 4.1.4, and 4.0.5 ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61071) Type pandas columns of Decimals and other values as PySpark does in createDataFrame of the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61058) Take the arguments of queryName, partitionBy and clusterBy of DataStreamWriter in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60694) Push predicates through external lookup joins ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61101) Validate the save mode of DataFrameWriter, and the arguments of DataFrameReader, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61092) Take a client seed in sample and randomSplit, and the arguments of withMetadata, withWatermark and randomSplit and the attributes of a DataFrame, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61095) Add the modules geo_utils, sql_formatter, table_arg and tvf_argument of pyspark.sql in the Python client as the PySpark client has them Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-54474) Disable the XML reports on tests that are supposed to fail Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61101) Validate the save mode of DataFrameWriter, and the arguments of DataFrameReader, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61075) Convert values in toInternal and fromInternal of data types in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60856) Fix DSv2 CHECK constraint failing every write when its condition subscripts a lambda variable Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61038) Take the triggers of DataStreamWriter.trigger, including realTime, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61038) Take the triggers of DataStreamWriter.trigger, including realTime, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61096) Represent GroupedData by its grouping expressions, the types of its DataFrame and its type in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61102) Reject unsupported NumPy longdouble scalar classes as PySpark does DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61093) Raise the errors of PySpark of Column.try_cast, and of Column.isin of a tuple, in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61092) Take a client seed in sample and randomSplit, and the arguments of withMetadata, withWatermark and randomSplit and the attributes of a DataFrame, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61093) Raise the errors of PySpark of Column.try_cast, and of Column.isin of a tuple, in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61085) Collect the results of the UDF profilers, and show them with spark.profile, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61085) Collect the results of the UDF profilers, and show them with spark.profile, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61080) Expose the attributes of the data types, typeName as a classmethod, and the singleton types in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61080) Expose the attributes of the data types, typeName as a classmethod, and the singleton types in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61080) Expose the attributes of the data types, typeName as a classmethod, and the singleton types in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61097) Preserve a session streaming listener manager across property access DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61094) Add UnparsedDataType of pyspark.sql.connect.types, the returnType of a UDTF of a DDL string, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61095) Add the modules geo_utils, sql_formatter, table_arg and tvf_argument of pyspark.sql in the Python client as the PySpark client has them ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60734) Prune the columns that the scans of Data Source V2 streaming sources read Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60734) Prune the columns that the scans of Data Source V2 streaming sources read Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61100) Preserve tuple compatibility for Python Row objects DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61098) Deliver streaming query start callbacks before returning the query DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61099) Honor binaryAsBytes when collecting rows DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61100) Preserve tuple compatibility for Python Row objects DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61099) Honor binaryAsBytes when collecting rows DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61096) Represent GroupedData by its grouping expressions, the types of its DataFrame and its type in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61098) Deliver streaming query start callbacks before returning the query DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61084) Register progress handlers, and call them with the progress of each execution, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61084) Register progress handlers, and call them with the progress of each execution, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61096) Represent GroupedData by its grouping expressions, the types of its DataFrame and its type in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61033) Fix query errors by ConstantPropagation when a rewritten operand of AND, OR, COALESCE or IN guards an expression that can fail Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61083) Raise the errors of PySpark for the tags, the table name, the paths of copyFromLocalToFs and the JVM attributes of a session in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61092) Take a client seed in sample and randomSplit, and the arguments of withMetadata, withWatermark and randomSplit and the attributes of a DataFrame, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61093) Raise the errors of PySpark of Column.try_cast, and of Column.isin of a tuple, in the Python client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61091) Return the NamedTuples of pyspark.sql.catalog from Catalog, and register functions with registerFunction, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61091) Return the NamedTuples of pyspark.sql.catalog from Catalog, and register functions with registerFunction, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61075) Convert values in toInternal and fromInternal of data types in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61070) Stream the chunks of artifact uploads, and refuse class files in addArtifacts, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61094) Add UnparsedDataType of pyspark.sql.connect.types, the returnType of a UDTF of a DDL string, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61022) Ask the server whether a DataFrame is streaming in isStreaming of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61094) Add UnparsedDataType of pyspark.sql.connect.types, the returnType of a UDTF of a DDL string, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61056) Send the function of DataStreamWriter.foreach in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61093) Raise the errors of PySpark of Column.try_cast, and of Column.isin of a tuple, in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61091) Return the NamedTuples of pyspark.sql.catalog from Catalog, and register functions with registerFunction, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61062) Upload large local relations of createDataFrame at the cache threshold in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61077) Support native LinearSVC training and prediction in the Rust client Ruifeng Zheng (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61052) Release the GIL across the requests of the writers, the catalog and the streaming queries in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61044) Send the frame boundaries of rowsBetween and rangeBetween, and check the columns of Window, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61032) MySQL TopN pushdown over a pushed GROUP BY expression fails under ONLY_FULL_GROUP_BY Aleksandar Trajković (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61092) Take a client seed in sample and randomSplit, and the arguments of withMetadata, withWatermark and randomSplit and the attributes of a DataFrame, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61086) Set the options on SparkSession.Builder and return it, validate its startup URLs, and name its class Builder, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61086) Set the options on SparkSession.Builder and return it, validate its startup URLs, and name its class Builder, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61072) Convert a schema to DDL on the server in StructType.toDDL in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61092) Take the arguments of withMetadata, withWatermark and randomSplit, and the attributes of a DataFrame, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61072) Convert a schema to DDL on the server in StructType.toDDL in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61083) Raise the errors of PySpark for the tags, the table name, the paths of copyFromLocalToFs and the JVM attributes of a session in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61085) Collect the results of the UDF profilers, and show them with spark.profile, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61075) Convert values in toInternal and fromInternal of data types in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61075) Convert values in toInternal and fromInternal of data types in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61060) Vendor pyspark.conf and pyspark.taskcontext, and export the names of pyspark, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61084) Register progress handlers, and call them with the progress of each execution, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61091) Return the NamedTuples of pyspark.sql.catalog from Catalog, and register functions with registerFunction, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61090) Harden reattach cleanup regression tests in Spark Connect Rust DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61061) Add InheritableThread and inheritable_thread_target, which inherit the tags of the session, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61089) Allow UDTF AnalyzeResult subclasses in the Rust Python client DB Tsai (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61083) Raise the errors of PySpark for the tags, the table name, the paths of copyFromLocalToFs and the JVM attributes of a session in the Python client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61086) Validate the startup URLs of SparkSession.Builder, and name its class Builder, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61052) Release the GIL across the requests of the writers, the catalog and the streaming queries in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61034) Send the output schema of transformWithState in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61051) Fix LongHashedRelation build failure when the dense key array does not fit in execution memory Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61074) Write and read the collations of string fields in the metadata of the JSON of a StructType, and order the keys of jsonValue, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61061) Add InheritableThread and inheritable_thread_target, which inherit the tags of the session, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61074) Write and read the collations of string fields in the metadata of the JSON of a StructType, and order the keys of jsonValue, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61087) to_time, try_to_time and time_from_seconds return TIME(6) values with more than 6 fractional digits Joel Robin (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61088) Fix wrong results by stale partitioning and constraints when a checkpointed Dataset is self-joined ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61067) Keep the tags of a session per thread in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61086) Set the options on SparkSession.Builder and return it, validate its startup URLs, and name its class Builder, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60745) Avoid row materialization for Arrow-backed pandas string input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-60697) Avoid materializing DecimalTuple for exact Python Decimal input conversion Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61057) Take the arguments of DataStreamReader in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61083) Raise the errors of PySpark for the tags, the table name, the paths of copyFromLocalToFs and the JVM attributes of a session in the Python client ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61086) Set the options on SparkSession.Builder and return it, validate its startup URLs, and name its class Builder, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61080) Expose the attributes of the data types, typeName as a classmethod, and the singleton types in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61079) Convert pandas input with an explicit schema as PySpark's Arrow conversion does in createDataFrame of the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61055) Return the status and the exception of a StreamingQuery, and check the timeouts of its waits, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61082) Fix UnsafeHashedRelation build failure when many small relations are alive in one task ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61085) Collect the results of the UDF profilers, and show them with spark.profile, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61079) Convert pandas input with an explicit schema as PySpark's Arrow conversion does in createDataFrame of the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61085) Collect the results of the UDF profilers, and show them with spark.profile, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61077) Support native LinearSVC training and prediction in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61084) Register progress handlers, and call them with the progress of each execution, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61086) Validate the startup URLs of SparkSession.Builder, and name its class Builder, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60621) Add ANALYZE mode to parse_sql Daniel Tenedorio (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61077) Support native LinearSVC training and prediction in the Rust client Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Created] (SPARK-61082) Fix UnsafeHashedRelation build failure when many small relations are alive in one task Dongjoon Hyun (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61044) Send the frame boundaries of rowsBetween and rangeBetween, and check the columns of Window, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61073) Raise KEY_NOT_EXISTS for a missing field of a StructType, and parse the JSON type of StructType.add, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61040) Parse the DDL strings of DataType.fromDDL and of the return types of UDFs on the server in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61057) Take the arguments of DataStreamReader in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-59089) Recover FloatType columns for the transpiler by widening operands to double Monica G (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-55208) Collect Spark UDFS for transpilation coverage Monica G (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61069) Collect TIMESTAMP_NTZ values, distant timestamps and year-month intervals in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61066) Raise the errors of join types and dict aggregations, and return the status of a streaming query, in the Rust client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61073) Raise KEY_NOT_EXISTS for a missing field of a StructType, and parse the JSON type of StructType.add, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Commented] (SPARK-55211) Create an optimizer rule to choose when to use transpiled Monica G (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61067) Keep the tags of a session per thread in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-60974) Accept a DDL string schema in mapInPandas, applyInPandas and the other map functions in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61067) Keep the tags of a session per thread in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Resolved] (SPARK-61060) Vendor pyspark.conf and pyspark.taskcontext, and export the names of pyspark, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-61060) Vendor pyspark.conf and pyspark.taskcontext, and export the names of pyspark, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Assigned] (SPARK-60915) Send the call sites of DataFrame API calls in Spark Connect Rust, so that errors carry DataFrame query contexts as in PySpark Hyukjin Kwon (Jira) via issues
• 2026/11/06 [jira] [Updated] (SPARK-61072) Convert a schema to DDL on the server in StructType.toDDL in the Python client as PySpark does ASF GitHub Bot (Jira) via issues

• Earlier messages
• Later messages