issues  

Messages by Thread

• [jira] [Resolved] (SPARK-61003) Register UDTFs on the server with spark.udtf.register of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61020) Ensure that every ignore/test pattern matches a repo file Nicholas Chammas (Jira) via issues
• [jira] [Assigned] (SPARK-60947) Send TIME values and parse the TIME type of DDL schemas in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60641) Accept Byte and Short Row values for Float and Double schemas in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61018) Name the UDFs of mapInPandas, mapInArrow, applyInPandas, applyInArrow and applyInPandasWithState after their functions in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61018) Name the UDFs of mapInPandas, mapInArrow, applyInPandas, applyInArrow and applyInPandasWithState after their functions in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61019) Print the plans of explain and StreamingQuery.explain with Python's print, and raise the errors of explain, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61019) Print the plans of explain and StreamingQuery.explain with Python's print, and raise the errors of explain, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60962) Pickle user-defined types as Python objects, and make them of arguments, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60962) Pickle user-defined types as Python objects, and make them of arguments, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60934) [SQL] Treat seedless TABLESAMPLE and aes_encrypt without an IV as non-deterministic ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-61006) Pass the arguments of Python UDF and UDTF calls of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61012) Sample by the fractions of sampleBy, and take a Column, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61012) Sample by the fractions of sampleBy, and take a Column, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-60997) Apply the per-RPC deadlines of PySpark Connect in the Rust client, and reattach an execution past its deadline Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60994) Type a decimal literal of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61015) Take the arguments of unpivot, melt and replace in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61015) Take the arguments of unpivot, melt and replace in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61015) Take the arguments of unpivot, melt and replace in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61007) Support the subquery expressions of scalar, exists, isin and asTable of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-61007) Support the subquery expressions of scalar, exists, isin and asTable of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61013) Set the results of the Observations of observe in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61012) Sample by the fractions of sampleBy, and take a Column, in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61014) Run foreach and foreachPartition, and return the DataFrame of toJSON, in the Python client as PySpark Connect does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60946) Send user-defined, VARIANT, GEOMETRY and GEOGRAPHY values in createDataFrame, and collect spatial values, in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-59589) Hand Expand's varying output columns to the consumer as globals Yang Jie (Jira) via issues
• [jira] [Created] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61011) Refer to the columns of a DataFrame by its plan ID in the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-60727) Use Arrow columns for supported pandas float64 input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61009) RANGE window frames over integral columns return wrong results when the offset or the frame bound does not fit in the column type ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61010) Fit native Rust LogisticRegression and predict with its cached model Ruifeng Zheng (Jira) via issues
• [jira] [Updated] (SPARK-61010) Fit native Rust LogisticRegression and predict with its cached model Ruifeng Zheng (Jira) via issues
  • [jira] [Updated] (SPARK-61010) Fit native Rust LogisticRegression and predict with its cached model ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-60998) LongToUnsafeRowMap reserves a full page (up to 64 MiB) of execution memory per map, causing OOM with many shuffled hash joins in one task L. C. Hsieh (Jira) via issues
• [jira] [Assigned] (SPARK-60666) Dispatch Arrow result decoding once per typed column in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61005) Create the UDFs of udf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60685) Avoid generic scalar probes for exact Python date inputs in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60686) Use columnar Arrow for supported pandas timestamp input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60975) Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-60999) Create the UDTFs of udtf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60999) Create the UDTFs of udtf and arrow_udtf of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-60999) Create the UDTFs of udtf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60974) Accept a DDL string schema in mapInPandas, applyInPandas and the other map functions in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61005) Create the UDFs of udf of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-61006) Pass the arguments of Python UDF and UDTF calls of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61006) Pass the named arguments of Python UDF and UDTF calls of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60640) Avoid intermediate Value clones during local Arrow input encoding in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60659) Support day-time interval inputs in the Rust Spark Connect client Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60659) Support day-time interval inputs in the Rust Spark Connect client Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61004) Extract shared SHOW command analysis helpers ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-60964) Retry each reattach, and release executions that fail at once, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60995) Check the arguments of when, bucket, pandas_udf, arrow_udf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61001) Raise the errors of toLocalIterator of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-60859) Show KeyedPartitioning partition keys in plan strings XiDuo You (Jira) via issues
• [jira] [Resolved] (SPARK-60687) Avoid numeric probes for exact list and tuple scalar arrays in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60741) Keep the build side's keyed partitioning in the dynamic partition pruning subquery XiDuo You (Jira) via issues
• [jira] [Resolved] (SPARK-60699) Build Arrow columns directly for exact integer tuple input in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60960) Keep executionInfo per DataFrame, and the operation id of every ExecutePlan error, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-61002) CBO estimates an equi-join as empty when a join key has no min/max ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-61002) CBO estimates an equi-join as empty when a join key has no min/max Yang Jie (Jira) via issues
• [jira] [Updated] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-61000) Convert the columns of toPandas of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-60943) Fix wrong results when a cast from `DECIMAL(19, 0)` to `BIGINT` overflows Dongjoon Hyun (Jira) via issues
• [jira] [Assigned] (SPARK-60985) Fix query failures when a filter inferred from data constraints can fail Dongjoon Hyun (Jira) via issues
• [jira] [Resolved] (SPARK-60980) Fix query failures by `CombineFilters` when a condition that can fail follows a non-deterministic or throwable one Dongjoon Hyun (Jira) via issues
• [jira] [Created] (SPARK-60999) Create the UDTFs of udtf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60680) Support positional DataFrame column indexing in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60682) Display DataFrame schema in Spark Connect Rust repr Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60698) Batch Arrow input normalization configuration reads in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60681) Expose DataFrame columns in Rust client dir and IPython completions Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-58612) [SQL] Handle archive recursion for nested archives Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60058) Support Z85 encoding and decoding for variant data in from_json and to_json expressiosn Dongjoon Hyun (Jira) via issues
• [jira] [Assigned] (SPARK-60993) Send the optional arguments of the SQL functions of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60973) Remove unused from Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60996) Upgrade Netty to 4.2.20.Final ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-60986) Take datetime.timedelta values in lit() and createDataFrame in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60996) Upgrade Netty to 4.2.20.Final Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60995) Check the arguments of when, bucket, pandas_udf, arrow_udf and arrow_udtf of the Python client as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-60995) Check the arguments of when, bucket, pandas_udf, arrow_udf and arrow_udtf of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60994) Type a decimal literal of the Python client as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60987) Fix `NoClassDefFoundError` when running Kafka benchmarks in the benchmark workflow ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-60987) Fix `NoClassDefFoundError` when running Kafka benchmarks in the benchmark workflow Dongjoon Hyun (Jira) via issues
• [jira] [Created] (SPARK-60991) Show a DataFrame as the server formats it, with truncate and vertical, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60954) Type and convert all-null, Decimal and map columns of pandas input in Spark Connect Rust createDataFrame as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60966) Cover reattachable execution cleanup over gRPC in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60972) Simplify DataFrameReader plan construction Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60959) Keep the values of a collected Row, and compare and pickle VariantVal, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60959) Keep the values of a collected Row, and compare and pickle VariantVal, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60990) Sort nulls first in Window.orderBy of a column in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60983) Fix query errors by ConstantPropagation when a constant is substituted into an expression that can fail ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-60984) Fix `HighlyCompressedMapStatusBenchmark` failure when `mockito` is not on the classpath Dongjoon Hyun (Jira) via issues
• [jira] [Assigned] (SPARK-60982) Build an array of a list or a NumPy array in lit() in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60970) Use `Cast.canUpCast` for the nullability of `try_cast` from decimal to integral types Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60990) Sort nulls first in Window.orderBy of a column in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-60973) Remove unused `VariableAssignmentUtils` from `sql/core` Dongjoon Hyun (Jira) via issues
• [jira] [Created] (SPARK-60990) Sort nulls first in Window.orderBy of a column in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60981) Alias a Column with several names, and with metadata of any JSON values, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60981) Alias a Column with several names, and with metadata of any JSON values, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60955) Make pyspark.ml.functions vector_to_array and array_to_vector work in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60988) Optimize DISTINCT window aggregate execution Mingliang Zhu (Jira) via issues
• [jira] [Assigned] (SPARK-60949) Access struct fields as attributes of a Column, and slice a Column, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60949) Access struct fields as attributes of a Column, and slice a Column, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60975) Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60662) Share field names across pandas input rows in Spark Connect Rust DB Tsai (Jira) via issues
  • [jira] [Updated] (SPARK-60662) Share field names across pandas input rows in Spark Connect Rust ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60666) Dispatch Arrow result decoding once per typed column in Spark Connect Rust DB Tsai (Jira) via issues
  • [jira] [Updated] (SPARK-60666) Dispatch Arrow result decoding once per typed column in Spark Connect Rust ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-60969) Keep pulling up correlated equalities on a cast from a scale-0 decimal to an integral type Dongjoon Hyun (Jira) via issues
• [jira] [Created] (SPARK-60985) Do not infer filters that can fail from data constraints Dongjoon Hyun (Jira) via issues
• [jira] [Resolved] (SPARK-59614) Compile the AS-OF join as-of/residual conditions to a Predicate Wenchen Fan (Jira) via issues
• [jira] [Created] (SPARK-60984) Fix `HighlyCompressedMapStatusBenchmark` failure when `mockito` is not on the classpath Dongjoon Hyun (Jira) via issues
• [jira] [Resolved] (SPARK-60932) Fix npm vulnerabilities in dev and ui-test Yang Jie (Jira) via issues
• [jira] [Resolved] (SPARK-60952) Send the optional arguments of hmac, variant_set, vector_norm and counter_diff in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60957) Import pyspark.sql.conversion, and PandasUDFType from pyspark.sql.functions, in Spark Connect Rust as in PySpark Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60932) Fix npm vulnerabilities in dev and ui-test Yang Jie (Jira) via issues
• [jira] [Created] (SPARK-60980) Fix query failures by `CombineFilters` when a condition that can fail follows a non-deterministic or throwable one Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60958) Accept url in SparkSession.builder.remote() in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case Dongjoon Hyun (Jira) via issues
  • [jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case Dongjoon Hyun (Jira) via issues
  • [jira] [Updated] (SPARK-60979) Fix wrong results by nested schema pruning when column names differ only by case ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
  • [jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
  • [jira] [Updated] (SPARK-60978) Fix wrong results by DSv2 DELETE, UPDATE and MERGE when column names differ only by case Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60977) Export StatefulProcessor and TwsTester from pyspark.sql.streaming in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-60977) Export StatefulProcessor and TwsTester from pyspark.sql.streaming in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60974) Accept a DDL string schema in mapInPandas, applyInPandas and the other map functions in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-60974) Accept a DDL string schema in mapInPandas, applyInPandas and the other map functions in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60976) Build applyInPandasWithState as an ApplyInPandasWithState relation in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60977) Export StatefulProcessor and TwsTester from pyspark.sql.streaming in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60973) Remove unused `VariableAssignmentUtils` from `sql/core` Dongjoon Hyun (Jira) via issues
• [jira] [Created] (SPARK-60975) Remove unused `PythonSQLUtils.addJarToCurrentClassLoader` Dongjoon Hyun (Jira) via issues
• [jira] [Created] (SPARK-60972) Simplify DataFrameReader plan construction Ruifeng Zheng (Jira) via issues
• [jira] [Created] (SPARK-60971) Infer the iterator forms of GroupedData.applyInPandas and applyInArrow from type hints in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60953) Render regexp_replace and instr columns in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
  • [jira] [Updated] (SPARK-60953) Render regexp_replace and instr columns in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60969) Keep pulling up correlated equalities on a cast from a scale-0 decimal to an integral type Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60970) Use `Cast.canUpCast` for the nullability of `try_cast` from decimal to integral types ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60954) Type and convert all-null, Decimal and map columns of pandas input in Spark Connect Rust createDataFrame as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60968) Treat explicit None arguments of SQL functions in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60967) Deserialize collected values of user-defined types, and give their dtypes, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-60967) Deserialize collected values of user-defined types, and give their dtypes, in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60956) Upload the jars, Python files and archives of addArtifacts in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Resolved] (SPARK-60924) Use GraphQL to count commits for post-merge CI sampling Ruifeng Zheng (Jira) via issues
• [jira] [Assigned] (SPARK-60924) Use GraphQL to count commits for post-merge CI sampling Ruifeng Zheng (Jira) via issues
• [jira] [Resolved] (SPARK-60943) Fix wrong results when a cast from `DECIMAL(19, 0)` to `BIGINT` overflows Dongjoon Hyun (Jira) via issues
• [jira] [Updated] (SPARK-60194) Improve type annotation for StreamingQueryListener sessions ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60183) Improve type annotation for pandas-on-Spark datetime callbacks ASF GitHub Bot (Jira) via issues
• [jira] [Assigned] (SPARK-60183) Improve type annotation for pandas-on-Spark datetime callbacks Tian Gao (Jira) via issues
• [jira] [Updated] (SPARK-60966) Cover reattachable execution cleanup over gRPC in Spark Connect Rust ASF GitHub Bot (Jira) via issues
• [jira] [Updated] (SPARK-60952) Send the optional arguments of hmac, variant_set, vector_norm and counter_diff in Spark Connect Rust Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-60952) Send the optional arguments of hmac, variant_set, vector_norm and counter_diff in Spark Connect Rust ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-60958) Accept url in SparkSession.builder.remote() in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60966) Cover reattachable execution cleanup over gRPC in Spark Connect Rust DB Tsai (Jira) via issues
• [jira] [Resolved] (SPARK-60913) Format spark.sql() queries with keyword arguments in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60962) Pickle user-defined types of __main__ as UDF return types in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60965) Caching a query with changelog can break shared table relation cache Anton Okolnychyi (Jira) via issues
• [jira] [Assigned] (SPARK-60913) Format spark.sql() queries with keyword arguments in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60962) Pickle user-defined types of __main__ as UDF return types in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60964) Retry each reattach, and release executions that fail at once, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-60964) Retry each reattach, and release executions that fail at once, in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-60961) Raise SparkConnectGrpcException for gRPC errors without server details in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60947) Send TIME values and parse the TIME type of DDL schemas in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
  • [jira] [Updated] (SPARK-60947) Send TIME values and parse the TIME type of DDL schemas in Spark Connect Rust as PySpark does ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-60957) Import pyspark.sql.conversion, and PandasUDFType from pyspark.sql.functions, in Spark Connect Rust as in PySpark Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60960) Keep executionInfo per DataFrame, and the operation id of every ExecutePlan error, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60964) Retry each reattach, and release executions that fail at once, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60963) Retry the cache upload of large local relations in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60959) Keep the values of a collected Row, and compare and pickle VariantVal, in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60955) Make pyspark.ml.functions vector_to_array and array_to_vector work in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60956) Upload the jars, Python files and archives of addArtifacts in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60952) Send the optional arguments of hmac, variant_set, vector_norm and counter_diff in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60954) Type and convert all-null, Decimal and map columns of pandas input in Spark Connect Rust createDataFrame as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60955) Make pyspark.ml.functions vector_to_array and array_to_vector work in Spark Connect Rust Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60951) Support configurable aggregation level for the Python UDF sampling profiler ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-60951) Support configurable aggregation level for the Python UDF sampling profiler Tian Gao (Jira) via issues
• [jira] [Assigned] (SPARK-60908) Infer createDataFrame types in Spark Connect Rust by merging all rows as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Resolved] (SPARK-60908) Infer createDataFrame types in Spark Connect Rust by merging all rows as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60950) MapOutputTrackerMaster never replies to a map output status request whose handler throws ASF GitHub Bot (Jira) via issues
• [jira] [Created] (SPARK-60950) MapOutputTrackerMaster never replies to a map output status request whose handler throws Ivan Sadikov (Jira) via issues
• [jira] [Resolved] (SPARK-60695) Print schema metadata instead of executing rows in Spark Connect Rust printSchema Hyukjin Kwon (Jira) via issues
• [jira] [Assigned] (SPARK-60911) Raise server errors in Spark Connect Rust with the exception class and details PySpark gives Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60948) Render Column reprs in Spark Connect Rust as PySpark Connect does Hyukjin Kwon (Jira) via issues
• [jira] [Created] (SPARK-60949) Access struct fields as attributes of a Column in Spark Connect Rust as PySpark does Hyukjin Kwon (Jira) via issues
• [jira] [Updated] (SPARK-60948) Render Column reprs in Spark Connect Rust as PySpark Connect does Hyukjin Kwon (Jira) via issues

• Earlier messages
• Later messages