Messages by Thread
-
[jira] [Assigned] (SPARK-58489) Support datetime functions in `DateTimeFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-56498) Implement decoupled state store maintenance
Anish Shrigondekar (Jira)
-
[jira] [Assigned] (SPARK-56498) Implement decoupled state store maintenance
Anish Shrigondekar (Jira)
-
[jira] [Updated] (SPARK-58490) Support collection functions in `CollectionFunctions`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58490) Support collection functions in `CollectionFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58489) Support datetime functions in `DateTimeFunctions`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58489) Support datetime functions in `DateTimeFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58483) Support string functions in `StringFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58483) Support string functions in `StringFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58488) Fix type annotations for varargs methods that also accept a single sequence
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-58487) "Pandas UDFs and Arrow-enabled toPandas() silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58487) Pandas UDFs and Arrow-enabled toPandas() silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58487) When Arrow execution is enabled, toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64
Josh Rosen (Jira)
-
[jira] [Created] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58487) toPandas() and Pandas UDFs silently corrupt nullable BIGINT values of magnitude 2^53 or more by upcasting the column to float64
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58482) Filtering a cached table for NaN values returns incorrect results: cached-batch pruning compares under a different ordering than the statistics were built with
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58443) Wrong results in instr and substring_index for an Int.MinValue position or count
Eric Yang (Jira)
-
[jira] [Created] (SPARK-58486) InjectRuntimeFilter builds runtime bloom filters with collation-agnostic XxHash64, silently dropping join rows when a collated equi-join key is a non-attribute expression
Josh Rosen (Jira)
-
[jira] [Resolved] (SPARK-58418) SCD2 AutoCDC fails with NUM_COLUMNS_MISMATCH when a flow narrower than the evolved target reconciles
Szehon Ho (Jira)
-
[jira] [Assigned] (SPARK-58418) SCD2 AutoCDC fails with NUM_COLUMNS_MISMATCH when a flow narrower than the evolved target reconciles
Szehon Ho (Jira)
-
[jira] [Created] (SPARK-58485) Broadcast hash join fails with "Subquery has not finished" when the join key > contains an uncorrelated scalar subquery
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58485) Broadcast hash join fails with "Subquery has not finished" when the join key contains an uncorrelated scalar subquery
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58482) Filtering a cached tables for NaN values returns incorrect results: cached-batch pruning compares under a different ordering than the statistics were built with
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58484) CSV scan fails with ArrayIndexOutOfBoundsException when a pushed filter has no column references and the required schema is empty
Josh Rosen (Jira)
-
[jira] [Created] (SPARK-58484) CSV scan fails with ArrayIndexOutOfBoundsException when a pushed filter has no column references and the required schema is empty
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58483) Support string functions in `StringFunctions`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58483) Support string functions in `StringFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58482) Filtering a cached tables for NaN values returns incorrect results: cached-batch pruning compares under a different ordering than the statistics were built with
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58481) InSubqueryExec declares incorrect nullability, which can cause incorrect query results
Josh Rosen (Jira)
-
[jira] [Created] (SPARK-58481) FULL OUTER JOIN with a NOT IN subquery condition returns the cross product
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58481) FULL OUTER JOIN with a NOT IN subquery condition returns the cross product
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58480) Coalesce input Python test files for new DF golden file suite
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58480) Coalesce input Python test files for new DF golden file suite
Daniel Tenedorio (Jira)
-
[jira] [Updated] (SPARK-45900) Expand hash functionalities from to include XXH3
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-40259) Support Parquet DSv2 in subquery plan merge
Peter Toth (Jira)
-
[jira] [Assigned] (SPARK-40259) Support Parquet DSv2 in subquery plan merge
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-58409) Add SCD2 end-to-end test suites to match SCD1 AutoCDC coverage
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58468) Support on-demand loading for single event logs in Spark History Server
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58468) Support on-demand loading for single event logs in Spark History Server
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58479) Support math functions in `MathFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58479) Support math functions in `MathFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58479) Support math functions in `MathFunctions`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58479) Support math functions in `MathFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58478) SCD1 AutoCDC rejects dropping a nested struct/array field but accepts dropping a top-level column
Andreas Neumann (Jira)
-
[jira] [Created] (SPARK-58478) SCD1 AutoCDC rejects dropping a nested struct/array field but accepts dropping a top-level column
Andreas Neumann (Jira)
-
[jira] [Assigned] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58454) Fully decouple pipelined shuffles from the MapOutputTracker- #57646
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58477) Support `when/otherwise` in `Column` and `Functions`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58475) Support predicate and string methods in Column
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58475) Support predicate and string methods in Column
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58476) Support Column-based `sort/withColumn/drop/join` in `DataFrame`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58475) Support predicate and string methods in Column
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58475) Support predicate and string methods in Column
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-57823) Support ORC predicate pushdown for nanosecond-precision timestamps
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57832) Support timestamp - timestamp subtraction for nanosecond-precision timestamps (microsecond-precision interval result)
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57897) Create connector/credential-aws module
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58474) Support Swift literal operands in `Column` operators via `SparkLiteral`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58473) Support comparison/logical/arithmetic operators in `Column`
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58431) SimplifyExtractValueOps folds an out-of-bounds array index to NULL under ANSI, suppressing INVALID_ARRAY_INDEX and corrupting the result's nullability
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58419) [SQL] Support ANSI SQL UNNEST in the FROM clause
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58468) Support on-demand loading for single event logs in Spark History Server
Cheng Pan (Jira)
-
[jira] [Created] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI
Kousuke Saruta (Jira)
-
[jira] [Assigned] (SPARK-58419) [SQL] Support ANSI SQL UNNEST in the FROM clause
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58468) Support on-demand loading for V1 event logs in Spark History Server
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57894) Implement UpdateUserCredentials RPC, backend integration, and task closure delivery
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58471) Improve TrainValidationSplitModel size estimation
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58471) Improve TrainValidationSplitModel size estimation
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58462) Exclude tuning params from CrossValidatorModel size
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58462) Exclude tuning params from CrossValidatorModel size
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58463) Close merged pull requests before posting summaries
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58470) Use native Spark expressions for NumPy trunc
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58469) Use native Spark expressions for NumPy rint
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58469) Use native Spark expressions for NumPy rint
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58470) Use native Spark expressions for NumPy trunc
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58468) Support on-demand loading for V1 event logs in Spark History Server
Cheng Pan (Jira)
-
[jira] [Updated] (SPARK-58463) Close merged pull requests before posting summaries
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58465) Use native expressions for NumPy reciprocal of floating-point columns
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58458) No test covers the CSV record split caused by a quoted line break when multiLine is disabled
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58460) Do not leak generated column expressions into DataFrame schemas and derived tables
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58460) Do not leak generated column expressions into DataFrame schemas and derived tables
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-58467) New node for udf expression and generalize ExtractPythonUDFs
Haiyang Sun (Jira)
-
[jira] [Assigned] (SPARK-57815) Handle nanosecond-precision timestamp columns in Hive-serde (STORED AS) tables
Jira
-
[jira] [Resolved] (SPARK-57815) Handle nanosecond-precision timestamp columns in Hive-serde (STORED AS) tables
Jira
-
[jira] [Assigned] (SPARK-58466) Support ORC and route time and timestamp nano through types framework
Jira
-
[jira] [Resolved] (SPARK-58466) Support ORC and route time and timestamp nano through types framework
Jira
-
[jira] [Updated] (SPARK-58466) Support ORC and route time and timestamp nano through types framework
Jira
-
[jira] [Created] (SPARK-58466) Support ORC and route time and timestamp nano through types framework
Stevo Mitric (Jira)
-
[jira] [Resolved] (SPARK-58315) Improve DSv2 scan statistics handling
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58315) Improve DSv2 scan statistics handling
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58465) Use native expressions for NumPy reciprocal ufunc
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58465) Use native expressions for NumPy reciprocal ufunc
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58464) Use native functions for NumPy bitwise shift ufuncs
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58464) Use native functions for NumPy bitwise shift ufuncs
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58444) Do not enable concurrent output writer when ordering already matched
XiDuo You (Jira)
-
[jira] [Assigned] (SPARK-58444) Do not enable concurrent output writer when ordering already matched
XiDuo You (Jira)
-
[jira] [Assigned] (SPARK-58405) Pull up project alias through window to eliminate redundant shuffle and sort
XiDuo You (Jira)
-
[jira] [Resolved] (SPARK-58405) Pull up project alias through window to eliminate redundant shuffle and sort
XiDuo You (Jira)
-
[jira] [Assigned] (SPARK-58463) Close merged pull requests before posting summaries
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58463) Close merged pull requests before posting summaries
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58436) Add missing @since tags in functions.scala
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58436) Add missing @since tags in functions.scala
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58436) Add missing @since tags in functions.scala
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58462) Exclude tuning params from CrossValidatorModel size- #57665
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58462) Exclude tuning params from CrossValidatorModel size
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58452) Support tracking columns evolution for SCD Type 2
Andreas Neumann (Jira)
-
[jira] [Updated] (SPARK-58461) Convert unreachable _LEGACY_ERROR_TEMP_3021-3042 invariants in SparkCoreErrors to internal errors
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58452) Support schema evolution for SCD Type 2
Andreas Neumann (Jira)
-
[jira] [Created] (SPARK-58461) Convert unreachable _LEGACY_ERROR_TEMP_3021-3042 invariants in SparkCoreErrors to internal errors
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-58460) Do not leak generated column expressions into DataFrame schemas and derived tables
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58460) Do not leak generated column expressions into DataFrame schemas and derived tables
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-58445) Fix NumPy isfinite and isinf mappings
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58445) Fix NumPy isfinite and isinf mappings
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58459) Remove branch-specific logic from build_main
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58448) Estimate IsotonicRegressionModel size
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58459) Remove branch-specific logic from build_main
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-58448) Estimate IsotonicRegressionModel size
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58457) CSV and JSON docs claim PERMISSIVE drops corrupt records when no columnNameOfCorruptRecord field is declared; it never does
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58457) CSV and JSON docs claim PERMISSIVE drops corrupt records when no columnNameOfCorruptRecord field is declared; it never does
Jorge Molina (Jira)
-
[jira] [Created] (SPARK-58458) No test covers the CSV record split caused by a quoted line break when multiLine is disabled
Jorge Molina (Jira)
-
[jira] [Created] (SPARK-58456) Handle chained comparisons
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-58455) SPIP: Spark Connect Gateway — Session Affinity, Auth, and Multi-Tenancy for Spark Connect Servers
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-58455) SPIP: Spark Connect Gateway — Session Affinity, Auth, and Multi-Tenancy for Spark Connect Servers
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-57787) Reuse a persistent local Spark Connect server for faster local startup
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-57787) Reuse a persistent local Spark Connect server for faster local startup
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-57825) Support ANSI year-month interval +/- for TIMESTAMP_NTZ(p)/TIMESTAMP_LTZ(p)
Jira
-
[jira] [Assigned] (SPARK-57825) Support ANSI year-month interval +/- for TIMESTAMP_NTZ(p)/TIMESTAMP_LTZ(p)
Jira
-
[jira] [Updated] (SPARK-58445) Fix NumPy isfinite and isinf mappings
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57898) Implement AwsStsCredentialProvider
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58450) Single pass analyzer support
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57226) Natively integrate concurrent scheduling capabilities into DAG scheduler
Boyang Jerry Peng (Jira)
-
[jira] [Created] (SPARK-58454) Fully decouple pipelined shuffles from the MapOutputTracker- #57646
Boyang Jerry Peng (Jira)
-
[jira] [Created] (SPARK-58453) Improve show() output to include row count if not truncated
Jason Altekruse (Jira)
-
[jira] [Created] (SPARK-58452) Support schema evolution for SCD Type 2
Andreas Neumann (Jira)
-
[jira] [Updated] (SPARK-58451) Filter null extension elements returned by GetStatus plugins
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58451) Filter null extension elements returned by GetStatus plugins
Haoyan Geng (Jira)
-
[jira] [Created] (SPARK-58450) Single pass analyzer support
Serge Rielau (Jira)
-
[jira] [Created] (SPARK-58449) PushDownJoinThroughUnion duplicates the probe side when only the Union side is broadcastable
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-58448) Estimate IsotonicRegressionModel size
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58448) Estimate IsotonicRegressionModel size
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58398) [Part4] Group-atomic failure and fail-fast rejection for pipelined-shuffle stage groups
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58398) [Part4] Group-atomic failure and fail-fast rejection for pipelined-shuffle stage groups
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58447) Preserve operation tags in Spark Connect Python foreachBatch callbacks
Jiwon Park (Jira)
-
[jira] [Assigned] (SPARK-58399) Add `collect_union` aggregate function
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58399) Add `collect_union` aggregate function
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-58447) Preserve operation tags in Spark Connect Python foreachBatch callbacks
Jiwon Park (Jira)
-
[jira] [Updated] (SPARK-58446) Dynamic allocation can remain at zero executors after TaskStart events arrive after StageCompleted
Jiwon Park (Jira)
-
[jira] [Created] (SPARK-58446) Dynamic allocation can remain at zero executors after TaskStart events arrive after StageCompleted
Jiwon Park (Jira)