Messages by Thread
-
[jira] [Assigned] (SPARK-59186) Validate NumPy ufunc operand types instead of silently casting them
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59186) Validate NumPy ufunc operand types instead of silently casting them
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59112) Treat CHAR/VARCHAR as string family at exact StringType matches
Daniel Tenedorio (Jira)
-
[jira] [Assigned] (SPARK-59112) Treat CHAR/VARCHAR as string family at exact StringType matches
Daniel Tenedorio (Jira)
-
[jira] [Updated] (SPARK-59189) Run the proxy tracing integration test in CI
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59189) Run the proxy tracing integration test in CI
L. C. Hsieh (Jira)
-
[jira] [Commented] (SPARK-59187) Carry the partition key data types on KeyedPartitioning
Peter Toth (Jira)
-
[jira] [Created] (SPARK-59188) `CatalogV2Util.replace` does not recurse through nested collections
Anish Mahto (Jira)
-
[jira] [Updated] (SPARK-59187) Carry the partition key data types on KeyedPartitioning
Peter Toth (Jira)
-
[jira] [Resolved] (SPARK-59161) Run the Redis-backed integration tests in CI
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-59121) Fix wrong results when a storage-partitioned join reduces the partition keys of both sides
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59176) Reduced partition keys report the un-reduced data types when the partitioning has no key
Peter Toth (Jira)
-
[jira] [Resolved] (SPARK-59121) Fix wrong results when a storage-partitioned join reduces the partition keys of both sides
Peter Toth (Jira)
-
[jira] [Created] (SPARK-59187) Carry the partition key data types on KeyedPartitioning
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59186) Validate NumPy ufunc operand types instead of silently casting them
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59186) Validate NumPy ufunc operand types instead of silently casting them
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-59185) Derive a StartsWith prefix filter from leading-literal LIKE patterns
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59185) Derive a StartsWith prefix filter from leading-literal LIKE patterns
David Mollitor (Jira)
-
[jira] [Updated] (SPARK-59184) Cleanup remaining references to Python 3.10 or earlier in the build
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59184) Cleanup remaining references to Python 3.10 or earlier in the build
Nicholas Chammas (Jira)
-
[jira] [Created] (SPARK-59183) SCD2 Ignore-null support; Populate version map per event row at ingest
Anish Mahto (Jira)
-
[jira] [Assigned] (SPARK-58443) Wrong results or exception in instr and substring_index for an Int.MinValue position or count
Jira
-
[jira] [Created] (SPARK-59174) State-store instance metrics are shipped in every task result
Diveyam Mishra (Jira)
-
[jira] [Updated] (SPARK-59171) [SQL] SchemaPruning is not idempotent when a query reads _metadata and a VARIANT column is only referenced below a nondeterministic filter
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59165) SCD2 Ignore-null support; Introduce version map in `_cdc_metadata`
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59147) Nested SELECT * EXCEPT turns NULL structs into non-NULL structs
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59182) Unify string trimming semantics for CAST from STRING across target types
Rui Mo (Jira)
-
[jira] [Assigned] (SPARK-59178) Use `Xcode 26.6` in CIs
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59178) Use `Xcode 26.6` in CIs
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59179) Add `Xcode 27` (Swift 6.4) GitHub Action job
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59179) Add `Xcode 27` (Swift 6.4) GitHub Action job
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59181) Use system default trust managers when the RPC truststore is missing
Tim Meehan (Jira)
-
[jira] [Commented] (SPARK-59176) Reduced partition keys report the un-reduced data types when the partitioning has no key
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59180) Explicitly map every repo path to a test module via `sparktestsupport`
Nicholas Chammas (Jira)
-
[jira] [Updated] (SPARK-59180) Explicitly map every repo path to a test module via {{sparktestsupport}}
Nicholas Chammas (Jira)
-
[jira] [Assigned] (SPARK-59177) Use lower-bound version checks in `SQLTests` and `SparkConnectClientTests`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59180) Explicitly map every repo path to a test module
Nicholas Chammas (Jira)
-
[jira] [Resolved] (SPARK-18381) Wrong date conversion between spark and python for dates before 1583
Nicholas Chammas (Jira)
-
[jira] [Resolved] (SPARK-59177) Use lower-bound version checks in `SQLTests` and `SparkConnectClientTests`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-31167) Refactor how we track Python test/build dependencies
Nicholas Chammas (Jira)
-
[jira] [Commented] (SPARK-58866) Add expression-level entry points to optimizer rules for the single-pass analyzer
Jira
-
[jira] [Resolved] (SPARK-58559) Package all of sbin in PySpark classic
Nicholas Chammas (Jira)
-
[jira] [Updated] (SPARK-59179) Add `Xcode 27` (Swift 6.4) GitHub Action job
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59179) Add `Xcode 27` (Swift 6.4) GitHub Action job
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59178) Use `Xcode 26.6` in CIs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59178) Use `Xcode 26.6` in CIs
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58866) Add expression-level entry points to optimizer rules for the single-pass analyzer
Jira
-
[jira] [Updated] (SPARK-59177) Use lower-bound version checks in `SQLTests` and `SparkConnectClientTests`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59177) Use lower-bound version checks in `SQLTests` and `SparkConnectClientTests`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58973) Stateful operations fail in non-streaming mode when StreamingQueryManager hasn't been initialized
Jungtaek Lim (Jira)
-
[jira] [Created] (SPARK-59176) Reduced partition keys report the un-reduced data types when the partitioning has no key
Peter Toth (Jira)
-
[jira] [Resolved] (SPARK-59070) Guard TorchDistributor log-socket getpeername() against OSError
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59175) MISSING_AGGREGATION when a select item combines a window function with the GROUP BY expression
Lino Rosa (Jira)
-
[jira] [Assigned] (SPARK-58973) Stateful operations fail in non-streaming mode when StreamingQueryManager hasn't been initialized
Jungtaek Lim (Jira)
-
[jira] [Resolved] (SPARK-58000) Fix a flaky test `listener event` in `ClientStreamingQuerySuite`
Kousuke Saruta (Jira)
-
[jira] [Assigned] (SPARK-58000) Fix a flaky test `listener event` in `ClientStreamingQuerySuite`
Kousuke Saruta (Jira)
-
[jira] [Updated] (SPARK-59174) State-store instance metrics are shipped in every task result
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58443) Wrong results or exception in instr and substring_index for an Int.MinValue position or count
Jira
-
[jira] [Updated] (SPARK-59173) Use isEmpty/nonEmpty instead of size comparisons in MLlib
Jira
-
[jira] [Updated] (SPARK-59172) Use isEmpty/nonEmpty instead of size comparisons in core
Jira
-
[jira] [Updated] (SPARK-59149) Use isEmpty/nonEmpty instead of size comparisons in the SQL modules
Jira
-
[jira] [Updated] (SPARK-59172) Use isEmpty instead of size == 0 in core tests
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59173) Use isEmpty instead of size == 0 in MLlib
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-59173) Use isEmpty instead of size == 0 in MLlib
Jira
-
[jira] [Commented] (SPARK-59172) Use isEmpty instead of size == 0 in core tests
Jira
-
[jira] [Created] (SPARK-59173) Use isEmpty instead of size == 0 in MLlib
Jira
-
[jira] [Created] (SPARK-59172) Use isEmpty instead of size == 0 in core tests
Jira
-
[jira] [Updated] (SPARK-59149) Use isEmpty instead of size == 0 in the SQL modules
Jira
-
[jira] [Updated] (SPARK-59169) Log a warning when KVStoreProtobufSerializer falls back to JSON SerDe
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-59171) [SQL] SchemaPruning is not idempotent when a query reads _metadata and a VARIANT column is only referenced below a nondeterministic filter
Felipe (Jira)
-
[jira] [Created] (SPARK-59171) [SQL] SchemaPruning is not idempotent when a query reads _metadata and a VARIANT column is only referenced below a nondeterministic filter
Felipe (Jira)
-
[jira] [Updated] (SPARK-59170) Align SQL function groupings across APIs and documentation
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59154) Optimize decision tree model transform closures
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59170) Align SQL function groupings across APIs and documentation
Ruifeng Zheng (Jira)
-
[jira] [Commented] (SPARK-59153) SPJ one-side shuffle with out-of-set keys must not satisfy a global sort
Hemanth Boyina (Jira)
-
[jira] [Created] (SPARK-59169) Log a warning when KVStoreProtobufSerializer falls back to JSON SerDe
Cheng Pan (Jira)
-
[jira] [Resolved] (SPARK-58836) Thread dump flame graph resources return 404 behind a web proxy
Jira
-
[jira] [Assigned] (SPARK-58836) Thread dump flame graph resources return 404 behind a web proxy
Jira
-
[jira] [Updated] (SPARK-59168) Avoid NoSuchElementException on missing keys in KVStore reads and writes
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59166) Split FunctionRegistry initialization into helper methods
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59168) Avoid NoSuchElementException on missing keys in KVStore reads and writes
XiDuo You (Jira)
-
[jira] [Assigned] (SPARK-59166) Split FunctionRegistry initialization into helper methods
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59166) Split FunctionRegistry initialization into helper methods
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59123) Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys
Peter Toth (Jira)
-
[jira] [Assigned] (SPARK-59123) Avoid per-key intermediate collections in KeyedPartitioning.projectKeys and reduceKeys
Peter Toth (Jira)
-
[jira] [Assigned] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-59162) Replace BLAS calls with while loops in GBT models
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59162) Replace BLAS calls with while loops in GBT models
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-59167) Add an end-to-end Spark Connect client benchmark harness (Rust drop-in vs reference PySpark)
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59167) Add an end-to-end Spark Connect client benchmark harness (Rust drop-in vs reference PySpark)
Hyukjin Kwon (Jira)
-
[jira] [Updated] (SPARK-59164) Support nested column schema evolution
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59166) Split FunctionRegistry initialization into helper methods
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59165) SCD2 Ignore-null support; Introduce version map in `_cdc_metadata`
Anish Mahto (Jira)
-
[jira] [Created] (SPARK-59164) Support nested column schema evolution
Anish Mahto (Jira)
-
[jira] [Updated] (SPARK-59163) Reuse projected table state options across table loading and cache lookup
Yan Yan (Jira)
-
[jira] [Created] (SPARK-59163) Reuse projected table state options across table loading and cache lookup
Yan Yan (Jira)
-
[jira] [Updated] (SPARK-59162) Replace BLAS calls with while loops in GBT models
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59162) Replace BLAS calls with while loops in GBT models
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-59152) Create CountVectorizer broadcast per transform
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59152) Create CountVectorizer broadcast per transform
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59161) Run the Redis-backed integration tests in CI
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59161) Run the Redis-backed integration tests in CI
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-59160) The currentStageId initialized to 0, in the AdaptiveSparkPlanExec constructor, may clash with existing stageIDs in the AdaptiveExecutionContext
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59160) The currentStageId initialized to 0, in the AdaptiveSparkPlanExec constructor, may clash with existing stageIDs in the AdaptiveExecutionContext
Asif (Jira)
-
[jira] [Resolved] (SPARK-59158) Import docs, Helm chart, deployment examples, and Dockerfile into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Resolved] (SPARK-59136) Make the active Spark Connect client identifiable (pyspark-client-rust vs the reference client)
Holden Karau (Jira)
-
[jira] [Assigned] (SPARK-52387) Migrate to use the official Apache Arrow Swift package
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59159) Remove `queriesForSpark4Only` from `SQLTests`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59158) Import docs, Helm chart, deployment examples, and Dockerfile into Spark Connect Gateway
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59158) Import docs, Helm chart, deployment examples, and Dockerfile into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59157) Upgrade `grpc-swift-2` to 2.4.3
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58926) Driver pod SPARK_USER should reflect --proxy-user when set
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59156) Add `MacOS` integration test with Apache Spark `4.3.0` RC1
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58926) Driver pod SPARK_USER should reflect --proxy-user when set
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59155) Support `TIME(p)` precision in `createDataFrame`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-57242) Avoid unbounded TaskMemoryManager page allocation retries after allocator OOM
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59145) Import gateway binary crate into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-59154) Optimize tree classification models to reduce transform closure size
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59154) Optimize tree classification models to reduce transform closure size
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59153) SPJ one-side shuffle with out-of-set keys must not satisfy a global sort
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59152) Create CountVectorizer broadcast per transform
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59152) Create CountVectorizer broadcast per transform
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58968) Fix data correctness issue when SPJ allowKeysSubsetOfPartitionKeys
Peter Toth (Jira)
-
[jira] [Resolved] (SPARK-58968) Fix data correctness issue when SPJ allowKeysSubsetOfPartitionKeys
Peter Toth (Jira)
-
[jira] [Created] (SPARK-59151) Variant aggregation- canonicalisation
Aleksandr Chernousov (Jira)
-
[jira] [Updated] (SPARK-59151) Variant aggregation- canonicalization
Aleksandr Chernousov (Jira)
-
[jira] [Created] (SPARK-59150) VARIANT datatype aggregation
Aleksandr Chernousov (Jira)
-
[jira] [Resolved] (SPARK-47397) count_distinct ignores null values
Jira
-
[jira] [Resolved] (SPARK-39897) StackOverflowError in TaskMemoryManager
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59086) Extract common build env setup into composite action
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59045) Fix SPJ throw ClassCastException with different data type transforms
XiDuo You (Jira)
-
[jira] [Updated] (SPARK-59149) Use isEmpty instead of size == 0 in OrcUtils
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59057) Make KeyedPartitioning's narrowing flag mean actual key collapse
Peter Toth (Jira)
-
[jira] [Commented] (SPARK-59149) Use isEmpty instead of size == 0 in OrcUtils
Jira
-
[jira] [Created] (SPARK-59149) Use isEmpty instead of size == 0 in OrcUtils
Jira
-
[jira] [Assigned] (SPARK-59045) Fix SPJ throw ClassCastException with different data type transforms
XiDuo You (Jira)
-
[jira] [Updated] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59148) Skip test_nested_dataframes in the Spark Connect compatibility test
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-58775) [UI] Filtering SQL metrics causes rows with total/min/med/max stats to be blank
Jira
-
[jira] [Commented] (SPARK-58775) [UI] Filtering SQL metrics causes rows with total/min/med/max stats to be blank
Jira
-
[jira] [Assigned] (SPARK-59079) Use Option.when in LiveEntity
Jira
-
[jira] [Resolved] (SPARK-59079) Use Option.when in LiveEntity
Jira
-
[jira] [Created] (SPARK-59147) Nested SELECT * EXCEPT turns NULL structs into non-NULL structs
Joel Robin (Jira)
-
[jira] [Created] (SPARK-59146) [SQL] Pipe SET do not retain qualified access to affected source columns
Joel Robin (Jira)
-
[jira] [Updated] (SPARK-59141) Columnar UnionExec ignores outputPartitioning and returns wrong results
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-59057) Make KeyedPartitioning's narrowing flag mean actual key collapse
Peter Toth (Jira)
-
[jira] [Assigned] (SPARK-58847) Collation-aware hash aggregation
Jira
-
[jira] [Resolved] (SPARK-58847) Collation-aware hash aggregation
Jira
-
[jira] [Updated] (SPARK-59145) Import gateway binary crate into Spark Connect Gateway
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59145) Import gateway binary crate into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Resolved] (SPARK-59103) Import scg-proxy crate into Spark Connect Gateway
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-59144) Plain SQL/JSON constructor function calls bypass routine resolution
Ganesha S (Jira)
-
[jira] [Resolved] (SPARK-59143) Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps in the Rust drop-in (connect submodule import paths and minor signatures)
Hyukjin Kwon (Jira)
-
[jira] [Assigned] (SPARK-59143) Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps in the Rust drop-in (connect submodule import paths and minor signatures)
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-59144) Plain SQL/JSON constructor function calls bypass routine resolution
Ganesha S (Jira)
-
[jira] [Updated] (SPARK-59142) Verify streamId when matching stream fetch responses to callbacks in TransportResponseHandler
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59143) Close remaining PySpark 4.2.0 Spark Connect public-API parity gaps in the Rust drop-in (connect submodule import paths and minor signatures)
ASF GitHub Bot (Jira)