Messages by Thread
-
[jira] [Resolved] (SPARK-58533) Use native Spark function for NumPy float_power
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58553) Use native Spark functions for NumPy fmax and fmin
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58551) Python Data Sources Limit Pushdown API
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58552) Add total task time column to the SQL / DataFrame tab
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58552) Add total task time column to the SQL / DataFrame tab
XiDuo You (Jira)
-
[jira] [Created] (SPARK-58551) Python Data Sources Limit Pushdown API
Ganesha S (Jira)
-
[jira] [Updated] (SPARK-58550) Delay GaussianMixture aggregation allocations
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58550) Delay GaussianMixture aggregation allocations
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58548) Use native Spark function for NumPy heaviside
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58549) Preserve key-grouped partitioning and ordering across a DSv2 scan merge
Peter Toth (Jira)
-
[jira] [Created] (SPARK-58549) Preserve key-grouped partitioning and ordering across a DSv2 scan merge
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-36284) Add shuffle checksum support for push-based shuffle
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58547) Expose Spark Connect operation IDs for end-to-end request attribution
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58548) Use native Spark function for NumPy heaviside
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58547) Expose Spark Connect operation IDs for end-to-end request attribution
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58544) Vector distance and norm functions return NaN, Infinity or NULL due to float overflow in intermediate sums
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58546) Avoid redundant StringIndexer label lookups
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58546) Avoid redundant StringIndexer label lookups
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58545) Add tests for pa.Array.to_pandas with types_mapper
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-58545) Add tests for pa.Array.to_pandas with types_mapper
Haotian Sun (Jira)
-
[jira] [Assigned] (SPARK-58543) Support reattachable execution with `ReattachExecute` and `ReleaseExecute`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58544) Vector distance and norm functions return NaN, Infinity or NULL due to float overflow in intermediate sums
sepuri sai krishna (Jira)
-
[jira] [Updated] (SPARK-58543) Support reattachable execution with `ReattachExecute` and `ReleaseExecute`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58543) Support reattachable execution with `ReattachExecute` and `ReleaseExecute`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58535) Create StringIndexer lookup maps during transformation
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58535) Create StringIndexer lookup maps during transformation
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58534) Change version in branch-4.x to 4.4.0
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58534) Change version in branch-4.x to 4.4.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-57225) Throw informative error on attempt to write using streaming StateDataSource or StateMetadataSource
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58542) Upgrade `gRPC Swift NIO Transport` to 2.9.1
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58542) Upgrade `gRPC Swift NIO Transport` to 2.9.1
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-57225) Throw informative error on attempt to write using streaming StateDataSource or StateMetadataSource
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58541) Support retry with exponential backoff in `SparkConnectClient`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58541) Support retry with exponential backoff in `SparkConnectClient`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58423) Raise MISSING_ATTRIBUTES for missing input after single-pass hidden-output insertion
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58423) Raise MISSING_ATTRIBUTES for missing input after single-pass hidden-output insertion
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58411) Fix bug for decorrelating Limit+Sort when partitionFields is empty
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58411) Fix bug for decorrelating Limit+Sort when partitionFields is empty
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58525) StructType.merge does not propagate the caseSensitive flag into nested struct/array/map field merges
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58525) StructType.merge does not propagate the caseSensitive flag into nested struct/array/map field merges
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58542) Upgrade `gRPC Swift NIO Transport` to 2.9.1
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-57640) Implement gRPC backend WorkerSession
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-58542) Upgrade `gRPC Swift NIO Transport` to 2.9.1
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-57640) Implement gRPC backend WorkerSession
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-58541) Support retry with exponential backoff in `SparkConnectClient`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58541) Support retry with exponential backoff in `SparkConnectClient`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-54945) Add tests for pa.Array.to_pandas with zero copy
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58511) Bypass ineffective pre-shuffle partial aggregation at runtime
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58539) Support error details in `SparkConnectError` using gRPC `ErrorInfo`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58539) Support error details in `SparkConnectError` using gRPC `ErrorInfo`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58540) Prepare Apache Spark 4.4.0
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58461) Convert unreachable _LEGACY_ERROR_TEMP_3021-3042 invariants in SparkCoreErrors to internal errors
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-58461) Convert unreachable _LEGACY_ERROR_TEMP_3021-3042 invariants in SparkCoreErrors to internal errors
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-58404) Support bypassing partial WindowGroupLimit
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58404) Support bypassing partial WindowGroupLimit
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58539) Support error details in `SparkConnectError` using gRPC `ErrorInfo`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58539) Support error details in `SparkConnectError` using gRPC `ErrorInfo`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58449) PushDownJoinThroughUnion duplicates the probe side when only the Union side is broadcastable
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-58449) PushDownJoinThroughUnion duplicates the probe side when only the Union side is broadcastable
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-58534) Change version in branch-4.x to 4.4.0
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58538) Add branch-4.3 CI scheduler and release integration
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-58537) Scheduled Maven workflows on branch-4.x build master instead of the branch
Jungtaek Lim (Jira)
-
[jira] [Created] (SPARK-58538) Add branch-4.3 CI scheduler and release integration
Jungtaek Lim (Jira)
-
[jira] [Created] (SPARK-58537) Scheduled Maven workflows on branch-4.x build master instead of the branch
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-58536) getDefaultFinalStatus() should return SUCCEEDED in cluster mode matching its documentation
luozonghai (Jira)
-
[jira] [Updated] (SPARK-58535) Create StringIndexer lookup maps during transformation
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58535) Create StringIndexer lookup maps during transformation
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58536) getDefaultFinalStatus() should return SUCCEEDED in cluster mode matching its documentation
luozonghai (Jira)
-
[jira] [Assigned] (SPARK-58514) Restore NumPy log2 mapping with a native Spark function
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58514) Restore NumPy log2 mapping with a native Spark function
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58465) Use native expressions for NumPy reciprocal of floating-point columns
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58465) Use native expressions for NumPy reciprocal of floating-point columns
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58534) Change version in branch-4.x to 4.4.0
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-58533) Use native Spark function for NumPy float_power
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58533) Use native Spark function for NumPy float_power
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58532) Use native functions for NumPy functions
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58265) Reuse projected broadcast values for dynamic partition pruning
Chao Sun (Jira)
-
[jira] [Resolved] (SPARK-58265) Reuse projected broadcast values for dynamic partition pruning
Chao Sun (Jira)
-
[jira] [Created] (SPARK-58532) Migrate pandas-on-Spark NumPy compatibility mappings from pandas UDFs to native functions
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58532) Migrate pandas-on-Spark NumPy compatibility mappings from pandas UDFs to native functions
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58504) Make FileTokenIngestor cache thread-safe
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58531) Convert spark.sql.artifact.copyFromLocalToFs.allowDestLocal to a static conf
Haoyan Geng (Jira)
-
[jira] [Updated] (SPARK-58531) Remove redundant config spark.sql.artifact.copyFromLocalToFs.allowDestLocal
Haoyan Geng (Jira)
-
[jira] [Resolved] (SPARK-58530) Support large local data in `createDataFrame` via `CachedLocalRelation`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58530) Support large local data in `createDataFrame` via `CachedLocalRelation`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58531) Remove redundant config spark.sql.artifact.copyFromLocalToFs.allowDestLocal
Haoyan Geng (Jira)
-
[jira] [Updated] (SPARK-58530) Support large local data in `createDataFrame` via `CachedLocalRelation`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58530) Support large local data in `createDataFrame` via `CachedLocalRelation`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58528) Support cache artifact upload in `SparkConnectClient`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58528) Support cache artifact upload in `SparkConnectClient`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58529) Unify RESULT_ROWS_MISMATCH message and consolidate row count verification in worker.py
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58529) Unify RESULT_ROWS_MISMATCH message and consolidate row count verification in worker.py
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-58528) Support cache artifact upload in `SparkConnectClient`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58528) Support cache artifact upload in `SparkConnectClient`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58527) Update `cyclonedx` to 3.3.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58527) Update `cyclonedx` to 3.3.0
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58523) Add SupportsRuntimeCatalystFilter API
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-58526) Fix `VariableBufferBuilder` to handle large first value and offsets truncation
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58526) Fix `VariableBufferBuilder` to handle large first value and offsets truncation
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58527) Update `cyclonedx` to 3.3.0
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58527) Update `cyclonedx` to 3.3.0
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58161) [PYTHON] Standardize PySpark UDF row count mismatch error to use RESULT_ROWS_MISMATCH
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-58161) [PYTHON] Standardize PySpark UDF row count mismatch error to use RESULT_ROWS_MISMATCH
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-58161) [PYTHON] Standardize PySpark UDF row count mismatch error to use RESULT_ROWS_MISMATCH
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-58272) Enable runtime Bloom filters for safely materialized cached join inputs
Chao Sun (Jira)
-
[jira] [Resolved] (SPARK-58272) Enable runtime Bloom filters for safely materialized cached join inputs
Chao Sun (Jira)
-
[jira] [Updated] (SPARK-58518) DataSource.checkAndGlobPathIfNecessary duplicates every input path when globbing is disabled, so an unpartitioned relation returns duplicate rows
Josh Rosen (Jira)
-
[jira] [Resolved] (SPARK-58426) Operator Helm chart passes `jvmArgs` as a single argv element, so JVM options are ignored
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58426) Operator Helm chart passes `jvmArgs` as a single argv element, so JVM options are ignored
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58525) StructType.merge does not propagate the caseSensitive flag into nested struct/array/map field merges
Andreas Neumann (Jira)
-
[jira] [Updated] (SPARK-58526) Fix `VariableBufferBuilder` to handle large first value and offsets truncation
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58526) Fix `VariableBufferBuilder` to handle large first value and offsets truncation
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58525) StructType.merge does not propagate the caseSensitive flag into nested struct/array/map field merges
Andreas Neumann (Jira)
-
[jira] [Assigned] (SPARK-58524) Add `SHA256` struct
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58524) Add `SHA256` struct
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58524) Add `SHA256` struct
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58524) Add `SHA256` struct
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58523) Add SupportsPushdownCatalystRuntimeFilter API
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58523) Add SupportsPushdownCatalystRuntimeFilter API
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-57594) Add support for spark_confs properties to auto cdc and auto cdc from snapshot flows
Szehon Ho (Jira)
-
[jira] [Updated] (SPARK-58522) Accept a single tuple of columns in Window and TableArg partitionBy/orderBy
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-57594) Add support for spark_confs properties to auto cdc and auto cdc from snapshot flows
Szehon Ho (Jira)
-
[jira] [Updated] (SPARK-57594) Add support for spark_confs properties to auto cdc and auto cdc from snapshot flows
Szehon Ho (Jira)
-
[jira] [Created] (SPARK-58522) Accept a single tuple of columns in Window and TableArg partitionBy/orderBy
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-58124) AS OF JOIN: Physical execution
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58176) ASOF JOIN: Docs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58123) ASOF JOIN: Analysis
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58125) AS OF JOIN: SQL integration tests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58173) ASOF JOIN: SQL Function Verification Tests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58122) ASOF JOIN: Parser + error conditions
Dongjoon Hyun (Jira)
-
[jira] [Closed] (SPARK-57057) Allow SELECT and INSERT to target a specific branch on SupportsBranching tables
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58066) [SQL] Hoist streamed-side residual predicates for left outer, left anti, right outer and existence joins
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58092) SQL support for ASOF join
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-56898) Add pre-pass rule to canonicalize COUNT(DISTINCT IF(cond, col, NULL)) into COUNT(DISTINCT col) FILTER
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-57933) Map Spark Connect client exceptions to SQLException in the JDBC driver
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-55206) Support basic single parameter addition Python UDF transpilation
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-58510) Make variant path functions error consistently on malformed constant paths across execution modes
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58096) approx_top_k returns wrong counts for ICU-collated string columns (distinct non-ASCII values merged)
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-57370) Add a JDK (javac) compiler backend for whole-stage codegen
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-57370) Add a JDK (javac) compiler backend for whole-stage codegen
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58520) Document the WITH (options) clause on the INSERT, MERGE INTO, and SELECT statements
Anurag Mantripragada (Jira)
-
[jira] [Created] (SPARK-58520) Document the WITH (options) clause on the INSERT, MERGE INTO, and SELECT statements
Anurag Mantripragada (Jira)
-
[jira] [Updated] (SPARK-58519) Document the UPDATE and DELETE FROM statements in the SQL reference
Anurag Mantripragada (Jira)
-
[jira] [Created] (SPARK-58519) Document the UPDATE and DELETE FROM statements in the SQL reference
Anurag Mantripragada (Jira)
-
[jira] [Resolved] (SPARK-55206) Support basic single parameter addition Python UDF transpilation
Holden Karau (Jira)
-
[jira] [Created] (SPARK-58518) DataSource.checkAndGlobPathIfNecessary duplicates every input path when globbing is disabled, so an unpartitioned relation returns duplicate rows
Jorge Molina (Jira)
-
[jira] [Resolved] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server
Holden Karau (Jira)
-
[jira] [Assigned] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-58516) Extend AbstractIterator in ColumnarIterator instead of mixing in Iterator
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-58517) SDP schema evolution ignores spark.sql.caseSensitive, corrupting the target schema on case-only column differences
Andreas Neumann (Jira)
-
[jira] [Created] (SPARK-58517) SDP schema evolution ignores spark.sql.caseSensitive, corrupting the target schema on case-only column differences
Andreas Neumann (Jira)
-
[jira] [Resolved] (SPARK-58096) approx_top_k returns wrong counts for ICU-collated string columns (distinct non-ASCII values merged)
Wenchen Fan (Jira)