Messages by Thread
-
[jira] [Created] (SPARK-58666) Upgrade `zstd-jni` to 1.5.7-13
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58665) Upgrade `lz4-java` to 1.11.2
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58664) Factor out repeated paths in PySpark Classic's setup.py
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58664) Factor out repeated paths in PySpark Classic's setup.py
Nicholas Chammas (Jira)
-
[jira] [Resolved] (SPARK-58643) Reject non-foldable create_if_missing in variant_set and try_variant_set
Jira
-
[jira] [Assigned] (SPARK-58643) Reject non-foldable create_if_missing in variant_set and try_variant_set
Jira
-
[jira] [Commented] (SPARK-58662) Remove redundant toString in RocksDBStateStoreProvider state transition messages
Jira
-
[jira] [Updated] (SPARK-58663) Fix typos and grammar in root pom.xml comments
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-58663) Fix typos and grammar in root pom.xml comments
Jira
-
[jira] [Updated] (SPARK-58662) Remove redundant toString in RocksDBStateStoreProvider state transition messages
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58661) Document return values and fix stale column references in DataFrameStatFunctions
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-58661) Document return values and fix stale column references in DataFrameStatFunctions
Jira
-
[jira] [Created] (SPARK-58661) Document return values and fix stale column references in DataFrameStatFunctions
Jira
-
[jira] [Created] (SPARK-58663) Fix typos and grammar in root pom.xml comments
Jira
-
[jira] [Created] (SPARK-58662) Remove redundant toString in RocksDBStateStoreProvider state transition messages
Jira
-
[jira] [Updated] (SPARK-58660) Self-heal the PR Build check when the notify workflow fails to create it
Ganesha S (Jira)
-
[jira] [Created] (SPARK-58660) Self-heal the PR Build check when the notify workflow fails to create it
Ganesha S (Jira)
-
[jira] [Updated] (SPARK-57896) Add Kerberos coexistence and per-user token integration tests
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58659) Set Real-Time Mode config defaults
Boyang Jerry Peng (Jira)
-
[jira] [Assigned] (SPARK-58658) Do not return redacted configurations from the Config RPC
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-58658) Do not return redacted configurations from the Config RPC
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-58658) Do not return spark.connect.authenticate.token from the Config RPC
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-58658) Do not return spark.connect.authenticate.token from the Config RPC
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-58658) Do not return spark.connect.authenticate.token from the Config RPC
L. C. Hsieh (Jira)
-
[jira] [Commented] (SPARK-48973) Unexpected behavior using spark mask function handle string contains invalid UTF-8 or wide character
Eric Yang (Jira)
-
[jira] [Updated] (SPARK-58657) Add tests for pa.Array.from_pandas with the mask argument
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-58657) Add tests for pa.Array.from_pandas with the mask argument
Haotian Sun (Jira)
-
[jira] [Resolved] (SPARK-58451) Filter null extension elements returned by GetStatus plugins
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-58656) Add tests for pa.ChunkedArray.to_pandas
Haotian Sun (Jira)
-
[jira] [Assigned] (SPARK-58451) Filter null extension elements returned by GetStatus plugins
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58656) Add tests for pa.ChunkedArray.to_pandas
Haotian Sun (Jira)
-
[jira] [Assigned] (SPARK-58652) Update `Spark Connect`-generated `Swift` source code with `branch-4.3 (2026-08-07)`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58656) Add tests for pa.ChunkedArray.to_pandas
Haotian Sun (Jira)
-
[jira] [Resolved] (SPARK-58652) Update `Spark Connect`-generated `Swift` source code with `branch-4.3 (2026-08-07)`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58649) Allow SparkApplication drivers ingress to SparkCluster workers
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58649) Allow SparkApplication drivers ingress to SparkCluster workers
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58655) Upgrade `Gradle` to 9.7.0
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58655) Upgrade `Gradle` to 9.7.0
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58654) Upgrade Apache DataFusion Comet to 1.0.0
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58654) Upgrade Apache DataFusion Comet to 1.0.0
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58653) Support typed `StreamingQueryProgress` in `(last|recent)Progress`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58653) Support typed `StreamingQueryProgress` in `(last|recent)Progress`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58651) Support `parseDDL` in `SparkSession`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58651) Support `parseDDL` in `SparkSession`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58653) Support typed `StreamingQueryProgress` in `(last|recent)Progress`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58653) Support typed `StreamingQueryProgress` in `(last|recent)Progress`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58622) Support TLS and mutual TLS (mTLS) for the Spark Connect gRPC server
Jira
-
[jira] [Commented] (SPARK-58642) Support mutual TLS (mTLS) for the Spark Connect gRPC server
Jira
-
[jira] [Resolved] (SPARK-58642) Support mutual TLS (mTLS) for the Spark Connect gRPC server
Jira
-
[jira] [Updated] (SPARK-58652) Update `Spark Connect`-generated `Swift` source code with `branch-4.3 (2026-08-07)`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58652) Update `Spark Connect`-generated `Swift` source code with `branch-4.3 (2026-08-07)`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58651) Support `parseDDL` in `SparkSession`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58651) Support `parseDDL` in `SparkSession`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58650) Transpilation: Handle multiple lambdas on one line
Holden Karau (Jira)
-
[jira] [Created] (SPARK-58650) Transpilation: Skip multiple lambdas on one line
Holden Karau (Jira)
-
[jira] [Assigned] (SPARK-58648) Support StructType in schema, createDataFrame, and to APIs
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58648) Support StructType in schema, createDataFrame, and to APIs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58649) Allow SparkApplication drivers ingress to SparkCluster workers
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58649) Allow SparkApplication drivers ingress to SparkCluster workers
Yannick Goetschel (Jira)
-
[jira] [Updated] (SPARK-48973) Unexpected behavior using spark mask function handle string contains invalid UTF-8 or wide character
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58648) Support StructType in schema, createDataFrame, and to APIs
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58648) Support StructType in schema, createDataFrame, and to APIs
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-51531) Proper StructType for Schema
Dongjoon Hyun (Jira)
-
[jira] [Closed] (SPARK-51531) Proper StructType for Schema
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-51531) Proper StructType for Schema
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58647) Add public `DataType` and `StructType`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58647) Add public `DataType` and `StructType`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58647) Add public `DataType` and `StructType`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58647) Add public `DataType` and `StructType`
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58407) Fix connect.SessionQueryTest spark lifecycle
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58407) Fix connect.SessionQueryTest spark lifecycle
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58638) Recognize Examples as a primary component tag in the merge script
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58638) Recognize Examples as a primary component tag in the merge script
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58646) Use native expressions for NumPy reciprocal on integer columns
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58646) Use native expressions for NumPy reciprocal on integer columns
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-58644) Document intentional ignore of `queryStartedEventJson` in `DataStreamWriter`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58644) Document intentional ignore of `queryStartedEventJson` in `DataStreamWriter`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58645) Add recursive flag to variant_explode
Bojana Zecevic (Jira)
-
[jira] [Updated] (SPARK-58644) Document intentional ignore of `queryStartedEventJson` in `DataStreamWriter`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58644) Document intentional ignore of `queryStartedEventJson` in `DataStreamWriter`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58643) Reject non-foldable create_if_missing in variant_set and try_variant_set
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58643) Reject non-foldable create_if_missing in variant_set and try_variant_set
Bojana Zecevic (Jira)
-
[jira] [Assigned] (SPARK-58640) Align getBool with the sibling option accessors in CSVOptions and XmlOptions
Jira
-
[jira] [Resolved] (SPARK-58640) Align getBool with the sibling option accessors in CSVOptions and XmlOptions
Jira
-
[jira] [Created] (SPARK-58642) Support mutual TLS (mTLS) for the Spark Connect gRPC server
Jira
-
[jira] [Resolved] (SPARK-58384) OptimizeJoinCondition rewrites the null-safe-equality pattern under NOT, returning wrong rows
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58358) SparkSession.removeTag does not validate tags (Spark Classic)
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58358) SparkSession.removeTag does not validate tags (Spark Classic)
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-56558) CTAS IF NOT EXISTS bypasses non-empty location check when table does not exist in catalog
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-56558) CTAS IF NOT EXISTS bypasses non-empty location check when table does not exist in catalog
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-58641) Additional identifier clause testing in Analyzer
Jira
-
[jira] [Resolved] (SPARK-58174) MAVEN_MIRROR_URL is ignored when fetching plugins
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58174) MAVEN_MIRROR_URL is ignored when fetching plugins
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58174) MAVEN_MIRROR_URL is ignored when fetching plugins
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58170) Provide sql shorthand in SparkSessionProvider interface
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58170) Provide sql shorthand in SparkSessionProvider interface
Wenchen Fan (Jira)
-
[jira] [Comment Edited] (SPARK-58502) Make in-limit SQL test deterministic
Jira
-
[jira] [Commented] (SPARK-58638) Recognize Examples as a primary component tag in the merge script
Jira
-
[jira] [Updated] (SPARK-58638) Recognize Examples as a primary component tag in the merge script
Jira
-
[jira] [Updated] (SPARK-58640) Align getBool with the sibling option accessors in CSVOptions and XmlOptions
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58639) Replace stale listCachedTables reference in the SQL performance tuning guide
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-58639) Replace stale listCachedTables reference in the SQL performance tuning guide
Jira
-
[jira] [Commented] (SPARK-58640) Align getBool with the sibling option accessors in CSVOptions and XmlOptions
Jira
-
[jira] [Created] (SPARK-58639) Replace stale listCachedTables reference in the SQL performance tuning guide
Jira
-
[jira] [Created] (SPARK-58640) Align getBool with the sibling option accessors in CSVOptions and XmlOptions
Jira
-
[jira] [Created] (SPARK-58638) Recognize [EXAMPLES] as a primary component tag in merge_spark_pr.py
Jira
-
[jira] [Assigned] (SPARK-58620) Fix incorrect comments and stale usage docs in the custom receiver examples
Jira
-
[jira] [Resolved] (SPARK-58620) Fix incorrect comments and stale usage docs in the custom receiver examples
Jira
-
[jira] [Resolved] (SPARK-58621) Add descriptive messages to SummarizerBuffer metric accessor require checks
Jira
-
[jira] [Assigned] (SPARK-58621) Add descriptive messages to SummarizerBuffer metric accessor require checks
Jira
-
[jira] [Resolved] (SPARK-58618) Fix duplicated path in lint-scala scalafmt failure message
Jira
-
[jira] [Assigned] (SPARK-58618) Fix duplicated path in lint-scala scalafmt failure message
Jira
-
[jira] [Updated] (SPARK-58637) Optimize HashingTF transform closure
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58637) Optimize HashingTF transform closure
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58561) Support backporting a PR merged into a non-default branch
Jira
-
[jira] [Assigned] (SPARK-58561) Support backporting a PR merged into a non-default branch
Jira
-
[jira] [Assigned] (SPARK-58420) COUNT(DISTINCT ...) does not sort maps in the argument trees
Jira
-
[jira] [Resolved] (SPARK-58420) COUNT(DISTINCT ...) does not sort maps in the argument trees
Jira
-
[jira] [Updated] (SPARK-58636) Remove unnecessary type: ignore[union-attr] in streaming MLlib trainers
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-58636) Remove unnecessary type: ignore[union-attr] in streaming MLlib trainers
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-58635) Support for streaming aggregation in Real-Time Mode (RTM)
Boyang Jerry Peng (Jira)
-
[jira] [Resolved] (SPARK-57227) Natively integrate Streaming Shuffle within Spark
Boyang Jerry Peng (Jira)
-
[jira] [Resolved] (SPARK-57226) Natively integrate concurrent scheduling capabilities into DAG scheduler
Boyang Jerry Peng (Jira)
-
[jira] [Resolved] (SPARK-57000) Add concurrent scheduling capabilites for Real-time Mode
Boyang Jerry Peng (Jira)
-
[jira] [Assigned] (SPARK-58625) Support pa.ChunkedArray columns in PandasToArrowConversion
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58602) Add tests for pa.Array.from_pandas
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58625) Support pa.ChunkedArray columns in PandasToArrowConversion
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58602) Add tests for pa.Array.from_pandas
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58634) Avoid caching VectorIndexer transformation state
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58633) Use integer label indexes in StringIndexerModel
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58629) Avoid empty fallback gRPC errors
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58634) Avoid caching VectorIndexer transformation state
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58633) Use integer label indexes in StringIndexerModel
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58630) Use native Spark expressions for NumPy copysign
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58632) Send Spark Connect operation ID in gRPC metadata
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58632) Send Spark Connect operation ID in gRPC metadata
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58631) array_repeat and array_insert raise inconsistent array size limit errors in codegen and interpreted execution
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58631) array_repeat and array_insert raise inconsistent array size limit errors in codegen and interpreted execution
sepuri sai krishna (Jira)
-
[jira] [Updated] (SPARK-58619) Support sub-condition level SQLSTATE in the error condition framework
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58630) Use native Spark expressions for NumPy copysign
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-58629) Avoid empty fallback gRPC errors
Haoyan Geng (Jira)
-
[jira] [Resolved] (SPARK-58613) [SQL] Add scan metrics for archive file reads
Akshat Shenoi (Jira)
-
[jira] [Resolved] (SPARK-58378) Fuse compatible approximate percentile sketches
Chao Sun (Jira)
-
[jira] [Created] (SPARK-58628) Transpilation: Avoid adding None/null checks with raises on non-nullable fields
Holden Karau (Jira)
-
[jira] [Created] (SPARK-58627) Mark RaiseError as throwable
Holden Karau (Jira)
-
[jira] [Commented] (SPARK-58602) Add tests for pa.Array.from_pandas
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-58626) Transpilation: avoid duplication of input parameters for evaluation
Holden Karau (Jira)
-
[jira] [Commented] (SPARK-58625) Support pa.ChunkedArray columns in PandasToArrowConversion
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-58625) Support pa.ChunkedArray columns in PandasToArrowConversion
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-58625) Support pa.ChunkedArray columns in PandasToArrowConversion
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-58624) Transpilation: Expand captures and assignments to support lists
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-58517) SDP schema evolution ignores spark.sql.caseSensitive, corrupting the target schema on case-only column differences
Szehon Ho (Jira)
-
[jira] [Assigned] (SPARK-58517) SDP schema evolution ignores spark.sql.caseSensitive, corrupting the target schema on case-only column differences
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-58350) Migrate _LEGACY_ERROR_TEMP_1228 to DECIMAL_SCALE_EXCEEDS_PRECISION
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-58350) Migrate _LEGACY_ERROR_TEMP_1228 to DECIMAL_SCALE_EXCEEDS_PRECISION
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-58594) Revise KeyedPartitioning handling in UnionExec output partitioning
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-58623) Extend ExpandBenchmark with a 2x2 rewrite/CSE matrix and section filter
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58623) Extend ExpandBenchmark with a 2x2 rewrite/CSE matrix and section filter
James Xu (Jira)
-
[jira] [Created] (SPARK-58622) Support server-side TLS for the Spark Connect gRPC server
Jira
-
[jira] [Assigned] (SPARK-57894) Implement UpdateUserCredentials RPC, backend integration, and task closure delivery
Kousuke Saruta (Jira)
-
[jira] [Assigned] (SPARK-57895) Implement initial credential delivery for newly registered executors
Kousuke Saruta (Jira)
-
[jira] [Resolved] (SPARK-57895) Implement initial credential delivery for newly registered executors
Kousuke Saruta (Jira)
-
[jira] [Resolved] (SPARK-57894) Implement UpdateUserCredentials RPC, backend integration, and task closure delivery
Kousuke Saruta (Jira)
-
[jira] [Updated] (SPARK-58622) Support server-side TLS for the Spark Connect gRPC server
Jira
-
[jira] [Resolved] (SPARK-58582) Use native Spark function for NumPy fmod
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58582) Use native Spark function for NumPy fmod
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58605) [SQL] Add Metadata testing for Archive Reads
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58605) [SQL] Add Metadata testing for Archive Reads
Wenchen Fan (Jira)
-
[jira] [Commented] (SPARK-58621) Add descriptive messages to SummarizerBuffer metric accessor require checks
Jira
-
[jira] [Commented] (SPARK-58620) Fix incorrect comments and stale usage docs in the custom receiver examples
Jira
-
[jira] [Updated] (SPARK-58620) Fix incorrect comments and stale usage docs in the custom receiver examples
ASF GitHub Bot (Jira)