Messages by Thread
-
[jira] [Updated] (SPARK-57594) Add support for spark_confs properties to auto cdc and auto cdc from snapshot flows
Szehon Ho (Jira)
-
[jira] [Created] (SPARK-58522) Accept a single tuple of columns in Window and TableArg partitionBy/orderBy
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-58124) AS OF JOIN: Physical execution
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58176) ASOF JOIN: Docs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58123) ASOF JOIN: Analysis
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58125) AS OF JOIN: SQL integration tests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58173) ASOF JOIN: SQL Function Verification Tests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58122) ASOF JOIN: Parser + error conditions
Dongjoon Hyun (Jira)
-
[jira] [Closed] (SPARK-57057) Allow SELECT and INSERT to target a specific branch on SupportsBranching tables
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58066) [SQL] Hoist streamed-side residual predicates for left outer, left anti, right outer and existence joins
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58092) SQL support for ASOF join
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-56898) Add pre-pass rule to canonicalize COUNT(DISTINCT IF(cond, col, NULL)) into COUNT(DISTINCT col) FILTER
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-57933) Map Spark Connect client exceptions to SQLException in the JDBC driver
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-55206) Support basic single parameter addition Python UDF transpilation
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-58510) Make variant path functions error consistently on malformed constant paths across execution modes
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58096) approx_top_k returns wrong counts for ICU-collated string columns (distinct non-ASCII values merged)
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-57370) Add a JDK (javac) compiler backend for whole-stage codegen
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-57370) Add a JDK (javac) compiler backend for whole-stage codegen
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-58521) Forward `X-Forwarded-Context` header and skip Master CSP on reverse-proxied UI requests
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58520) Document the WITH (options) clause on the INSERT, MERGE INTO, and SELECT statements
Anurag Mantripragada (Jira)
-
[jira] [Created] (SPARK-58520) Document the WITH (options) clause on the INSERT, MERGE INTO, and SELECT statements
Anurag Mantripragada (Jira)
-
[jira] [Updated] (SPARK-58519) Document the UPDATE and DELETE FROM statements in the SQL reference
Anurag Mantripragada (Jira)
-
[jira] [Created] (SPARK-58519) Document the UPDATE and DELETE FROM statements in the SQL reference
Anurag Mantripragada (Jira)
-
[jira] [Resolved] (SPARK-55206) Support basic single parameter addition Python UDF transpilation
Holden Karau (Jira)
-
[jira] [Created] (SPARK-58518) DataSource.checkAndGlobPathIfNecessary duplicates every input path when globbing is disabled, so an unpartitioned relation returns duplicate rows
Jorge Molina (Jira)
-
[jira] [Resolved] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server
Holden Karau (Jira)
-
[jira] [Assigned] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-47017) Show metrics of the physical plan of RDDScanExec's internal RDD in the history server
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-58516) Extend AbstractIterator in ColumnarIterator instead of mixing in Iterator
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-58517) SDP schema evolution ignores spark.sql.caseSensitive, corrupting the target schema on case-only column differences
Andreas Neumann (Jira)
-
[jira] [Created] (SPARK-58517) SDP schema evolution ignores spark.sql.caseSensitive, corrupting the target schema on case-only column differences
Andreas Neumann (Jira)
-
[jira] [Resolved] (SPARK-58096) approx_top_k returns wrong counts for ICU-collated string columns (distinct non-ASCII values merged)
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58096) approx_top_k returns wrong counts for ICU-collated string columns (distinct non-ASCII values merged)
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-58449) PushDownJoinThroughUnion duplicates the probe side when only the Union side is broadcastable
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58516) Extend AbstractIterator in ColumnarIterator instead of mixing in Iterator
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-58515) Improve Syntax error detection for MySQL
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58515) Improve Syntax error detection for MySQL
Alek Jarmov (Jira)
-
[jira] [Resolved] (SPARK-58509) Exclude OneVsRest classifier from model size estimation
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58509) Exclude OneVsRest classifier from model size estimation
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58514) Restore NumPy log2 mapping with a native Spark function
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58514) Restore NumPy log2 mapping with a native Spark function
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-58513) Init UnifiedMemeoryManager should check driver config in driver , check executor config in executor
angerszhu (Jira)
-
[jira] [Created] (SPARK-58513) Init UnifiedMemeoryManager should check driver config in driver , check executor config in executor
angerszhu (Jira)
-
[jira] [Updated] (SPARK-58512) Merge same-partition window operators and rewrite reversed-order row_number to share one sort
XiDuo You (Jira)
-
[jira] [Created] (SPARK-58511) Bypass ineffective pre-shuffle partial aggregation at runtime
XiDuo You (Jira)
-
[jira] [Created] (SPARK-58512) Bypass ineffective pre-shuffle partial aggregation at runtime
XiDuo You (Jira)
-
[jira] [Assigned] (SPARK-58510) Make variant path functions error consistently on malformed constant paths across execution modes
Jira
-
[jira] [Resolved] (SPARK-58510) Make variant path functions error consistently on malformed constant paths across execution modes
Jira
-
[jira] [Commented] (SPARK-57670) Spark Pipelines table properties are not dropped on subsequent run
Power John (Jira)
-
[jira] [Updated] (SPARK-58510) Make variant path functions raise INVALID_VARIANT_PATH consistently in interpreted and codegen execution
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58510) Make variant path functions error consistently on malformed constant paths across execution modes
Bojana Zecevic (Jira)
-
[jira] [Created] (SPARK-58510) Make variant path functions raise INVALID_VARIANT_PATH consistently in interpreted and codegen execution
Bojana Zecevic (Jira)
-
[jira] [Updated] (SPARK-38240) Improve RuntimeReplaceable and add a guideline for adding new functions
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58509) Exclude OneVsRest classifier from model size estimation
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-58509) Exclude OneVsRest classifier from model size estimation
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58506) Assert Spark's own error contract in codegen compile failure tests
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-58506) Assert Spark's own error contract in codegen compile failure tests
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-58470) Use native Spark expressions for NumPy trunc
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58470) Use native Spark expressions for NumPy trunc
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58469) Use native Spark expressions for NumPy rint
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58469) Use native Spark expressions for NumPy rint
Ruifeng Zheng (Jira)
-
[jira] [Commented] (SPARK-58502) Make in-limit SQL test deterministic
Jira
-
[jira] [Updated] (SPARK-58395) Include LDA metadata in size estimates
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58395) Include LDA metadata in size estimates
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58502) Make in-limit SQL test deterministic
Jira
-
[jira] [Assigned] (SPARK-58502) Make in-limit SQL test deterministic
Jira
-
[jira] [Assigned] (SPARK-58395) Include LDA metadata in size estimates
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58464) Use native functions for NumPy bitwise shift ufuncs
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-58464) Use native functions for NumPy bitwise shift ufuncs
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-54879) Add final application status to Spark History Server for failed executions
Cheng Pan (Jira)
-
[jira] [Updated] (SPARK-58508) Activate pipelined shuffles for Real-Time Mode streaming queries to support Stateful Queries
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-57933) Map Spark Connect client exceptions to SQLException in the JDBC driver
Cheng Pan (Jira)
-
[jira] [Assigned] (SPARK-57933) Map Spark Connect client exceptions to SQLException in the JDBC driver
Cheng Pan (Jira)
-
[jira] [Resolved] (SPARK-58471) Improve TrainValidationSplitModel size estimation
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58471) Improve TrainValidationSplitModel size estimation
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-56898) Add pre-pass rule to canonicalize COUNT(DISTINCT IF(cond, col, NULL)) into COUNT(DISTINCT col) FILTER
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-56898) Add pre-pass rule to canonicalize COUNT(DISTINCT IF(cond, col, NULL)) into COUNT(DISTINCT col) FILTER
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58066) [SQL] Hoist streamed-side residual predicates for left outer, left anti, right outer and existence joins
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58066) [SQL] Hoist streamed-side residual predicates for left outer, left anti, right outer and existence joins
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58450) Single pass analyzer support
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58450) Single pass analyzer support
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-58508) Activate pipelined shuffles for Real-Time Mode streaming queries to support Stateful Queries
Boyang Jerry Peng (Jira)
-
[jira] [Updated] (SPARK-58507) Avoid redundant closure-class parsing in ClosureCleaner's indylambda path
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58507) ClosureCleaner's indylambda path repeats expensive work on every clean() call
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58507) ClosureCleaner's indylambda path repeats expensive work on every clean() call
Josh Rosen (Jira)
-
[jira] [Created] (SPARK-58507) ClosureCleaner's indylambda path repeats expensive work on every clean() call
Josh Rosen (Jira)
-
[jira] [Updated] (SPARK-58506) Assert Spark's own error contract in codegen compile failure tests
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58506) Assert Spark's own error contract in codegen compile failure tests
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-58505) Attach per-consumer memory breakdown to UNABLE_TO_ACQUIRE_MEMORY task errors
Ganesha S (Jira)
-
[jira] [Created] (SPARK-58505) Attach per-consumer memory breakdown to UNABLE_TO_ACQUIRE_MEMORY task errors
Ganesha S (Jira)
-
[jira] [Updated] (SPARK-58504) Make FileTokenIngestor cache thread-safe
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58504) Make FileTokenIngestor cache thread-safe
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-58454) Fully decouple pipelined shuffles from the MapOutputTracker- #57646
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58454) Fully decouple pipelined shuffles from the MapOutputTracker- #57646
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window
Jira
-
[jira] [Resolved] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window
Jira
-
[jira] [Updated] (SPARK-58154) Several expressions hold shared mutable state that is unprotected by the stateful-expression mechanism, corrupting results under concurrent evaluation
Josh Rosen (Jira)
-
[jira] [Resolved] (SPARK-58348) Move PySpark error doc header into global variable
Jira
-
[jira] [Assigned] (SPARK-58348) Move PySpark error doc header into global variable
Jira
-
[jira] [Assigned] (SPARK-57841) Add cross-precision and nested test coverage for nanosecond-precision timestamps
Jira
-
[jira] [Resolved] (SPARK-57841) Add cross-precision and nested test coverage for nanosecond-precision timestamps
Jira
-
[jira] [Resolved] (SPARK-58459) Remove branch-specific logic from build_main
Jira
-
[jira] [Assigned] (SPARK-58459) Remove branch-specific logic from build_main
Jira
-
[jira] [Resolved] (SPARK-57161) Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect
Jira
-
[jira] [Assigned] (SPARK-57161) Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect
Jira
-
[jira] [Assigned] (SPARK-57835) Define read behavior for persisted nanosecond-typed tables when the preview flag is off
Jira
-
[jira] [Resolved] (SPARK-57835) Define read behavior for persisted nanosecond-typed tables when the preview flag is off
Jira
-
[jira] [Updated] (SPARK-58486) InjectRuntimeFilter builds runtime bloom filters with collation-agnostic XxHash64, silently dropping join rows when a collated equi-join key is a non-attribute expression
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window
Vladimir Golubev (Jira)
-
[jira] [Created] (SPARK-58503) In the presence of a generator function, Having is not pushed below the Window
Vladimir Golubev (Jira)
-
[jira] [Updated] (SPARK-58502) Make in-limit SQL test deterministic
Vladimir Golubev (Jira)
-
[jira] [Created] (SPARK-58502) Make in-limit SQL test deterministic
Vladimir Golubev (Jira)
-
[jira] [Updated] (SPARK-58501) [SQL] Eliminate redundant subexpression evaluation across Expand branches in whole-stage codegen
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58501) [SQL] Eliminate redundant subexpression evaluation across Expand branches in whole-stage codegen
James Xu (Jira)
-
[jira] [Resolved] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI
Kousuke Saruta (Jira)
-
[jira] [Assigned] (SPARK-58472) Add AutoCloseable lifecycle to CredentialProvider SPI
Kousuke Saruta (Jira)
-
[jira] [Updated] (SPARK-58500) Accept a single tuple of column names in DataFrame.describe and selectExpr
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58500) Accept a single tuple of column names in DataFrame.describe and selectExpr
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-58499) Support hostNetwork mode for kubernetes
Chenyu Zheng (Jira)
-
[jira] [Resolved] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58498) Support `geometry/geography` types in `DataType.simpleString`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58497) Support `createDataFrame` in `SparkSession`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58496) Support field-name-based access in `Row`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58496) Support field-name-based access in `Row`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58497) Support `createDataFrame` in `SparkSession`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58497) Support `createDataFrame` in `SparkSession`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58497) Support `createDataFrame` in `SparkSession`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58496) Support field-name-based access in `Row`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58496) Support field-name-based access in `Row`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58495) Use 7077 for `spark` named container port in master StatefulSet
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-57835) Define read behavior for persisted nanosecond-typed tables when the preview flag is off
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57161) Convert nanosecond-capable timestamp types and literals between proto and Catalyst in Spark Connect
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57460) Support nanosecond-precision timestamp types in the JDBC datasource
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-57837) Support the precision argument in current_timestamp(p) and localtimestamp(p)
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-57897) Create connector/credential-aws module
Kousuke Saruta (Jira)
-
[jira] [Assigned] (SPARK-57897) Create connector/credential-aws module
Kousuke Saruta (Jira)
-
[jira] [Updated] (SPARK-58443) Wrong results or exception in instr and substring_index for an Int.MinValue position or count
Eric Yang (Jira)
-
[jira] [Resolved] (SPARK-58437) Fix invalid Java constructs in generated code that Janino tolerates
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-58391) Validate AutoCDC sequencing, track-history, and delete-condition drift across incremental runs
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-58391) Validate AutoCDC sequencing, track-history, and delete-condition drift across incremental runs
Szehon Ho (Jira)
-
[jira] [Created] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58494) Upgrade spotless-plugin-gradle to 8.9.0
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-58493) Support collection functions in `CollectionFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58493) Support collection functions in `CollectionFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over`
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-58455) SPIP: Spark Connect Gateway — Session Affinity, Auth, and Multi-Tenancy for Spark Connect Servers
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58493) Support collection functions in `CollectionFunctions`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58493) Support collection functions in `CollectionFunctions`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-58492) Support window functions with `Window`, `WindowSpec` and `Column.over`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-58491) Support `expr` in `Functions`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-58491) Support `expr` in `Functions`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-58488) Fix type annotations for varargs methods that also accept a single sequence
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-58488) Fix type annotations for DataFrameWriter and DataStreamWriter partitionBy/clusterBy/bucketBy/sortBy
Haotian Sun (Jira)