Messages by Thread
-
[jira] [Updated] (SPARK-60218) Migrate SQL_TABLE_UDF to the EvalTypeHandler pipeline and remove read_udtf
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-60209) Migrate SQL_ARROW_TABLE_UDF to the EvalTypeHandler pipeline
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-60209) Migrate SQL_ARROW_TABLE_UDF to the EvalTypeHandler pipeline
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-60217) Add a decompressionCodec read option to text-based file sources to override extension-based codec detection
Sandip Agarwala (Jira)
-
[jira] [Assigned] (SPARK-60208) Migrate grouped aggregate and window pandas UDF eval types to pandas eval type handlers
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-60208) Migrate grouped aggregate and window pandas UDF eval types to pandas eval type handlers
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-60213) Upgrade sbt to `1.13.0`
Kousuke Saruta (Jira)
-
[jira] [Resolved] (SPARK-60213) Upgrade sbt to `1.13.0`
Kousuke Saruta (Jira)
-
[jira] [Resolved] (SPARK-59987) AssertionError on NOT CAST to BOOLEAN during V2 predicate pushdown
Jira
-
[jira] [Assigned] (SPARK-60088) Remove non-existent built-in functions `ai_complete` and `ai_embed` from the single-pass resolver guard
Jira
-
[jira] [Resolved] (SPARK-60088) Remove non-existent built-in functions `ai_complete` and `ai_embed` from the single-pass resolver guard
Jira
-
[jira] [Updated] (SPARK-59987) AssertionError on NOT CAST to BOOLEAN during V2 predicate pushdown
Jira
-
[jira] [Assigned] (SPARK-59987) AssertionError on NOT CAST to BOOLEAN during V2 predicate pushdown
Jira
-
[jira] [Updated] (SPARK-60212) Publish Maven and sbt Build Scans to develocity.apache.org
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-60216) [SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1002
Devansh Singh (Jira)
-
[jira] [Created] (SPARK-60216) [SQL] Assign a name to the error condition _LEGACY_ERROR_TEMP_1002
Devansh Singh (Jira)
-
[jira] [Resolved] (SPARK-59909) PySpark raises internal errors instead of intended messages due to undefined error conditions and mismatched message parameters
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-59909) PySpark raises internal errors instead of intended messages due to undefined error conditions and mismatched message parameters
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-60040) Carry the AS-OF join direction to SortMergeAsOfJoinExec instead of inferring it from the as-of condition
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-60040) Carry the AS-OF join direction to SortMergeAsOfJoinExec instead of inferring it from the as-of condition
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-60215) Add tests for Pipelines CLI run cleanup
David Hsieh (Jira)
-
[jira] [Created] (SPARK-60215) Add tests for Pipelines CLI run cleanup
David Hsieh (Jira)
-
[jira] [Updated] (SPARK-60214) Rejecting non-folable lgNomEntries in analysis phase- #252798
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60214) Rejecting non-folable lgNomEntries in analysis phase- #252798
Stefan Savic (Jira)
-
[jira] [Updated] (SPARK-60213) Upgrade sbt to `1.13.0`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60213) Upgrade sbt to `1.13.0`
Kousuke Saruta (Jira)
-
[jira] [Created] (SPARK-60212) Publish Maven and sbt Build Scans to develocity.apache.org
Jerome Prinet (Jira)
-
[jira] [Commented] (SPARK-60071) Use identity equality for HybridRowQueue
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-60207) Move eval type handler test helpers onto the test classes
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-60207) Move eval type handler test helpers onto the test classes
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-60192) Metric Views: Include supported YAML versions in "Invalid YAML version" error message
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-60211) Fix applyInPandasWithState failure with PyArrow 26 due to float slice offsets
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60211) Fix applyInPandasWithState failure with PyArrow 26 due to float slice offsets
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-60115) Pin the transitive h2 dependency to 0.4.16 to pick up RUSTSEC-2026-0258
L. C. Hsieh (Jira)
-
[jira] [Resolved] (SPARK-60115) Pin the transitive h2 dependency to 0.4.16 to pick up RUSTSEC-2026-0258
L. C. Hsieh (Jira)
-
[jira] [Commented] (SPARK-60181) Guard stream-stream join state format and RocksDB merge operator compatibility
Jungtaek Lim (Jira)
-
[jira] [Resolved] (SPARK-60181) Guard stream-stream join state format and RocksDB merge operator compatibility
Jungtaek Lim (Jira)
-
[jira] [Assigned] (SPARK-60181) Guard stream-stream join state format and RocksDB merge operator compatibility
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-60125) regexp_instr ignores the specified regex group index
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60210) Add scheduled Python 3.15 build
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59521) Store word vectors directly in ml Word2VecModel
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59521) Store word vectors directly in ml Word2VecModel
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-59521) Store word vectors directly in ml Word2VecModel
Ruifeng Zheng (Jira)
-
[jira] [Commented] (SPARK-60205) Decimal.set(unscaled, precision, scale) reports the previous value instead of the rejected one on overflow
Yahya Kisana (Jira)
-
[jira] [Updated] (SPARK-60208) Migrate grouped aggregate and window pandas UDF eval types to pandas eval type handlers
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-60209) Migrate SQL_ARROW_TABLE_UDF to the EvalTypeHandler pipeline
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-60209) Migrate SQL_ARROW_TABLE_UDF to the EvalTypeHandler pipeline
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-60208) Migrate grouped aggregate and window pandas UDF eval types to pandas eval type handlers
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-59523) Store IDF data directly in IDFModel
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59523) Store IDF data directly in IDFModel
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-59523) Store IDF data directly in IDFModel
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-60194) Improve type annotation for StreamingQueryListener sessions
Tim Hsiung (Jira)
-
[jira] [Assigned] (SPARK-59563) Use BLAS routines for vector L1 and L2 norms
Ruifeng Zheng (Jira)
-
[jira] [Resolved] (SPARK-59563) Use BLAS routines for vector L1 and L2 norms
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59563) Use BLAS routines for vector L1 and L2 norms
Ruifeng Zheng (Jira)
-
[jira] [Commented] (SPARK-60206) Metric views resolve unqualified names in the reader's current namespace instead of the creation namespace
Lisa Cao (Jira)
-
[jira] [Updated] (SPARK-60206) Metric views resolve unqualified names in the reader's current namespace instead of the creation namespace
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60207) Move eval type handler test helpers onto the test classes
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-60207) Move eval type handler test helpers onto the test classes
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-60069) Migrate SQL_ARROW_UDTF to the EvalTypeHandler pipeline
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-60069) Migrate SQL_ARROW_UDTF to the EvalTypeHandler pipeline
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-60069) Migrate SQL_ARROW_UDTF to the EvalTypeHandler pipeline
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60201) Spark 4 XML silently changes ISO date interpretation when a custom dateFormat is configured
Matthew Bayer (Jira)
-
[jira] [Updated] (SPARK-60192) Metric Views: Include supported YAML versions in "Invalid YAML version" error message
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60206) Metric views resolve unqualified names in the reader's current namespace instead of the creation namespace
Lisa Cao (Jira)
-
[jira] [Assigned] (SPARK-60100) Migrate grouped and cogrouped map pandas UDF eval types to pandas eval type handlers
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-60100) Migrate grouped and cogrouped map pandas UDF eval types to pandas eval type handlers
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-60191) Add `ExecutorResizePlugin` E2E test to `pi-java25` group
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59560) Reduce Word2Vec driver peak memory during training
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-60187) Assign a name to the error condition _LEGACY_ERROR_TEMP_1000
Devansh Singh (Jira)
-
[jira] [Commented] (SPARK-60204) SQL execution page "Download SVG" produces an unstyled (black-box) plan
Yahya Kisana (Jira)
-
[jira] [Resolved] (SPARK-59998) Make LogEntry concatenation lazy
Hyukjin Kwon (Jira)
-
[jira] [Created] (SPARK-60185) Improve type annotation for SparkConnectGrpcException
Tim Hsiung (Jira)
-
[jira] [Assigned] (SPARK-60158) Avoid per-character synchronized reads in the bounded event log line reader
L. C. Hsieh (Jira)
-
[jira] [Resolved] (SPARK-60071) Use identity equality for HybridRowQueue
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60205) Decimal.set(unscaled, precision, scale) reports the previous value instead of the rejected one on overflow
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60205) Decimal.set(unscaled, precision, scale) reports the previous value instead of the rejected one on overflow
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60112) Use identity equality for memory consumers
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-59682) [SQL] Excluding RemoveRedundantAliases causes typed Dataset execution to fail with unsupported ObjectType projection
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-59998) Make LogEntry concatenation lazy
Hyukjin Kwon (Jira)
-
[jira] [Resolved] (SPARK-60158) Avoid per-character synchronized reads in the bounded event log line reader
L. C. Hsieh (Jira)
-
[jira] [Comment Edited] (SPARK-60122) Remove non-existent `avro` Maven profile from Avro doctest skip messages
Jira
-
[jira] [Updated] (SPARK-60190) Pass the callable (`func`) to `_transpile_from_ast`
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-58601) Tighten mapInPandas return-value contract to require a strict Iterator
Jira
-
[jira] [Updated] (SPARK-60200) Casting a decimal with a huge negative scale to string or showing it builds an unbounded plain string
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-60204) SQL execution page "Download SVG" produces an unstyled (black-box) plan
Sowmya Sundar (Jira)
-
[jira] [Created] (SPARK-60204) SQL execution page "Download SVG" produces an unstyled (black-box) plan
Sowmya Sundar (Jira)
-
[jira] [Updated] (SPARK-60193) Single-pass resolver code health improvements
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60203) SPJ with allowJoinKeysSubsetOfPartitionKeys fails in AQE skew-join validation when a non-join partition key comes first
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59978) Fix BIN BY boundary index overflow
Jira
-
[jira] [Created] (SPARK-60200) Casting a decimal with a huge negative scale to string or showing it builds an unbounded plain string
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-60197) Introduce drop table sql golden tests
Jira
-
[jira] [Created] (SPARK-60188) Warn on unknown variety names in `pyTranspilers`
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-59768) Audit foldability property for sql expressions
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-60203) SPJ with allowJoinKeysSubsetOfPartitionKeys fails in AQE skew-join validation when a non-join partition key comes first
Ammar Chalifah (Jira)
-
[jira] [Created] (SPARK-60203) SPJ with allowJoinKeysSubsetOfPartitionKeys fails in AQE skew-join validation when a non-join partition key comes first
Ammar Chalifah (Jira)
-
[jira] [Updated] (SPARK-60202) Preserve floating-point boundaries in scaled floor and ceil
Varun Bhandary (Jira)
-
[jira] [Created] (SPARK-60202) Preserve floating-point boundaries in scaled floor and ceil
Varun Bhandary (Jira)
-
[jira] [Updated] (SPARK-60201) Spark 4 XML silently changes ISO date interpretation when a custom dateFormat is configured
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-60122) Remove non-existent `avro` Maven profile from Avro doctest skip messages
Jira
-
[jira] [Updated] (SPARK-58601) Tighten mapInPandas return-value contract to require a strict Iterator
Jira
-
[jira] [Assigned] (SPARK-43253) Assign a name to the error class _LEGACY_ERROR_TEMP_2017
Jira
-
[jira] [Created] (SPARK-60196) Support DATE and TIMESTAMP keys in the sort-merge as-of join
Jira
-
[jira] [Updated] (SPARK-60199) XML reader silently changes microsecond timestamps under LEGACY timeParserPolicy, even in FAILFAST mode
Matthew Bayer (Jira)
-
[jira] [Created] (SPARK-60199) XML reader silently changes microsecond timestamps under LEGACY timeParserPolicy, even in FAILFAST mode
Matthew Bayer (Jira)
-
[jira] [Resolved] (SPARK-43253) Assign a name to the error class _LEGACY_ERROR_TEMP_2017
Jira
-
[jira] [Created] (SPARK-60189) Validate reported category strings at construction
Holden Karau (Jira)
-
[jira] [Created] (SPARK-60193) Single-pass resolver code health improvements
Mihailo Aleksic (Jira)
-
[jira] [Created] (SPARK-60198) Document the transpilers hook's runtime contract
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-59717) GROUP BY / DISTINCT on a UDT backed by a primitive type fails with scala.MatchError
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-59682) [SQL] Excluding RemoveRedundantAliases causes typed Dataset execution to fail with unsupported ObjectType projection
Wenchen Fan (Jira)
-
[jira] [Updated] (SPARK-60150) A filter pushed below a DISTINCT on a float key returns a row that fails the predicate
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60195) Improve type annotation for StatCounter callables
Tim Hsiung (Jira)
-
[jira] [Commented] (SPARK-59132) FileType: A new data type to simplify handling of unstructured data in Spark
Dejan Krakovic (Jira)
-
[jira] [Assigned] (SPARK-60191) Add `ExecutorResizePlugin` E2E test to `pi-java25` group
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-60191) Add `ExecutorResizePlugin` E2E test to `pi-java25` group
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-60187) Assign a name to the error condition _LEGACY_ERROR_TEMP_1000
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60192) Metric Views: Include supported YAML versions in "Invalid YAML version" error message
Jacek Laskowski (Jira)
-
[jira] [Resolved] (SPARK-59560) Reduce Word2Vec driver peak memory during training
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59560) Reduce Word2Vec driver peak memory during training
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-60191) Add `ExecutorResizePlugin` E2E test to `pi-java25` group
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-60190) Pass the callable (`func`) to `_transpile_from_ast`
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-59865) Decide Oracle TimestampNTZ wall-clock conversion from JDBCOptions instead of column metadata
Jira
-
[jira] [Commented] (SPARK-60187) Assign a name to the error condition _LEGACY_ERROR_TEMP_1000
Devansh Singh (Jira)
-
[jira] [Created] (SPARK-60186) Simplify remove_unused_categories
Tim Hsiung (Jira)
-
[jira] [Assigned] (SPARK-59978) Fix BIN BY boundary index overflow
Jira
-
[jira] [Commented] (SPARK-43253) Assign a name to the error class _LEGACY_ERROR_TEMP_2017
Jira
-
[jira] [Comment Edited] (SPARK-43253) Assign a name to the error class _LEGACY_ERROR_TEMP_2017
Jira
-
[jira] [Assigned] (SPARK-60184) Fix workload RBAC to allow `ExecutorResizePlugin` to resize executor pods
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-60184) Fix workload RBAC to allow `ExecutorResizePlugin` to resize executor pods
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59865) Decide Oracle TimestampNTZ wall-clock conversion from JDBCOptions instead of column metadata
Jira
-
[jira] [Updated] (SPARK-60184) Fix workload RBAC to allow `ExecutorResizePlugin` to resize executor pods
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60184) Fix workload RBAC to allow `ExecutorResizePlugin` to resize executor pods
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-60183) Improve type annotation for pandas-on-Spark datetime callbacks
Tim Hsiung (Jira)
-
[jira] [Assigned] (SPARK-60104) Switch Snowflake JDBC Driver from fat to thin
Cheng Pan (Jira)
-
[jira] [Resolved] (SPARK-60104) Switch Snowflake JDBC Driver from fat to thin
Cheng Pan (Jira)
-
[jira] [Created] (SPARK-60182) Improve type annotation for MLlib Vector indexing
Tim Hsiung (Jira)
-
[jira] [Updated] (SPARK-59723) Support partition projection in Hive 4.0 for write and truncate commands
Yuming Wang (Jira)
-
[jira] [Resolved] (SPARK-59662) Check for isRepartitionBatch can crash if metadata keys are missing
Jungtaek Lim (Jira)
-
[jira] [Assigned] (SPARK-59662) Check for isRepartitionBatch can crash if metadata keys are missing
Jungtaek Lim (Jira)
-
[jira] [Updated] (SPARK-60181) Guard stream-stream join state format and RocksDB merge operator compatibility
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-60181) Guard stream-stream join state format and RocksDB merge operator compatibility
Jungtaek Lim (Jira)
-
[jira] [Assigned] (SPARK-60090) TRANSFORM clause and CHAR: V2: Treat like any other STRING source
Daniel Tenedorio (Jira)
-
[jira] [Resolved] (SPARK-60090) TRANSFORM clause and CHAR: V2: Treat like any other STRING source
Daniel Tenedorio (Jira)
-
[jira] [Updated] (SPARK-60120) Upgrade zstd-jni to 1.5.7-23
Cheng Pan (Jira)
-
[jira] [Created] (SPARK-60180) Improve type annotation for SparkContext._accumulatorServer
Tim Hsiung (Jira)
-
[jira] [Resolved] (SPARK-60028) LikeSimplification duplicates a nondeterministic input of a single-pattern LIKE
Yang Jie (Jira)
-
[jira] [Assigned] (SPARK-60028) LikeSimplification duplicates a nondeterministic input of a single-pattern LIKE
Yang Jie (Jira)
-
[jira] [Updated] (SPARK-60179) Cast.needsTimeZone misses complex-to-STRING casts containing a timestamp leaf
Hengrui Hu (Jira)
-
[jira] [Created] (SPARK-60179) Cast.needsTimeZone misses complex-to-STRING casts containing a timestamp leaf
Hengrui Hu (Jira)
-
[jira] [Updated] (SPARK-60178) Canonicalization re-associates floating-point Add/Multiply, producing wrong results
Hengrui Hu (Jira)
-
[jira] [Created] (SPARK-60178) Canonicalization re-associates floating-point Add/Multiply, producing wrong results
Hengrui Hu (Jira)
-
[jira] [Updated] (SPARK-60011) Keep a DSv2 nested-field ordering after schema pruning
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-60177) CREATE OR REPLACE VIEW ... WITH METRICS fails on an existing metric view in the session catalog
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-58151) Publish Apache Spark 4.2.0 to docker registry
Huaxin Gao (Jira)
-
[jira] [Resolved] (SPARK-60122) Remove non-existent `avro` Maven profile from Avro doctest skip messages
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-60122) Remove non-existent `avro` Maven profile from Avro doctest skip messages
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-60177) CREATE OR REPLACE VIEW ... WITH METRICS fails on an existing metric view in the session catalog
Lisa Cao (Jira)
-
[jira] [Updated] (SPARK-60169) Add SQL Utils Tests
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-60141) Correct SparkContext profiler collector type annotation
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-60159) Add tests for string and DataFrame keyword arguments in spark.sql formatting
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-60151) CrossValidatorModel.load() returns the last fold's sub-models for every fold
Tian Gao (Jira)
-
[jira] [Created] (SPARK-60161) Add tests for nested timestamp conversion in pandas type converters
Jason Chen (Jira)
-
[jira] [Created] (SPARK-60154) Add test for Catalog.createDatabase with properties
JyunSheng Kao (Jira)
-
[jira] [Created] (SPARK-60155) Expand VectorUDT test coverage
Ivan Zhang (Jira)