issues
Thread
Date
Earlier messages
Later messages
Messages by Date
2026/02/15
[jira] [Closed] (SPARK-46464) Fix the scroll issue of tables when overflow
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46700) count the last spilling for the shuffle disk spilling bytes metric
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45652) SPJ: Handle empty input partitions after dynamic filtering
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46546) Fix the formatting of tables in `running-on-yarn` pages
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45588) Minor scaladoc improvement in StreamingForeachBatchHelper
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45389) Correct MetaException matching rule on getting partition metadata
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45585) Fix time format and redirection issues in SparkSubmit tests
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45132) Fix IDENTIFIER clause for functions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45543) InferWindowGroupLimit causes bug if the other window functions haven't the same window frame as the rank-like functions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45484) Fix the bug that uses incorrect parquet compression codec lz4raw
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45167) Python Spark Connect client does not call `releaseAll`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45883) Upgrade ORC to 1.9.2
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45786) Inaccurate Decimal multiplication and division results
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45171) GenerateExec fails to initialize non-deterministic expressions before use
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45371) FIx shading problem in Spark Connect
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45187) Fix WorkerPage to use the same pattern for `logPage` urls
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45553) Deprecate assertPandasOnSparkEqual
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45286) Add back Matomo analytics to release docs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45934) Fix `Spark Standalone` documentation table layout
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46182) Shuffle data lost on decommissioned executor caused by race condition between lastTaskRunningTime and lastShuffleMigrationTime
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46062) CTE reference node does not inherit the flag `isStreaming` from CTE definition node
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45882) BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45814) ArrowConverters.createEmptyArrowBatch may cause memory leak
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49054) Column default value should support current_* functions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47085) Preformance issue on thrift API
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47299) Use the same `versions. json` in the dropdown of different versions of PySpark documents
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46189) Various Pandas functions fail in interpreted mode
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46339) Directory with number name should not be treated as metadata log
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44805) Data lost after union using spark.sql.parquet.enableNestedColumnVectorizedReader=true
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45706) Makes entire Binder build fails fast during setting up
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48610) Remove ExplainUtils.processPlan synchronize
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47236) Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46610) Create table should throw exception when no value for a key in options
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-41086) Consolidate SecondArgumentXXX error to INVALID_PARAMETER_VALUE
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46170) Support inject adaptive query post planner strategy rules in SparkSessionExtensions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47072) Wrong error message for incorrect ANSI intervals
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45117) Implement missing otherCopyArgs for the MultiCommutativeOp expression
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48086) Different Arrow versions in client and server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46092) Overflow in Parquet row group filter creation causes incorrect results
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.InternalFutureFailureAccess"
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47083) Upgrade `commons-codec` to 1.16.1
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-43393) Sequence expression can overflow
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45419) Avoid reusing rocksdb sst files in a dfferent rocksdb instance by removing file version map entry of larger versions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46796) RocksDB versionID Mismatch in SST files
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45016) Add missing `try_remote_functions` annotations
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48167) Skip known behaviour change by SPARK-46122
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48308) Unify getting data schema without partition columns in FileSourceStrategy
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44508) Add user guide for Python UDTFs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45969) Document configuration change of executor failure tracker
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48709) varchar resolution mismatch for DataSourceV2 CTAS
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46861) Avoid Deadlock in DAGScheduler
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45078) The ArrayInsert function should make explicit casting when element type not equals derived component type
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47021) Fix `kvstore` module to have explicit `commons-lang3` test dependency
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46064) EliminateEventTimeWatermark does not consider the fact that isStreaming flag can change for current child during resolution
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48089) Streaming query listener not working in 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45989) Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in Python 3.11
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45250) Support stage level task resource profile for yarn cluster when dynamic allocation disabled
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48806) Pass actual exception when url_decode fails
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45360) Initialize spark session builder configuration from SPARK_REMOTE
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46640) RemoveRedundantAliases does not account for SubqueryExpression when removing aliases
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46779) Grouping by subquery with a cached relation can fail
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47318) AuthEngine key exchange needs additional KDF round
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47651) Better Documentation of Spark Remote Connect for Pyspark
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48138) Disable a flaky `SparkSessionE2ESuite.interrupt tag` test
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47840) Remove foldable propagation across Streaming Aggregate/Join nodes
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45445) Upgrade snappy to 1.1.10.5
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48934) Python datetime types converted incorrectly for setting timeout in applyInPandasWithState
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47921) Fix ExecuteJobTag creation in ExecuteHolder
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47146) Possible thread leak when doing sort merge join
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48991) FileStreamSink.hasMetadata handles invalid path
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49005) Use `17-jammy` instead of `17` to prevent Python 3.12
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48889) testStream should unload state stores before finishing
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48273) Late rewrite of PlanWithUnresolvedIdentifier
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47646) try_to_number fails with NPE for malformed input
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48173) CheckAnalsis should see the entire query plan
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47904) Preserve case in Avro schema when using enableStableIdentifiersForUnionType
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47561) fix analyzer rule order issues about Alias
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48642) False reported SparkOutOfMemoryError caused by killing task on spilling
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48498) always do char padding in predicates
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46335) Upgrade Maven to 3.9.6 for MNG-7913
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47774) Remove redundant rules from `MimaExcludes`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48719) Wrong Result in regr_slope®r_intercept Aggregate with Tuples has NULL
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48535) Update doc to log warning for join null related config usage
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48133) Run `sparkr` only in PR builders and Daily CIs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47494) Add migration doc for the behavior change of Parquet timestamp inference since Spark 3.3
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48484) V2Write use the same TaskAttemptId for different task attempts
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47428) Upgrade Jetty to 9.4.54.v20240208
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45357) Maven test `SparkConnectProtoSuite` failed
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47927) Nullability after join not respected in UDF
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48297) Char/Varchar breaks in TRANSFORM clause
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47734) Fix flaky pyspark.sql.dataframe.DataFrame.writeStream doctest by stopping streaming query
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47368) Remove inferTimestampNTZ config check in ParquetRowConverter
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47895) group by all should be idempotent
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45141) Pin `pyarrow==12.0.1` in CI
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48128) BitwiseCount / bit_count generated code for boolean inputs fails to compile
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48843) Infinite loop with GlobalLimit/BindParameters
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48109) Enable `k8s-integration-tests` only for `kubernetes` module change
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48608) Spark 3.5: fails to build with value defaultValueNotConstantError is not a member of object org.apache.spark.sql.errors.QueryCompilationErrors
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48391) use addAll instead of add function in TaskMetrics to accelerate
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47910) Memory leak when interrupting shuffle write using zstd compression
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48237) After executing `test-dependencies.sh`, the dir `dev/pr-deps` should be deleted
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47202) AttributeError: module 'pandas' has no attribute 'Timstamp'
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48197) avoid assert error for invalid lambda function
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48184) Always set the seed of dataframe.sample in Client side
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48494) Update `aircompressor` to 0.27
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48267) Regression e2e test with SPARK-47305
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47432) Add `pyarrow` upper bound requirement, `<13.0.0`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46957) Migrated shuffle data files from the decommissioned node should be removed when job completed
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48871) Fix INVALID_NON_DETERMINISTIC_EXPRESSIONS validation in CheckAnalysis
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46411) Change to use bcprov/bcpkix-jdk18on for test
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48068) `mypy` should have `--python-executable` parameter
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47125) Return null if Univocity never triggers parsing
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48428) IllegalStateException due to nested column aliasing
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48863) ClassCastException: class org.apache.spark.unsafe.types.UTF8String cannot be cast to class org.apache.spark.sql.catalyst.util.ArrayData when parsing JSON with "spark.sql.json.enablePartialResults" enabled
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48241) CSV parsing failure with char/varchar type columns
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48921) ScalaUDF in subquery should run through analyzer
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49000) Aggregation with DISTINCT gives wrong results when dealing with literals
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47790) Upgrade `commons-io` to 2.16.1
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48019) ColumnVectors with dictionaries and nulls are not read/copied correctly
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44619) Free up disk space for container jobs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47111) Upgrade `PostgreSQL` JDBC driver to 42.7.2 and docker image to 16.2
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44638) Unable to read from JDBC data sources when using custom schema containing varchar
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48666) A filter should not be pushed down if it contains Unevaluable expression
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47463) An error occurred while pushing down the filter of if expression for iceberg datasource.
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48845) GenericUDF Can not CatchException From Child UDFs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48586) Remove lock acquisition in doMaintenance() by making a deep copy of file mappings in RocksDBFileManager in load()
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47507) Upgrade ORC to 1.9.3
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48930) Redact `awsAccessKeyId` by including `accesskey` pattern
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48294) Make nestedTypeMissingElementTypeError case insensitive
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47537) Use MySQL Connector/J for MySQL DB instead of MariaDB Connector/J
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47305) PruneFilters incorrectly tags isStreaming flag when replacing child of Filter with LocalRelation
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48179) Pin `nbsphinx` to `0.9.3`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47762) Add pyspark.sql.connect.protobuf into setup.py
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47434) Streaming Statistics link redirect causing 302 error
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48081) Fix ClassCastException in NTile.checkInputDataTypes() when argument is non-foldable or of wrong type
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47385) Tuple encoder produces wrong results with Option inputs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48116) Run `pyspark-pandas*` only in PR builder and Daily Python CIs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49094) ignoreCorruptFiles file source option is partially supported for orc format
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49066) Reduce the effective scope of the configuration `spark.hadoop.hadoop.security.key.provider.path` in test scenarios
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48286) Analyze 'exists' default expression instead of 'current' default expression in structField to v2 column conversion
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47481) Fix Python linter
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47455) Fix Resource Handling of `scalaStyleOnCompileConfig` in SparkBuild.scala
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47172) Upgrade Transport block cipher mode to GCM
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48920) Upgrade ORC to 1.9.4
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47897) ExpressionSet performance regression in scala 2.12
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48481) OptimizeOneRowPlan should not be effective for streaming DataFrame
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47177) Cached SQL plan do not display final AQE plan in explain string
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47063) CAST long to timestamp has different behavior for codegen vs interpreted
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47847) Deprecate spark.network.remoteReadNioBufferConversion
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48016) Fix a bug in try_divide function when with decimals
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48791) Perf regression due to accumulator registration overhead using CopyOnWriteArrayList
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48248) Fix nested array to respect legacy conf of inferArrayTypeFromFirstElement
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48105) Fix the data corruption issue when state store unload and snapshotting happens concurrently for HDFS state store
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45201) NoClassDefFoundError: InternalFutureFailureAccess when compiling Spark 3.5.0
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47307) Spark 3.3 produces invalid base64
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48132) Run `k8s-integration-tests` only in PR builder and Daily CIs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47676) Clean up the removed `VersionsSuite` references
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48192) Enable TPC-DS and docker tests in forked repository
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48265) Infer window group limit batch should do constant folding
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47370) Add migration doc: TimestampNTZ type inference on Parquet files
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48178) Run `build/scala-213/java-11-17` jobs of branch-3.5 only if needed
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47770) Fix `GenerateMIMAIgnore.isPackagePrivateModule` to return false instead of failing
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48037) SortShuffleWriter lacks shuffle write related metrics resulting in potentially inaccurate data
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49179) Fix v2 multi bucketed inner joins throw AssertionError
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49099) Refactor CatalogManager.setCurrentNamespace
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45587) Skip UNIDOC and MIMA in build GitHub Action job
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47666) Fix NPE when reading mysql bit array as LongType
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49065) Rebasing in legacy formatters/parsers must support non JVM default time zones
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49381) Fix `SPARK-41388` test case to assert the result
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49294) The tip of shuffle-write-time checkbox is in a strange position.
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48172) Fix escaping issues in JDBCDialects
Dongjoon Hyun (Jira)
Earlier messages
Later messages