issues
Thread
Date
Earlier messages
Later messages
Messages by Date
2026/02/15
[jira] [Closed] (SPARK-45124) Do not use local user ID for Local Relations
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45071) Optimize the processing speed of `BinaryArithmetic#dataType` when processing multi-column data
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45764) Make code block copyable
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46014) Run RocksDBStateStoreStreamingAggregationSuite on a dedicated JVM
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45237) Correct the default value of `spark.history.store.hybridStore.diskBackend` in `monitoring.md`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46562) Remove retrieval of `keytabFile` from `UserGroupInformation` in `HiveAuthFactory`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46425) Pin the bundler version in CI
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45975) STORE_ASSIGNMENT_POLICY should be reset in HiveCompatibilitySuite
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45631) Broken backward compatibility in PySpark: StreamingQueryListener due to the addition of onQueryIdle
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46945) Add `spark.kubernetes.legacy.useReadWriteOnceAccessMode` for old K8s clusters
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46789) Add `VolumeSuite` to K8s IT
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45211) Scala 2.13 daily test failed
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45383) Missing case for RelationTimeTravel in CheckAnalysis
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45847) CliSuite flakiness due to non-sequential guarantee for stdout&stderr
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46274) Range operator computeStats() proper long conversions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46786) Fix MountVolumesFeatureStep to use ReadWriteOncePod instead of ReadWriteOnce
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44725) Document spark.network.timeoutInterval
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45182) Ignore task completion from old stage after retrying indeterminate stages
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45473) Incorrect error message for RoundBase
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46535) NPE when describe extended a column without col stats
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46577) HiveMetastoreLazyInitializationSuite leaks hive's SessionState
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45508) Add "--add-opens=java.base/jdk.internal.ref=ALL-UNNAMED" so Platform can access cleaner on Java 9+
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46029) Escape the single quote, _ and % for DS V2 pushdown
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47023) Upgrade `aircompressor` to 0.26
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46769) Refine timestamp related schema inference
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45449) Cache Invalidation Issue with JDBC Table
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46684) CoGroup.applyInPandas/Arrow should pass arguments properly
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45538) pyspark connect overwrite_partitions bug
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45592) AQE and InMemoryTableScanExec correctness bug
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46888) Fix `Master` to reject worker kill request if decommission is disabled
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46817) Fix `spark-daemon.sh` usage by adding `decommission` command
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45568) WholeStageCodegenSparkSubmitSuite flakiness
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45433) CSV/JSON schema inference when timestamps do not match specified timestampFormat with only one row on each partition report error
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45678) Cover BufferReleasingInputStream.available under tryOrFetchFailedException
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45963) Restore documentation for DSv2 API
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45961) Document `spark.master.*` configurations
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44833) Spark Connect reattach when initial ExecutePlan didn't reach server doing too eager Reattach
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46019) Fix HiveThriftServer2ListenerSuite and ThriftServerPageSuite to create java.io.tmpdir if it doesn't exist
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45189) Creating UnresolvedRelation from TableIdentifier should include the catalog field
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45081) Encoders.bean does no longer work with read-only properties
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46602) CREATE VIEW IF NOT EXISTS should never throw `TABLE_OR_VIEW_ALREADY_EXISTS` exception
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45424) Regression in CSV schema inference when timestamps do not match specified timestampFormat
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45829) The default value of ‘spark.executor.logs.rolling.maxSize' on the official website is incorrect
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45604) Converting timestamp_ntz to array<timestamp_ntz> can cause NPE or SEGFAULT on parquet vectorized reader
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46590) Coalesce partiton assert error after skew join optimization
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45974) Add scan.filterAttributes non-empty judgment for RowLevelOperationRuntimeGroupFiltering
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44495) Use the latest minikube in K8s IT
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45495) Support stage level task resource profile for k8s cluster when dynamic allocation disabled
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45291) Use unknown query execution id instead of no such app when id is invalid
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45878) ConcurrentModificationException in CliSuite
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46033) Fix flaky ArithmeticExpressionSuite
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44880) Remove unnecessary curly braces at the end of the thread locks info
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45498) Followup: Ignore task completion from old stage after retrying indeterminate stages
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46893) Remove inline scripts from UI descriptions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46443) Decimal precision and scale should decided by JDBC dialect.
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44843) flaky test: RocksDBStateStoreStreamingAggregationSuite
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-40154) PySpark: DataFrame.cache docstring gives wrong storage level
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45050) Improve error message for UNKNOWN io.grpc.StatusRuntimeException
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46763) ReplaceDeduplicateWithAggregate fails when non-grouping keys have duplicate attributes
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45640) Fix flaky ProtobufCatalystDataConversionSuite
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45306) Make `InMemoryColumnarBenchmark` use AQE-aware utils to collect plans
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46862) Incorrect count() of a dataframe loaded from CSV datasource
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45430) FramelessOffsetWindowFunctionFrame fails when ignore nulls and offset > # of rows
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47022) Fix `connect/client/jvm` to have explicit `commons-lang3` test dependency
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47206) Add official image Dockerfile for Apache Spark 3.5.1
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44872) Testing reattachable execute
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46663) Disable memory profiler for pandas UDFs with iterators
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46369) Remove `kill` link from RELAUNCHING drivers in MasterPage
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46855) Add `sketch` to the dependencies of the `catalyst` module in `module.py`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44840) array_insert() give wrong results for ngative index
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46676) dropDuplicatesWithinWatermark throws error on canonicalizing plan
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46095) Document REST API for Spark Standalone Cluster
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45735) Reenable CatalogTests without Spark Connect
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44742) Add Spark version drop down to the PySpark doc site
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45057) Deadlock caused by rdd replication level of 2
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46464) Fix the scroll issue of tables when overflow
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45311) Encoder fails on many "NoSuchElementException: None.get" since 3.4.x, search for an encoder for a generic type, and since 3.5.x isn't "an expression encoder"
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46700) count the last spilling for the shuffle disk spilling bytes metric
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45652) SPJ: Handle empty input partitions after dynamic filtering
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46546) Fix the formatting of tables in `running-on-yarn` pages
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45588) Minor scaladoc improvement in StreamingForeachBatchHelper
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46275) Protobuf: Permissive mode should return null rather than struct with null fields
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45389) Correct MetaException matching rule on getting partition metadata
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45386) Correctness issue when persisting using StorageLevel.NONE
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45585) Fix time format and redirection issues in SparkSubmit tests
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45132) Fix IDENTIFIER clause for functions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46400) When there are corrupted files in the local maven repo, retry to skip this cache
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45543) InferWindowGroupLimit causes bug if the other window functions haven't the same window frame as the rank-like functions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45484) Fix the bug that uses incorrect parquet compression codec lz4raw
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45167) Python Spark Connect client does not call `releaseAll`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45883) Upgrade ORC to 1.9.2
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45786) Inaccurate Decimal multiplication and division results
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45171) GenerateExec fails to initialize non-deterministic expressions before use
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45371) FIx shading problem in Spark Connect
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45187) Fix WorkerPage to use the same pattern for `logPage` urls
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45553) Deprecate assertPandasOnSparkEqual
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45286) Add back Matomo analytics to release docs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45934) Fix `Spark Standalone` documentation table layout
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46182) Shuffle data lost on decommissioned executor caused by race condition between lastTaskRunningTime and lastShuffleMigrationTime
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46006) YarnAllocator miss clean targetNumExecutorsPerResourceProfileId after YarnSchedulerBackend call stop
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46062) CTE reference node does not inherit the flag `isStreaming` from CTE definition node
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46953) Wrap withTable for a test in ResolveDefaultColumnsSuite
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45882) BroadcastHashJoinExec propagate partitioning should respect CoalescedHashPartitioning
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45814) ArrowConverters.createEmptyArrowBatch may cause memory leak
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49054) Column default value should support current_* functions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47085) Preformance issue on thrift API
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47299) Use the same `versions. json` in the dropdown of different versions of PySpark documents
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46189) Various Pandas functions fail in interpreted mode
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46339) Directory with number name should not be treated as metadata log
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48034) NullPointerException in MapStatusesSerDeserBenchmark
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44805) Data lost after union using spark.sql.parquet.enableNestedColumnVectorizedReader=true
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45706) Makes entire Binder build fails fast during setting up
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45599) Percentile can produce a wrong answer if -0.0 and 0.0 are mixed in the dataset
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48610) Remove ExplainUtils.processPlan synchronize
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47236) Fix `deleteRecursivelyUsingJavaIO` to skip non-existing file
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46610) Create table should throw exception when no value for a key in options
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-41086) Consolidate SecondArgumentXXX error to INVALID_PARAMETER_VALUE
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46170) Support inject adaptive query post planner strategy rules in SparkSessionExtensions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47521) Use `Utils.tryWithResource` during reading shuffle data from external storage
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47072) Wrong error message for incorrect ANSI intervals
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45117) Implement missing otherCopyArgs for the MultiCommutativeOp expression
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48086) Different Arrow versions in client and server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46092) Overflow in Parquet row group filter creation causes incorrect results
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45593) Building a runnable distribution from master code running spark-sql raise error "java.lang.ClassNotFoundException: org.sparkproject.guava.util.concurrent.internal.InternalFutureFailureAccess"
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47083) Upgrade `commons-codec` to 1.16.1
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-43393) Sequence expression can overflow
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45419) Avoid reusing rocksdb sst files in a dfferent rocksdb instance by removing file version map entry of larger versions
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46796) RocksDB versionID Mismatch in SST files
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45016) Add missing `try_remote_functions` annotations
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48167) Skip known behaviour change by SPARK-46122
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48308) Unify getting data schema without partition columns in FileSourceStrategy
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-44508) Add user guide for Python UDTFs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46598) OrcColumnarBatchReader should respect the memory mode when creating column vectors for the missing column
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-39910) DataFrameReader API cannot read files from hadoop archives (.har)
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45969) Document configuration change of executor failure tracker
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48709) varchar resolution mismatch for DataSourceV2 CTAS
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46861) Avoid Deadlock in DAGScheduler
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46801) Do not treat exit 5 as a test failure in Python testing script
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45078) The ArrayInsert function should make explicit casting when element type not equals derived component type
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47021) Fix `kvstore` module to have explicit `commons-lang3` test dependency
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46064) EliminateEventTimeWatermark does not consider the fact that isStreaming flag can change for current child during resolution
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48089) Streaming query listener not working in 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45989) Fix `pyspark.pandas.tests.connect.computation.test_parity_apply_func` in Python 3.11
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45250) Support stage level task resource profile for yarn cluster when dynamic allocation disabled
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48806) Pass actual exception when url_decode fails
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45360) Initialize spark session builder configuration from SPARK_REMOTE
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45670) SparkSubmit does not support --total-executor-cores when deploying on K8s
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46640) RemoveRedundantAliases does not account for SubqueryExpression when removing aliases
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46779) Grouping by subquery with a cached relation can fail
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47318) AuthEngine key exchange needs additional KDF round
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47651) Better Documentation of Spark Remote Connect for Pyspark
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47398) AQE doesn't allow for extension of InMemoryTableScanExec
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47825) Make `KinesisTestUtils` & `WriteInputFormatTestDataGenerator` deprecated
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47636) Use Java 17 instead of 17-jre image in K8s Dockerfile
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48138) Disable a flaky `SparkSessionE2ESuite.interrupt tag` test
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47840) Remove foldable propagation across Streaming Aggregate/Join nodes
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45445) Upgrade snappy to 1.1.10.5
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48934) Python datetime types converted incorrectly for setting timeout in applyInPandasWithState
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47921) Fix ExecuteJobTag creation in ExecuteHolder
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47146) Possible thread leak when doing sort merge join
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47435) SPARK-45561 causes mysql unsigned tinyint overflow
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48991) FileStreamSink.hasMetadata handles invalid path
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-49005) Use `17-jammy` instead of `17` to prevent Python 3.12
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48889) testStream should unload state stores before finishing
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48273) Late rewrite of PlanWithUnresolvedIdentifier
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47646) try_to_number fails with NPE for malformed input
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48087) Python UDTF incompatibility in 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48173) CheckAnalsis should see the entire query plan
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47904) Preserve case in Avro schema when using enableStableIdentifiersForUnionType
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47828) DataFrameWriterV2.overwrite fails with invalid plan
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47561) fix analyzer rule order issues about Alias
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48642) False reported SparkOutOfMemoryError caused by killing task on spilling
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48498) always do char padding in predicates
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-46335) Upgrade Maven to 3.9.6 for MNG-7913
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48090) Streaming exception catch failure in 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47774) Remove redundant rules from `MimaExcludes`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47036) RocksDB versionID Mismatch in SST files with Compaction
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48719) Wrong Result in regr_slope®r_intercept Aggregate with Tuples has NULL
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48292) Revert [SPARK-39195][SQL] Spark OutputCommitCoordinator should abort stage when committed file not consistent with task status
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48535) Update doc to log warning for join null related config usage
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48133) Run `sparkr` only in PR builders and Daily CIs
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47494) Add migration doc for the behavior change of Parquet timestamp inference since Spark 3.3
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48484) V2Write use the same TaskAttemptId for different task attempts
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47428) Upgrade Jetty to 9.4.54.v20240208
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45357) Maven test `SparkConnectProtoSuite` failed
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47927) Nullability after join not respected in UDF
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48083) session.copyFromLocalToFs failure with 3.5 client <> 4.0 server
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47824) Nondeterminism in pyspark.pandas.series.asof
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48297) Char/Varchar breaks in TRANSFORM clause
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47440) SQLServer does not support LIKE operator in binary comparison
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47734) Fix flaky pyspark.sql.dataframe.DataFrame.writeStream doctest by stopping streaming query
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45988) Fix `pyspark.pandas.tests.computation.test_apply_func` in Python 3.11
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47068) Recover -1 and 0 case for spark.sql.execution.arrow.maxRecordsPerBatch
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47633) Cache miss for queries using JOIN LATERAL with join condition
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47368) Remove inferTimestampNTZ config check in ParquetRowConverter
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47895) group by all should be idempotent
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-45141) Pin `pyarrow==12.0.1` in CI
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-47182) Exclude `commons-(io|lang3)` transitive dependencies from `commons-compress` and `avro-*`
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48128) BitwiseCount / bit_count generated code for boolean inputs fails to compile
Dongjoon Hyun (Jira)
2026/02/15
[jira] [Closed] (SPARK-48843) Infinite loop with GlobalLimit/BindParameters
Dongjoon Hyun (Jira)
Earlier messages
Later messages