Messages by Thread
-
-
[jira] [Assigned] (SPARK-59774) Warn once, and name the remedy, when a whole-stage codegen method is too long to be JIT compiled
Max Gekk (Jira)
-
[jira] [Resolved] (SPARK-59774) Warn once, and name the remedy, when a whole-stage codegen method is too long to be JIT compiled
Max Gekk (Jira)
-
[jira] [Updated] (SPARK-59774) Warn once, and name the remedy, when a whole-stage codegen method is too long to be JIT compiled
Max Gekk (Jira)
-
[jira] [Resolved] (SPARK-59673) Floor the NAAJ broadcast threshold
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-59673) Floor the NAAJ broadcast threshold
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-59685) Preserve built-in ownership in the canonical SQL of clause-free SQL/JSON functions
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-59685) Preserve built-in ownership in the canonical SQL of clause-free SQL/JSON functions
Wenchen Fan (Jira)
-
[jira] [Assigned] (SPARK-59746) Improve golden file testing for hints
Jira
-
[jira] [Resolved] (SPARK-59746) Improve golden file testing for hints
Jira
-
[jira] [Assigned] (SPARK-59765) Codegen size checks over empty TPC-DS tables measure stubs for broadcast joins
Max Gekk (Jira)
-
[jira] [Resolved] (SPARK-59765) Codegen size checks over empty TPC-DS tables measure stubs for broadcast joins
Max Gekk (Jira)
-
[jira] [Updated] (SPARK-59781) PySpark Classic createDataFrame silently drops trailing values of rows longer than the schema when a field needs a Python-side converter
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59781) PySpark Classic createDataFrame silently drops trailing values of rows longer than the schema when a field needs a Python-side converter
Li Guo (Jira)
-
[jira] [Updated] (SPARK-56511) NPE in ShuffleInMemorySorter.getMemoryUsage() when reset() fails to reallocate array
Peter Toth (Jira)
-
[jira] [Created] (SPARK-59780) Use Java 27 toolchain while supporting Java 21+
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59780) Use Java 27 toolchain while supporting Java 21+
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59262) Add Java 27 to GitHub Actions
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59262) Add Java 27-ea to GitHub Actions
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59262) Add Java 27-ea to GitHub Actions
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59764) BenchmarkQueryTest.checkGeneratedCode checks nothing under adaptive query execution
Max Gekk (Jira)
-
[jira] [Resolved] (SPARK-59764) BenchmarkQueryTest.checkGeneratedCode checks nothing under adaptive query execution
Max Gekk (Jira)
-
[jira] [Assigned] (SPARK-59775) Upgrade `Gradle` to 9.8.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59775) Upgrade `Gradle` to 9.8.0
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59771) Release the Kueue `Workload` of `SparkApplication` only after its pods are gone
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59771) Release the Kueue `Workload` of `SparkApplication` only after its pods are gone
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59779) Document spark.sql.codegen.hugeMethodLimit as a tuning knob, or make it public
Max Gekk (Jira)
-
[jira] [Updated] (SPARK-59778) Add display-only properties to the Table API
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59778) Add display-only properties to the Table API
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-59755) Add ASV benchmarks for Arrow incremental aggregate and window UDF eval types
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-59755) Add ASV benchmarks for Arrow incremental aggregate and window UDF eval types
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-58626) Optimize evaluating inputs to transpiled UDFs
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-58626) Optimize evaluating inputs to transpiled UDFs
Holden Karau (Jira)
-
[jira] [Assigned] (SPARK-59069) Transpile Python UDFs with explicit positional-only parameters
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-59069) Transpile Python UDFs with explicit positional-only parameters
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-59069) Transpile Python UDFs with explicit positional-only parameters
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-8682) Range Join for Spark SQL
Yuming Wang (Jira)
-
[jira] [Assigned] (SPARK-59405) Improve & speedup XML validation on read path
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-59405) Improve & speedup XML validation on read path
Holden Karau (Jira)
-
[jira] [Commented] (SPARK-59405) Improve & speedup XML validation on read path
Holden Karau (Jira)
-
[jira] [Reopened] (SPARK-59405) Improve & speedup XML validation on read path
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-59405) Improve & speedup XML validation on read path
Holden Karau (Jira)
-
[jira] [Updated] (SPARK-59406) Fix UI display on weird custom log names
Holden Karau (Jira)
-
[jira] [Commented] (SPARK-59406) Fix UI display on weird custom log names
Holden Karau (Jira)
-
[jira] [Created] (SPARK-59776) Dynamic allocation shuffle tracking never releases executors when SQL shuffle file cleanup is enabled
Saurabh Damle (Jira)
-
[jira] [Updated] (SPARK-59777) Fix timing metrics for reused Python workers
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-59777) Fix timing metrics for reused Python workers
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-59775) Upgrade `Gradle` to 9.8.0
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59553) Make SparkSession.addArtifact honor spark.jars.ivySettings
Qianlan Chen (Jira)
-
[jira] [Created] (SPARK-59775) Upgrade `Gradle` to 9.8.0
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59763) Annotate `TokenIngestor` with `@Private` instead of `@DeveloperApi`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59763) Annotate `TokenIngestor` with `@Private` instead of `@DeveloperApi`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59773) Add versioned Python worker metrics reports
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-59772) Improve Python UDF worker metrics collection and reporting
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-59774) Log at WARN, and name the remedy, when a generated method is too long to be JIT compiled
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59774) Log at WARN, and name the remedy, when a generated method is too long to be JIT compiled
Max Gekk (Jira)
-
[jira] [Updated] (SPARK-59771) Release the Kueue `Workload` of `SparkApplication` only after its pods are gone
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59772) Improve Python UDF worker metrics collection and reporting
Haotian Sun (Jira)
-
[jira] [Created] (SPARK-59771) Release the Kueue `Workload` of `SparkApplication` only after its pods are gone
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59773) Add versioned Python worker metrics reports
Haotian Sun (Jira)
-
[jira] [Resolved] (SPARK-59770) Add `ValidatingAdmissionPolicy` to keep the Kueue queue of started `Spark(Application|Cluster)`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59770) Add `ValidatingAdmissionPolicy` to keep the Kueue queue of started `Spark(Application|Cluster)`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59769) Apply the flavors of an admitted Kueue `Workload` to a resource whose queue label was removed
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59769) Apply the flavors of an admitted Kueue `Workload` to a resource whose queue label was removed
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59770) Add `ValidatingAdmissionPolicy` to keep the Kueue queue of started `Spark(Application|Cluster)`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59770) Add `ValidatingAdmissionPolicy` to keep the Kueue queue of started `Spark(Application|Cluster)`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59769) Apply the flavors of an admitted Kueue `Workload` to a resource whose queue label was removed
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59766) Make a pending Kueue `Workload` follow the changed or removed queue label
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59769) Keep the admitted Kueue flavors when the queue label is removed after the admission
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-59768) Audit foldability property for sql expressions
Nick Young (Jira)
-
[jira] [Created] (SPARK-59768) Audit foldability property for sql expressions
Nick Young (Jira)
-
[jira] [Updated] (SPARK-59763) Annotate `TokenIngestor` with `@Private` instead of `@DeveloperApi`
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59764) BenchmarkQueryTest.checkGeneratedCode checks nothing under adaptive query execution
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59767) Consolidate `Kueue` integration tests into the `kueue` E2E test
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59767) Consolidate `Kueue` integration tests into the `kueue` E2E test
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59631) Persisted V1 time-travel relations are recached after table writes
Wenchen Fan (Jira)
-
[jira] [Resolved] (SPARK-59631) Persisted V1 time-travel relations are recached after table writes
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-59767) Consolidate `Kueue` integration tests into the `kueue` E2E test
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59767) Consolidate `Kueue` integration tests into the `kueue` E2E test
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59766) Make a pending Kueue `Workload` follow the changed or removed queue label
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59766) Make a pending Kueue `Workload` follow the changed or removed queue label
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59766) Make a pending Kueue `Workload` follow the changed or removed queue label
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59749) ASOF JOIN MATCH_CONDITION rejects empty STRUCT operands accepted by the comparison operator
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59760) Add `spark.kubernetes.operator.kueue.enabled` to disable the Kueue integration by default
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59765) Codegen size checks over empty TPC-DS tables measure stubs for broadcast joins
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59765) Codegen size checks over empty TPC-DS tables measure stubs for broadcast joins
Max Gekk (Jira)
-
[jira] [Commented] (SPARK-56249) Auto CDC support
melin (Jira)
-
[jira] [Created] (SPARK-59764) BenchmarkQueryTest.checkGeneratedCode checks nothing under adaptive query execution
Max Gekk (Jira)
-
[jira] (SPARK-56249) Auto CDC support
melin (Jira)
-
[jira] [Updated] (SPARK-56249) Auto CDC support
melin (Jira)
-
[jira] [Created] (SPARK-59763) Annotate `TokenIngestor` with `@Private` instead of `@DeveloperApi`
Kousuke Saruta (Jira)
-
[jira] [Assigned] (SPARK-59760) Add `spark.kubernetes.operator.kueue.enabled` to disable the Kueue integration by default
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59758) Release the Kueue `Workload` of a stopped `SparkApplication` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59758) Release the Kueue `Workload` of a stopped `SparkApplication` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59762) Release Python UDF init message before processing rows
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59762) Release Python UDF init message before processing rows
Craiu Constantin-Tiberiu (Jira)
-
[jira] [Updated] (SPARK-59761) Improve set variable test coverage
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59760) Release the Kueue `Workload` of a stopped `SparkApplication` regardless of the queue label
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59761) Improve set variable test coverage
Jira
-
[jira] [Updated] (SPARK-59760) Add `spark.kubernetes.operator.kueue.enabled` to disable the Kueue integration by default
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59758) Release the Kueue `Workload` of a stopped `SparkApplication` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59760) .
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59760) Release the Kueue `Workload` of a stopped `SparkApplication` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59754) Release the Kueue `Workload` of suspended `Spark(Application|Cluster)` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59754) Release the Kueue `Workload` of suspended `Spark(Application|Cluster)` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59754) Release the Kueue `Workload` of suspended `Spark(Application|Cluster)` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59758) Release the Kueue `Workload` of a terminated `SparkApplication` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59758) Release the Kueue `Workload` of suspended `Spark(Application|Cluster)` regardless of the queue label
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59759) Support Spark accumulator updates in unified external UDF execution
Haiyang Sun (Jira)
-
[jira] [Created] (SPARK-59758) Release the Kueue `Workload` of a terminated `SparkApplication` regardless of the queue label
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59512) StructField.fromJson mutates collation metadata and fails on repeated parsing
Jira
-
[jira] [Assigned] (SPARK-59512) StructField.fromJson mutates collation metadata and fails on repeated parsing
Jira
-
[jira] [Resolved] (SPARK-59512) StructField.fromJson mutates collation metadata and fails on repeated parsing
Jira
-
[jira] [Updated] (SPARK-59757) Fix NPE in BytesToBytesMap after failed reset during spill
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59757) Fix NPE in BytesToBytesMap after failed reset during spill
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-59756) Make Utils.chmod700 atomic on POSIX FS
Holden Karau (Jira)
-
[jira] [Resolved] (SPARK-59508) Harden client safety with restricted unpickle serializer
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-59508) Harden client safety with restricted unpickle serializer
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-59703) Update the dependency list for nogil docker image
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-59703) Update the dependency list for nogil docker image
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-59645) SCD1 Ignore-null support; Refactor SCD1 microbatch reconciliation into strategies
Szehon Ho (Jira)
-
[jira] [Assigned] (SPARK-59645) SCD1 Ignore-null support; Refactor SCD1 microbatch reconciliation into strategies
Szehon Ho (Jira)
-
[jira] [Assigned] (SPARK-58989) Replace pyspark-install with pyspark-scheduled and put some tests in it
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-58989) Replace pyspark-install with pyspark-scheduled and put some tests in it
Tian Gao (Jira)
-
[jira] [Resolved] (SPARK-59705) Clean up the dependency list for pandas 3 docker image
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-59705) Clean up the dependency list for pandas 3 docker image
Tian Gao (Jira)
-
[jira] [Assigned] (SPARK-59689) Run EXECUTE IMMEDIATE commands at execution time instead of during analysis
Jira
-
[jira] [Resolved] (SPARK-59689) Run EXECUTE IMMEDIATE commands at execution time instead of during analysis
Jira
-
[jira] [Updated] (SPARK-59755) Add ASV benchmarks for Arrow incremental aggregate and window UDF eval types
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59624) Move element-wise UDF conversion behind Arrow batch interfaces
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-59624) Move element-wise UDF conversion behind Arrow batch interfaces
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-59624) Move element-wise UDF conversion behind Arrow batch interfaces
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-59755) Add ASV benchmarks for Arrow incremental aggregate and window UDF eval types
Yicong Huang (Jira)
-
[jira] [Updated] (SPARK-59721) Fall back to unknown partitioning instead of failing when a reported partition key cannot be resolved
Anurag Mantripragada (Jira)
-
[jira] [Assigned] (SPARK-31760) Simplification Based on Containment
Jira
-
[jira] [Updated] (SPARK-59605) ORC filter pushdown fails on an `IN` list containing `NULL`
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59719) Mark CheckOverflow as null-intolerant to match MakeDecimal
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59719) Mark CheckOverflow as null-intolerant to match MakeDecimal
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59733) Cover the p=7/8 boundary in nanosecond timestamp widening
Jira
-
[jira] [Commented] (SPARK-44426) optimize adaptive skew join for ExistenceJoin
Jaromir Vanek (Jira)
-
[jira] [Assigned] (SPARK-59733) Cover the p=7/8 boundary in nanosecond timestamp widening
Jira
-
[jira] [Updated] (SPARK-59754) Release the Kueue `Workload` of a suspended `SparkCluster` regardless of its queue label
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59754) Release the Kueue `Workload` of a suspended `SparkCluster` regardless of its queue label
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59753) Upgrade Java Operator SDK to 5.6.2
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59753) Upgrade Java Operator SDK to 5.6.2
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59753) Upgrade Java Operator SDK to 5.6.2
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59753) Upgrade Java Operator SDK to 5.6.2
Dongjoon Hyun (Jira)
-
[jira] [Commented] (SPARK-59751) Preserve CHAR/VARCHAR scan policy across cache mutation, refresh, and rename
Serge Rielau (Jira)
-
[jira] [Assigned] (SPARK-59750) Support `spec.suspend` for a running `SparkCluster`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59750) Support `spec.suspend` for a running `SparkCluster`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59752) dev/scalastyle drops GitHub annotations for scalastyle checkers that report a column (e.g. nonascii)
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59752) dev/scalastyle drops GitHub annotations for scalastyle checkers that report a column (e.g. nonascii)
Rajesh Vakkalagadda (Jira)
-
[jira] [Updated] (SPARK-59527) ASOF JOIN MATCH_CONDITION rejects DATE vs STRING accepted by the comparison operator
Jira
-
[jira] [Updated] (SPARK-59736) Use `Swift 6.4` Docker image in all Linux CI jobs
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59737) Ban `sun.misc.Signal` usage except `SignalUtils`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59737) Ban `sun.misc.Signal` usage except `SignalUtils`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59751) Preserve CHAR/VARCHAR scan policy across cache mutation, refresh, and rename
Serge Rielau (Jira)
-
[jira] [Resolved] (SPARK-59735) Use `static-debian13` distroless image in `Examples`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59735) Use `static-debian13` distroless image in `Examples`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59736) Use `Swift 6.4` Docker image in all Linux CI jobs
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59736) Use `Swift 6.4` Docker image in all Linux CI jobs
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59750) Support `spec.suspend` for a running `SparkCluster`
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59750) Support `spec.suspend` for a running `SparkCluster`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59743) Consolidate `Helm Tests` matrix jobs into a single job
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59743) Consolidate `Helm Tests` matrix jobs into a single job
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59529) ASOF JOIN MATCH_CONDITION accepts a constant operand referencing no join input
Jira
-
[jira] [Resolved] (SPARK-59734) Deprecate the unused `resourceRetainPolicy` parameter of `ApplicationStatus.terminateOrRestart`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59734) Deprecate the unused `resourceRetainPolicy` parameter of `ApplicationStatus.terminateOrRestart`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59743) Consolidate `Helm Tests` matrix jobs into a single job
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59744) Execute scalar external UDFs through worker sessions
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59742) Build the operator image once and share it via artifact in CI
Dongjoon Hyun (Jira)