Messages by Thread
-
-
[jira] [Created] (SPARK-59594) Release Kueue `Workload` when `AppCleanUpStep` releases `SparkApplication` resources
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59593) Add opt-in Kueue `Workload` informer
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59593) Add opt-in Kueue `Workload` informer
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59585) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59585) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59588) Add `KueueWorkloadUtils` to request admission and release Kueue Workloads
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59588) Add `KueueWorkloadUtils` to request admission and release Kueue Workloads
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59586) Support `spark.kubernetes.operator.events.excludedReasons` to skip K8s events by reason
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59586) Support `spark.kubernetes.operator.events.excludedReasons` to skip K8s events by reason
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59592) Use Java 21 at least in CI
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59592) Use Java 21 at least in CI
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59122) UnionExec fused into whole-stage codegen can fail with "key not found: numOutputRows"
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-57901) Add documentation about OIDC Credential Propagation
ASF GitHub Bot (Jira)
-
[jira] [Commented] (SPARK-59272) Revalidate the storage-partitioned join pairing when a regrouped side drops the keyed claim
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59591) Add integration tests with Swift 6.4
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59591) Add integration tests with Swift 6.4
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59592) Use Java 21 at least in CI
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59592) Use Java 21 at least in CI
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59590) Remove unnecessary `try` keywords reported by Swift 6.4
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59590) Remove unnecessary `try` keywords reported by Swift 6.4
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59583) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59583) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59579) Keep the conditional-branch guards after the subexpression elimination shortcut peel
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59591) Add integration tests with Swift 6.4
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59591) Add integration tests with Swift 6.4
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59590) Remove unnecessary `try` keywords reported by Swift 6.4
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59590) Remove unnecessary `try` keywords reported by Swift 6.4
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59589) Hand Expand's varying output columns to the consumer as globals
Yang Jie (Jira)
-
[jira] [Created] (SPARK-59588) Add `KueueWorkloadUtils` to request admission and release Kueue Workloads
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59588) Add `KueueWorkloadUtils` to request admission and release Kueue Workloads
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59555) Fix flaky DataFrameReader.json doctest by sorting multi-directory read
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-59584) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59587) Narrow Helm RBAC verbs for `events` to `create|get|patch`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59587) Narrow Helm RBAC verbs for `events` to `get`, `create` and `patch`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59587) Narrow Helm RBAC verbs for `events` to `get`, `create` and `patch`
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59584) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59586) Support `spark.kubernetes.operator.events.excludedReasons` to skip K8s events by reason
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59586) Support `spark.kubernetes.operator.events.excludedReasons` to skip K8s events by reason
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59015) Rebind refreshed DSv2 relations to the current table schema
Gengliang Wang (Jira)
-
[jira] [Resolved] (SPARK-59015) Rebind refreshed DSv2 relations to the current table schema
Gengliang Wang (Jira)
-
[jira] [Updated] (SPARK-59585) Upgrade `actions/checkout` to v7
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59585) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59584) Upgrade `actions/checkout` to v7
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59584) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59583) Upgrade `actions/checkout` to v7
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59583) Upgrade `actions/checkout` to v7
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59401) Read INT96 TIMESTAMP(MICROS) columns as nanosecond timestamps
Jira
-
[jira] [Created] (SPARK-59575) Storage-partitioned join is lost when a marked layout's declared key order is not sorted
Peter Toth (Jira)
-
[jira] [Created] (SPARK-59582) Include External Engine SQL state in External Engine alert
Alek Jarmov (Jira)
-
[jira] [Updated] (SPARK-59576) Support K8s `Normal` events for all `SparkApplication` and `SparkCluster` state transitions
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59576) Support K8s `Normal` events for all `SparkApplication` and `SparkCluster` state transitions
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59576) Support K8s `Normal` events for all `SparkApplication` and `SparkCluster` state transitions
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59580) TreeNode construction allocates unused cache state
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59581) Avoid copying every input row in TakeOrderedAndProject top-N
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59581) Avoid copying every input row in TakeOrderedAndProject top-N
David Mollitor (Jira)
-
[jira] [Updated] (SPARK-44702) Cannot derive ExpressionEncoder when using types tagged by a trait
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59580) TreeNode construction allocates unused cache state
Ben Hollis (Jira)
-
[jira] [Created] (SPARK-59579) Keep the conditional-branch guards after the subexpression elimination shortcut peel
Yang Jie (Jira)
-
[jira] [Resolved] (SPARK-59555) Fix flaky DataFrameReader.json doctest by sorting multi-directory read
Yicong Huang (Jira)
-
[jira] [Resolved] (SPARK-59031) Support best-effort Spark Connect commands that no-op when the server does not implement the API
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-59540) Warn about deprecated Helm `enable` keys via `NOTES.txt`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59540) Warn about deprecated Helm `enable` keys via `NOTES.txt`
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59540) Warn about deprecated Helm `enable` keys via `NOTES.txt`
Dongjoon Hyun (Jira)
-
[jira] [Resolved] (SPARK-59559) Add `kueue` E2E test for resources without `kueue.x-k8s.io/queue-name`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59559) Add `kueue` E2E test for resources without `kueue.x-k8s.io/queue-name`
Dongjoon Hyun (Jira)
-
[jira] [Created] (SPARK-59578) Clarify the Kueue `integrations.externalFrameworks` recommendation in `docs/operations.md`
Peter Toth (Jira)
-
[jira] [Created] (SPARK-59576) Support K8s `Normal` events for all `SparkApplication` and `SparkCluster` state transitions
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59577) Add Python test Dockerfiles to pyspark-core test module
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59577) Add Python test Dockerfiles to pyspark-core test module
Nicholas Chammas (Jira)
-
[jira] [Resolved] (SPARK-59562) Fix stale values in reused multinomial logistic aggregation buffer
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-59562) Fix stale values in reused multinomial logistic aggregation buffer
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59554) Support the TIME data type in the count_min_sketch function
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59573) Fix multi-value UNPIVOT with mixed types
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59502) Support K8s `Warning` events for `SparkApplication` and `SparkCluster` failures
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59502) Support K8s `Warning` events for `SparkApplication` and `SparkCluster` failures
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59502) Support Kubernetes `Warning` events for `SparkApplication` and `SparkCluster` failures
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59502) Support K8s `Warning` events for `SparkApplication` and `SparkCluster` failures
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59401) Read INT96 TIMESTAMP(MICROS) columns as nanosecond timestamps
Jira
-
[jira] [Updated] (SPARK-59575) Storage-partitioned join is lost when a marked layout's declared key order is not sorted
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59054) Fix KeyGroupedPartitioner to compare partition keys by value in storage-partitioned join shuffles
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59574) Single-pass Analyzer does not apply injectHintResolutionRule
ASF GitHub Bot (Jira)
-
[jira] [Resolved] (SPARK-59298) ASOF JOIN production-readiness: improve test coverage and QA
Luka Zdravic (Jira)
-
[jira] [Created] (SPARK-59574) Single-pass Analyzer does not apply injectHintResolutionRule
Simon Maling (Jira)
-
[jira] [Resolved] (SPARK-58481) InSubqueryExec declares incorrect nullability, which can cause incorrect query results
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-59571) Cover every TIME precision, null pattern and interval sign in ArrowCachedBatchSerializerSuite
Max Gekk (Jira)
-
[jira] [Updated] (SPARK-59566) Create test module for sbin scripts
Nicholas Chammas (Jira)
-
[jira] [Assigned] (SPARK-59438) Add planner-stage test coverage for ASOF JOIN sort-merge operator
Jira
-
[jira] [Resolved] (SPARK-59438) Add planner-stage test coverage for ASOF JOIN sort-merge operator
Jira
-
[jira] [Updated] (SPARK-57833) Support nanosecond-precision timestamps in the timestampadd and timestampdiff functions
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59493) Add execution-metric test coverage for the ASOF JOIN sort-merge operator
Jira
-
[jira] [Resolved] (SPARK-59493) Add execution-metric test coverage for the ASOF JOIN sort-merge operator
Jira
-
[jira] [Created] (SPARK-59573) Fix multi-value UNPIVOT with mixed types
Stevo Mitric (Jira)
-
[jira] [Updated] (SPARK-59534) Support implicit casting for time_bucket timestamp arguments
ASF GitHub Bot (Jira)
-
[jira] [Assigned] (SPARK-59536) Parse hint-shaped comments nested in bracketed comments
Jira
-
[jira] [Resolved] (SPARK-59536) Parse hint-shaped comments nested in bracketed comments
Jira
-
[jira] [Updated] (SPARK-59572) PartitionPredicate evaluation failure must not be reported as a partition match
Cheng Pan (Jira)
-
[jira] [Created] (SPARK-59561) ExecutorAllocationManager permanently stalls if a SparkListenerStageSubmitted event is dropped from the executorManagement queue
dongjunhwang (Jira)
-
[jira] [Reopened] (SPARK-59272) Revalidate the storage-partitioned join pairing when a regrouped side drops the keyed claim
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59571) Cover every TIME precision, null pattern and interval sign in ArrowCachedBatchSerializerSuite
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59572) PartitionPredicate evaluation failure must not be reported as a partition match
Cheng Pan (Jira)
-
[jira] [Updated] (SPARK-58532) Use native functions for NumPy functions
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59570) Migrate from `source_file_regexes` to PurePath patterns
Nicholas Chammas (Jira)
-
[jira] [Created] (SPARK-59569) Add support for shell script test goals
Nicholas Chammas (Jira)
-
[jira] [Created] (SPARK-59568) Create Scala linter test module
Nicholas Chammas (Jira)
-
[jira] [Updated] (SPARK-59494) Memoize a join condition's common expression instead of inlining it into every reference
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59567) Create Python linter test module
Nicholas Chammas (Jira)
-
[jira] [Created] (SPARK-59565) Ensure that ignored files are not also included in test modules
Nicholas Chammas (Jira)
-
[jira] [Created] (SPARK-59566) Create test module for sbin scripts
Nicholas Chammas (Jira)
-
[jira] [Updated] (SPARK-59562) Fix stale values in reused multinomial logistic aggregation buffer
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59563) Use BLAS routines for vector L1 and L2 norms
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59564) Combine adjacent aggregation across a GroupPartitionsExec
XiDuo You (Jira)
-
[jira] [Created] (SPARK-59563) Use BLAS routines for vector L1 and L2 norms
Ruifeng Zheng (Jira)
-
[jira] [Created] (SPARK-59562) Fix stale values in reused multinomial logistic aggregation buffer
Ruifeng Zheng (Jira)
-
[jira] [Updated] (SPARK-59561) ExecutorAllocationManager permanently stalls if a SparkListenerStageSubmitted event is dropped from the executorManagement queue
dongjunhwang (Jira)
-
[jira] [Updated] (SPARK-59560) Reduce Word2Vec driver peak memory during training
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59560) Reduce Word2Vec driver peak memory during training
Ruifeng Zheng (Jira)
-
[jira] [Assigned] (SPARK-58481) InSubqueryExec declares incorrect nullability, which can cause incorrect query results
Wenchen Fan (Jira)
-
[jira] [Created] (SPARK-59559) Add `kueue` E2E test for resources without `kueue.x-k8s.io/queue-name`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59559) Add `kueue` E2E test for resources without `kueue.x-k8s.io/queue-name`
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59558) Use ArrayDeque instead of LinkedList for the whole-stage codegen row buffer
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59558) Use ArrayDeque instead of LinkedList for the whole-stage codegen row buffer
David Mollitor (Jira)
-
[jira] [Updated] (SPARK-59447) Python API for ignore nulls
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59557) Avoid intermediate java.lang.String when casting integral and boolean values to string
David Mollitor (Jira)
-
[jira] [Created] (SPARK-59557) Avoid intermediate java.lang.String when casting integral and boolean values to string
David Mollitor (Jira)
-
[jira] [Resolved] (SPARK-59542) Support `spec.suspend` to hold driver and master/worker creation in `AppInitStep` and `ClusterInitStep`
Dongjoon Hyun (Jira)
-
[jira] [Assigned] (SPARK-59542) Support `spec.suspend` to hold driver and master/worker creation in `AppInitStep` and `ClusterInitStep`
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59556) Compile a lookup-shaped CASE WHEN on a string key to a hash probe
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59556) Compile a lookup-shaped CASE WHEN on a string key to a hash probe
David Mollitor (Jira)
-
[jira] [Updated] (SPARK-59555) Fix flaky DataFrameReader.json doctest by sorting multi-directory read
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59555) Fix flaky DataFrameReader.json doctest by sorting multi-directory read
Yicong Huang (Jira)
-
[jira] [Created] (SPARK-59554) Support the TIME data type in the count_min_sketch function
Stevo Mitric (Jira)
-
[jira] [Commented] (SPARK-59553) Make SparkSession.addArtifact honor spark.jars.ivySettings
Qianlan Chen (Jira)
-
[jira] [Updated] (SPARK-59553) Make SparkSession.addArtifact honor spark.jars.ivySettings
Qianlan Chen (Jira)
-
[jira] [Created] (SPARK-59553) Make SparkSession.addArtifact honor spark.jars.ivySettings
Qianlan Chen (Jira)
-
[jira] [Updated] (SPARK-59552) Upgrade jsonwebtoken to 10 and select the rust_crypto provider
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59552) Upgrade jsonwebtoken to 10 and select the rust_crypto provider
L. C. Hsieh (Jira)
-
[jira] [Updated] (SPARK-59551) Avoid recomputing existence default values per row in the Parquet, ORC, and CSV readers
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59551) Avoid recomputing existence default values per row in the Parquet, ORC, and CSV readers
David Mollitor (Jira)
-
[jira] [Updated] (SPARK-59550) Group coupled crate families in dependabot updates
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59548) Upgrade the OpenTelemetry crates to 0.32 and tracing-opentelemetry to 0.33
L. C. Hsieh (Jira)
-
[jira] [Created] (SPARK-59550) Group coupled crate families in dependabot updates
L. C. Hsieh (Jira)
-
[jira] [Assigned] (SPARK-59272) Revalidate the storage-partitioned join pairing when a regrouped side drops the keyed claim
Peter Toth (Jira)
-
[jira] [Resolved] (SPARK-59272) Revalidate the storage-partitioned join pairing when a regrouped side drops the keyed claim
Peter Toth (Jira)
-
[jira] [Updated] (SPARK-59549) Add tests for pandas.Series.astype
Haotian Sun (Jira)
-
[jira] [Updated] (SPARK-59548) Upgrade the OpenTelemetry crates to 0.32 and tracing-opentelemetry to 0.33
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59549) Add tests for pandas.Series.astype
Haotian Sun (Jira)
-
[jira] [Resolved] (SPARK-59519) Add opt-in `Kueue` RBAC rules to Helm chart
Dongjoon Hyun (Jira)
-
[jira] [Updated] (SPARK-59545) AvroSchemaHelperSuite map-key overflow test fails deterministically on Java 25
ASF GitHub Bot (Jira)
-
[jira] [Updated] (SPARK-59547) Flush Python worker logs before task completion so python_worker_logs() is consistent
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59547) Flush Python worker logs before task completion so python_worker_logs() is consistent
Yicong Huang (Jira)
-
[jira] [Assigned] (SPARK-59446) Spark Connect API for ignore nulls
Szehon Ho (Jira)
-
[jira] [Resolved] (SPARK-59446) Spark Connect API for ignore nulls
Szehon Ho (Jira)
-
[jira] [Updated] (SPARK-59546) Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XM
ASF GitHub Bot (Jira)
-
[jira] [Created] (SPARK-59546) Avoid per-row exceptions when inferring TimeType in JSON, CSV, and XM
David Mollitor (Jira)
-
[jira] [Created] (SPARK-59545) AvroSchemaHelperSuite map-key overflow test fails deterministically on Java 25
Max Gekk (Jira)
-
[jira] [Created] (SPARK-59541) Coalesce OR-connected equality and IN predicates on the same column into a single IN
David Mollitor (Jira)
-
[jira] [Updated] (SPARK-59542) Support `spec.suspend` to hold driver and master/worker creation in `AppInitStep` and `ClusterInitStep`
Dongjoon Hyun (Jira)