commits  

Messages by Thread

• (spark-kubernetes-operator) branch main updated: [SPARK-55002] Bump version to 0.8.0-SNAPSHOT in `main` branch dongjoon
• (spark-kubernetes-operator) branch branch-0.7 updated: [SPARK-55001] Update GitHub Action YAML file in branch-0.7 dongjoon
• (spark-kubernetes-operator) branch branch-0.7 created (now 497ed99) dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-54926] Improve Helm chart for adding labels and annotations for operator config map dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-54997] Use Spark 4.1.1 in docs, examples, tests, and default values dongjoon
• (spark-docker) branch master updated: [SPARK-54994] Publish Apache Spark `4.1.1` to docker registry dongjoon
• (spark) branch master updated: [SPARK-54984][SS] State Repartition execution and integrate with State Rewriter ashrigondekar
• (spark) branch master updated (d2b00ae84341 -> cc9e4112f5a6) dtenedor
• (spark) branch master updated: [SPARK-54443][SS] Integrate PartitionKeyExtractor in Re-partition reader ashrigondekar
• (spark) branch branch-4.1 updated: [SPARK-54610][SDP][DOCS] Improve SDP Programming Guide sandy
• (spark) branch master updated: [SPARK-54660][SS] Add RTM trigger to python viirya
• (spark) branch master updated: [SPARK-53882][CONNECT][DOCS] Add documentation comparing behavioral differences between Spark Connect and Spark Classic hvanhovell
• (spark) branch master updated: [SPARK-54887][CONNECT] Add optional sqlstate to sparkthrowables hvanhovell
• (spark) branch master updated: [SPARK-54972][SQL] Improve NOT IN subqueries with non-nullable columns ptoth
• (spark) branch master updated: [SPARK-54940][PYTHON] Add tests for pa.scalar type inference ruifengz
• svn commit: r81757 - dev/spark/v4.1.1-rc2-docs/_site release/spark/docs/4.1.1 gurwls223
• svn commit: r81758 - dev/spark/v4.1.1-rc2-bin release/spark/spark-4.1.1 gurwls223
• (spark) branch master updated: [SPARK-47086][SPARK-48022][BUILD][CORE][WEBUI] Upgrade Jetty to 12.1.5, Jersey to 3.1.11 and Servlet to 6.0 sarutak
• (spark) tag v4.1.1 created (now c0690c763baf) gurwls223
• (spark) branch master updated (98a17fdd6cb7 -> d4bd663581e7) sarutak
• (spark) branch master updated (60bbac0b892d -> 98a17fdd6cb7) wenchen
• (spark-kubernetes-operator) branch main updated: [SPARK-54983] Upgrade Spark to 4.1.1 dongjoon
• (spark-connect-swift) branch main updated: [SPARK-54981] Improve `DataFrame.collect` to support `Bool|Int|Float|Double` types via `[any Sendable]` cast dongjoon
• (spark-website) branch asf-site updated: Document ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC gurwls223
• (spark) branch master updated (bf71e593a87c -> 60bbac0b892d) ruifengz
• (spark) branch master updated: [SPARK-54949][PYTHON] Move pyproject.toml to repo root ruifengz
• (spark) branch branch-3.5 updated: [SPARK-54982][INFRA] Use ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC gurwls223
• (spark) branch branch-4.0 updated: [SPARK-54982][INFRA] Use ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC gurwls223
• [PR] Document ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC [spark-website] via GitHub
  • Re: [PR] Document ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC [spark-website] via GitHub
  • Re: [PR] Document ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC [spark-website] via GitHub
  • Re: [PR] Document ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC [spark-website] via GitHub
  • Re: [PR] Document ASF_NEXUS_TOKEN to release and drop staging repository when finalizing the RC [spark-website] via GitHub
• (spark) branch master updated: [SPARK-54977][PYTHON][TEST] Accelerate test_observation.py gurwls223
• (spark) branch master updated (6933078aef09 -> 5910b09c4bfb) kabhwan
• (spark) branch master updated (78d5229980e1 -> 6933078aef09) ruifengz
• (spark) branch master updated (fe9ffd50e58b -> 78d5229980e1) ruifengz
• (spark) branch master updated (38d3af27535d -> fe9ffd50e58b) gurwls223
• (spark) branch master updated: [SPARK-54954][PYTHON] Fix remote related type hints in util.py gurwls223
• (spark-website) branch asf-site updated: Recover documentation mistakenly removed in 4.1.0-preview2 release gurwls223
• (spark) branch master updated (2fff424dba26 -> 49afd6b58144) ashrigondekar
• (spark-kubernetes-operator) branch main updated: [SPARK-54964] Bump Java Operator SDK to version 5.2.2 ptoth
• (spark) branch branch-3.5 updated: [SPARK-54900][BUILD][3.5] Upgrade `ORC` to 1.9.8 dongjoon
• (spark) branch master updated (9c675099c9bb -> 2fff424dba26) wenchen
• (spark) branch master updated: [SPARK-54634][SQL] Add clear error message for empty IN predicate wenchen
• [PR] Recover documentation mistakenly removed in 4.1.0-preview2 release [spark-website] via GitHub
  • Re: [PR] Recover documentation mistakenly removed in 4.1.0-preview2 release [spark-website] via GitHub
  • Re: [PR] Recover documentation mistakenly removed in 4.1.0-preview2 release [spark-website] via GitHub
  • Re: [PR] Recover documentation mistakenly removed in 4.1.0-preview2 release [spark-website] via GitHub
  • Re: [PR] Recover documentation mistakenly removed in 4.1.0-preview2 release [spark-website] via GitHub
  • Re: [PR] Recover documentation mistakenly removed in 4.1.0-preview2 release [spark-website] via GitHub
  • Re: [PR] Recover documentation mistakenly removed in 4.1.0-preview2 release [spark-website] via GitHub
• (spark-website) branch asf-site updated: improve spark 4.1.0 release notes (#657) wenchen
• (spark) branch master updated: Revert "[SPARK-54922][PYTHON] Remove ignore[arg-type] for np.set_prin… gurwls223
• (spark) branch master updated: [SPARK-54925][PYTHON] Add the capability to dump threads for pyspark ruifengz
• (spark) branch master updated (5a5308695304 -> 6b39e94e250e) gurwls223
• (spark) branch master updated (6b39e94e250e -> 3dc641b4a384) gurwls223
• (spark) branch master updated: [SPARK-54930][PYTHON] Remove redundant _accumulatorRegistry.clear() call in worker.py gurwls223
• (spark) branch master updated (f27f8d9c7105 -> 186570cdc569) gurwls223
• (spark) branch master updated (bdafb1eb7b81 -> f27f8d9c7105) gurwls223
• (spark) branch master updated (934a171124cc -> bdafb1eb7b81) gurwls223
• (spark) branch master updated: [SPARK-54948][PYTHON][TEST] Use the same testsuite name for same tests gurwls223
• (spark) branch master updated: [SPARK-53991][SQL][TEST][FOLLOW-UP] Improve KLL quantile errors by removing internal details dtenedor
• (spark) branch branch-4.1 updated: [SPARK-53991][SQL][TEST][FOLLOW-UP] Improve KLL quantile errors by removing internal details dtenedor
• (spark) branch master updated: [SPARK-54924][SS] State Rewriter to read state, transform it and write new state ashrigondekar
• (spark) branch master updated: [SPARK-54865][CONNECT][SQL] Add foreachWithSubqueriesAndPruning method to QueryPlan wenchen
• (spark) branch master updated: [SPARK-54905][SQL] Simplify foreachWithSubqueries implementation in QueryPlan wenchen
• [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
  • Re: [PR] improve spark 4.1.0 release notes [spark-website] via GitHub
• (spark) branch master updated: [SPARK-54771][SQL] Remove ResolveUserSpecifiedColumns rule from RuleIdCollection wenchen
• (spark-kubernetes-operator) branch main updated: [SPARK-54931] Support `Pod Disruption Budget` for Spark cluster workers dongjoon
• (spark-connect-swift) branch main updated: [SPARK-54935] Improve `Row.==` to support array types dongjoon
• (spark) branch branch-4.1 updated: [SPARK-54852][SQL] `NOT IN` subquery returns incorrect results with a collated table wenchen
• (spark) branch master updated: [SPARK-54852][SQL] `NOT IN` subquery returns incorrect results with a collated table wenchen
• (spark) branch master updated: [SPARK-54713][SQL] Add vector similarity/distance function expressions support wenchen
• (spark) branch branch-3.5 updated: [SPARK-49872][FOLLOWUP] Remove Jackson JSON string length limit in KVStoreScalaSerializer wenchen
• (spark) branch master updated (ce6b5a62567e -> ed201397c2ac) wenchen
• (spark) branch branch-4.1 updated: [SPARK-49872][FOLLOWUP] Remove Jackson JSON string length limit in KVStoreScalaSerializer wenchen
• (spark) branch branch-4.0 updated: [SPARK-49872][FOLLOWUP] Remove Jackson JSON string length limit in KVStoreScalaSerializer wenchen
• (spark-kubernetes-operator) branch main updated: [SPARK-54932] Use `(pi|pi-with-driver-timeout).yaml` to show `ttlAfterStopMillis` example dongjoon
• (spark) branch master updated: [SPARK-54912][BUILD] Upgrade `commons-pool2` to 2.13.1 dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-54927] Add `Volcano` example dongjoon
• (spark) branch master updated (f8760286a679 -> c27ede3a070d) ruifengz
• (spark) branch master updated: [SPARK-54922][PYTHON] Unify how args are passed to python workers gurwls223
• svn commit: r81680 - in dev/spark/v4.2.0-preview1-rc1-docs: . _site _site/api _site/api/R _site/api/R/articles _site/api/R/articles/sparkr-vignettes_files _site/api/R/articles/sparkr-vignettes_files/accessible-code-block-0.0.1 _site/api/R/deps _site/ap... gurwls223
• (spark) branch master updated: [SPARK-54916][K8S][BUILD] Enable `volcano` profile by default dongjoon
• svn commit: r81679 - dev/spark/v4.2.0-preview1-rc1-bin gurwls223
• (spark) branch master updated: [SPARK-54768][SS] Python Stream Data Source should classify error if data returned doesn't match configured schema ashrigondekar
• (spark) tag v4.2.0-preview1-rc1 created (now 33b4056eee8f) gurwls223
  • (spark) 01/02: Removing test jars and class files gurwls223
  • (spark) 02/02: Preparing Spark release v4.2.0-preview1-rc1 gurwls223
• (spark) branch master updated: [SPARK-54920][SQL] Move grouping analytics extraction logic to a common `GroupingAnalyticsExtractor` gurwls223
• svn commit: r81678 - dev/spark/v4.2.0-preview1-rc1-docs gurwls223
• svn commit: r81677 - dev/spark/v4.2.0-preview1-rc1-bin gurwls223
• (spark) tag v4.2.0-preview1-rc1 deleted (was d7519b3c9546) gurwls223
• (spark) branch master updated: [SPARK-54872][SQL] Unify column default value handling between v1 and v2 commands wenchen
• (spark) branch master updated: [SPARK-54682][SQL] Support showing parameters in DESCRIBE PROCEDURE wenchen
• (spark) branch master updated: [SPARK-54915][K8S][INFRA][DOCS] Upgrade Volcano to 1.13.1 dongjoon
• svn commit: r81669 - in dev/spark/v4.2.0-preview1-rc1-docs: . _site _site/api _site/api/R _site/api/R/articles _site/api/R/articles/sparkr-vignettes_files _site/api/R/articles/sparkr-vignettes_files/accessible-code-block-0.0.1 _site/api/R/deps _site/ap... gurwls223
• svn commit: r81668 - dev/spark/v4.2.0-preview1-rc1-bin gurwls223
• (spark) tag v4.2.0-preview1-rc1 created (now d7519b3c9546) gurwls223
  • (spark) 01/02: Removing test jars and class files gurwls223
  • (spark) 02/02: Preparing Spark release v4.2.0-preview1-rc1 gurwls223
• (spark) branch master updated (752e8a1a7ee0 -> b615f34aebd7) sarutak
• (spark) branch master updated: [SPARK-53807][SPARK-50771][CORE] Fix race condition issues between `unlock` and `releaseAllLocksForTask` in `BlockInfoManager` sarutak
• (spark) branch master updated: [SPARK-54313][CORE] Add --extra-properties-file option for configuration layering sarutak
• (spark) branch master updated: [SPARK-54911][BUILD][TESTS] Upgrade `bouncycastle` to 1.83 dongjoon
• (spark) branch master updated: [SPARK-54902][PYTHON][TESTS] Rename testing helper contextmanager for temp view gurwls223
• (spark) branch master updated: [SPARK-54903][PYTHON] Make to_arrow_schema/to_arrow_type able to set timezone ruifengz
• (spark) branch master updated (1d86c4d023ea -> 98874f0a376c) gurwls223
• (spark) branch master updated: [SPARK-54632][PYTHON][FOLLOWUP] Add ruff to cli help options gurwls223
• (spark) branch master updated: [MINOR] Fix an invalid escape string gurwls223
• (spark) branch master updated (c76eeebc4780 -> e13fb1184b74) gengliang
• (spark) branch master updated (0b5e92b7815d -> c76eeebc4780) sandy
• (spark) branch branch-4.1 updated: [SPARK-54886] Add base session created in SparkConnectService hvanhovell
• (spark) branch master updated: [SPARK-54886] Add base session created in SparkConnectService hvanhovell
• (spark) branch master updated (3e73da2d904c -> 7bc810745c9e) wenchen
• (spark) branch master updated: [SPARK-54889][INFRA] Report test results to codecov ruifengz
• (spark) branch master updated (25307abfbfbc -> 5c88e9385e31) ruifengz
• (spark) branch master updated (9d8126027875 -> c12bb71a069e) wenchen
• (spark) branch master updated (20de5e7f2bdb -> 9d8126027875) wenchen
• (spark) branch master updated: [SPARK-54884][CORE][TESTS] Remove private function `totalRunningTasksPerResourceProfile` from `ExecutorAllocationManager` wuyi
• (spark-connect-swift) branch main updated: [SPARK-54899] Upgrade `FlatBuffers` to v25.12.19 dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-54898] Upgrade `Iceberg` to 1.10.1 in `spark-connect-server-iceberg.yaml` dongjoon
• (spark-connect-swift) branch main updated: [SPARK-54897] Upgrade `Iceberg` to 1.10.1 in integration tests dongjoon
• (spark-connect-swift) branch main updated: [SPARK-54893] Support `listTables` and `getTable` in `Catalog` dongjoon
• (spark) branch master updated: [SPARK-54610][SDP][DOCS] Improve SDP Programming Guide sandy
• (spark-kubernetes-operator) branch main updated: [SPARK-54813] Remove `cores` configs from `tests/e2e/watched-namespaces/spark-example.yaml` dongjoon
• (spark-connect-swift) branch main updated: [SPARK-54892] Support `list` data type dongjoon
• (spark-kubernetes-operator) branch main updated: [SPARK-54789] Support label selector based filter on resources to reconcile dongjoon
• (spark) branch master updated (735eda8a5b6b -> ea2617af1ca4) ruifengz
• (spark) branch master updated: [SPARK-54874][TESTS][INFRA] Avoid interleave failed test logs with test outputs ruifengz
• (spark) branch master updated (03537905f144 -> 1fc6ff235345) ruifengz
• (spark) branch master updated: [SPARK-54871][SQL] Trim aliases from grouping and aggregate expressions before handling grouping analytics wenchen
• (spark) branch master updated: [SPARK-54885][PYTHON] Remove unreachable code after upgrading pyarrow minimum version to 18.0.0 ruifengz
• (spark) branch master updated: [SPARK-54867][SS] Introduce NamedStreamingRelation wrapper for source identification during analysis ashrigondekar
• (spark) branch master updated: [SPARK-54390][SS] Fix JSON Deserialize in StreamingQueryListenerBus ashrigondekar
• svn commit: r81598 - in dev/spark/v4.1.1-rc2-docs: . _site _site/api _site/api/R _site/api/R/articles _site/api/R/articles/sparkr-vignettes_files _site/api/R/articles/sparkr-vignettes_files/accessible-code-block-0.0.1 _site/api/R/deps _site/api/R/deps/... gurwls223
• svn commit: r81596 - dev/spark/v4.1.1-rc2-bin gurwls223
• (spark) branch branch-4.1 updated (31ecc1061655 -> b300b17d8c2d) gurwls223
  • (spark) 01/02: Revert "Removing test jars and class files" gurwls223
  • (spark) 02/02: Preparing development version 4.1.2-SNAPSHOT gurwls223
• (spark) tag v4.1.1-rc2 created (now c0690c763baf) gurwls223
  • (spark) 02/02: Preparing Spark release v4.1.1-rc2 gurwls223
  • (spark) 01/02: Removing test jars and class files gurwls223
• svn commit: r81595 - dev/spark/v4.1.1-rc2-bin gurwls223
• (spark) tag v4.1.1-rc2 deleted (was f85e4074c2a0) gurwls223
• (spark) branch master updated: [SPARK-54882][PYTHON] Remove legacy PYARROW_IGNORE_TIMEZONE ruifengz
• svn commit: r81594 - dev/spark/v4.1.1-rc2-bin gurwls223
• (spark) branch branch-4.1 updated (6d1113b20f4c -> 31ecc1061655) gurwls223
  • (spark) 02/02: Preparing development version 4.1.2-SNAPSHOT gurwls223
  • (spark) 01/02: Revert "Removing test jars and class files" gurwls223
• (spark) tag v4.1.1-rc2 created (now f85e4074c2a0) gurwls223
  • (spark) 02/02: Preparing Spark release v4.1.1-rc2 gurwls223
  • (spark) 01/02: Removing test jars and class files gurwls223
• (spark) branch master updated: Revert "[SPARK-54182][SQL][PYTHON] Optimize non-arrow conversion of df.toPandas`" gurwls223
• (spark) branch master updated: [SPARK-54877][UI] Make display stacktrace on UI error page configurable sarutak
• (spark) branch master updated (6695a6911e78 -> eaed471c8f4e) yangjie01
• (spark) branch master updated: [SPARK-54701][PYTHON] Improve the runnerConf chain for Python workers gurwls223
• (spark) branch branch-4.0 updated (2fc65e1c98ed -> 4d30961a92bc) gurwls223
• (spark) branch branch-4.1 updated (bfc94ab3104e -> 6d1113b20f4c) gurwls223
• (spark) branch master updated: [SPARK-54868][PYTHON][INFRA][FOLLOW-UP] Also enable `faulthandler` in classic tests ruifengz
• (spark) branch master updated: [SPARK-54753][SQL] fix memory leak of ArtifactManager gurwls223
• (spark) branch master updated: [SPARK-54859][PYTHON] Arrow by default PySpark UDF API reference doc ruifengz
• (spark) branch master updated: [SPARK-54868][PYTHON][INFRA][FOLLOWUP] Increase test timeout to 450s ruifengz
• (spark) branch master updated (f80b919d19ce -> faa4d19a1cd9) ruifengz
• (spark-website) branch asf-site updated: Remove redundant forward slash from Spark URL (#656) yao
• [PR] Remove redundant forward slash from Spark URL [spark-website] via GitHub
  • Re: [PR] Remove redundant forward slash from Spark URL [spark-website] via GitHub
• (spark) branch master updated: [SPARK-54849][PYTHON] Upgrade the minimum version of `pyarrow` to 18.0.0 ruifengz
• (spark) branch master updated: [SPARK-54868][PYTHON][INFRA] Fail hanging tests and log the tracebacks ruifengz
• (spark) branch master updated: [SPARK-54862][DSTREAM] Remove unused private object `RawTextHelper` yangjie01
• (spark) branch master updated (ea8e9412b1ce -> 2c5b4b09868d) wuyi
• (spark) branch master updated: Revert "[SPARK-54830][CORE] Enable checksum based indeterminate shuffle retry by default" yao
• (spark) branch master updated: [SPARK-54869][PYTHON][TESTS] Apply the standard import of pyarrow compute in `test_arrow_udf_scalar` ruifengz
• (spark) branch master updated: [SPARK-54860][INFRA] Add JIRA Ticket Validating in GHA yao
• svn commit: r81560 - in dev/spark/v4.1.1-rc1-docs: . _site _site/api _site/api/R _site/api/R/articles _site/api/R/articles/sparkr-vignettes_files _site/api/R/articles/sparkr-vignettes_files/accessible-code-block-0.0.1 _site/api/R/deps _site/api/R/deps/... gurwls223
• svn commit: r81558 - dev/spark/v4.1.1-rc1-bin gurwls223
• (spark) branch branch-4.1 updated (1cc2478a1f37 -> bfc94ab3104e) gurwls223
  • (spark) 02/02: Preparing development version 4.1.2-SNAPSHOT gurwls223
  • (spark) 01/02: Revert "Removing test jars and class files" gurwls223
• (spark) tag v4.1.1-rc1 created (now 639216180c74) gurwls223
  • (spark) 01/02: Removing test jars and class files gurwls223
  • (spark) 02/02: Preparing Spark release v4.1.1-rc1 gurwls223
• (spark) branch branch-4.1 updated: [SPARK-54850][SQL] Improve `extractShuffleIds` to find `AdaptiveSparkPlanExec` anywhere in plan tree yao
• (spark) branch master updated: [SPARK-54850][SQL] Improve `extractShuffleIds` to find `AdaptiveSparkPlanExec` anywhere in plan tree yao
• (spark) branch master updated: [SPARK-54830][CORE] Enable checksum based indeterminate shuffle retry by default wenchen
  • (spark) branch master updated: [SPARK-54830][CORE] Enable checksum based indeterminate shuffle retry by default wenchen
• (spark) branch master updated (df604f04f103 -> 8cc2e4677d59) ruifengz
• (spark-website) branch asf-site updated: Introduce Cursor/VS Code support (#655) wenchen
• (spark) branch master updated: [SPARK-54857][WEBUI][TESTS] Add test ensuring user name and app name in historypage get escaped sarutak
• (spark) branch branch-4.1 updated: [SPARK-54837][DOCS] Document all built-in JDBC datasource providers yangjie01
• (spark) branch master updated: [SPARK-54837][DOCS] Document all built-in JDBC datasource providers yangjie01

• Earlier messages