(spark) branch master updated (fe2174d8caaf -> d705d868aaaa)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git from fe2174d8caaf [SPARK-47304][SQL][TESTS] Distribute tests from `DataFrameSuite` to more specific suites add d705d868 [SPARK-39771][CORE] Add a warning msg in `Dependency` when a too large number of shuffle blocks is to be created No new revisions were added by this update. Summary of changes: core/src/main/scala/org/apache/spark/Dependency.scala | 12 core/src/test/scala/org/apache/spark/ShuffleSuite.scala | 11 +++ 2 files changed, 23 insertions(+) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark-website] branch 3.5.0-release deleted (was dc8b61a479)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch 3.5.0-release in repository https://gitbox.apache.org/repos/asf/spark-website.git was dc8b61a479 Add docs for Apache Spark 3.5.0 The revisions that were on this branch are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark-website] branch 3.5.0-release created (now dc8b61a479)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch 3.5.0-release in repository https://gitbox.apache.org/repos/asf/spark-website.git at dc8b61a479 Add docs for Apache Spark 3.5.0 No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63956 - /dev/spark/v3.5.0-rc5-docs/
Author: liyuanjian Date: Tue Sep 12 20:53:39 2023 New Revision: 63956 Log: Remove RC artifacts Removed: dev/spark/v3.5.0-rc5-docs/ - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] tag v3.5.0 created (now ce5ddad9903)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0 in repository https://gitbox.apache.org/repos/asf/spark.git at ce5ddad9903 (commit) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63882 - in /dev/spark/v3.5.0-rc5-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.2.2/ _site/api/R/deps/jquery-3.6.0/ _site/api
Author: liyuanjian Date: Sat Sep 9 05:42:36 2023 New Revision: 63882 Log: Apache Spark v3.5.0-rc5 docs [This commit notification would consist of 4517 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63878 - /dev/spark/v3.5.0-rc5-bin/
Author: liyuanjian Date: Sat Sep 9 02:10:16 2023 New Revision: 63878 Log: Apache Spark v3.5.0-rc5 Added: dev/spark/v3.5.0-rc5-bin/ dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.asc dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz.asc dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz (with props) dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.asc dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.sha512 dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-hadoop3.tgz (with props) dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-hadoop3.tgz.asc dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-hadoop3.tgz.sha512 dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-without-hadoop.tgz (with props) dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-without-hadoop.tgz.asc dev/spark/v3.5.0-rc5-bin/spark-3.5.0-bin-without-hadoop.tgz.sha512 dev/spark/v3.5.0-rc5-bin/spark-3.5.0.tgz (with props) dev/spark/v3.5.0-rc5-bin/spark-3.5.0.tgz.asc dev/spark/v3.5.0-rc5-bin/spark-3.5.0.tgz.sha512 Added: dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.asc Sat Sep 9 02:10:16 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmT706gWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFri4D/0YeE799zjehAsuNVbzE1wrHlOM +ZMxIUg+pYg8ssNGU6I4fIhwx6GK2p+6zLfTRs8igB+q+sf6mTc497p4AOBR7o2AN +IW6re5cFoh0zDO2Myot0uwbr8iMG8WsE5PB3icyQW0jlKJQaWGQcp675hlaYWnaw +DH9cOq5hHi1Ghvy7f/Ff5F2JT5OKlHcXqV+qHuc+7MQjCTKB7bxKlcxlxu39kzgN +H1aIyTme6CL145VTi0TEv7q85jOPy6Wz05Lj9PpXStyvkKYFBeCGvoVvnAnhhTS/ +lfs8nYlK8irLZb2n1ILblWQXp197Z6T3W8mX4nQML3GDzNQ6egtdJg+nJN/Gra3C +e8bV/exx//634dARKeoz3tVyT7QNdf96jAYdl36WjgnBiY0C0JQrqZhHRsOOAM4C ++IIHsrkwyiJPkK7UUqXhcFdLBm023U4B92wpeg29Mjk8FFneLAtcrau5Qiy71BpP +phE4XgjAW/FEoxDBrwRlv4hgVXeWQ41C6lC4J1q0QA2LUCy3x1jUCigtdRca3a+t +YA5CI4XgnQffl3bMYMezEbvc9q4FKfKHLM4nv3ZoFReuRey1GGab1HsQaTgAnfAv +3DHMLcIW4TZY+ST3kDcCA5k8gzE+R31H/smRSgSNG0RDD8FauzIiHbN3MuEBdKRJ +yX1+HmdB9T8n/uc74g== +=qD2e +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.sha512 (added) +++ dev/spark/v3.5.0-rc5-bin/SparkR_3.5.0.tar.gz.sha512 Sat Sep 9 02:10:16 2023 @@ -0,0 +1 @@ +766b5e2268615db7f02a27e17261237d693413fa9a895c04ee2b106f45145fe32a029cba5ec289d2004fc8bbc99e63a4bea91491a5d0286f81bedcc1ce54fad0 SparkR_3.5.0.tar.gz Added: dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz.asc Sat Sep 9 02:10:16 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmT706kWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFurWEACmTtJT+U+eOVKbqlZnwisTrGus +oB7kfc2BDYZYRuXg5EU2a1KK09Cfh4qR43ITAWN4kxoTI58B1Rguq36Al3ChEIzH +KVY6Z4nUb3IM2f8lHdImJkr/3I9zZFdMszsVRrS627TFqUO5NTVbq/bK5dyJEffD +lqkXf3lDm8HI7P5qA5GvqhkKYIsIqQqkU2XNoPgHPE51nOpwguuuvihcBVj2a9Rm +9q/3/0izWpj3ieWu056lXYaU0EU57Nn3ynDMM7x2TPcPrRtvXif7qEYkZQntx4EV +OgZze/6nttoDRuHXAwIHfjRQbE4+n1/uZEEYox8lwVXKi8XVAglie+z/OblKtaru +aDKK3pvb4PsxZS0R97REkC5iJTnOCg6ib36e1frB0UOqw2OPXzTRQIOioQww3pL5 +plt0yk2dfDWrafgtZo3QRViRn2LG863Ex+0Ui2li4F4bNP7f6UJXwvkghJjEHEaU +W+zUkk83rUX4DOZeAHkCI1o9SzbZkf6lHywdf12rXc1vhSd9jUk+r6mXtaNkEJ1S +ZLLkrf5RL6xrCEPpRRyuRHGMwXlYx3ZYxazEFww+B7g7gNdyKInJbY8AvM9DbWZI +Z+AsyWJpKE9QViwEseiJULTrYNdL8dHKEtuIgtBcPU46zn0upnDRBCDiVruiC8qK +KjCpZxNnJXKf7Rvmhw== +=xXc+ +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc5-bin/pyspark-3.5.0.tar.gz.sha512 (added
[spark] 01/01: Preparing development version 3.5.1-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git commit 5342c015ba47daa410128dfa5c79e2865e74d244 Author: Yuanjian Li AuthorDate: Sat Sep 9 01:24:10 2023 + Preparing development version 3.5.1-SNAPSHOT --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 1c093a4a980..66faa8031c4 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.0 +Version: 3.5.1 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index a0aca22eab9..45b68dd81cb 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index ce180f49ff1..1b1a8d0066f 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 8da48076a43..54c10a05eed 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 48e64d21a58..92bf5bc0785 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 2bbacbe71a4..3003927e713 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark sp
[spark] tag v3.5.0-rc5 created (now ce5ddad9903)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git at ce5ddad9903 (commit) This tag includes the following new commits: new ce5ddad9903 Preparing Spark release v3.5.0-rc5 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: Preparing Spark release v3.5.0-rc5
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to tag v3.5.0-rc5 in repository https://gitbox.apache.org/repos/asf/spark.git commit ce5ddad990373636e94071e7cef2f31021add07b Author: Yuanjian Li AuthorDate: Sat Sep 9 01:24:06 2023 + Preparing Spark release v3.5.0-rc5 --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 66faa8031c4..1c093a4a980 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.1 +Version: 3.5.0 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index 45b68dd81cb..a0aca22eab9 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index 1b1a8d0066f..ce180f49ff1 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 54c10a05eed..8da48076a43 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 92bf5bc0785..48e64d21a58 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 3003927e713..2bbacbe71a4 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-paren
[spark] branch branch-3.5 updated (05b57bc1ebe -> 5342c015ba4)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from 05b57bc1ebe [SPARK-45075][SQL] Fix alter table with invalid default value will not report error add ce5ddad9903 Preparing Spark release v3.5.0-rc5 new 5342c015ba4 Preparing development version 3.5.1-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63807 - in /dev/spark/v3.5.0-rc4-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.2.2/ _site/api/R/deps/jquery-3.6.0/ _site/api
Author: liyuanjian Date: Tue Sep 5 23:50:07 2023 New Revision: 63807 Log: Apache Spark v3.5.0-rc4 docs [This commit notification would consist of 4517 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63805 - /dev/spark/v3.5.0-rc4-bin/
Author: liyuanjian Date: Tue Sep 5 21:17:23 2023 New Revision: 63805 Log: Apache Spark v3.5.0-rc4 Added: dev/spark/v3.5.0-rc4-bin/ dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.asc dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz.asc dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz (with props) dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.asc dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.sha512 dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-hadoop3.tgz (with props) dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-hadoop3.tgz.asc dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-hadoop3.tgz.sha512 dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-without-hadoop.tgz (with props) dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-without-hadoop.tgz.asc dev/spark/v3.5.0-rc4-bin/spark-3.5.0-bin-without-hadoop.tgz.sha512 dev/spark/v3.5.0-rc4-bin/spark-3.5.0.tgz (with props) dev/spark/v3.5.0-rc4-bin/spark-3.5.0.tgz.asc dev/spark/v3.5.0-rc4-bin/spark-3.5.0.tgz.sha512 Added: dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.asc Tue Sep 5 21:17:23 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmT3moAWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFrCeD/9BPI36Ut/Sc1RUzAXbzP7bn7H0 +Pcuu9Prm5uz1x+9Dqv5ybYsr1PsgINlWa33J6aK1i/J30k6kUybMA0b8dQ+BmDbL +xwIUcrfqX8+DKlBV5oc0HlLFpBpfqHXk5aVe616Cm1XuOToDxU+30LZEaL9/w6kz ++TnLKv+oS7kzGd1UJVf4qJQftPrekuNuxgk9mx0q0/fMdOtZBBE3RrWzdu1w2soN +ro082r7SkY1alOfMN8kgsGguhOCBmiLQRUKw8PXmZoAdo92wxpdh8+gWiv+JfRhD +sol78cmuRvT8pOg1bOEpCMl0J6ITmDyg6a+DcsmkZ94VQblpvKXhGixIIAbiaTc0 +njF8HuZWBC0EaO4EvV6oV6k+T7L/ysj/Vz1dUuFYVGUtrDK/92qzLYQBzmpS6va3 +0Il5h9JHOwEMFOkhkSSi129XDpdO+SDrWNpA9kR7/uqJmo8VYa43Gc0WWiHu75ni +e1YxxtD8aOnHhUY1LU2LO58w7KcgOmuSHdbDjHSBsRe+cu7LH2zv0dSgYpwCP42o +whOSaNJPW49WILZVWRC0T1sP5kMSNJjxPVr+mgawia6ImvoWQvXloo48T0QpKmhf +rDv1JDFlBuXPw55Sq69BZhHAa5+vMZfwW/kSgA7hVu3vKEVttrAB3w0OyKlSxenP +Fepv5E7YkD6/cr7ALQ== +=kzYJ +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.sha512 (added) +++ dev/spark/v3.5.0-rc4-bin/SparkR_3.5.0.tar.gz.sha512 Tue Sep 5 21:17:23 2023 @@ -0,0 +1 @@ +16b93fd63aa30221d5edcdcf0a56c4d40c99d65cebcd818cdc2a4c1dc5ead043511012e3f58bfc3352281ff39557d29e507cef5a574e06c350364debe3f33583 SparkR_3.5.0.tar.gz Added: dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz.asc Tue Sep 5 21:17:23 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmT3moIWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFltND/9r1O0WaGcRnqzjJZkU0clFR5Fv +Z8A3XugA01fC6Z/Asq2/LkW8vCmTDB+1Daj4w5/f3rQO8r7+KlO92whx3rWiyEpQ +7xgZ2WIbkidtXfmu8XmYaXrSdN2D2MsyfJDMhB7sgI3upz/auwCtPRdyxb99GfAq +n/SglIQW7icuWo4XAHlQ1QjCFJMY4a1Fj8KfAfahoLswj3jTNxGMrVBMrNdHKPJg +9ldh3rdd8IQKRqCaixLUKnpWerQhQK/IjUESNHCC2nEQAsg3KbQjvzDeUWaMFF/o +fHJxMGZcOx0lEQLwI787NDxHCtUWDABImYJ7QgcrVtmIHEQOEdvyB61mrqfbXi8k +DW+5ZVfz3m9KoMg+tczNnEJgsr/ddVFYgL2wHjerEcV0klHEeYyizkjzLzpX2tTs +vNqB/01SvVXoH9Td02+I3wXTBs/zcS/aP6U9VrI2rOWrxbZJkoN+0pelIQi8JXTR +knd2qDdFKnyee3vSPxxGj+rZztgKki3RN2DCyEsR7kZKseOq1Zj/+klBE0DphjnL +LRUPH+0wAV7JeovSsrVeSNM3COPVzDTRgJZnA37y8acnnXG3JmIYNraN+IGAD+Hq +0mOIBKjCjzgeHOhR1s1rQrUJ3HhY9Hns0R3vpT//AlKlhCZrDdJ/OO3J3c3twY9l +dqsqae7TFAFUa5qaAw== +=Ziwk +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc4-bin/pyspark-3.5.0.tar.gz.sha512 (added
[spark] 01/01: Preparing development version 3.5.1-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git commit 66e07c97b7a5ac454e96a7b0b7ed83d942302991 Author: Yuanjian Li AuthorDate: Tue Sep 5 20:15:48 2023 + Preparing development version 3.5.1-SNAPSHOT --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 1c093a4a9804..66faa8031c45 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.0 +Version: 3.5.1 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index a0aca22eab91..45b68dd81cb9 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index ce180f49ff12..1b1a8d0066f8 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 8da48076a43a..54c10a05eed2 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 48e64d21a58b..92bf5bc07854 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 2bbacbe71a43..3003927e713c 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.sp
[spark] branch branch-3.5 updated (dc6af11082ee -> 66e07c97b7a5)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from dc6af11082ee [SPARK-45082][DOC] Review and fix issues in API docs for 3.5.0 add c2939589a29d Preparing Spark release v3.5.0-rc4 new 66e07c97b7a5 Preparing development version 3.5.1-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: Preparing Spark release v3.5.0-rc4
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to tag v3.5.0-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git commit c2939589a29dd0d6a2d3d31a8d833877a37ee02a Author: Yuanjian Li AuthorDate: Tue Sep 5 20:15:44 2023 + Preparing Spark release v3.5.0-rc4 --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 66faa8031c45..1c093a4a9804 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.1 +Version: 3.5.0 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index 45b68dd81cb9..a0aca22eab91 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index 1b1a8d0066f8..ce180f49ff12 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 54c10a05eed2..8da48076a43a 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 92bf5bc07854..48e64d21a58b 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 3003927e713c..2bbacbe71a43 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark sp
[spark] tag v3.5.0-rc4 created (now c2939589a29d)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0-rc4 in repository https://gitbox.apache.org/repos/asf/spark.git at c2939589a29d (commit) This tag includes the following new commits: new c2939589a29d Preparing Spark release v3.5.0-rc4 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.5 updated: [SPARK-45082][DOC] Review and fix issues in API docs for 3.5.0
This is an automated email from the ASF dual-hosted git repository.
liyuanjian pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new dc6af11082ee [SPARK-45082][DOC] Review and fix issues in API docs for
3.5.0
dc6af11082ee is described below
commit dc6af11082ee39666aa6ae64df0f32dc142bf807
Author: Yuanjian Li
AuthorDate: Tue Sep 5 12:45:36 2023 -0700
[SPARK-45082][DOC] Review and fix issues in API docs for 3.5.0
### What changes were proposed in this pull request?
Compare the 3.4 API doc with the 3.5 RC3 cut. Fix the following issues:
- Remove the leaking class/object in API doc
### Why are the changes needed?
Fix the issues in the Spark 3.5.0 release API docs.
### Does this PR introduce _any_ user-facing change?
No, API doc changes only.
### How was this patch tested?
Manually test.
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #42819 from xuanyuanking/SPARK-45082.
Authored-by: Yuanjian Li
Signed-off-by: Yuanjian Li
(cherry picked from commit e0a6af988df3f52e95d46ac4c333825d2940065f)
Signed-off-by: Yuanjian Li
---
.../scala/org/apache/spark/SparkBuildInfo.scala| 2 +-
.../org/apache/spark/util/SparkClassUtils.scala| 4 +--
.../apache/spark/util/SparkCollectionUtils.scala | 4 +--
.../org/apache/spark/util/SparkErrorUtils.scala| 2 +-
.../org/apache/spark/util/SparkSerDeUtils.scala| 4 +--
.../org/apache/spark/sql/avro/CustomDecimal.scala | 4 +--
.../org/apache/spark/util/StubClassLoader.scala| 4 +--
.../spark/sql/errors/CompilationErrors.scala | 2 +-
.../spark/sql/types/DataTypeExpression.scala | 30 +++---
.../org/apache/spark/sql/jdbc/JdbcDialects.scala | 2 +-
10 files changed, 29 insertions(+), 29 deletions(-)
diff --git a/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
b/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
index 23f671f9d764..ebc62460d231 100644
--- a/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
+++ b/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
@@ -18,7 +18,7 @@ package org.apache.spark
import java.util.Properties
-object SparkBuildInfo {
+private[spark] object SparkBuildInfo {
val (
spark_version: String,
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
index 679d546d04c9..5984eaee42e7 100644
--- a/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
+++ b/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
@@ -20,7 +20,7 @@ import java.util.Random
import scala.util.Try
-trait SparkClassUtils {
+private[spark] trait SparkClassUtils {
val random = new Random()
def getSparkClassLoader: ClassLoader = getClass.getClassLoader
@@ -80,4 +80,4 @@ trait SparkClassUtils {
}
}
-object SparkClassUtils extends SparkClassUtils
+private[spark] object SparkClassUtils extends SparkClassUtils
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
index 7fecc9ccb664..be8282db31be 100644
---
a/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
+++
b/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
@@ -18,7 +18,7 @@ package org.apache.spark.sql.catalyst.util
import scala.collection.immutable
-trait SparkCollectionUtils {
+private[spark] trait SparkCollectionUtils {
/**
* Same function as `keys.zipWithIndex.toMap`, but has perf gain.
*/
@@ -34,4 +34,4 @@ trait SparkCollectionUtils {
}
}
-object SparkCollectionUtils extends SparkCollectionUtils
+private[spark] object SparkCollectionUtils extends SparkCollectionUtils
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
index 97a07984a228..8194d1e42417 100644
--- a/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
+++ b/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
@@ -90,4 +90,4 @@ private[spark] trait SparkErrorUtils extends Logging {
}
}
-object SparkErrorUtils extends SparkErrorUtils
+private[spark] object SparkErrorUtils extends SparkErrorUtils
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
index 9b6174c47bde..2cc14fea5f30 100644
--- a/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
+++ b/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
@@ -18,7
[spark] branch master updated: [SPARK-45082][DOC] Review and fix issues in API docs for 3.5.0
This is an automated email from the ASF dual-hosted git repository.
liyuanjian pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new e0a6af988df3 [SPARK-45082][DOC] Review and fix issues in API docs for
3.5.0
e0a6af988df3 is described below
commit e0a6af988df3f52e95d46ac4c333825d2940065f
Author: Yuanjian Li
AuthorDate: Tue Sep 5 12:45:36 2023 -0700
[SPARK-45082][DOC] Review and fix issues in API docs for 3.5.0
### What changes were proposed in this pull request?
Compare the 3.4 API doc with the 3.5 RC3 cut. Fix the following issues:
- Remove the leaking class/object in API doc
### Why are the changes needed?
Fix the issues in the Spark 3.5.0 release API docs.
### Does this PR introduce _any_ user-facing change?
No, API doc changes only.
### How was this patch tested?
Manually test.
### Was this patch authored or co-authored using generative AI tooling?
no
Closes #42819 from xuanyuanking/SPARK-45082.
Authored-by: Yuanjian Li
Signed-off-by: Yuanjian Li
---
.../scala/org/apache/spark/SparkBuildInfo.scala| 2 +-
.../org/apache/spark/util/SparkClassUtils.scala| 4 +--
.../apache/spark/util/SparkCollectionUtils.scala | 4 +--
.../org/apache/spark/util/SparkErrorUtils.scala| 2 +-
.../org/apache/spark/util/SparkSerDeUtils.scala| 4 +--
.../org/apache/spark/sql/avro/CustomDecimal.scala | 4 +--
.../org/apache/spark/util/StubClassLoader.scala| 4 +--
.../spark/sql/errors/CompilationErrors.scala | 2 +-
.../spark/sql/types/DataTypeExpression.scala | 30 +++---
.../org/apache/spark/sql/jdbc/JdbcDialects.scala | 2 +-
10 files changed, 29 insertions(+), 29 deletions(-)
diff --git a/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
b/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
index 23f671f9d764..ebc62460d231 100644
--- a/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
+++ b/common/utils/src/main/scala/org/apache/spark/SparkBuildInfo.scala
@@ -18,7 +18,7 @@ package org.apache.spark
import java.util.Properties
-object SparkBuildInfo {
+private[spark] object SparkBuildInfo {
val (
spark_version: String,
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
index 679d546d04c9..5984eaee42e7 100644
--- a/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
+++ b/common/utils/src/main/scala/org/apache/spark/util/SparkClassUtils.scala
@@ -20,7 +20,7 @@ import java.util.Random
import scala.util.Try
-trait SparkClassUtils {
+private[spark] trait SparkClassUtils {
val random = new Random()
def getSparkClassLoader: ClassLoader = getClass.getClassLoader
@@ -80,4 +80,4 @@ trait SparkClassUtils {
}
}
-object SparkClassUtils extends SparkClassUtils
+private[spark] object SparkClassUtils extends SparkClassUtils
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
index 7fecc9ccb664..be8282db31be 100644
---
a/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
+++
b/common/utils/src/main/scala/org/apache/spark/util/SparkCollectionUtils.scala
@@ -18,7 +18,7 @@ package org.apache.spark.sql.catalyst.util
import scala.collection.immutable
-trait SparkCollectionUtils {
+private[spark] trait SparkCollectionUtils {
/**
* Same function as `keys.zipWithIndex.toMap`, but has perf gain.
*/
@@ -34,4 +34,4 @@ trait SparkCollectionUtils {
}
}
-object SparkCollectionUtils extends SparkCollectionUtils
+private[spark] object SparkCollectionUtils extends SparkCollectionUtils
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
index 97a07984a228..8194d1e42417 100644
--- a/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
+++ b/common/utils/src/main/scala/org/apache/spark/util/SparkErrorUtils.scala
@@ -90,4 +90,4 @@ private[spark] trait SparkErrorUtils extends Logging {
}
}
-object SparkErrorUtils extends SparkErrorUtils
+private[spark] object SparkErrorUtils extends SparkErrorUtils
diff --git
a/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
b/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
index 9b6174c47bde..2cc14fea5f30 100644
--- a/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
+++ b/common/utils/src/main/scala/org/apache/spark/util/SparkSerDeUtils.scala
@@ -18,7 +18,7 @@ package org.apache.spark.util
import java.io.{ByteArrayInputStream, ByteArrayOutputStream
svn commit: r63684 - in /dev/spark/v3.5.0-rc3-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.2.2/ _site/api/R/deps/jquery-3.6.0/ _site/api
Author: liyuanjian Date: Tue Aug 29 08:04:02 2023 New Revision: 63684 Log: Apache Spark v3.5.0-rc3 docs [This commit notification would consist of 2898 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63683 - /dev/spark/v3.5.0-rc3-bin/
Author: liyuanjian Date: Tue Aug 29 07:22:56 2023 New Revision: 63683 Log: Apache Spark v3.5.0-rc3-bin Added: dev/spark/v3.5.0-rc3-bin/ dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3.tgz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-without-hadoop.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-without-hadoop.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-without-hadoop.tgz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0.tgz.sha512 Added: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc Tue Aug 29 07:22:56 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTtlDMWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFmCqD/49rr8dtJvwJI0OgTeAKUO16cyh +tF2j7rnPmYppZN1kDAzcj5y03ikJKmAPund9hW8bTTIVB3FxpEHIVfjmrh8AqEi9 +7RGWQod5JmJ56O4LqVmjlZWbVFksPbrJ2/Am5ugTun+q9WTZFwjiIH2HprNWq4C4 +bbX3BDVOB5OG/WIucbWo5le01I9G75zpt/xnQ5FTJ+O9mMYwZ0DFC7QgQMIdWLHS +1+6GpDSt+gGC6aYqcOcCzIVqS4oJqkXGBxZwAO3+cQ0GQU0WA70KLRrt/2wacsvA +qhVgD9N+1stMf/G6tUbSeyB//uffbIrHwco660+fP8+x75HqUdc5U+jycjFWkH/e +MRX8AaBqepYK3K/Jk7Dm/6k4cN14IEpxYg87LC1Q+6bLVBZ/V6rduXatUcw+wMJT +qtoKEA0o60AaKNge70mJBmH5x2/Aknb5mOk/fGN90i+9u3pY26gVHPHT3qzsx3NK +3yVuL7qpDblaPbb7fllhBV9P8dLBIDhYVqsxTZpg98xfoVCDOjVc3vuQwDgVUBLw +q3iDgtBbuUZg4LBzGVks+bh0jq2SsHMptfpWz6fIjFFpyZV7p8CzuuQ78osK++wv +TDZt8dQILrnwASrWyuEp5j+PIpcOjtuK7BAMGD+M86Vq12k/X60tOTZAt9eqJpmX +S7i3eIKkM8GT7G2Pvg== +=MlOU +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 (added) +++ dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 Tue Aug 29 07:22:56 2023 @@ -0,0 +1 @@ +28ca9ab31c97ec172ec6ef09dbeaa4741c9ba3721811e097ea3905da49e5332237ba1ce43aae388c5436a211964b672e397c5793e6c6510f8fb2f228111aa95e SparkR_3.5.0.tar.gz Added: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc Tue Aug 29 07:22:56 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTtlDQWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFqBTD/9Ffs9IVpY4WOvcIvxbnvUpzf30 +Fn47zNuL5bKe/Nn81qr93COWHw+3SzqM2pZgcUfYbuwv5TwZz3o9xRF2Yi3F0R7Z +/OmcJeeccdvtruE7/KQtS2WuHkDK6yZC0Bo5XLZawVY2vXfB6mSrArgYjvRzBNeR +8XO+99JX3gNAuzahE8gEDDvJ0f7HqaRyGFvHwn/D4GeI8qi/pcW8tbSofLlmR6Og +rcfdscDeRPwSf6uU8ty+z3m8ZecdeaQbJvzGUt6ed8mfhQO+qPPYsHFWqHP0m/xZ +pzkB9Sx1Q0XRuguYhItEY204+DIiHkflJ/Ejutq2Oz8p0Kef5uUWPAZjRaElOtVU +eHOTbQIseV68wih510f6t6SwcCrU1Pfgm4gab5mIKgFO4NOLaznHfOPeFntSRECU +A8Kz6JyChON1WO/lrFjZSD9SghUFbl9/EJv436w/E1Lpv2dSjhVeWL40tWd6iMRr +5dbRF8numy7Fr1ndT5z+JjriltbASMOsMD09YdoAm9fS9GWwmZe8/aEBVG5PQeGu +harlm6nfsOYGzWvhFJhvoQS/1XVlXEwl/oUMu6etSbZXivtc9ZJezrI8amPT48jF +wDbL/+bujXo+U06lPwUt8FzU2JEiYb5VIt8AQsf973Q7iVYhPBmJcm/L6+h53sgq +BSgIjzSoyTFVuGtU4w== +=SpR1 +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.sha512 (added
[spark] 01/01: Preparing development version 3.5.1-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git commit cecd79ab57e323a55e99be89f372a61ac50bfe82 Author: Yuanjian Li AuthorDate: Tue Aug 29 05:57:11 2023 + Preparing development version 3.5.1-SNAPSHOT --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 1c093a4a980..66faa8031c4 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.0 +Version: 3.5.1 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index a0aca22eab9..45b68dd81cb 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index ce180f49ff1..1b1a8d0066f 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 8da48076a43..54c10a05eed 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 48e64d21a58..92bf5bc0785 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 2bbacbe71a4..3003927e713 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark sp
[spark] tag v3.5.0-rc3 created (now 9f137aa4dc4)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git at 9f137aa4dc4 (commit) This tag includes the following new commits: new 9f137aa4dc4 Preparing Spark release v3.5.0-rc3 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.5 updated (bbe12e148eb -> cecd79ab57e)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from bbe12e148eb Revert "[SPARK-44742][PYTHON][DOCS] Add Spark version drop down to the PySpark doc site" add 9f137aa4dc4 Preparing Spark release v3.5.0-rc3 new cecd79ab57e Preparing development version 3.5.1-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: Preparing Spark release v3.5.0-rc3
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to tag v3.5.0-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git commit 9f137aa4dc43398aafa0c3e035ed3174182d7d6c Author: Yuanjian Li AuthorDate: Tue Aug 29 05:57:06 2023 + Preparing Spark release v3.5.0-rc3 --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 66faa8031c4..1c093a4a980 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.1 +Version: 3.5.0 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index 45b68dd81cb..a0aca22eab9 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index 1b1a8d0066f..ce180f49ff1 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 54c10a05eed..8da48076a43 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 92bf5bc0785..48e64d21a58 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 3003927e713..2bbacbe71a4 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-paren
[spark] tag v3.5.0-rc3 deleted (was d5423e7a89c)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git *** WARNING: tag v3.5.0-rc3 was deleted! *** was d5423e7a89c Preparing Spark release v3.5.0-rc3 The revisions that were on this tag are still contained in other references; therefore, this change does not discard any commits from the repository. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch branch-3.5 updated: Revert "[SPARK-44742][PYTHON][DOCS] Add Spark version drop down to the PySpark doc site"
This is an automated email from the ASF dual-hosted git repository.
liyuanjian pushed a commit to branch branch-3.5
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/branch-3.5 by this push:
new bbe12e148eb Revert "[SPARK-44742][PYTHON][DOCS] Add Spark version drop
down to the PySpark doc site"
bbe12e148eb is described below
commit bbe12e148eb1f289cfb1f4412525f4c4381c10a9
Author: Yuanjian Li
AuthorDate: Mon Aug 28 22:43:50 2023 -0700
Revert "[SPARK-44742][PYTHON][DOCS] Add Spark version drop down to the
PySpark doc site"
This reverts commit 319dff11c373cc872aab4e7d55745561ee5d7b0e.
---
python/docs/source/_static/css/pyspark.css | 13
python/docs/source/_static/versions.json | 22 ---
.../docs/source/_templates/version-switcher.html | 77 --
python/docs/source/conf.py | 9 +--
4 files changed, 1 insertion(+), 120 deletions(-)
diff --git a/python/docs/source/_static/css/pyspark.css
b/python/docs/source/_static/css/pyspark.css
index ccfe60f2bca..89b7c65f27a 100644
--- a/python/docs/source/_static/css/pyspark.css
+++ b/python/docs/source/_static/css/pyspark.css
@@ -95,16 +95,3 @@ u.bd-sidebar .nav>li>ul>.active:hover>a,.bd-sidebar
.nav>li>ul>.active>a {
.spec_table tr, td, th {
border-top: none!important;
}
-
-/* Styling to the version dropdown */
-#version-button {
- padding-left: 0.2rem;
- padding-right: 3.2rem;
-}
-
-#version_switcher {
- height: auto;
- max-height: 300px;
- width: 165px;
- overflow-y: auto;
-}
diff --git a/python/docs/source/_static/versions.json
b/python/docs/source/_static/versions.json
deleted file mode 100644
index 3d0bd148180..000
--- a/python/docs/source/_static/versions.json
+++ /dev/null
@@ -1,22 +0,0 @@
-[
-{
-"name": "3.4.1",
-"version": "3.4.1"
-},
-{
-"name": "3.4.0",
-"version": "3.4.0"
-},
-{
-"name": "3.3.2",
-"version": "3.3.2"
-},
-{
-"name": "3.3.1",
-"version": "3.3.1"
-},
-{
-"name": "3.3.0",
-"version": "3.3.0"
-}
-]
diff --git a/python/docs/source/_templates/version-switcher.html
b/python/docs/source/_templates/version-switcher.html
deleted file mode 100644
index 16c443229f4..000
--- a/python/docs/source/_templates/version-switcher.html
+++ /dev/null
@@ -1,77 +0,0 @@
-
-
-
-
-{{ release }}
-
-
-
-
-
-
-
-
-// Function to construct the target URL from the JSON components
-function buildURL(entry) {
-var template = "{{ switcher_template_url }}"; // supplied by jinja
-template = template.replace("{version}", entry.version);
-return template;
-}
-
-// Function to check if corresponding page path exists in other version of docs
-// and, if so, go there instead of the homepage of the other docs version
-function checkPageExistsAndRedirect(event) {
-const currentFilePath = "{{ pagename }}.html",
- otherDocsHomepage = event.target.getAttribute("href");
-let tryUrl = `${otherDocsHomepage}${currentFilePath}`;
-$.ajax({
-type: 'HEAD',
-url: tryUrl,
-// if the page exists, go there
-success: function() {
-location.href = tryUrl;
-}
-}).fail(function() {
-location.href = otherDocsHomepage;
-});
-return false;
-}
-
-// Function to populate the version switcher
-(function () {
-// get JSON config
-$.getJSON("{{ switcher_json_url }}", function(data, textStatus, jqXHR) {
-// create the nodes first (before AJAX calls) to ensure the order is
-// correct (for now, links will go to doc version homepage)
-$.each(data, function(index, entry) {
-// if no custom name specified (e.g., "latest"), use version string
-if (!("name" in entry)) {
-entry.name = entry.version;
-}
-// construct the appropriate URL, and add it to the dropdown
-entry.url = buildURL(entry);
-const node = document.createElement("a");
-node.setAttribute("class", "list-group-item list-group-item-action
py-1");
-node.setAttribute("href", `${entry.url}`);
-node.textContent = `${entry.name}`;
-node.onclick = checkPageExistsAndRedirect;
-$("#version_switcher").append(node);
-});
-});
-})();
-
diff --git a/python/docs/source/conf.py b/python/docs/source/conf.py
index 0f57cb37cee..38c331048e7 100644
--- a/python/docs/s
svn commit: r63661 - /dev/spark/v3.5.0-rc3-bin/
Author: liyuanjian Date: Mon Aug 28 08:21:10 2023 New Revision: 63661 Log: Apache Spark v3.5.0-rc3 Added: dev/spark/v3.5.0-rc3-bin/ dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-hadoop3.tgz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-without-hadoop.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-without-hadoop.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0-bin-without-hadoop.tgz.sha512 dev/spark/v3.5.0-rc3-bin/spark-3.5.0.tgz (with props) dev/spark/v3.5.0-rc3-bin/spark-3.5.0.tgz.asc dev/spark/v3.5.0-rc3-bin/spark-3.5.0.tgz.sha512 Added: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.asc Mon Aug 28 08:21:10 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTsWJYWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFhTrEACuJKbQ4KQeyC2rnWxD5X35FRvJ +K8+Oodzju3zuA1MUSKROOR/d3gWAW5iv+DScqD/30AoEkmR17JwygD25dT7Kj3N6 +EntulHvCCT52bX+iz8f6vNCmC/OsgwUSRbG4Q7zkFThTQAgsyqCPyfMhdPvL5bfP +dA50A9b6uhromOSKs+4lXAw4CADee0DMMLGGEqk+NiCga55JydbqhV77E6319ANK +2kGL+pAYKuDnQSYtHzjfooqD5dLTmy5EoaODEdlexH3msqXTC57OczKBXAcSem+d +AWn/wGDx9ZmC6jJ6PjorgdIOooQw2HOmCtF/03S2eq2K0cp0PUpCLVhfgC3Bnxty +LlGyr2rcDg7c2qRUzKF+60TiCHsCpukiOqt3CIj8Ey2cD+MGn7WcICvciwXO1pc+ +Xkm5fIOO4jmw+1G5KIpmOcTs7FxayYDevURWfdW3oQAiETFQhjaIN3zWW2TpMuPU +wQ3yAopyrSZxkfJ6pQ8ekQo93eahe0S6uJG777hbhqNwd1nF8GDHVzdMYALmGAiG +EZ6HoFxvcl3swydseDMmG8ItZFiJfHv+C+66XfwhPE+eiZuC8jVMXGCwOe/5rqc8 +ZgoSas++PeLnPjU/jrsE8TSfZeG6n59AKP8gmYPiDzdxO+J1bi+5ReRJysY4CNo/ +upeCSJcXESxZLDxzmQ== +=A7NR +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 (added) +++ dev/spark/v3.5.0-rc3-bin/SparkR_3.5.0.tar.gz.sha512 Mon Aug 28 08:21:10 2023 @@ -0,0 +1 @@ +e90007efce8d63c10aaa9efc09fb0b63496c6a8e1bbac06941bc48fd5642a8e87da05b14e886f4fc18412ca1d816b455d3b4665b7242ee759c58b3849829cc74 SparkR_3.5.0.tar.gz Added: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.asc Mon Aug 28 08:21:10 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTsWJcWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFh9yD/4nQKM0ROSW08uBgcNQIHg7cYjt +9gdnueZEaIFhEEhBqlCnFsV3IlUenuc6yimqmIoMvRH8Y2zacrG7cu0DhvnUWMQL +nysi/6MY3FX2iVvsnM0K4GWa25VQ+0XJbEJK7mra9DfGbkA1GiDmUn9VY/lzifjQ +fKbajPJVCo9j+wDeKHh/tAyD2JHveB8LB5zg+yY9Wgtyw/VgHqSnNRB1wJRreojz +r54w8NGzO8nj3nu+TAmHjiprqpjWx7MQOaFiCFKgsYpooSBmfDXx38KxBshINIbv +9ZbiAXwTpIpCr2N2yPAgowtoUvC/Jusl7Tu/ao/4Y8m3ENBl8q0xxhvHjMkZgH5c +811xswVanFn4FR0e/tQnd3599yf2sFoHo72RVJ1Vac/AopFYFnowgJcxRB6vabkM +6BOHDffQxg+MVGvypywU60+2TFw0EyZnIvAj1t0qKKXnIgRldXYdVjppDm8OKenv +X84KryLmoF40uQpInABn4ML8kk5mD+lZt6ckAhZOv1xbLiNIH5uCozo+EoAQLlJK +T7AF25BXkjqM0cekN9CChqVTpYc/dat9iOtAba3+1ri7SQDJ/HEZpBxL6/JHv5pe +IHcYfMPBWlGfp2NSKclFy9d10a46enC3hNSli7f+HT0n7A96g1vONTqO9iSkmVsD +UIRfRlvkVm0tL58uiQ== +=HA3S +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc3-bin/pyspark-3.5.0.tar.gz.sha512 (added
[spark] branch branch-3.5 updated (fa2e53f6105 -> 9b00d367c18)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from fa2e53f6105 [SPARK-44784][CONNECT] Make SBT testing hermetic add d5423e7a89c Preparing Spark release v3.5.0-rc3 new 9b00d367c18 Preparing development version 3.5.1-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: Preparing development version 3.5.1-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git commit 9b00d367c1898d63ba276a3c973c54f34cfcb5c1 Author: Yuanjian Li AuthorDate: Sun Aug 27 23:45:57 2023 + Preparing development version 3.5.1-SNAPSHOT --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 1c093a4a980..66faa8031c4 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.0 +Version: 3.5.1 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index a0aca22eab9..45b68dd81cb 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index ce180f49ff1..1b1a8d0066f 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 8da48076a43..54c10a05eed 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 48e64d21a58..92bf5bc0785 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 2bbacbe71a4..3003927e713 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark sp
[spark] tag v3.5.0-rc3 created (now d5423e7a89c)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git at d5423e7a89c (commit) This tag includes the following new commits: new d5423e7a89c Preparing Spark release v3.5.0-rc3 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: Preparing Spark release v3.5.0-rc3
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to tag v3.5.0-rc3 in repository https://gitbox.apache.org/repos/asf/spark.git commit d5423e7a89ccca92beab15c82719fd60f6576e49 Author: Yuanjian Li AuthorDate: Sun Aug 27 23:45:52 2023 + Preparing Spark release v3.5.0-rc3 --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 66faa8031c4..1c093a4a980 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.1 +Version: 3.5.0 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index 45b68dd81cb..a0aca22eab9 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index 1b1a8d0066f..ce180f49ff1 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 54c10a05eed..8da48076a43 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 92bf5bc0785..48e64d21a58 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 3003927e713..2bbacbe71a4 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-paren
svn commit: r63512 - in /dev/spark/v3.5.0-rc2-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.2.2/ _site/api/R/deps/jquery-3.6.0/ _site/api
Author: liyuanjian Date: Sat Aug 19 08:16:38 2023 New Revision: 63512 Log: Apache Spark v3.5.0-rc2 docs [This commit notification would consist of 2894 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63506 - /dev/spark/v3.5.0-rc2-bin/
Author: liyuanjian Date: Fri Aug 18 21:12:20 2023 New Revision: 63506 Log: Apache Spark v3.5.0-rc2 Added: dev/spark/v3.5.0-rc2-bin/ dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.asc dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz.asc dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz (with props) dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.asc dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.sha512 dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-hadoop3.tgz (with props) dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-hadoop3.tgz.asc dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-hadoop3.tgz.sha512 dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-without-hadoop.tgz (with props) dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-without-hadoop.tgz.asc dev/spark/v3.5.0-rc2-bin/spark-3.5.0-bin-without-hadoop.tgz.sha512 dev/spark/v3.5.0-rc2-bin/spark-3.5.0.tgz (with props) dev/spark/v3.5.0-rc2-bin/spark-3.5.0.tgz.asc dev/spark/v3.5.0-rc2-bin/spark-3.5.0.tgz.sha512 Added: dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.asc Fri Aug 18 21:12:20 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTf3lIWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFptrD/4+D/3YCZuXw2tb4GUq4CpCR3uO +uJogYTjVlDxxuuCD5J8g9CKXTNQEghGwddHJxkGW42B6R8KVoOylxyWDj7ZlUkbK +gae1c3srPFbNqlCS9wuI9Bxtb1CFr9qvIaNSYwTRWkfBWJvz6nmkLpqccz6QIBFo +yGcdfNg2+ZaYe3uG6DsSqWWTsUFXqsnaG02QTkxRBE6fxjVZFb7W7PWFMb98d94U +TnoNpnZSttA/g7cQUJkyuE9e7vEKzf7+Q1DWVyByZB+EjYWrrDkElF1NWQtOUAxw +NxkVud22JmQMmrbQfD25lPD/rD7DxkVpKHkz6v3Mif9ZUkAvk2BBK9Zud9GnUdrh +5AnZ3A/YxO68Beqp0mQnFYRXMzLPRB3VuyI5yifUafZUsihly4k7i5B6iSNLiFMU +Ub1xXVMLPEmrn8ZGAsVc6HcxSmI+GJhf92weOKEs7HgOULcy7IRaUGSefNXXmILB +g2LC1zS3uwO5i19hyG+j8HoVLuy61yaeeRzEFCfs/9fpIBS9R22PJxFkVuU/2OwS +Px7vYWxGTUR0xXCHB26Ep/n6413lIfoiKm7bDRFkcHQbpuZHV5GiuSC+0L2WKBGd +yvRTXknJb0nmfONzjmqXzd6ClkHZbAPlgZg+nY0oaAHA2JXdVhjfcYRIiiMcUU7i +JLzXAMuXQJrTntoD2w== +=enEM +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.sha512 (added) +++ dev/spark/v3.5.0-rc2-bin/SparkR_3.5.0.tar.gz.sha512 Fri Aug 18 21:12:20 2023 @@ -0,0 +1 @@ +92a36033042014dea66914f4d0be9a1d243a9ec736fb4efb9fdcbd6ad7c1c54a54183455936f250839826c9cb24cd79084afb033675c3073c2d318fb77c8f64d SparkR_3.5.0.tar.gz Added: dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz.asc Fri Aug 18 21:12:20 2023 @@ -0,0 +1,17 @@ +-BEGIN PGP SIGNATURE- + +iQJKBAABCgA0FiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTf3lMWHGxpeXVhbmpp +YW5AYXBhY2hlLm9yZwAKCRB+GrzFOqoiFrzQEACqQmjnoQ+LmZfmbsJxhs1prxX3 +b4FUWk5HVnD0BKebELThLx9Fsu2V8CU6WmOz0RuPcObS0mJrmb7ekh/vRAnzstJq +W8hYyfGXUMgDWvJcliNgILaN0i+HW5raN3xsMqCe+YVpvX4pEeni0FSUXLDM7Brh +J23WRoJvT60buDtyjuUTCT/cdSmzuKg+MVSOp2u+gA7qwcXvejNFDFJY9eFndrVa +gi6BzM4qYWpY4sJuAADy/zA6KBawvMgML4dk0gefswKR1MBz9WWVjy5nvx5ki/Od +NUV2vYKkRjucqpMrQJ4fY/knkN89bTpua0M4X2Bbbfn0uoj1IuXYKvCt9z+AY4To +yRyAxO8pMfT6b7tq5qogh0Jc1y3EQsyBjhyuE65NF+RrAGFvASWNikEdXQNjJVlc +fwYL016esso6KjHCAb7Vwnoca6L4UinB1DfKuWAKzwphQOUK7HQHyOpPBmDn4Ceo +X4AlO0I3uIxuiGvCKdlhkEJyVleSYzhO2ZLb837A9S4U388VTAgX4N5eXqQPLoOB +4RHZJ4SFhpl/bks44lFGLD91izxGUs63RwV5f8xABW9qPwBu8eJgYCvB9NjADpGZ +3zNua3pZ0YK3Mlb0PZGbzWXgwECUQthtZC/xpCNQPXvX82bOQsr+T9zGOC3YGWwg +V4HhhBHsd5xm/Ng5rg== +=NtnC +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc2-bin/pyspark-3.5.0.tar.gz.sha512 (added
[spark] tag v3.5.0-rc2 created (now 010c4a6a05f)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0-rc2 in repository https://gitbox.apache.org/repos/asf/spark.git at 010c4a6a05f (commit) No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/02: Preparing Spark release v3.5.0-rc2
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git commit 010c4a6a05ff290bec80c12a00cd1bdaed849242 Author: Yuanjian Li AuthorDate: Fri Aug 18 08:37:59 2023 + Preparing Spark release v3.5.0-rc2 --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 66faa8031c4..1c093a4a980 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.1 +Version: 3.5.0 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index d97f724f0b5..a389e3fe9a5 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index 1b1a8d0066f..ce180f49ff1 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 54c10a05eed..8da48076a43 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 92bf5bc0785..48e64d21a58 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.1-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 3003927e713..2bbacbe71a4 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-paren
[spark] 02/02: Preparing development version 3.5.1-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git commit 2682cfbf36e04d25a99d1b5b3db0426eb66955d0 Author: Yuanjian Li AuthorDate: Fri Aug 18 08:38:03 2023 + Preparing development version 3.5.1-SNAPSHOT --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 1c093a4a980..66faa8031c4 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.0 +Version: 3.5.1 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index a389e3fe9a5..d97f724f0b5 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index ce180f49ff1..1b1a8d0066f 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 8da48076a43..54c10a05eed 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 48e64d21a58..92bf5bc0785 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 2bbacbe71a4..3003927e713 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark sp
[spark] branch branch-3.5 updated (41e7234b848 -> 2682cfbf36e)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from 41e7234b848 [SPARK-44834][PYTHON][SQL][TESTS][FOLLOW-UP] Update the analyzer results of the udtf tests new 010c4a6a05f Preparing Spark release v3.5.0-rc2 new 2682cfbf36e Preparing development version 3.5.1-SNAPSHOT The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63311 - in /dev/spark/v3.5.0-rc1-docs: ./ _site/ _site/api/ _site/api/R/ _site/api/R/articles/ _site/api/R/deps/ _site/api/R/deps/bootstrap-5.2.2/ _site/api/R/deps/jquery-3.6.0/ _site/api
Author: liyuanjian Date: Wed Aug 2 08:03:54 2023 New Revision: 63311 Log: Apache Spark v3.5.0-rc1 docs [This commit notification would consist of 2892 parts, which exceeds the limit of 50 ones, so it was shortened to the summary.] - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
svn commit: r63306 - /dev/spark/v3.5.0-rc1-bin/
Author: liyuanjian Date: Wed Aug 2 02:57:39 2023 New Revision: 63306 Log: Apache Spark v3.5.0-rc1 Added: dev/spark/v3.5.0-rc1-bin/ dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.asc dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz (with props) dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.asc dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.sha512 dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz (with props) dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.asc dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-hadoop3-scala2.13.tgz.sha512 dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-hadoop3.tgz (with props) dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-hadoop3.tgz.asc dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-hadoop3.tgz.sha512 dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-without-hadoop.tgz (with props) dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-without-hadoop.tgz.asc dev/spark/v3.5.0-rc1-bin/spark-3.5.0-bin-without-hadoop.tgz.sha512 dev/spark/v3.5.0-rc1-bin/spark-3.5.0.tgz (with props) dev/spark/v3.5.0-rc1-bin/spark-3.5.0.tgz.asc dev/spark/v3.5.0-rc1-bin/spark-3.5.0.tgz.sha512 Added: dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.asc Wed Aug 2 02:57:39 2023 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTJxbgACgkQfhq8xTqq +IhZ8rRAArVC0miH0g7k5hSoW4LHaraZylR90vghAYOQAl/7AenBE11MZM8gKwuil +oRgbH70B6YimdNIV4/D6LMkk9+ZgWpqsfxYrM10jjK09/9Q7eqI0aKwb69sI8WO4 +YKOwMaLs511qZkNa3rinK1UzJZP3n28+m6UjmxVs4VJM1DFfGX0YCeuZX0hcZbIM +KpUxXpenWiRv1XLeHQAvINxLtb6Dps9tooeKSagTwljlkEE6nO5PnZaOZytbp6OS +lR7aozlbwSJuXbc32Qorbnuu196T2ytL96Wcy15dLEaKKyfwCVYgXCPWonRoFH0b +ayM6rj5EjYmkud0blrPdS+mP6HZnRUiBB1pqZU+Fz+f7KUFBuV3gEkqKs9vqpPDa +b7HzEe6LK+DhNZw3xail99UKPc1Rxh+vZZ6FlmQlxU4Ru/ITN5garhhGcoQqvXgT +//CLae2idX1EYrRXlKLVv0GkutzRqhILaaf/TrVm4YV+XkGQJNDy2pS1SxLdq72y +IGeH1Rqxz1CDHbDWNCdIrYMv82hEI2eg6M7xoZL0h+i2u/rAARyaIc3BtZ/yUf6g +6FVjwcPRGtQ/BWmouAW0+4IsiRYzJ5+G2AgMU0nyPp4ZyM46ta+aEQwa59SDHBzI +cEVHIs1q+2P0tpF/E9z4GSbJrC6M87x87vQf58RizvJ+agHsr/I= +=Gld6 +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.sha512 (added) +++ dev/spark/v3.5.0-rc1-bin/SparkR_3.5.0.tar.gz.sha512 Wed Aug 2 02:57:39 2023 @@ -0,0 +1 @@ +3ec2a549720354a5a49f06159dabf848796cc8fc61e544dffcce5d92bf6b2bb2939d6a4d50d2fab67b1f76fc56ea8667cc45c371717db3b05a4379a49b88bf55 SparkR_3.5.0.tar.gz Added: dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz == Binary file - no diff available. Propchange: dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz -- svn:mime-type = application/octet-stream Added: dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.asc == --- dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.asc (added) +++ dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.asc Wed Aug 2 02:57:39 2023 @@ -0,0 +1,16 @@ +-BEGIN PGP SIGNATURE- + +iQIzBAABCgAdFiEE/Drjp+qhusmHcIQOfhq8xTqqIhYFAmTJxboACgkQfhq8xTqq +IhYBlg//d0kfe8i2f5qTsxymcXy2oyB8jmRV6raCyqX7IrvQhSN67a2eKdwS39ji +2VE7ikCrpyQDg11KW3PgvL2XMchcWi2T3N75pX5YNeMevLmjyepRHb91M+A7WfKt +sNg6krtRU8arPKw48rRiiAsY7f9SJnVYt8A/8qrB7MmQEVlUUByzm5ENMQrr1AaV +0lwu1Xpu8YP+YqtJFc1Yo5QJFl/ERtOf8M6BCHJ44B4c2Dtu+14Apf/cTKVtKZPP +itcvHWEtKnFjJhz1zYUOkQ2d5vhpsVVKWJXOrPZDWNp09xjyflz01JMZlszd8sM7 +Mmfn7pCPwDViG5rBdz34x78Oz+BO7vdxO/Cr42o1iOIaC0vTfhpMISiTvXeanzgd +wfgKoTrFvWVxY5LVu1rDvna5FudxCnlhB0PI6qlf6go66tjSxGaH7qLqwCV34vd1 +GKAKhoDQ8FaQExepJv793PVPLrTQEVArMdKUecvgbTWU5zZ46q8AlKyVVY6o5+KM +xHXNCoLh3kK7CljAQEXMd8SIARCPNb7jQGQMp9ttK2q/dSqntUS5TqYYkhTDlDkO +PFhD7RWiXw7zSxuMPolJrdKA6Ov4LE6WqMTdGnu6ErN5v7XqrWfd527Z/qHp9qap +ss3D5DQyLAjGKGN6AHiixGuQnvgZ19Wu0D88g/SM9FGRZyFgO2k= +=FInA +-END PGP SIGNATURE- Added: dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.sha512 == --- dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.sha512 (added) +++ dev/spark/v3.5.0-rc1-bin/pyspark-3.5.0.tar.gz.sha512 Wed Aug 2 02
[spark] branch branch-3.5 updated (d8ce4a70c93 -> 495447f3c04)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git from d8ce4a70c93 [SPARK-42497][FOLLOWUPS][TESTS] Add missing UTs to `modules.py` add 7e862c01fc9 Preparing Spark release v3.5.0-rc1 new 495447f3c04 Preparing development version 3.5.1-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: Preparing development version 3.5.1-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git commit 495447f3c04b389f8b13d314714604611532d062 Author: Yuanjian Li AuthorDate: Wed Aug 2 02:19:22 2023 + Preparing development version 3.5.1-SNAPSHOT --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 6 +++--- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 45 files changed, 47 insertions(+), 47 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 1c093a4a980..66faa8031c4 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.0 +Version: 3.5.1 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index a389e3fe9a5..d97f724f0b5 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index ce180f49ff1..1b1a8d0066f 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 8da48076a43..54c10a05eed 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index 48e64d21a58..92bf5bc0785 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0 +3.5.1-SNAPSHOT ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 2bbacbe71a4..3003927e713 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark sp
[spark] tag v3.5.0-rc1 created (now 7e862c01fc9)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to tag v3.5.0-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git at 7e862c01fc9 (commit) This tag includes the following new commits: new 7e862c01fc9 Preparing Spark release v3.5.0-rc1 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: Preparing Spark release v3.5.0-rc1
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to tag v3.5.0-rc1 in repository https://gitbox.apache.org/repos/asf/spark.git commit 7e862c01fc9a1d3b47764df8b6a4b5c4cafb0807 Author: Yuanjian Li AuthorDate: Wed Aug 2 02:19:19 2023 + Preparing Spark release v3.5.0-rc1 --- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- docs/_config.yml | 4 ++-- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- python/pyspark/version.py | 2 +- repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 44 files changed, 45 insertions(+), 45 deletions(-) diff --git a/assembly/pom.xml b/assembly/pom.xml index 09d6bd8a33f..a389e3fe9a5 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +3.5.0 ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index bef8303874b..ce180f49ff1 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 2b43f9ce98a..8da48076a43 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index a8bde14a259..48e64d21a58 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 671d5cb7e01..2bbacbe71a4 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/sketch/pom.xml b/common/sketch/pom.xml index 4cc597519c3..fca31591b1e 100644 --- a/common/sketch/pom.xml +++ b/common/sketch/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +3.5.0 ../../pom.xml diff --git a/common/tags/pom.xml b/common/tags/pom.xml index 9a44c847d8a..a93e227655e 100644 --- a/common/tags
svn commit: r63291 - /dev/spark/KEYS
Author: liyuanjian Date: Tue Aug 1 09:02:39 2023 New Revision: 63291 Log: Update KEYS from Yuanjian Modified: dev/spark/KEYS Modified: dev/spark/KEYS == --- dev/spark/KEYS (original) +++ dev/spark/KEYS Tue Aug 1 09:02:39 2023 @@ -1906,3 +1906,60 @@ SwG6KnEvjr0Rt2ktLnx2RWcKBhHNP78tOKIK1Gf/ fVwsw+tRkSftdafHeZuJKHkXbw== =LnC6 -END PGP PUBLIC KEY BLOCK- + +pub rsa4096 2023-07-17 [SC] + FC3AE3A7EAA1BAC98770840E7E1ABCC53AAA2216 +uid Yuanjian Li (CODE SIGNING KEY) +sub rsa4096 2023-07-17 [E] +-BEGIN PGP PUBLIC KEY BLOCK- + +mQINBGS1szEBEAC4Bve0aRc5IYF2D+bhvf/6LFF8fiN2WHGiS2p8PImdWwvABwM5 +uHIOGLQVlJ5vEjIhhyJ8tBWJMnUdP0nHS1Y6bl5P7FC0ry/+JmWu8S8beCspREm1 +isMfnOXI/xYrx/bwFtkbpoIB4QDBoJ/yrlSJLO86DRjRBTYwv3UpUXUz8xIUfTca +MF+k9zbbXrttcUeP23BKWELvkdmz5PwBxLfLHa6qKFXO2+rBdtzGSIwiwgcr1N1b +o/ePihXQzkKa8vCDrM9e0GvMqT0eLwy647ATNHg/3OF0X5zC/oQjU38kBQ8KKDsu +KTct1/k5RfyfiIDEXI5vcJxJOjs4LCQiW/aBqM4fJ0MbBTu8Fkj/hkg06wKBYu53 +sFjkUZL43imfa68M1/xpCb0EjATP7vzp6hWqor7++n1/Vkq3xyxZKWi7ALWu/9pp +1LO/Uc/xENIDfCDZ9ppkji0s4UARd/87BP8VPKUrCuTXCLWcRr7so4a3TBLKj9iR +9aYUijzj0adeBQ72XyCofB5asiFpfoytPtAhBQur05b+WIPMIkLC8RjMe5Tg18Wr +eJ4rzAC5o186B8xvfqnHYzLgs2q/3roUwz7NiQgqY5NXXDcwWtrMvXIlJ1KNHdCL ++Ge1yn+KbSNrHrBX5yqGunqDSuwSrZ7mKaenqBD4RavHi3nn9IvAWRwjTwARAQAB +tDZZdWFuamlhbiBMaSAoQ09ERSBTSUdOSU5HIEtFWSkgPGxpeXVhbmppYW5AYXBh +Y2hlLm9yZz6JAlEEEwEIADsWIQT8OuOn6qG6yYdwhA5+GrzFOqoiFgUCZLWzMQIb +AwULCQgHAgIiAgYVCgkICwIEFgIDAQIeBwIXgAAKCRB+GrzFOqoiFkEkD/kBnFGC +p4fmJVTOTh0Jmpxqfj+uTweT5103KbNgjdGuvVYk1OfpfX2RCaJotwRBMJxL0lwe +DF51tP6V4EVcgfKxuhQ38qZ5OLxOB+wq/sxeTZ9uRtvxYmVzMtyMJcEy8UaqkR4n +9amSF50kZBTeAGyh/3YIXWYXqMUx22RNlKExv/tBvI3ZHnzlJD5xV3IX0ZrA/3xi +JAR9/gwAmuIFW0RVjjzeT88fVgv+CRfda6YFFJkLFjLMP/48Xa/AsmR2ll6rtgEQ +rL5a3S1nwGIHi0bU3aqbBchr0APZFVjmtlyqg965ITQqLUqieXlcVLWodDxS0rUz +ytxXpRcs2byow221iHOBkKkLzOIZv93GoFh4ZbNamfbqYuLR+pe0Ylukp0+bwxIO +BE2/ByJZnMWAP1eoMe54cL539hgh1E08kw2mk1ldC9aJNUItimxcOUsaXpmfQlvR +nbBOIyy0gAfaxa9S1GKZdVLqslBHBklhq9bcF8m4jk4mHifriwCXeINEz8OQWFg1 +DuIyLiB3Zfq+bxwAdhxz7DznBpUVnumWPda9UZB3Sj21B/5XjFO6uTvWRuecTCxD +tqR8USXZ2PgurSaSW51U/3SLj3NmKopf/j5eZfWcLbty7qh/j0ZfZFJsfAbKG0AY +XlqcNI0EUizhRmeHYnujjCmdEas7Tz0m2p3WjrkCDQRktbMxARAAy5Rz1uege1zV +zNFt3dhF6OVxc6FP3ik/KBsoaOBmm0+K/1qOE/zK02pcEuJoUdP5deU9XU8It+6Y +vYtQf/ygHj0ArWqtkMb7av86gpWPJWpL3LrMpG6H6CzoJ327KAYfulxJdPn/tmk6 +oUdbP8q0b+xXNVfuzXxHmPVlSXh0WHZvCnZzn08f+PQbWBf7iv2ctaWRBQyQbbvz +yGO8RqzDRnXz/YFLjvUrSaBIDX2k9Ev0378T9R/DLQUKUtM/EBeoWa0+Nr9BHIc3 +6eOBlmWROptDdurBeydiWcFBnl3KI9is2iXw05xvViS7nIWe+5HX0UBs3Vv/wBb2 +pMvA9h7rYfXer7A8Mu/GzG8j3z+d/tzAakLJArcWhJ/tM1PD4K5q49MlZYjmvAK5 +2tv2LTCN2ug8+8DonMonSQa+jwTBeUyMqtP8GK3m2r/o2NheHAprx20bzjp+Q9Tv +Q30rdca+Y4/XpZDyj8s7eZd+Cankr0EMvM6lkaWLEjs45lMu00E4DMM2qAiFQqRh +faA6DPXy2FKT9BJqrz+XuSiyrt1qxsEbCIE7+gHuqGclPibzAGG334XJ+GxWRXY1 +a9xjRpUkFkkcEdFJnHqRId1jlNrg4j4nqbaVzZ1eY6EYsuQyeWojVFUM8CHnjT0I +c3xvFUedetuLCpvOAcJDCti2A48fqRsAEQEAAYkCNgQYAQgAIBYhBPw646fqobrJ +h3CEDn4avMU6qiIWBQJktbMxAhsMAAoJEH4avMU6qiIWRKsP+wY3oXhTI6WIT2Bw +UBGnoxBzF0sooyUubTpkStJTB4r9fhV64QCfaqh9KJst3rnFDisAm7rohtDy/rQe +N/TxMwTLgqB1wF5a5bhMkOPglrJXRVJp+JJjr9Ot/aQUSx22bmuxrLgUvSCGjCa6 +jtWoU2jckR5YtW3NJWovPSJ07zu76sfjKvnvjD1M4udzatRlzVGQUQR5Q3Z86xP1 +T/LF6DbI1aF/LadZsROgVRKPkV8imEd/5pa/d3KgF4RZvxoJCtRzV5nmA8sbqWQA ++dQPMlUZ6DeDR9D2mtFOpvEscO5QafBH8m0eMuUfWPZ/aMXiLiwhgCUy/Z+/BjFa +zxIG9YqUgLOFjQW1AxHrq5dFa0OQdO0zTnesdgfUDrmgFZGzI+JzykTgmG3dNbT7 +WjDJafAoOwWOgg8r180oq6CD4I67SQSvFiJtGNoVF8zHY8+Gzx1YTB/4016eZTki +QpnZvBLLSWZWP2l2xZJbPILUbik8kxDcToRJXpoV9KktALA5CWjVZ5tJWajtoL33 +eWXXiC+qnz+Wk+Hs87zUSQxbway19r79Jz1+aHQUpR0P1V+kqqNMuUyQmSVSMLLJ +3BTWQdHTH/vxCWAj9RlzBBdWufB+a9CDTI7dLpHx1az+rGBf85fYC+uVaNRmrS/1 +udDbyJxrGbyiCaZiSV6aSgf+U5xi +=Yumi +-END PGP PUBLIC KEY BLOCK- - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch SPARK-44470 deleted (was 55a9b7a8704)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch SPARK-44470 in repository https://gitbox.apache.org/repos/asf/spark.git was 55a9b7a8704 setting version to 4.0.0-SNAPSHOT This change permanently discards the following revisions: discard 55a9b7a8704 setting version to 4.0.0-SNAPSHOT - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch SPARK-44470 created (now 55a9b7a8704)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch SPARK-44470 in repository https://gitbox.apache.org/repos/asf/spark.git at 55a9b7a8704 setting version to 4.0.0-SNAPSHOT This branch includes the following new commits: new 55a9b7a8704 setting version to 4.0.0-SNAPSHOT The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] 01/01: setting version to 4.0.0-SNAPSHOT
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch SPARK-44470 in repository https://gitbox.apache.org/repos/asf/spark.git commit 55a9b7a870465a293f76047d5859610a818d015d Author: Yuanjian Li AuthorDate: Mon Jul 17 23:18:35 2023 -0700 setting version to 4.0.0-SNAPSHOT --- R/pkg/DESCRIPTION | 2 +- assembly/pom.xml | 2 +- common/kvstore/pom.xml | 2 +- common/network-common/pom.xml | 2 +- common/network-shuffle/pom.xml | 2 +- common/network-yarn/pom.xml| 2 +- common/sketch/pom.xml | 2 +- common/tags/pom.xml| 2 +- common/unsafe/pom.xml | 2 +- common/utils/pom.xml | 2 +- connector/avro/pom.xml | 2 +- connector/connect/client/jvm/pom.xml | 2 +- connector/connect/common/pom.xml | 2 +- connector/connect/server/pom.xml | 2 +- connector/docker-integration-tests/pom.xml | 2 +- connector/kafka-0-10-assembly/pom.xml | 2 +- connector/kafka-0-10-sql/pom.xml | 2 +- connector/kafka-0-10-token-provider/pom.xml| 2 +- connector/kafka-0-10/pom.xml | 2 +- connector/kinesis-asl-assembly/pom.xml | 2 +- connector/kinesis-asl/pom.xml | 2 +- connector/protobuf/pom.xml | 2 +- connector/spark-ganglia-lgpl/pom.xml | 2 +- core/pom.xml | 2 +- examples/pom.xml | 2 +- graphx/pom.xml | 2 +- hadoop-cloud/pom.xml | 2 +- launcher/pom.xml | 2 +- mllib-local/pom.xml| 2 +- mllib/pom.xml | 2 +- pom.xml| 2 +- project/MimaExcludes.scala | 4 repl/pom.xml | 2 +- resource-managers/kubernetes/core/pom.xml | 2 +- resource-managers/kubernetes/integration-tests/pom.xml | 2 +- resource-managers/mesos/pom.xml| 2 +- resource-managers/yarn/pom.xml | 2 +- sql/api/pom.xml| 2 +- sql/catalyst/pom.xml | 2 +- sql/core/pom.xml | 2 +- sql/hive-thriftserver/pom.xml | 2 +- sql/hive/pom.xml | 2 +- streaming/pom.xml | 2 +- tools/pom.xml | 2 +- 44 files changed, 47 insertions(+), 43 deletions(-) diff --git a/R/pkg/DESCRIPTION b/R/pkg/DESCRIPTION index 1c093a4a980..cb9c5f1be07 100644 --- a/R/pkg/DESCRIPTION +++ b/R/pkg/DESCRIPTION @@ -1,6 +1,6 @@ Package: SparkR Type: Package -Version: 3.5.0 +Version: 4.0.0 Title: R Front End for 'Apache Spark' Description: Provides an R Front end for 'Apache Spark' <https://spark.apache.org>. Authors@R: diff --git a/assembly/pom.xml b/assembly/pom.xml index 09d6bd8a33f..4f80719afd4 100644 --- a/assembly/pom.xml +++ b/assembly/pom.xml @@ -21,7 +21,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +4.0.0-SNAPSHOT ../pom.xml diff --git a/common/kvstore/pom.xml b/common/kvstore/pom.xml index bef8303874b..6a4d029562a 100644 --- a/common/kvstore/pom.xml +++ b/common/kvstore/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +4.0.0-SNAPSHOT ../../pom.xml diff --git a/common/network-common/pom.xml b/common/network-common/pom.xml index 8a63e999c53..bb734faaac5 100644 --- a/common/network-common/pom.xml +++ b/common/network-common/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +4.0.0-SNAPSHOT ../../pom.xml diff --git a/common/network-shuffle/pom.xml b/common/network-shuffle/pom.xml index a8bde14a259..8fccc855a53 100644 --- a/common/network-shuffle/pom.xml +++ b/common/network-shuffle/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SNAPSHOT +4.0.0-SNAPSHOT ../../pom.xml diff --git a/common/network-yarn/pom.xml b/common/network-yarn/pom.xml index 671d5cb7e01..57e18f7a43d 100644 --- a/common/network-yarn/pom.xml +++ b/common/network-yarn/pom.xml @@ -22,7 +22,7 @@ org.apache.spark spark-parent_2.12 -3.5.0-SN
[spark] branch branch-3.5 created (now e578d466d4e)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch branch-3.5 in repository https://gitbox.apache.org/repos/asf/spark.git at e578d466d4e [SPARK-6][PYTHON] Add checks for expected list type special cases No new revisions were added by this update. - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated: [SPARK-43755][CONNECT] Move execution out of SparkExecutePlanStreamHandler and to a different thread
This is an automated email from the ASF dual-hosted git repository.
liyuanjian pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git
The following commit(s) were added to refs/heads/master by this push:
new 18d0a276c50 [SPARK-43755][CONNECT] Move execution out of
SparkExecutePlanStreamHandler and to a different thread
18d0a276c50 is described below
commit 18d0a276c501a102af3e7ed251831983b9148a4f
Author: Juliusz Sompolski
AuthorDate: Fri Jul 14 09:56:41 2023 -0700
[SPARK-43755][CONNECT] Move execution out of SparkExecutePlanStreamHandler
and to a different thread
### What changes were proposed in this pull request?
* Move code related to execution from being done directly in the GRPC
callback in SparkConnextStreamHandler, to it's own classes.
* `ExecutionHolder` (renamed from `ExecuteHolder`) launches the execution
in it's own thread using `ExecuteThreadRunner`
* The execution pushes responses via `ExecuteResponseObserver` (running in
the execution thread)
* `ExecuteResponseObserver` notifies `ExecuteGrpcResponseSender` (running
in the rpc handler thread) to send the responses.
* The actual execution code is refactored into `SparkConnectPlanExecution`
This allows to improve query interruption, by making `interrupt` method
interrupt the execution thread. This makes `interrupt` work also when no Spark
Jobs are running.
The refactoring further opens the possibilities of detaching query
execution from a single RPC execution. Right now `ExecutionHolder` is waiting
for the execution thread to finish, and `ExecutePlanResponseObserver` is
forwarding the responses directly to the RPC observer.
In a followup, we can design different modes of execution, e.g.
`ExecutePlanResponseObserver` buffering the responses. A client which lost
connection could then reconnect and ask for the stream to be retransmitted.
* `ExecutionHolder` returning the operationId to the client directly, and
then client requesting results in separate RPCs, with more control over the
response stream, instead of having it just pushed to it.
### Why are the changes needed?
* Improve the working of `interrupt`
* Refactoring that opens up possibilities of detaching query execution from
a single RPC.
### Does this PR introduce _any_ user-facing change?
No
### How was this patch tested?
Existing Spark Connect CI covers the execution.
Closes #41315 from juliuszsompolski/sc-execute-thread.
Lead-authored-by: Juliusz Sompolski
Co-authored-by: Hyukjin Kwon
Signed-off-by: Yuanjian Li
---
.../src/main/resources/error/error-classes.json| 6 +
.../apache/spark/sql/SparkSessionE2ESuite.scala| 8 +-
.../connect/execution/CachedStreamResponse.scala | 25 +++
.../execution/ExecuteGrpcResponseSender.scala | 117 ++
.../execution/ExecuteResponseObserver.scala| 161 +++
.../connect/execution/ExecuteThreadRunner.scala| 174 +
.../SparkConnectPlanExecution.scala} | 158 ---
.../sql/connect/planner/SparkConnectPlanner.scala | 4 +-
.../spark/sql/connect/service/ExecuteHolder.scala | 89 +++
.../sql/connect/service/ExecutePlanHolder.scala| 42 -
.../spark/sql/connect/service/SessionHolder.scala | 19 ++-
.../service/SparkConnectExecutePlanHandler.scala | 50 ++
.../sql/connect/service/SparkConnectService.scala | 124 ++-
.../spark/sql/connect/utils/ErrorUtils.scala | 134
.../spark/sql/connect/utils/MetricGenerator.scala | 73 +
docs/sql-error-conditions-sqlstates.md | 15 ++
docs/sql-error-conditions.md | 6 +
17 files changed, 905 insertions(+), 300 deletions(-)
diff --git a/common/utils/src/main/resources/error/error-classes.json
b/common/utils/src/main/resources/error/error-classes.json
index 99a0a4ae4ba..e8cdaa6c63b 100644
--- a/common/utils/src/main/resources/error/error-classes.json
+++ b/common/utils/src/main/resources/error/error-classes.json
@@ -2166,6 +2166,12 @@
"Number of given aliases does not match number of output columns.
Function name: ; number of aliases: ; number of output
columns: ."
]
},
+ "OPERATION_CANCELED" : {
+"message" : [
+ "Operation has been canceled."
+],
+"sqlState" : "HY008"
+ },
"ORDER_BY_POS_OUT_OF_RANGE" : {
"message" : [
"ORDER BY position is not in select list (valid range is [1,
])."
diff --git
a/connector/connect/client/jvm/src/test/scala/org/apache/spark/sql/SparkSessionE2ESuite.scala
b/connector/connect/client/jvm/src/test/scala/org/apache/spark/sql/SparkSessionE2ESuite.scala
index 044f6a48cc8..70eeb6c2c41 100644
---
a/connecto
[spark] branch master updated (21db916 -> 4e31000)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 21db916 [SPARK-38484][PYTHON] Move usage logging instrumentation util functions from pandas module to pyspark.util module add 4e31000 [SPARK-38204][SS] Use StatefulOpClusteredDistribution for stateful operators with respecting backward compatibility No new revisions were added by this update. Summary of changes: docs/ss-migration-guide.md | 4 + .../org/apache/spark/sql/internal/SQLConf.scala| 17 + .../spark/sql/execution/aggregate/AggUtils.scala | 64 ++- .../execution/aggregate/BaseAggregateExec.scala| 23 +- .../execution/aggregate/HashAggregateExec.scala| 2 + .../execution/aggregate/MergingSessionsExec.scala | 15 +- .../aggregate/ObjectHashAggregateExec.scala| 2 + .../execution/aggregate/SortAggregateExec.scala| 2 + .../execution/aggregate/UpdatingSessionsExec.scala | 18 +- .../streaming/FlatMapGroupsWithStateExec.scala | 13 +- .../execution/streaming/IncrementalExecution.scala | 17 + .../spark/sql/execution/streaming/OffsetSeq.scala | 5 +- .../streaming/StatefulOperatorPartitioning.scala | 53 +++ .../execution/streaming/statefulOperators.scala| 37 +- .../commits/0 | 0 .../metadata | 1 + .../offsets/0 | 3 + .../state/0/0}/1.delta | Bin .../state/0/0/_metadata/schema | Bin 0 -> 407 bytes .../state/0/1/1.delta | Bin 0 -> 96 bytes .../state/0/2}/1.delta | Bin .../state/0/3}/1.delta | Bin .../state/0/4/1.delta | Bin .../commits/.0.crc | Bin 0 -> 12 bytes .../commits/.1.crc | Bin 0 -> 12 bytes .../commits/0 | 0 .../commits/1 | 0 .../metadata | 1 + .../offsets/.0.crc | Bin 0 -> 16 bytes .../offsets/.1.crc | Bin 0 -> 16 bytes .../offsets/0 | 3 + .../offsets/1 | 3 + .../state/0/0/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/0/.2.delta.crc | Bin 0 -> 12 bytes .../state/0/0}/1.delta | Bin .../state/0/0}/2.delta | Bin .../state/0/0/_metadata/.schema.crc| Bin 0 -> 12 bytes .../state/0/0/_metadata/schema | Bin 0 -> 393 bytes .../state/0/1/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/1/.2.delta.crc | Bin 0 -> 12 bytes .../state/0/1}/1.delta | Bin .../state/0/1/2.delta | Bin 0 -> 75 bytes .../state/0/2/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/2/.2.delta.crc | Bin 0 -> 12 bytes .../state/0/2}/1.delta | Bin .../state/0/2/2.delta | Bin 0 -> 75 bytes .../state/0/3/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/3/.2.delta.crc | Bin 0 -> 12 bytes .../state/0/3/1.delta | Bin 0 -> 74 bytes .../state/0/3/2.delta | Bin .../state/0/4/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/4/.2.delta.crc | Bin 0 -> 12 bytes .../state/0/4/1.delta | Bin 0 -> 75 bytes .../state/0/4}/2.delta | Bin .../commits/.0.crc | Bin 0 -> 12 bytes .../commits/0 | 0 .../metadata | 1 + .../offsets/.0.crc | Bin 0 -> 16 bytes .../offsets/0 | 3 + .../state/0/0/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/0}/1.delta | Bin .../state/0/0/_metadata/.schema.crc| Bin 0 -> 12 bytes .../state/0/0/_metadata/schema | Bin 0 -> 415 bytes .../state/0/1/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/1/1.delta | Bin 0 -> 138 bytes .../state/0/2/.1.delta.crc | Bin 0 -> 12 bytes .../state/0/2}/1.delta | Bin .../
[spark] branch master updated (a62ae9f -> e0bc977)
This is an automated email from the ASF dual-hosted git repository.
liyuanjian pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/spark.git.
from a62ae9f [SPARK-38177][SQL] Fix wrong transformExpressions in Optimizer
add e0bc977 [SPARK-37970][SS] Introduce AcceptsLatestSeenOffset to
indicate latest seen offset to streaming source
No new revisions were added by this update.
Summary of changes:
...ionReader.java => AcceptsLatestSeenOffset.java} | 26 +-
.../streaming/AcceptsLatestSeenOffsetHandler.scala | 55 +
.../execution/streaming/MicroBatchExecution.scala | 2 +
.../streaming/continuous/ContinuousExecution.scala | 4 +
.../streaming/AcceptsLatestSeenOffsetSuite.scala | 270 +
5 files changed, 343 insertions(+), 14 deletions(-)
copy
sql/catalyst/src/main/java/org/apache/spark/sql/connector/read/streaming/{ContinuousPartitionReader.java
=> AcceptsLatestSeenOffset.java} (53%)
create mode 100644
sql/core/src/main/scala/org/apache/spark/sql/execution/streaming/AcceptsLatestSeenOffsetHandler.scala
create mode 100644
sql/core/src/test/scala/org/apache/spark/sql/streaming/AcceptsLatestSeenOffsetSuite.scala
-
To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org
For additional commands, e-mail: commits-h...@spark.apache.org
[spark] branch master updated (2b7442e -> b01c5ab)
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/spark.git. from 2b7442e [SPARK-27442][SQL] Remove check field name when reading/writing data in parquet add b01c5ab [SPARK-36649][SQL] Support `Trigger.AvailableNow` on Kafka data source No new revisions were added by this update. Summary of changes: .../spark/sql/kafka010/KafkaMicroBatchStream.scala | 20 +-- .../apache/spark/sql/kafka010/KafkaSource.scala| 20 +-- .../sql/kafka010/KafkaMicroBatchSourceSuite.scala | 41 +- 3 files changed, 74 insertions(+), 7 deletions(-) - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
[spark-website] branch asf-site updated: Add Yuanjian Li to committers
This is an automated email from the ASF dual-hosted git repository. liyuanjian pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/spark-website.git The following commit(s) were added to refs/heads/asf-site by this push: new ab6612c Add Yuanjian Li to committers ab6612c is described below commit ab6612c4bfef9ea6f72f37b0a9e88e40c282e47c Author: Yuanjian Li AuthorDate: Mon Jan 17 23:57:40 2022 -0800 Add Yuanjian Li to committers Author: Yuanjian Li Closes #373 from xuanyuanking/modify-committer-list. --- committers.md| 1 + site/committers.html | 4 2 files changed, 5 insertions(+) diff --git a/committers.md b/committers.md index 5e3fb2d..25cd9d8 100644 --- a/committers.md +++ b/committers.md @@ -50,6 +50,7 @@ navigation: |Haoyuan Li|Alluxio| |Xiao Li|Databricks| |Yinan Li|Google| +|Yuanjian Li|Databricks| |Davies Liu|Juicedata| |Cheng Lian|Databricks| |Yanbo Liang|Facebook| diff --git a/site/committers.html b/site/committers.html index 346f7af..86c60ae 100644 --- a/site/committers.html +++ b/site/committers.html @@ -315,6 +315,10 @@ Google + Yuanjian Li + Databricks + + Davies Liu Juicedata - To unsubscribe, e-mail: commits-unsubscr...@spark.apache.org For additional commands, e-mail: commits-h...@spark.apache.org
