[beam] branch master updated (b33bebc -> d7f6405)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from b33bebc Merge pull request #16215 from dpcollins-google/publish-no-desync add d7f6405 [BEAM-13578] Validate that repeatable PipelineOptions need to be specified as a list if set programmatically (#16372) No new revisions were added by this update. Summary of changes: .../apache_beam/examples/snippets/snippets.py | 3 ++ .../python/apache_beam/options/pipeline_options.py | 18 +++- .../options/pipeline_options_validator.py | 16 +++ .../options/pipeline_options_validator_test.py | 33 ++ 4 files changed, 69 insertions(+), 1 deletion(-)
[beam] branch master updated (d7f6405 -> c5294f0)
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from d7f6405 [BEAM-13578] Validate that repeatable PipelineOptions need to be specified as a list if set programmatically (#16372) add c5294f0 [BEAM-13430] Update comment over eclipse plugin. (#16387) No new revisions were added by this update. Summary of changes: .../src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy | 6 ++ 1 file changed, 2 insertions(+), 4 deletions(-)
[beam] branch master updated: Update venv creation commands in release scripts. (#16381)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new a7f73d3 Update venv creation commands in release scripts. (#16381) a7f73d3 is described below commit a7f73d3d6af54df803923fe490046383c22a83ae Author: tvalentyn AuthorDate: Wed Dec 29 12:33:01 2021 -0800 Update venv creation commands in release scripts. (#16381) --- .../jenkins/dependency_check/generate_report.sh| 7 ++-- .test-infra/jenkins/job_00_seed.groovy | 3 +- .test-infra/jenkins/job_seed_standalone.groovy | 5 ++- .../python_release_automation_utils.sh | 3 +- .../src/main/scripts/build_release_candidate.sh| 3 +- release/src/main/scripts/deploy_pypi.sh| 1 + .../main/scripts/deploy_release_candidate_pypi.sh | 2 +- release/src/main/scripts/run_rc_validation.sh | 44 +++--- runners/portability/test_flink_uber_jar.sh | 1 + runners/portability/test_pipeline_jar.sh | 1 + .../container/license_scripts/license_script.sh| 3 +- .../apache_beam/examples/kafkataxi/README.md | 5 ++- .../apache_beam/runners/interactive/README.md | 31 +++ sdks/python/container/run_generate_requirements.sh | 3 +- .../site/content/en/contribute/release-guide.md| 27 +++-- .../en/documentation/sdks/python-dependencies.md | 2 +- 16 files changed, 65 insertions(+), 76 deletions(-) diff --git a/.test-infra/jenkins/dependency_check/generate_report.sh b/.test-infra/jenkins/dependency_check/generate_report.sh index 825287b..4a8c879 100755 --- a/.test-infra/jenkins/dependency_check/generate_report.sh +++ b/.test-infra/jenkins/dependency_check/generate_report.sh @@ -44,10 +44,9 @@ REPORT_DESCRIPTION=" # Virtualenv for the rest of the script to run setup $PYTHON -m venv dependency/check -. dependency/check/bin/activate -pip install --upgrade google-cloud-bigquery -pip install --upgrade google-cloud-bigtable -pip install --upgrade google-cloud-core +. ./dependency/check/bin/activate +pip install --upgrade pip setuptools wheel +pip install --upgrade google-cloud-bigquery google-cloud-bigtable google-cloud-core rm -f build/dependencyUpdates/beam-dependency-check-report.txt # Insall packages and run the unit tests of the report generator and the jira manager diff --git a/.test-infra/jenkins/job_00_seed.groovy b/.test-infra/jenkins/job_00_seed.groovy index e01bc34..820f3c4 100644 --- a/.test-infra/jenkins/job_00_seed.groovy +++ b/.test-infra/jenkins/job_00_seed.groovy @@ -108,7 +108,8 @@ job('beam_SeedJob') { command(""" ( cd .test-infra/jenkins/committers_list_generator && python3.8 -m venv ve3 && source ve3/bin/activate && -pip install -r requirements.txt && +pip install --retries 10 --upgrade pip setuptools wheel && +pip install --retries 10 -r requirements.txt && python main.py -o .. && deactivate ) || { echo "ERROR: Failed to fetch committers"; exit 3; } diff --git a/.test-infra/jenkins/job_seed_standalone.groovy b/.test-infra/jenkins/job_seed_standalone.groovy index 33ac831..6ae0cfb 100644 --- a/.test-infra/jenkins/job_seed_standalone.groovy +++ b/.test-infra/jenkins/job_seed_standalone.groovy @@ -107,8 +107,9 @@ job('beam_SeedJob_Standalone') { shell { command(""" ( cd .test-infra/jenkins/committers_list_generator && -python3.8 -m venv ve3 && source ve3/bin/activate && -pip install -r requirements.txt && +python3.8 -m venv ve3 && source ./ve3/bin/activate && +pip install --retries 10 --upgrade pip setuptools wheel && +pip install --retries 10 -r requirements.txt && python main.py -o .. && deactivate ) || { echo "ERROR: Failed to fetch committers"; exit 3; } diff --git a/release/src/main/python-release/python_release_automation_utils.sh b/release/src/main/python-release/python_release_automation_utils.sh index 507f50f..5d0e1c6 100644 --- a/release/src/main/python-release/python_release_automation_utils.sh +++ b/release/src/main/python-release/python_release_automation_utils.sh @@ -161,7 +161,8 @@ function install_sdk() { gsutil version -l rm -rf ./temp_virtualenv_${2} $2 -m venv temp_virtualenv_${2} - . temp_virtualenv_${2}/bin/activate + . ./temp_virtualenv_${2}/bin/activate + pip install --upgrade pip setuptools wheel gcloud_version=$(gcloud --version | head -1 | awk '{print $4}') if [[ "$gcloud_version" < "189" ]]; then update_gcloud diff --git a/release/src/main/scripts/build_release_candidate.sh b/release/src/main/scripts/build_release_candidate.sh index 0c8e7ae..7132ad2 100755 --- a/release/src/main/scripts/build_release_candidate.sh +++ b/release/src/main/scripts/build_release_candidate.sh @@ -271,7 +271,7 @@ if [[ $confirmation
[beam] branch master updated: [BEAM-13430] Fix broken ULR validates runner tests
This is an automated email from the ASF dual-hosted git repository. altay pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 114ba24 [BEAM-13430] Fix broken ULR validates runner tests new 7c3fd2a Merge pull request #16391 from y1chi/BEAM-13430-ulr 114ba24 is described below commit 114ba247c20af39fdb8bdaa51391dfad3dee6ded Author: Yichi Zhang AuthorDate: Wed Dec 29 11:36:58 2021 -0800 [BEAM-13430] Fix broken ULR validates runner tests --- runners/portability/java/build.gradle | 1 + 1 file changed, 1 insertion(+) diff --git a/runners/portability/java/build.gradle b/runners/portability/java/build.gradle index c040e28..9fbb2bb 100644 --- a/runners/portability/java/build.gradle +++ b/runners/portability/java/build.gradle @@ -53,6 +53,7 @@ dependencies { validatesRunner project(path: ":sdks:java:core", configuration: "shadowTest") validatesRunner project(path: ":runners:core-java", configuration: "testRuntimeMigration") + validatesRunner project(project.path) validatesRunner project(path: project.path, configuration: "testRuntimeMigration") }
svn commit: r51824 - in /release/beam: ./ 2.33.0/ 2.34.0/ 2.35.0/ 2.35.0/python/
Author: altay Date: Wed Dec 29 22:07:48 2021 New Revision: 51824 Log: Add 2.35.0. Remove 2.33.0 and 2.34.0 Added: release/beam/2.35.0/ release/beam/2.35.0/apache-beam-2.35.0-source-release.zip (with props) release/beam/2.35.0/apache-beam-2.35.0-source-release.zip.asc release/beam/2.35.0/apache-beam-2.35.0-source-release.zip.sha512 release/beam/2.35.0/python/ release/beam/2.35.0/python/apache-beam-2.35.0.zip (with props) release/beam/2.35.0/python/apache-beam-2.35.0.zip.asc release/beam/2.35.0/python/apache-beam-2.35.0.zip.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-macosx_10_9_x86_64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-macosx_10_9_x86_64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-macosx_10_9_x86_64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux1_i686.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux1_i686.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux1_i686.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux1_x86_64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux1_x86_64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux1_x86_64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2010_i686.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2010_i686.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2010_i686.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2010_x86_64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2010_x86_64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2010_x86_64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2014_aarch64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2014_aarch64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-manylinux2014_aarch64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-win32.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-win32.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-win32.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-win_amd64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-win_amd64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp36-cp36m-win_amd64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-macosx_10_9_x86_64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-macosx_10_9_x86_64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-macosx_10_9_x86_64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux1_i686.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux1_i686.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux1_i686.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux1_x86_64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux1_x86_64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux1_x86_64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2010_i686.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2010_i686.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2010_i686.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2010_x86_64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2010_x86_64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2010_x86_64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2014_aarch64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2014_aarch64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-manylinux2014_aarch64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-win32.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-win32.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-win32.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-win_amd64.whl (with props) release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-win_amd64.whl.asc release/beam/2.35.0/python/apache_beam-2.35.0-cp37-cp37m-win_amd64.whl.sha512 release/beam/2.35.0/python/apache_beam-2.35.0
svn commit: r51825 - /dev/beam/2.35.0/
Author: altay Date: Wed Dec 29 22:08:36 2021 New Revision: 51825 Log: Remove 2.35.0. Moved to rel Removed: dev/beam/2.35.0/
[beam] branch master updated (7c3fd2a -> f859247)
This is an automated email from the ASF dual-hosted git repository. emilyye pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 7c3fd2a Merge pull request #16391 from y1chi/BEAM-13430-ulr add f859247 [BEAM-12777] Stable URL for current API docs (#16327) No new revisions were added by this update. Summary of changes: release/src/main/scripts/build_release_candidate.sh | 2 ++ sdks/python/scripts/generate_pydoc.sh | 3 +++ 2 files changed, 5 insertions(+)
svn commit: r51827 - /dev/beam/KEYS
Author: emilyye Date: Wed Dec 29 23:17:42 2021 New Revision: 51827 Log: (empty) Modified: dev/beam/KEYS Modified: dev/beam/KEYS == --- dev/beam/KEYS (original) +++ dev/beam/KEYS Wed Dec 29 23:17:42 2021 @@ -2463,3 +2463,148 @@ iDXwGMYiSqRdPptjB4HZZQiqfN8LqsKJ7wqvjVyS NcNJBbvGzJGdCYWs2CMdOITnmneOvlFjmLw= =aDaB -END PGP PUBLIC KEY BLOCK- +pub rsa3072 2021-07-19 [SC] + FFC9CF76A96FD608F2A6AF44795129323A1DB99E +uid [ultimate] Emily Ye +sig 3795129323A1DB99E 2021-07-19 Emily Ye +sub rsa3072 2021-07-19 [E] +sig 795129323A1DB99E 2021-07-19 Emily Ye + +pub rsa3072 2021-07-19 [SC] + 12423ADD570D8C2A4D61FF578148B536EBC8D78A +uid [ultimate] Emily Ye +sig 38148B536EBC8D78A 2021-07-19 Emily Ye +sub rsa3072 2021-07-19 [E] +sig 8148B536EBC8D78A 2021-07-19 Emily Ye + +pub rsa4096 2021-12-29 [SC] + 730D5E8D4CA810C1F01D304B610B38AA1BE11656 +uid [ultimate] Emily Ye +sig 3610B38AA1BE11656 2021-12-29 Emily Ye +sub rsa4096 2021-12-29 [E] +sig 610B38AA1BE11656 2021-12-29 Emily Ye + +-BEGIN PGP PUBLIC KEY BLOCK- + +mQGNBGD1txYBDAC3sptnoSXkv6yXUd7fTNFviEjL225HsedTdZfupwKjwl5cq+qC +zWhZEqFic3tk8tyrvBTuGtwXQQTyaFAIRtHGGbARf7qJJ2TX/JYYyBKpjlzyt1ys +FiFt+tRN66lY1iADYNH7FpnIXLje9sENgmyzEbCobArc8KQGp7GQpyz9qeTadrWt +2nbqZuqmF5sl3ACn9+89s1iL04nV55tXz/CRskN6emQPDC0/HogAje8WnWUAv0un +aEeiHd3nqW+FjYKfteD8QUBaowyxi9P9Fm1aHcEw5uxtamahBth2jGaozZsyeZm5 +d4mK4MSBX5bmtKDVlxRMJTZhjmsmldQPBRJI96UWQDNriNc9RXoIvNDN811bC5EB +F3TPgHdMhh7EInIWd0g4jJfq1PbQRMOJnklojML5cdR5HCdVb53eF5TRWAZ+lzbG ++6RsukTilpkXz5OShoPxPtdEiUv9pCIL5dgaO/AoMWeb9d/HKKJJO9oJoORA90jJ +7r1mXRM4UNHM0TEAEQEAAbQdRW1pbHkgWWUgPGVtaWx5M3llQGdtYWlsLmNvbT6J +Ac4EEwEKADgWIQT/yc92qW/WCPKmr0R5USkyOh25ngUCYPW3FgIbAwULCQgHAgYV +CgkICwIEFgIDAQIeAQIXgAAKCRB5USkyOh25nq7LDAChV81ygIl6M3vWEpqhlJUL +bSBkYLFPIYpFkGkcd0QAN05eH8uqZ/GaziykgT2v38+Zxss4ZYAJPBIxmxpz6via +oUjOsqlR2Xl7/UkjvpCfFlvMB8QgO0c9SZ3aH/3tjiGKZJdOX2LJESiWrMhZJfM0 +NKeBzbX/U6DyMtL0PCZu1EyTe6DOIb71RQQx8Kc6lkpCEReeu5qIHvpRnRhU5qTU +13IaxDafz5UjDjI8d9IkET6FB41VPFA9m0uGP4QE1lcW6iukqxofWSjTKb84rIu2 +rBE4XHzbfbzJdcbEMglFyTu+BDGFnnPhe0affa6VLM8cv94pAk2b6FrFYofmQqk/ +ykOHbpzgJizvuTiSWWZpeTYMnsaNyL3tKeswWZKIM6FSLPdspbHWwqyaXYWeFasV +Pj/lvJa0WJq/ffaedAMvtUZL/q+v6oEZBirmxA0rMZsPSV/81WK1EDwsAvIT1r4M +t9FjwlMq3Jb8THUzevQfc8lyaw02kEvkjBKd+ETx6zK5AY0EYPW3FgEMAJ3LvFsF +zTbRbab2nD2O0L2frHdY5dbkoIEnRqANBcCUZtm1pdqJZIFJ+ZUMv+8Phg4878S+ +++yoNFHrG6oCCD3LP2tbE8nLXnFjugzXCV5lCsMsesHme6Uq+PIuWadhtWNCgsQk +6ClHPEFoVQUIjs7XHqsGV7SNM7lShrxZ0nYiorvdB4HuhydYHyY15/WrZ5vEero1 +FdqIPvUJVkbDj8bLNbnMxknoa8fChYXItJEreSKOObI563oFdmd2GBtEr1y5cD5p +s8lidIbByCoKOPICRXqhBWUA+A+d7QPd79ySCv3wXPc3F5zbvNfXKZaIltQpg/lA +yTi3B4g8Js9XW7qMzUYrG4xT5fuUYXi/SpBLSXgTtAuojOo89KLv0Yy+R0LrwKfl +WjWPvPVZsrNwft/AOYCfG68QZcHkrwbNTwYMQuWOZghsV+r207qbLbrtY3f8KN6z +K/YPY115AYcYRKrMqZ50L+xM/r25/2FviIXS+64bsjo9cEQxZtt5aGwKcwARAQAB +iQG2BBgBCgAgFiEE/8nPdqlv1gjypq9EeVEpMjoduZ4FAmD1txYCGwwACgkQeVEp +MjoduZ4HPQv/TIMhI1q++518+0GFDvRXiDH+bZVdbWIMtbNQQwnYmG0LO0vmPgBU +fc7Y3c5AoyEKR/mp40j6iNg1NRpGJrSID3qm2lU0wxU7BUzdhJmwRw5NKpk66cfV +IuDSxLj5WBsRaEzWFhGm8BPIjCRhKUWIVjW97Z5+eP4djGKEjMfC3ugfcBDexC4t +QM7wCzUSrevXiJ6KgrgDX6O/tRMyxYB2H613RbU9xMV1ER7OBPsN4TvKZo+j9ssM +olLLRFvdbw0fWcWBVIl77OWXJ3rIjrZINp/yBS5suGERq6LvGnpEs/zwcz7as1eo +Z0BASSsZ7M+5XE+awvQf4vsuMMu6ml8hn4e/H/73WczNF/c7xUTqMTOKiveCgv03 +j6PBG5gMe09FF1LHhduLoUFCh40VvmnvnKhvbX+GSffhw9GeVMHRlZYqgHUfL/GY +Zu8OL0GdRyhzd1tE6WpR2U0bucUJPQbPRcgJJALJot7BqaOeb0W1RVXe9F7ooca7 +hrgRS+L1rQj8mQGNBGD1uLsBDACwjGO5tchUAXJcc/4XX8nYn57JgNrfshxd0Sz9 +tUG/ghEK9Fzy9EZqq4hYiiDhcopuqqLqrAFwtbRU1tVtd6LZO1CQj29dNgrvH+Jd +fbKKeXwr4lK44L0h0uA/CJtRC2JhxkozOzMW80e9pSNBS6wHfFZG3Wlrq1/+K2xr +VknlqkpAfK/f1orBi7sD/IqE3960+JrAh+E1dX4XpBTw1NEgjG9Jwgy/96QA+iBO +91kHJtdQlyfAmhfxx2wIOYO6TTFbYlqwofU3G8cqVCyTNPpQWMaBbeAqymhVN9t0 +odq6xOZKNmafmG6/+6i1wVOTS4xy4WhxeYj5QsSGd6TPyc9Kn/15b4Jaefgn+xLn +e60pOgZ1UwpBc9sisrtzzTZrNMl9x8pe91IxjyHRydhgGzfVfpdIuW3j+XKbg6lH +pEc2RUw1NOQG+eYyx8ZIBxxFlKPpQkPoOknALusseSeuXJdI4QjfS5PimjmDLyM7 +KS1tCBYliiXZiuVre9U7vwRuTWEAEQEAAbQdRW1pbHkgWWUgPGVtaWx5M3llQGdt +YWlsLmNvbT6JAc4EEwEKADgWIQQSQjrdVw2MKk1h/1eBSLU268jXigUCYPW4uwIb +AwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRCBSLU268jXilCDC/9pdVz6KTiH +/m822wv5uww7cyt53qJxOSYqH24j8D7Kl7MNOqHZKTg0bsvdTMeZZRa2a2nv8dsE +QfVEfaDlD+y6H0JIO0sFqis0PQPKApvs0UYvAJi4XNzz5PkH7X53QdDNVq7DKUw+ +WReHGG9xE8/rwbICIUpthPHkTgCw8cNniNoj7zZkpS8ET6L6+/5S8eLysp/zHCVG +U3MXBaRvvlAJXkgPr4x41SN8t0Rz9nxh0Is/MDwzIkf3qHeWlU0LseHDUXOz7tMp +zku64JB5r7fUshR6/+F0XMccfJl3GmZE3GEGEUqLprS87DmaRbZPkt/7JUb+Jfmn +wCYCxtzx2K46kYJZyru4KG1DwEqj38hSgjObuX9HXuw1ndmbExlJRKqw9pOTShKD ++Vt1tiBFNTeXPWLNrpueXk89tXPYuDQeErWBOAfyKpayg4hRoM9k9cwxMe7n9Izm +VU9de0um1QgOG+bFwrX0eOqoh68LYZmiWWUTUDHFB95c1rTnuox4YFS5AY0EYPW4 +uwEMAMV+5Afaolcll2Kko4MYizCoIHOGeNGgnGfUx3FoYb5w2DVVYrow+6sMfUDf +D96bu0g9lTFHcLDAVK2kexSGZOyc9YKBJaQUX6T9Nhl4fAamPWAQrDJRyvIBdrOQ +vt300
svn commit: r51828 - /dev/beam/KEYS
Author: emilyye Date: Wed Dec 29 23:26:13 2021 New Revision: 51828 Log: Add emilyye to KEYS Modified: dev/beam/KEYS Modified: dev/beam/KEYS == --- dev/beam/KEYS (original) +++ dev/beam/KEYS Wed Dec 29 23:26:13 2021 @@ -2608,3 +2608,61 @@ IrtKOCebhVFW1R+GGXCLM7W5jii5I3VcnfImDgQz POn3aXrCY8RBzzQ= =mgKW -END PGP PUBLIC KEY BLOCK- +pub rsa4096 2021-12-29 [SC] + 730D5E8D4CA810C1F01D304B610B38AA1BE11656 +uid [ultimate] Emily Ye +sig 3610B38AA1BE11656 2021-12-29 Emily Ye +sub rsa4096 2021-12-29 [E] +sig 610B38AA1BE11656 2021-12-29 Emily Ye + +-BEGIN PGP PUBLIC KEY BLOCK- + +mQINBGHM7BwBEACaqbdNCUTei23kTepZWTNJTdd4jTATLwQcIUfxjdDGmr+56d1s +jHSERQqqMyd1jzQyZ7NHLnXdW6nYI0oQ3p/qYPTkm9vN8v0vbclL+xSv9cwueAhH +oHkDEmopepnkuUkJxtWLD/1B6IktXF0KfWzLOhdfXp75GWbBCA5Yd+/DuxiOEsO/ +U1vx5nbztCjbRmJqY5FPfG82+z9rK7vJSZCd4/nu5p2iV3npflwZpzc7Drq4HZwC +5GGtFyBJ9HmMrZLz5CGGi3BTHpavu13/DTviFbd+zA3aJgwBlxvAIydx39gxGkMG +zIIy0k+2tAxY74qGKtlKKKLjB8bqYOk7uYj8EN5lb+Z9l+5BoIPHSsJf6iIWh00W +Gr4wzY/nbzWAANlRPvl16hiGDKyL0RU8zlFEwvO+kPmq6BIn40MkSf/OlAAqOV3R +6iqh0xALjwuQUYZGn7sW9DhBytcGA1tRb3ytLz5Ajyx//Cw3TGRNXpPM69aDAZwZ +eN3qyuJgCNai4A5nBHpO5bUgnYL6JS33gf497w58ExR7bBFtSuzRfgZT5usm4ay6 +eLh1kKOZneXk5GPlfDbROKU+dO5D6RNr5vMMqYVMR+B4lM8SuI8cvmXeMj7hvrNO +j3VLCCfOgezoW/GvzOydOaFbqzHbwrhjN5qiKq/vMqc5cxuw0OLyLYNiXwARAQAB +tB1FbWlseSBZZSA8ZW1pbHl5ZUBhcGFjaGUub3JnPokCTgQTAQoAOBYhBHMNXo1M +qBDB8B0wS2ELOKob4RZWBQJhzOwcAhsDBQsJCAcCBhUKCQgLAgQWAgMBAh4BAheA +AAoJEGELOKob4RZWNJ4P/2kHuOmGajce9wawNeAIqSo2OU9oaMNArJG9IAIKOVNy +wsfbn/JF9hfRo1uq0OWxHyN54MeBQCfFTESQfAr8RpyW/cvp2vuDNwhu6NWr3JJx +e5HXGg+1OtRv8HiCGpWyP3HjJxqD41d4ugZaC+ac9Jshu+y8BFoW7lRyi5FY+5RS +p5E6IgTvuDNGOBmwwhyGdwg3v7NhDCxXnxKM63IZDOcORBHtnLm3uR9Ebldl5NCJ +ab9vtU5MFqPvvCsu2mok8EnoO4EgV2G4HAWWnx+nDzjx+00KO9CtGsGh1aEqDxri +kGbyT2wQK+3HNHm+hY5T1ynLDi4kL7ALXVx+CL1X6awPXuanV8CnPyGGByF3djgH +A9eR5NL+HljuI0ldrsBjh7oq52IL++0EY9WpuzjThVg3mMlxtVshDCEIkSuz2DZG +F/+bkz+xVR8uSrdetINJWVd2JEgsvwlYKlR8BngSbR34wc79ikS8ptogSG/wtoyb +gUKBClrUxp3rR4ASxX8WcjZERF4qV/N90czgHpSgs9LV6rqBSRdiM5Iym0kPGoaq +az+SCnw98iaHhciZ37AytLAiS8WCr/HfOS4pjXrzVMBD5q3sTiipAHQAbw5DbMjF +y+X8MdXJIl7PnwTsgIUDhWF8Ye9mJRry0t5Fb/A+tBdt1KwibbHVFqcj9JZbWn1g +uQINBGHM7BwBEAC0f4Y6ndBGcB4eKVgveNyokt8TFtVaajk6i3CR0mCcgrteEwKf +uf3NT7L5xBvHM9HuZkZzlCoTuO+EyW/fFPWQprlj7OCPkvLvZ4PHSXeftZGc8srr +IzgGsH2+bwYrrntueaI8RTQqaDluz3BjC9py+BaN8/K9hQrx7ZRVEq6YXxG1xcL9 +o8H06YUpQ5nl5/Cvxy16euEouBN1vIsKKIBDjAZS0XMq4XnZaMzaHY4Mfe6IvxWK +mSMiT1EdAWvmHOB/on/JKIEYGjbr9SjSxBJyVMrvcIFhLV5Rz1t88Q61GhTZGuCi +j8J4hIaSh2igHwrk/1xPadou5EW63wcK6b42rp9gck+1uylTiUDUqEtQB5f4KpgI +CjkGdtQ/6s7YoocGUgmQrZeVtl87+gZ6JvMsU6Loppn7AO0yaV3E22beo4fzScn/ +QFJ7zNyeHhoJNMg/99VRlCP9H3q5VHftSlyfG9UZYt5NK5mZnOjpSNFzcs4Bgfn0 +KjWoL82kJ9lARHX/k4i/r9wHF/+ILdvMtz3L5310jvvommnkxtY5e/4AYQjVg9ov +l791qgYja2uCE5EDfsx9a4y2p+Zef/LcntUx1gxUyOjjr+k/Tv4jGmb9NXSxSvgG +ue0nrchrmS2AZ6pYiu9WGpHHMxwDJ8v8zqauxHFlBhnL7nco40LprOtu4wARAQAB +iQI2BBgBCgAgFiEEcw1ejUyoEMHwHTBLYQs4qhvhFlYFAmHM7BwCGwwACgkQYQs4 +qhvhFla7wg//YlHR6zFYmDOdoHgjq6ss4gFEZYjxKC3xdT9BrY3tJUparNloren7 +3Z1WzZHUoYw78aqyKKfxACiWKSbnQgifdBk1vmSh/VLkM/pAgNpLPxoGIK6o9cwC +HWRTlwnqhjGnTFPcesj7FnsNi8bwFrRaxzR7QcHKHBlg3OZ2BbBDRRlaAt1YdltM +GLV9SKY5Ena/L/b0WNU0OekJUyZINypf+J7kb1Kvwo5CNkb141S21hYDaJk49CBy +FOiQ1rP4hA8Obg12pPB+Z6dOaGYs8O4DRpTn4Es8+Si8uZzuH+QhgyympxSrG9VY +2B8ynFoGMCssrOYFEfPi/S0mVL/6aHP8HzNKFl9O1cNKHfcRaj//tpjMXiI8KxVj +RiTHEtxoXoxrMVAeDTO3ge5ZUVTbMN93RU5j0ghNKpnNCxNsXUWgeD83wqpjIyQP +yrH1c+H4sNSHFrrQID5s731zUbvCCsOHrAFb/l6V3k2QxkFUl8cDSJVPqhSJ9oG7 +ZET/ysaXYH+Py94ORVgyaxbd7bgYqvAxEuUPTKBPIrtKOCebhVFW1R+GGXCLM7W5 +jii5I3VcnfImDgQzjvWQdnE9zyK6lNGYMns9GBHu9BKUS1/hZXHkzBUMwJ/nmhWF +642TggMBXzBvc6FkB+cKOBUu0jjUG6FJf0g+8xAYPOn3aXrCY8RBzzQ= +=gB37 +-END PGP PUBLIC KEY BLOCK-
svn commit: r51829 - /dev/beam/KEYS
Author: emilyye Date: Wed Dec 29 23:30:47 2021 New Revision: 51829 Log: Remove emilyye keys added by mistake Modified: dev/beam/KEYS Modified: dev/beam/KEYS == --- dev/beam/KEYS (original) +++ dev/beam/KEYS Wed Dec 29 23:30:47 2021 @@ -2463,151 +2463,6 @@ iDXwGMYiSqRdPptjB4HZZQiqfN8LqsKJ7wqvjVyS NcNJBbvGzJGdCYWs2CMdOITnmneOvlFjmLw= =aDaB -END PGP PUBLIC KEY BLOCK- -pub rsa3072 2021-07-19 [SC] - FFC9CF76A96FD608F2A6AF44795129323A1DB99E -uid [ultimate] Emily Ye -sig 3795129323A1DB99E 2021-07-19 Emily Ye -sub rsa3072 2021-07-19 [E] -sig 795129323A1DB99E 2021-07-19 Emily Ye - -pub rsa3072 2021-07-19 [SC] - 12423ADD570D8C2A4D61FF578148B536EBC8D78A -uid [ultimate] Emily Ye -sig 38148B536EBC8D78A 2021-07-19 Emily Ye -sub rsa3072 2021-07-19 [E] -sig 8148B536EBC8D78A 2021-07-19 Emily Ye - -pub rsa4096 2021-12-29 [SC] - 730D5E8D4CA810C1F01D304B610B38AA1BE11656 -uid [ultimate] Emily Ye -sig 3610B38AA1BE11656 2021-12-29 Emily Ye -sub rsa4096 2021-12-29 [E] -sig 610B38AA1BE11656 2021-12-29 Emily Ye - --BEGIN PGP PUBLIC KEY BLOCK- - -mQGNBGD1txYBDAC3sptnoSXkv6yXUd7fTNFviEjL225HsedTdZfupwKjwl5cq+qC -zWhZEqFic3tk8tyrvBTuGtwXQQTyaFAIRtHGGbARf7qJJ2TX/JYYyBKpjlzyt1ys -FiFt+tRN66lY1iADYNH7FpnIXLje9sENgmyzEbCobArc8KQGp7GQpyz9qeTadrWt -2nbqZuqmF5sl3ACn9+89s1iL04nV55tXz/CRskN6emQPDC0/HogAje8WnWUAv0un -aEeiHd3nqW+FjYKfteD8QUBaowyxi9P9Fm1aHcEw5uxtamahBth2jGaozZsyeZm5 -d4mK4MSBX5bmtKDVlxRMJTZhjmsmldQPBRJI96UWQDNriNc9RXoIvNDN811bC5EB -F3TPgHdMhh7EInIWd0g4jJfq1PbQRMOJnklojML5cdR5HCdVb53eF5TRWAZ+lzbG -+6RsukTilpkXz5OShoPxPtdEiUv9pCIL5dgaO/AoMWeb9d/HKKJJO9oJoORA90jJ -7r1mXRM4UNHM0TEAEQEAAbQdRW1pbHkgWWUgPGVtaWx5M3llQGdtYWlsLmNvbT6J -Ac4EEwEKADgWIQT/yc92qW/WCPKmr0R5USkyOh25ngUCYPW3FgIbAwULCQgHAgYV -CgkICwIEFgIDAQIeAQIXgAAKCRB5USkyOh25nq7LDAChV81ygIl6M3vWEpqhlJUL -bSBkYLFPIYpFkGkcd0QAN05eH8uqZ/GaziykgT2v38+Zxss4ZYAJPBIxmxpz6via -oUjOsqlR2Xl7/UkjvpCfFlvMB8QgO0c9SZ3aH/3tjiGKZJdOX2LJESiWrMhZJfM0 -NKeBzbX/U6DyMtL0PCZu1EyTe6DOIb71RQQx8Kc6lkpCEReeu5qIHvpRnRhU5qTU -13IaxDafz5UjDjI8d9IkET6FB41VPFA9m0uGP4QE1lcW6iukqxofWSjTKb84rIu2 -rBE4XHzbfbzJdcbEMglFyTu+BDGFnnPhe0affa6VLM8cv94pAk2b6FrFYofmQqk/ -ykOHbpzgJizvuTiSWWZpeTYMnsaNyL3tKeswWZKIM6FSLPdspbHWwqyaXYWeFasV -Pj/lvJa0WJq/ffaedAMvtUZL/q+v6oEZBirmxA0rMZsPSV/81WK1EDwsAvIT1r4M -t9FjwlMq3Jb8THUzevQfc8lyaw02kEvkjBKd+ETx6zK5AY0EYPW3FgEMAJ3LvFsF -zTbRbab2nD2O0L2frHdY5dbkoIEnRqANBcCUZtm1pdqJZIFJ+ZUMv+8Phg4878S+ -++yoNFHrG6oCCD3LP2tbE8nLXnFjugzXCV5lCsMsesHme6Uq+PIuWadhtWNCgsQk -6ClHPEFoVQUIjs7XHqsGV7SNM7lShrxZ0nYiorvdB4HuhydYHyY15/WrZ5vEero1 -FdqIPvUJVkbDj8bLNbnMxknoa8fChYXItJEreSKOObI563oFdmd2GBtEr1y5cD5p -s8lidIbByCoKOPICRXqhBWUA+A+d7QPd79ySCv3wXPc3F5zbvNfXKZaIltQpg/lA -yTi3B4g8Js9XW7qMzUYrG4xT5fuUYXi/SpBLSXgTtAuojOo89KLv0Yy+R0LrwKfl -WjWPvPVZsrNwft/AOYCfG68QZcHkrwbNTwYMQuWOZghsV+r207qbLbrtY3f8KN6z -K/YPY115AYcYRKrMqZ50L+xM/r25/2FviIXS+64bsjo9cEQxZtt5aGwKcwARAQAB -iQG2BBgBCgAgFiEE/8nPdqlv1gjypq9EeVEpMjoduZ4FAmD1txYCGwwACgkQeVEp -MjoduZ4HPQv/TIMhI1q++518+0GFDvRXiDH+bZVdbWIMtbNQQwnYmG0LO0vmPgBU -fc7Y3c5AoyEKR/mp40j6iNg1NRpGJrSID3qm2lU0wxU7BUzdhJmwRw5NKpk66cfV -IuDSxLj5WBsRaEzWFhGm8BPIjCRhKUWIVjW97Z5+eP4djGKEjMfC3ugfcBDexC4t -QM7wCzUSrevXiJ6KgrgDX6O/tRMyxYB2H613RbU9xMV1ER7OBPsN4TvKZo+j9ssM -olLLRFvdbw0fWcWBVIl77OWXJ3rIjrZINp/yBS5suGERq6LvGnpEs/zwcz7as1eo -Z0BASSsZ7M+5XE+awvQf4vsuMMu6ml8hn4e/H/73WczNF/c7xUTqMTOKiveCgv03 -j6PBG5gMe09FF1LHhduLoUFCh40VvmnvnKhvbX+GSffhw9GeVMHRlZYqgHUfL/GY -Zu8OL0GdRyhzd1tE6WpR2U0bucUJPQbPRcgJJALJot7BqaOeb0W1RVXe9F7ooca7 -hrgRS+L1rQj8mQGNBGD1uLsBDACwjGO5tchUAXJcc/4XX8nYn57JgNrfshxd0Sz9 -tUG/ghEK9Fzy9EZqq4hYiiDhcopuqqLqrAFwtbRU1tVtd6LZO1CQj29dNgrvH+Jd -fbKKeXwr4lK44L0h0uA/CJtRC2JhxkozOzMW80e9pSNBS6wHfFZG3Wlrq1/+K2xr -VknlqkpAfK/f1orBi7sD/IqE3960+JrAh+E1dX4XpBTw1NEgjG9Jwgy/96QA+iBO -91kHJtdQlyfAmhfxx2wIOYO6TTFbYlqwofU3G8cqVCyTNPpQWMaBbeAqymhVN9t0 -odq6xOZKNmafmG6/+6i1wVOTS4xy4WhxeYj5QsSGd6TPyc9Kn/15b4Jaefgn+xLn -e60pOgZ1UwpBc9sisrtzzTZrNMl9x8pe91IxjyHRydhgGzfVfpdIuW3j+XKbg6lH -pEc2RUw1NOQG+eYyx8ZIBxxFlKPpQkPoOknALusseSeuXJdI4QjfS5PimjmDLyM7 -KS1tCBYliiXZiuVre9U7vwRuTWEAEQEAAbQdRW1pbHkgWWUgPGVtaWx5M3llQGdt -YWlsLmNvbT6JAc4EEwEKADgWIQQSQjrdVw2MKk1h/1eBSLU268jXigUCYPW4uwIb -AwULCQgHAgYVCgkICwIEFgIDAQIeAQIXgAAKCRCBSLU268jXilCDC/9pdVz6KTiH -/m822wv5uww7cyt53qJxOSYqH24j8D7Kl7MNOqHZKTg0bsvdTMeZZRa2a2nv8dsE -QfVEfaDlD+y6H0JIO0sFqis0PQPKApvs0UYvAJi4XNzz5PkH7X53QdDNVq7DKUw+ -WReHGG9xE8/rwbICIUpthPHkTgCw8cNniNoj7zZkpS8ET6L6+/5S8eLysp/zHCVG -U3MXBaRvvlAJXkgPr4x41SN8t0Rz9nxh0Is/MDwzIkf3qHeWlU0LseHDUXOz7tMp -zku64JB5r7fUshR6/+F0XMccfJl3GmZE3GEGEUqLprS87DmaRbZPkt/7JUb+Jfmn -wCYCxtzx2K46kYJZyru4KG1DwEqj38hSgjObuX9HXuw1ndmbExlJRKqw9pOTShKD -+Vt1tiBFNTeXPWLNrpueXk89tXPYuDQeErWBOAfyKpayg4hRoM9k9cwxMe7n9Izm -VU9de0um1QgOG+bFwrX0eOqoh68LYZmiWWUTUDHFB95c1rTnuox4YFS5AY0EYPW4 -uwEMAMV+5Afaolcll2Kko4MYizCoIHOGeNGgnGfUx3FoYb5w2DVVYrow+6sMfUDf -D96bu0g9lTFHcLDAVK2kexSGZOyc9YKBJaQUX6T9N
[beam] branch master updated (f859247 -> 8eaa0aa)
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from f859247 [BEAM-12777] Stable URL for current API docs (#16327) add 8eaa0aa [BEAM-13539] correct resource override dependencies (#16392) No new revisions were added by this update. Summary of changes: runners/flink/flink_runner.gradle | 4 ++-- runners/spark/spark_runner.gradle | 4 ++-- 2 files changed, 4 insertions(+), 4 deletions(-)
[beam] branch asf-site updated: Publishing website 2021/12/30 00:05:40 at commit 8eaa0aa
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 52833b4 Publishing website 2021/12/30 00:05:40 at commit 8eaa0aa 52833b4 is described below commit 52833b49dcc668a14264d1ed97fe6e13239c22d0 Author: jenkins AuthorDate: Thu Dec 30 00:05:41 2021 + Publishing website 2021/12/30 00:05:40 at commit 8eaa0aa --- website/generated-content/contribute/index.xml | 29 -- .../contribute/release-guide/index.html| 21 +--- .../sdks/python-dependencies/index.html| 2 +- website/generated-content/sitemap.xml | 2 +- 4 files changed, 13 insertions(+), 41 deletions(-) diff --git a/website/generated-content/contribute/index.xml b/website/generated-content/contribute/index.xml index 00e8842..4256f6f 100644 --- a/website/generated-content/contribute/index.xml +++ b/website/generated-content/contribute/index.xml @@ -719,28 +719,10 @@ This only verifies that everything builds with unit tests passing.There are some projects that don’t produce the artifacts, e.g.
beam-test-tools
, you may be able to ignore failures there.To triage the failures and narrow things down you may want to look at
settings.gradle.kts
and run the build only for the projects you’re interested at the moment, e.g../gradlew :runners:java-fn-execution
.(Alternative) Run release build manually (locally)
+You will need to have Python interpreters for all supported Python minor +versions to run Python tests. See Python installation tips in Developer Wiki.
- -
-Pre-installation for python build
--
-- -
-Install pip
-curl https://bootstrap.pypa.io/get-pip.py -o get-pip.py -python get-pip.py -
- -
-Cython
-sudo pip install cython -sudo apt-get install gcc -sudo apt-get install python-dev -sudo apt-get install python3-dev -sudo apt-get install python3.5-dev -sudo apt-get install python3.6-dev -sudo apt-get install python3.7-dev -
Run gradle release build
- @@ -1261,10 +1243,9 @@ python setup.py sdist
Setup virtual environment
-pip install --upgrade pip -pip install --upgrade setuptools -python -m venv beam_env -. beam_env/bin/activate +
python3 -m venv beam_env +. ./beam_env/bin/activate +pip install --upgrade pip setuptools wheel
Install SDK
diff --git a/website/generated-content/contribute/release-guide/index.html b/website/generated-content/contribute/release-guide/index.html index 6b83c5f..87495dc 100644 --- a/website/generated-content/contribute/release-guide/index.html +++ b/website/generated-content/contribute/release-guide/index.html @@ -102,16 +102,8 @@ You can run https://github.com/apache/beam/blob/master/release/src/main/ Or manually add one trigger phrase per PR comment. See COMMENTS_TO_ADD in https://github.com/apache/beam/blob/master/release/src/main/scripts/mass_comment.py>mass_comment.py for full list of phrases.Tasks included in the scriptInstalls hub with your agreement and setup local git repo;Create a test PR against release branch;The https://ci-beam.apache.org/job/beam_Release_Gradle_Build/>beam_Release_Gradle_Build Jenkins job runs ./gradlew build -PisRelease. -This only verifies that everything builds with unit tests passing.Verify the build succeedsTasks you need to do manually to verify the build succeed:Check the build result.If build failed, scan log will contain all failures.You should stabilize the release branch until release build succeeded.There are some projects that don’t produce the artifacts, e.g. beam-te [...] -python get-pip.py -Cythonsudo pip install cython -sudo apt-get install gcc -sudo apt-get install python-dev -sudo apt-get install python3-dev -sudo apt-get install python3.5-dev -sudo apt-get install python3.6-dev -sudo apt-get install python3.7-dev -Run gradle release buildClean current workspacegit clean -fdx +This only verifies that everything builds with unit tests passing.Verify the build succeedsTasks you need to do manually to verify the build succeed:Check the build result.If build failed, scan log will contain all failures.You should stabilize the release branch until release build succeeded.There are some projects that don’t produce the artifacts, e.g. beam-te [...] +versions to run Python tests. See Python installation tips in https://cwiki.apache.org/con
[beam] branch master updated: [BEAM-13581] Remove previous job name for Flink PVR precommit.
This is an automated email from the ASF dual-hosted git repository. ibzib pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 79fe544 [BEAM-13581] Remove previous job name for Flink PVR precommit. new ea09119 Merge pull request #16394 from ibzib/seed 79fe544 is described below commit 79fe544072e8885aa738baa488fb590cb5aa301b Author: Kyle Weaver AuthorDate: Wed Dec 29 15:33:01 2021 -0800 [BEAM-13581] Remove previous job name for Flink PVR precommit. For some reason Jenkins is having problems renaming it. --- .../job_PreCommit_Java_PortableValidatesRunner_Flink_Batch.groovy| 1 - 1 file changed, 1 deletion(-) diff --git a/.test-infra/jenkins/job_PreCommit_Java_PortableValidatesRunner_Flink_Batch.groovy b/.test-infra/jenkins/job_PreCommit_Java_PortableValidatesRunner_Flink_Batch.groovy index 8efb098..22aed70 100644 --- a/.test-infra/jenkins/job_PreCommit_Java_PortableValidatesRunner_Flink_Batch.groovy +++ b/.test-infra/jenkins/job_PreCommit_Java_PortableValidatesRunner_Flink_Batch.groovy @@ -32,7 +32,6 @@ PrecommitJobBuilder builder = new PrecommitJobBuilder( ], ) builder.build { - previousNames('beam_PostCommit_Java_PVR_Flink_Batch') // Publish all test results to Jenkins. publishers { archiveJunit('**/build/test-results/**/*.xml')
[beam] branch master updated (ea09119 -> e97afe9)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from ea09119 Merge pull request #16394 from ibzib/seed add 6fcb582 [BEAM-13459] Cache artifacts across job runs on python+dataflow new e97afe9 [BEAM-13459] Cache artifacts across job runs on python+dataflow #16229 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../python/apache_beam/options/pipeline_options.py | 7 + .../runners/dataflow/dataflow_runner.py| 3 +- .../runners/dataflow/internal/apiclient.py | 61 - .../runners/dataflow/internal/apiclient_test.py| 249 - .../apache_beam/runners/portability/stager.py | 13 +- .../apache_beam/runners/portability/stager_test.py | 2 +- 6 files changed, 319 insertions(+), 16 deletions(-)
[beam] 01/01: [BEAM-13459] Cache artifacts across job runs on python+dataflow #16229
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit e97afe9fdf1ec600bbd29f53ddec12dbb4a0ec71 Merge: ea09119 6fcb582 Author: tvalentyn AuthorDate: Wed Dec 29 16:36:29 2021 -0800 [BEAM-13459] Cache artifacts across job runs on python+dataflow #16229 .../python/apache_beam/options/pipeline_options.py | 7 + .../runners/dataflow/dataflow_runner.py| 3 +- .../runners/dataflow/internal/apiclient.py | 61 - .../runners/dataflow/internal/apiclient_test.py| 249 - .../apache_beam/runners/portability/stager.py | 13 +- .../apache_beam/runners/portability/stager_test.py | 2 +- 6 files changed, 319 insertions(+), 16 deletions(-)
[beam] branch master updated (e97afe9 -> 006a7ee)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from e97afe9 [BEAM-13459] Cache artifacts across job runs on python+dataflow #16229 add 970bdc0 [BEAM-13488] Work around bug in classpath detection new 006a7ee [BEAM-13488] Work around bug in classpath detection #16275 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../construction/resources/ClasspathScanningResourcesDetector.java | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-)
[beam] 01/01: [BEAM-13488] Work around bug in classpath detection #16275
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git commit 006a7ee378e1895fc1c347383eb119b3c07d679f Merge: e97afe9 970bdc0 Author: tvalentyn AuthorDate: Wed Dec 29 16:39:34 2021 -0800 [BEAM-13488] Work around bug in classpath detection #16275 .../construction/resources/ClasspathScanningResourcesDetector.java | 6 +- 1 file changed, 5 insertions(+), 1 deletion(-)
[beam] branch master updated: Moving to 2.37.0-SNAPSHOT on master branch.
This is an automated email from the ASF dual-hosted git repository. emilyye pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/master by this push: new 28ea3f8 Moving to 2.37.0-SNAPSHOT on master branch. 28ea3f8 is described below commit 28ea3f81a59a7b96945b13ee2af4bc5bc8d3fbd7 Author: Emily Ye AuthorDate: Thu Dec 30 01:06:40 2021 + Moving to 2.37.0-SNAPSHOT on master branch. --- .../src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy| 2 +- gradle.properties | 4 ++-- sdks/go/pkg/beam/core/core.go | 2 +- sdks/python/apache_beam/version.py| 2 +- 4 files changed, 5 insertions(+), 5 deletions(-) diff --git a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy index c835ac9..e492065 100644 --- a/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy +++ b/buildSrc/src/main/groovy/org/apache/beam/gradle/BeamModulePlugin.groovy @@ -378,7 +378,7 @@ class BeamModulePlugin implements Plugin { // Automatically use the official release version if we are performing a release // otherwise append '-SNAPSHOT' -project.version = '2.36.0' +project.version = '2.37.0' if (!isRelease(project)) { project.version += '-SNAPSHOT' } diff --git a/gradle.properties b/gradle.properties index bc0dc86..5876c34 100644 --- a/gradle.properties +++ b/gradle.properties @@ -24,8 +24,8 @@ offlineRepositoryRoot=offline-repository signing.gnupg.executable=gpg signing.gnupg.useLegacyGpg=true -version=2.36.0-SNAPSHOT -sdk_version=2.36.0.dev +version=2.37.0-SNAPSHOT +sdk_version=2.37.0.dev javaVersion=1.8 diff --git a/sdks/go/pkg/beam/core/core.go b/sdks/go/pkg/beam/core/core.go index 506672f..0f23e86 100644 --- a/sdks/go/pkg/beam/core/core.go +++ b/sdks/go/pkg/beam/core/core.go @@ -27,5 +27,5 @@ const ( // SdkName is the human readable name of the SDK for UserAgents. SdkName = "Apache Beam SDK for Go" // SdkVersion is the current version of the SDK. - SdkVersion = "2.36.0.dev" + SdkVersion = "2.37.0.dev" ) diff --git a/sdks/python/apache_beam/version.py b/sdks/python/apache_beam/version.py index fb7b7d1..f80b339 100644 --- a/sdks/python/apache_beam/version.py +++ b/sdks/python/apache_beam/version.py @@ -17,4 +17,4 @@ """Apache Beam SDK version information and utilities.""" -__version__ = '2.36.0.dev' +__version__ = '2.37.0.dev'
[beam] branch release-2.36.0 created (now f62cabf)
This is an automated email from the ASF dual-hosted git repository. emilyye pushed a change to branch release-2.36.0 in repository https://gitbox.apache.org/repos/asf/beam.git. at f62cabf Set Dataflow container to release version. This branch includes the following new commits: new f62cabf Set Dataflow container to release version. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference.
[beam] 01/01: Set Dataflow container to release version.
This is an automated email from the ASF dual-hosted git repository. emilyye pushed a commit to branch release-2.36.0 in repository https://gitbox.apache.org/repos/asf/beam.git commit f62cabf68f4ff53d5e34e24c28c808552c6668f2 Author: Emily Ye AuthorDate: Thu Dec 30 01:09:05 2021 + Set Dataflow container to release version. --- runners/google-cloud-dataflow-java/build.gradle | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/runners/google-cloud-dataflow-java/build.gradle b/runners/google-cloud-dataflow-java/build.gradle index 0387fe2..ebf8238 100644 --- a/runners/google-cloud-dataflow-java/build.gradle +++ b/runners/google-cloud-dataflow-java/build.gradle @@ -45,8 +45,8 @@ processResources { filter org.apache.tools.ant.filters.ReplaceTokens, tokens: [ 'dataflow.legacy_environment_major_version' : '8', 'dataflow.fnapi_environment_major_version' : '8', -'dataflow.legacy_container_version' : 'beam-master-20211213', -'dataflow.fnapi_container_version' : 'beam-master-20210913', +'dataflow.legacy_container_version' : 'beam-2.36.0', +'dataflow.fnapi_container_version' : 'beam-2.36.0', 'dataflow.container_base_repository' : 'gcr.io/cloud-dataflow/v1beta3', ] }
[beam] annotated tag sdks/v2.35.0 updated (a3400e3 -> ad8388a)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to annotated tag sdks/v2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag sdks/v2.35.0 was modified! *** from a3400e3 (commit) to ad8388a (tag) tagging 3fe411f2bd13082597446f4db6e98b7f66d2ed84 (tag) length 155 bytes by Valentyn Tymofieiev on Wed Dec 29 17:30:01 2021 -0800 - Log - Apache Beam 2.35.0. -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEkHE5Z3XlzmG0rN/DHfUGAyJdKaQFAmHNC6IACgkQHfUGAyJd KaRlDhAAwEG/EE+q+1bewewc2BtJGpLOvQlijmf8vB0w0VJRfO3K0PqJ1jdodEXV t4ajX1SWEQqstDaNdb7SFO7xsH75av9xNgzgZ2IlUYFLOjg+x4GpEhPeGmUK+PhV c7eFcSssR5O+wQs5X0jVy8jge9Rp5laaAs4foVZ17vZPJO2uC9CPiH1LT2m5Brh0 1pwgE0zfifqLQkBNofU9J5g1VFMwG/p+GMSuaJ879K7c2M9o/DeVSXn4TlfpnNAH OHTLdfIZIC6qq0jA65xciiI72kVLXFcz0kzjA9VjdoXpN58cLwduVOx8+vvuwVYq zzEiUUHIWCcpiWNZBQALc/uROZUxTxqMVrLg3mZ/W51b1MVR9ARaTTforoN6Xnci ED/advDiF47VRdu8n9fD8laX7QBH3DuCGJ0G33mGOSmN+RfnTJDxqZ6xeVcZlxxj 06+ww2K0XtPrddX8onF7vKKCoBxE3wpsfE0V/veBEAM0IN4VtFrHldTv3uAKF5Ds f1NbHp7B4QD9a4gxW4Eku5UdiOF5j6Pw6X5i6UICddd/ylvg9Ok9tpJqsHcsu482 q2h6gMRitabfe7c/uyKsrjeczA4r1CLwRMjBa8sSD7OTtJo/mYfvQLBfNo7l2xpu +h7d3klqhoXLv1T5tcxjx+/yGopK+q4cW+WtOFvkSA20WP5/0Fg= =jvKE -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
[beam] annotated tag v2.35.0 updated (a3400e3 -> e65d651)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to annotated tag v2.35.0 in repository https://gitbox.apache.org/repos/asf/beam.git. *** WARNING: tag v2.35.0 was modified! *** from a3400e3 (commit) to e65d651 (tag) tagging 3fe411f2bd13082597446f4db6e98b7f66d2ed84 (tag) length 155 bytes by Valentyn Tymofieiev on Wed Dec 29 17:31:21 2021 -0800 - Log - Apache Beam 2.35.0 -BEGIN PGP SIGNATURE- iQIzBAABCgAdFiEEkHE5Z3XlzmG0rN/DHfUGAyJdKaQFAmHNC+8ACgkQHfUGAyJd KaS3pA//RaIY7FNgdXTNJNECWMY4TWCkxu2A3CTHoxpy1sF7E3JV8rPS97gnuE9F 0nlvtQAt/PQs0r1sbcCOK/H/SaKxWslyiT/RWs2UHO/EPvfs/jxRIppfYU/e2Qd8 0wiEUubSySisuhBbExk4zNhxpl7/ODdtxqS4+5bPNw1NYVPT933WZ3o/IdGGOVs6 3qr5ZGF5D9G4G/B5rfXv1khBzoHuy0WaGEMd4ZRQlD+OunrpPn6ATo98r9pZlfUa bI15VzoYfbXs9OU/Kvi8UbkbZPJiHxwJS+sz27TxVm2aRLW29J9zJBDhul8I7XGO A1CtkmeAG5+MOtVaNm3kup4ck4euSN8eGThPeN9Vs/u2TST27bGhkBqGlZx0P8fO d9kjuC9coMFF1O/UVfzLvbONHqPxw/VapCpyFAuJoYHNKbXxesbchIOBFxhGGDlE 6k/COfv3JfNejHtlr311WKvZ3Ildt7e4wSgDRHp05ZOa8zjEczdVUcUuJI232egl OfRMFk11wEi8paCeEKbXoR7TW5CJAFXXZ9gY4KXFFsyQpeib1uKo0oeGYKBIFnDl 43/ipNU/WBizSuovkmbBf6zob7IFZdNtG9E25eiBMevKw/z1cuw7gJVwD+GuVXfM il4uEA3Rvvyp4B5vVPIlHIW6U2sfCR7ThMmfWE1Wrfy3zvxVhuA= =5mX2 -END PGP SIGNATURE- --- No new revisions were added by this update. Summary of changes:
[beam] branch master updated (28ea3f8 -> 12fbe03)
This is an automated email from the ASF dual-hosted git repository. tvalentyn pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 28ea3f8 Moving to 2.37.0-SNAPSHOT on master branch. add 12fbe03 Release website update for Beam 2.35.0 (#16115) No new revisions were added by this update. Summary of changes: CHANGES.md | 48 +++ website/www/site/config.toml | 2 +- website/www/site/content/en/blog/beam-2.35.0.md| 160 + .../www/site/content/en/get-started/downloads.md | 8 ++ website/www/site/data/capability_matrix.yaml | 4 +- .../www/site/data/capability_matrix_snapshot.yaml | 4 +- website/www/site/static/.htaccess | 2 +- 7 files changed, 192 insertions(+), 36 deletions(-) create mode 100644 website/www/site/content/en/blog/beam-2.35.0.md
[beam] branch nightly-refs/heads/master updated (b33bebc -> 12fbe03)
This is an automated email from the ASF dual-hosted git repository. github-bot pushed a change to branch nightly-refs/heads/master in repository https://gitbox.apache.org/repos/asf/beam.git. from b33bebc Merge pull request #16215 from dpcollins-google/publish-no-desync add d7f6405 [BEAM-13578] Validate that repeatable PipelineOptions need to be specified as a list if set programmatically (#16372) add c5294f0 [BEAM-13430] Update comment over eclipse plugin. (#16387) add a7f73d3 Update venv creation commands in release scripts. (#16381) add 114ba24 [BEAM-13430] Fix broken ULR validates runner tests add 7c3fd2a Merge pull request #16391 from y1chi/BEAM-13430-ulr add f859247 [BEAM-12777] Stable URL for current API docs (#16327) add 8eaa0aa [BEAM-13539] correct resource override dependencies (#16392) add 79fe544 [BEAM-13581] Remove previous job name for Flink PVR precommit. add ea09119 Merge pull request #16394 from ibzib/seed add 6fcb582 [BEAM-13459] Cache artifacts across job runs on python+dataflow add e97afe9 [BEAM-13459] Cache artifacts across job runs on python+dataflow #16229 add 970bdc0 [BEAM-13488] Work around bug in classpath detection add 006a7ee [BEAM-13488] Work around bug in classpath detection #16275 add 28ea3f8 Moving to 2.37.0-SNAPSHOT on master branch. add 12fbe03 Release website update for Beam 2.35.0 (#16115) No new revisions were added by this update. Summary of changes: .../jenkins/dependency_check/generate_report.sh| 7 +- .test-infra/jenkins/job_00_seed.groovy | 3 +- ...Java_PortableValidatesRunner_Flink_Batch.groovy | 1 - .test-infra/jenkins/job_seed_standalone.groovy | 5 +- CHANGES.md | 48 ++-- .../org/apache/beam/gradle/BeamModulePlugin.groovy | 8 +- gradle.properties | 4 +- .../python_release_automation_utils.sh | 3 +- .../src/main/scripts/build_release_candidate.sh| 5 +- release/src/main/scripts/deploy_pypi.sh| 1 + .../main/scripts/deploy_release_candidate_pypi.sh | 2 +- release/src/main/scripts/run_rc_validation.sh | 44 ++-- .../ClasspathScanningResourcesDetector.java| 6 +- runners/flink/flink_runner.gradle | 4 +- runners/portability/java/build.gradle | 1 + runners/portability/test_flink_uber_jar.sh | 1 + runners/portability/test_pipeline_jar.sh | 1 + runners/spark/spark_runner.gradle | 4 +- sdks/go/pkg/beam/core/core.go | 2 +- .../container/license_scripts/license_script.sh| 3 +- .../apache_beam/examples/kafkataxi/README.md | 5 +- .../apache_beam/examples/snippets/snippets.py | 3 + .../python/apache_beam/options/pipeline_options.py | 25 ++- .../options/pipeline_options_validator.py | 16 ++ .../options/pipeline_options_validator_test.py | 33 +++ .../runners/dataflow/dataflow_runner.py| 3 +- .../runners/dataflow/internal/apiclient.py | 61 - .../runners/dataflow/internal/apiclient_test.py| 249 - .../apache_beam/runners/interactive/README.md | 31 +-- .../apache_beam/runners/portability/stager.py | 13 +- .../apache_beam/runners/portability/stager_test.py | 2 +- sdks/python/apache_beam/version.py | 2 +- sdks/python/container/run_generate_requirements.sh | 3 +- sdks/python/scripts/generate_pydoc.sh | 3 + website/www/site/config.toml | 2 +- website/www/site/content/en/blog/beam-2.35.0.md| 160 + .../site/content/en/contribute/release-guide.md| 27 +-- .../en/documentation/sdks/python-dependencies.md | 2 +- .../www/site/content/en/get-started/downloads.md | 8 + website/www/site/data/capability_matrix.yaml | 4 +- .../www/site/data/capability_matrix_snapshot.yaml | 4 +- website/www/site/static/.htaccess | 2 +- 42 files changed, 667 insertions(+), 144 deletions(-) create mode 100644 website/www/site/content/en/blog/beam-2.35.0.md
[beam] branch master updated (12fbe03 -> 0af3689)
This is an automated email from the ASF dual-hosted git repository. lcwik pushed a change to branch master in repository https://gitbox.apache.org/repos/asf/beam.git. from 12fbe03 Release website update for Beam 2.35.0 (#16115) add 0af3689 [BEAM-13430] Re-enable checkerframework for the project excluding the two classes it started to crash on. (#16389) No new revisions were added by this update. Summary of changes: .../groovy/org/apache/beam/gradle/BeamModulePlugin.groovy | 7 --- runners/google-cloud-dataflow-java/build.gradle | 9 + sdks/java/extensions/sql/build.gradle | 11 +++ sdks/java/extensions/sql/hcatalog/build.gradle | 13 - 4 files changed, 32 insertions(+), 8 deletions(-)