This is an automated email from the ASF dual-hosted git repository. yhu pushed a commit to branch master in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/master by this push: new c8f68f92097 Update Beam website to release 2.49.0 (#27374) c8f68f92097 is described below commit c8f68f92097de33fe2c6863344404a1b9922ae27 Author: Yi Hu <ya...@google.com> AuthorDate: Mon Jul 17 10:57:17 2023 -0400 Update Beam website to release 2.49.0 (#27374) * Update Beam website to release 2.49.0 * Simplify Flink Version Compatibility table * Update support status of IO as of 2.49.0 --- website/www/site/config.toml | 2 +- website/www/site/content/en/blog/beam-2.49.0.md | 221 +++++++++++++++++++++ .../site/content/en/documentation/io/connectors.md | 5 +- .../site/content/en/documentation/runners/flink.md | 189 ++---------------- .../www/site/content/en/get-started/downloads.md | 14 +- website/www/site/data/authors.yml | 5 +- 6 files changed, 260 insertions(+), 176 deletions(-) diff --git a/website/www/site/config.toml b/website/www/site/config.toml index 406011422bd..e57bdbd280e 100644 --- a/website/www/site/config.toml +++ b/website/www/site/config.toml @@ -104,7 +104,7 @@ github_project_repo = "https://github.com/apache/beam" [params] description = "Apache Beam is an open source, unified model and set of language-specific SDKs for defining and executing data processing workflows, and also data ingestion and integration flows, supporting Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs). Dataflow pipelines simplify the mechanics of large-scale batch and streaming data processing and can run on a number of runtimes like Apache Flink, Apache Spark, and Google Cloud Dataflow (a cloud service). Be [...] -release_latest = "2.48.0" +release_latest = "2.49.0" # The repository and branch where the files live in Github or Colab. This is used # to serve and stage from your local branch, but publish to the master branch. # e.g. https://github.com/{{< param branch_repo >}}/path/to/notebook.ipynb diff --git a/website/www/site/content/en/blog/beam-2.49.0.md b/website/www/site/content/en/blog/beam-2.49.0.md new file mode 100644 index 00000000000..621637d655f --- /dev/null +++ b/website/www/site/content/en/blog/beam-2.49.0.md @@ -0,0 +1,221 @@ +--- +title: "Apache Beam 2.49.0" +date: 2023-07-17 09:00:00 -0400 +categories: + - blog + - release +authors: + - yhu +--- +<!-- +Licensed under the Apache License, Version 2.0 (the "License"); +you may not use this file except in compliance with the License. +You may obtain a copy of the License at +http://www.apache.org/licenses/LICENSE-2.0 +Unless required by applicable law or agreed to in writing, software +distributed under the License is distributed on an "AS IS" BASIS, +WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +See the License for the specific language governing permissions and +limitations under the License. +--> + +We are happy to present the new 2.49.0 release of Beam. +This release includes both improvements and new functionality. +See the [download page](/get-started/downloads/#2490-2023-07-17) for this release. + +<!--more--> + +For more information on changes in 2.49.0, check out the [detailed release notes](https://github.com/apache/beam/milestone/13). + +## I/Os + +* Support for Bigtable Change Streams added in Java `BigtableIO.ReadChangeStream` ([#27183](https://github.com/apache/beam/issues/27183)). +* Added Bigtable Read and Write cross-language transforms to Python SDK (([#26593](https://github.com/apache/beam/issues/26593)), ([#27146](https://github.com/apache/beam/issues/27146))). + +## New Features / Improvements + +* Allow prebuilding large images when using `--prebuild_sdk_container_engine=cloud_build`, like images depending on `tensorflow` or `torch` ([#27023](https://github.com/apache/beam/pull/27023)). +* Disabled `pip` cache when installing packages on the workers. This reduces the size of prebuilt Python container images ([#27035](https://github.com/apache/beam/pull/27035)). +* Select dedicated avro datum reader and writer (Java) ([#18874](https://github.com/apache/beam/issues/18874)). +* Timer API for the Go SDK (Go) ([#22737](https://github.com/apache/beam/issues/22737)). + + +## Deprecations + +* Remove Python 3.7 support. ([#26447](https://github.com/apache/beam/issues/26447)) + +## Bugfixes + +* Fixed KinesisIO `NullPointerException` when a progress check is made before the reader is started (IO) ([#23868](https://github.com/apache/beam/issues/23868)) + +### Known Issues + + +## List of Contributors + +According to git shortlog, the following people contributed to the 2.49.0 release. Thank you to all contributors! + +Abzal Tuganbay + +AdalbertMemSQL + +Ahmed Abualsaud + +Ahmet Altay + +Alan Zhang + +Alexey Romanenko + +Anand Inguva + +Andrei Gurau + +Arwin Tio + +Bartosz Zablocki + +Bruno Volpato + +Burke Davison + +Byron Ellis + +Chamikara Jayalath + +Charles Rothrock + +Chris Gavin + +Claire McGinty + +Clay Johnson + +Damon + +Daniel Dopierała + +Danny McCormick + +Darkhan Nausharipov + +David Cavazos + +Dip Patel + +Dmitry Repin + +Gavin McDonald + +Jack Dingilian + +Jack McCluskey + +James Fricker + +Jan Lukavský + +Jasper Van den Bossche + +John Casey + +John Gill + +Joseph Crowley + +Kanishk Karanawat + +Katie Liu + +Kenneth Knowles + +Kyle Galloway + +Liam Miller-Cushon + +MakarkinSAkvelon + +Masato Nakamura + +Mattie Fu + +Michel Davit + +Naireen Hussain + +Nathaniel Young + +Nelson Osacky + +Nick Li + +Oleh Borysevych + +Pablo Estrada + +Reeba Qureshi + +Reuven Lax + +Ritesh Ghorse + +Robert Bradshaw + +Robert Burke + +Rouslan + +Saadat Su + +Sam Rohde + +Sam Whittle + +Sanil Jain + +Shunping Huang + +Smeet nagda + +Svetak Sundhar + +Timur Sultanov + +Udi Meiri + +Valentyn Tymofieiev + +Vlado Djerek + +WuA + +XQ Hu + +Xianhua Liu + +Xinyu Liu + +Yi Hu + +Zachary Houfek + +alexeyinkin + +bigduu + +bullet03 + +bzablocki + +jonathan-lemos + +jubebo + +magicgoody + +ruslan-ikhsan + +sultanalieva-s + +vitaly.terentyev + diff --git a/website/www/site/content/en/documentation/io/connectors.md b/website/www/site/content/en/documentation/io/connectors.md index 83c53f165b5..a1f458377af 100644 --- a/website/www/site/content/en/documentation/io/connectors.md +++ b/website/www/site/content/en/documentation/io/connectors.md @@ -554,7 +554,10 @@ This table provides a consolidated, at-a-glance overview of the available built- </td> <td class="present"> ✔ - <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.io.gcp.bigtableio.html">native</a> + <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.io.gcp.bigtableio.html">native</a> (sink) + <br> + ✔ + <a href="https://beam.apache.org/releases/pydoc/current/apache_beam.io.gcp.bigtableio.html">via X-language</a> </td> <td>Not available</td> <td>Not available</td> diff --git a/website/www/site/content/en/documentation/runners/flink.md b/website/www/site/content/en/documentation/runners/flink.md index 1549857068f..64a6e9bade9 100644 --- a/website/www/site/content/en/documentation/runners/flink.md +++ b/website/www/site/content/en/documentation/runners/flink.md @@ -325,235 +325,84 @@ To find out which version of Flink is compatible with Beam please see the table <table class="table table-bordered"> <tr> - <th>Beam Version</th> <th>Flink Version</th> <th>Artifact Id</th> + <th>Supported Beam Versions</th> </tr> <tr> - <td rowspan="5">≥ 2.47.0</td> <td>1.16.x</td> <td>beam-runners-flink-1.16</td> + <td>≥ 2.47.0</td> </tr> <tr> <td>1.15.x</td> <td>beam-runners-flink-1.15</td> + <td>≥ 2.40.0</td> </tr> <tr> <td>1.14.x</td> <td>beam-runners-flink-1.14</td> + <td>≥ 2.38.0</td> </tr> <tr> <td>1.13.x</td> <td>beam-runners-flink-1.13</td> + <td>≥ 2.31.0</td> </tr> <tr> <td>1.12.x</td> <td>beam-runners-flink-1.12</td> -</tr> -<tr> - <td rowspan="4">2.40.0 - 2.46.0</td> - <td>1.15.x</td> - <td>beam-runners-flink-1.15</td> -</tr> -<tr> - <td>1.14.x</td> - <td>beam-runners-flink-1.14</td> -</tr> -<tr> - <td>1.13.x</td> - <td>beam-runners-flink-1.13</td> -</tr> -<tr> - <td>1.12.x</td> - <td>beam-runners-flink-1.12</td> -</tr> -<tr> - <td rowspan="3">2.39.0</td> - <td>1.14.x</td> - <td>beam-runners-flink-1.14</td> -</tr> -<tr> - <td>1.13.x</td> - <td>beam-runners-flink-1.13</td> -</tr> -<tr> - <td>1.12.x</td> - <td>beam-runners-flink-1.12</td> -</tr> -<tr> - <td rowspan="4">2.38.0</td> - <td>1.14.x</td> - <td>beam-runners-flink-1.14</td> -</tr> -<tr> - <td>1.13.x</td> - <td>beam-runners-flink-1.13</td> -</tr> -<tr> - <td>1.12.x</td> - <td>beam-runners-flink-1.12</td> -</tr> -<tr> - <td>1.11.x</td> - <td>beam-runners-flink-1.11</td> -</tr> -<tr> - <td rowspan="3">2.31.0 - 2.37.0</td> - <td>1.13.x</td> - <td>beam-runners-flink-1.13</td> -</tr> -<tr> - <td>1.12.x</td> - <td>beam-runners-flink-1.12</td> -</tr> -<tr> - <td>1.11.x</td> - <td>beam-runners-flink-1.11</td> -</tr> -<tr> - <td rowspan="3">2.30.0</td> - <td>1.12.x</td> - <td>beam-runners-flink-1.12</td> -</tr> -<tr> - <td>1.11.x</td> - <td>beam-runners-flink-1.11</td> -</tr> -<tr> - <td>1.10.x</td> - <td>beam-runners-flink-1.10</td> -</tr> -<tr> - <td rowspan="5">2.27.0 - 2.29.0</td> - <td>1.12.x</td> - <td>beam-runners-flink-1.12</td> + <td>≥ 2.27.0</td> </tr> <tr> <td>1.11.x</td> <td>beam-runners-flink-1.11</td> + <td>2.25.0 - 2.38.0</td> </tr> <tr> <td>1.10.x</td> <td>beam-runners-flink-1.10</td> + <td>2.21.0 - 2.30.0</td> </tr> <tr> <td>1.9.x</td> <td>beam-runners-flink-1.9</td> + <td>2.17.0 - 2.29.0</td> </tr> <tr> <td>1.8.x</td> <td>beam-runners-flink-1.8</td> -</tr> -<tr> - <td rowspan="4">2.25.0 - 2.26.0</td> - <td>1.11.x</td> - <td>beam-runners-flink-1.11</td> -</tr> -<tr> - <td>1.10.x</td> - <td>beam-runners-flink-1.10</td> -</tr> -<tr> - <td>1.9.x</td> - <td>beam-runners-flink-1.9</td> -</tr> -<tr> - <td>1.8.x</td> - <td>beam-runners-flink-1.8</td> -</tr> -<tr> - <td rowspan="3">2.21.0 - 2.24.0</td> - <td>1.10.x</td> - <td>beam-runners-flink-1.10</td> -</tr> -<tr> - <td>1.9.x</td> - <td>beam-runners-flink-1.9</td> -</tr> -<tr> - <td>1.8.x</td> - <td>beam-runners-flink-1.8</td> -</tr> -<tr> - <td rowspan="3">2.17.0 - 2.20.0</td> - <td>1.9.x</td> - <td>beam-runners-flink-1.9</td> -</tr> -<tr> - <td>1.8.x</td> - <td>beam-runners-flink-1.8</td> -</tr> -<tr> - <td>1.7.x</td> - <td>beam-runners-flink-1.7</td> -</tr> -<tr> - <td rowspan="4">2.13.0 - 2.16.0</td> - <td>1.8.x</td> - <td>beam-runners-flink-1.8</td> + <td>2.13.0 - 2.29.0</td> </tr> <tr> <td>1.7.x</td> <td>beam-runners-flink-1.7</td> + <td>2.10.0 - 2.20.0</td> </tr> <tr> <td>1.6.x</td> <td>beam-runners-flink-1.6</td> + <td>2.10.0 - 2.16.0</td> </tr> <tr> <td>1.5.x</td> <td>beam-runners-flink_2.11</td> + <td>2.6.0 - 2.16.0</td> </tr> <tr> - <td rowspan="3">2.10.0 - 2.16.0</td> - <td>1.7.x</td> - <td>beam-runners-flink-1.7</td> -</tr> -<tr> - <td>1.6.x</td> - <td>beam-runners-flink-1.6</td> -</tr> -<tr> - <td>1.5.x</td> + <td>1.4.x with Scala 2.11</td> <td>beam-runners-flink_2.11</td> + <td>2.3.0 - 2.5.0</td> </tr> <tr> - <td>2.9.0</td> - <td rowspan="4">1.5.x</td> - <td rowspan="4">beam-runners-flink_2.11</td> -</tr> -<tr> - <td>2.8.0</td> -</tr> -<tr> - <td>2.7.0</td> -</tr> -<tr> - <td>2.6.0</td> -</tr> -<tr> - <td>2.5.0</td> - <td rowspan="3">1.4.x with Scala 2.11</td> - <td rowspan="3">beam-runners-flink_2.11</td> -</tr> -<tr> - <td>2.4.0</td> -</tr> -<tr> - <td>2.3.0</td> -</tr> -<tr> - <td>2.2.0</td> - <td rowspan="2">1.3.x with Scala 2.10</td> - <td rowspan="2">beam-runners-flink_2.10</td> -</tr> -<tr> - <td>2.1.x</td> + <td>1.3.x with Scala 2.10</td> + <td>beam-runners-flink_2.10</td> + <td>2.1.x - 2.2.0</td> </tr> <tr> - <td>2.0.0</td> <td>1.2.x with Scala 2.10</td> <td>beam-runners-flink_2.10</td> + <td>2.0.0</td> </tr> </table> diff --git a/website/www/site/content/en/get-started/downloads.md b/website/www/site/content/en/get-started/downloads.md index 35acb147f11..a0762fd2ea9 100644 --- a/website/www/site/content/en/get-started/downloads.md +++ b/website/www/site/content/en/get-started/downloads.md @@ -96,10 +96,18 @@ versions denoted `0.x.y`. ## Releases +### 2.49.0 (2023-07-17) +Official [source code download](https://downloads.apache.org/beam/2.49.0/apache-beam-2.49.0-source-release.zip). +[SHA-512](https://downloads.apache.org/beam/2.49.0/apache-beam-2.49.0-source-release.zip.sha512). +[signature](https://downloads.apache.org/beam/2.49.0/apache-beam-2.49.0-source-release.zip.asc). + +[Release notes](https://github.com/apache/beam/releases/tag/v2.49.0) +[Blog post](/blog/beam-2.49.0). + ### 2.48.0 (2023-05-31) -Official [source code download](https://downloads.apache.org/beam/2.48.0/apache-beam-2.48.0-source-release.zip). -[SHA-512](https://downloads.apache.org/beam/2.48.0/apache-beam-2.48.0-source-release.zip.sha512). -[signature](https://downloads.apache.org/beam/2.48.0/apache-beam-2.48.0-source-release.zip.asc). +Official [source code download](https://archive.apache.org/dist/beam/2.48.0/apache-beam-2.48.0-source-release.zip). +[SHA-512](https://archive.apache.org/dist/beam/2.48.0/apache-beam-2.48.0-source-release.zip.sha512). +[signature](https://archive.apache.org/dist/beam/2.48.0/apache-beam-2.48.0-source-release.zip.asc). [Release notes](https://github.com/apache/beam/releases/tag/v2.48.0) [Blog post](/blog/beam-2.48.0). diff --git a/website/www/site/data/authors.yml b/website/www/site/data/authors.yml index f9a2996ebe3..0458bda2c96 100644 --- a/website/www/site/data/authors.yml +++ b/website/www/site/data/authors.yml @@ -265,4 +265,7 @@ sysede: linkedin: desyse riteshghorse: name: Ritesh Ghorse - email: riteshgho...@apache.org \ No newline at end of file + email: riteshgho...@apache.org +yhu: + name: Yi Hu + email: y...@apache.org