This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 2f44e0b25c0 Publishing website 2022/04/21 16:17:47 at commit 373c1c9
2f44e0b25c0 is described below
commit 2f44e0b25c0ae47e15940f275d9c6f0dc273e4f3
Author: jenkins <bui...@apache.org>
AuthorDate: Thu Apr 21 16:17:48 2022 +0000
Publishing website 2022/04/21 16:17:47 at commit 373c1c9
---
website/generated-content/blog/beam-2.29.0/index.html | 2 +-
website/generated-content/blog/beam-a-look-back/index.html | 2 +-
.../generated-content/blog/beam-summit-digital-2020/index.html | 2 +-
website/generated-content/blog/beam-summit-europe-2019/index.html | 2 +-
website/generated-content/blog/index.html | 2 +-
website/generated-content/blog/index.xml | 8 +++++---
.../blog/review-input-streaming-connectors/index.html | 4 ++--
website/generated-content/categories/blog/index.xml | 8 +++++---
.../generated-content/contribute/become-a-committer/index.html | 4 ++--
website/generated-content/contribute/index.xml | 6 +++---
website/generated-content/contribute/release-guide/index.html | 4 ++--
website/generated-content/documentation/index.xml | 6 +++---
.../documentation/io/built-in/google-bigquery/index.html | 4 ++--
website/generated-content/documentation/io/testing/index.html | 4 ++--
.../generated-content/documentation/programming-guide/index.html | 4 ++--
.../documentation/resources/learning-resources/index.html | 4 ++--
website/generated-content/documentation/runners/direct/index.html | 4 ++--
website/generated-content/documentation/runners/jstorm/index.html | 6 +++---
.../documentation/runtime/environments/index.html | 4 ++--
website/generated-content/sitemap.xml | 2 +-
20 files changed, 43 insertions(+), 39 deletions(-)
diff --git a/website/generated-content/blog/beam-2.29.0/index.html
b/website/generated-content/blog/beam-2.29.0/index.html
index 41269cda6b1..dd5c390af83 100644
--- a/website/generated-content/blog/beam-2.29.0/index.html
+++ b/website/generated-content/blog/beam-2.29.0/index.html
@@ -20,7 +20,7 @@ function endSearch(){var
search=document.querySelector(".searchBar");search.clas
function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog</p><p>2021/04/29</p></div><header class=post-header><h2
itemprop="name headline">Apache Beam 2.29.0</h1><div
class=post-info><span>Kenneth Knowles [<a
href=https://twitter.com/KennKnowles>@KennKnowles</a>]</span></div></header><div
class="arrow-list [...]
This release includes both improvements and new functionality.
-See the <a href=/get-started/downloads/#2290-2021-04-15>download page</a> for
this release.</p><p>For more information on changes in 2.29.0, check out the <a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12349629";>detailed
release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Spark Classic
and Portable runners officially support Spark 3 (<a
href=https://issues.apache.org/jira/browse/BEAM-7093>BEAM-7093</a>).</li><li>Official
Java 11 supp [...]
+See the <a href=/get-started/downloads/#2290-2021-04-15>download page</a> for
this release.</p><p>For more information on changes in 2.29.0, check out the <a
href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12349629";>detailed
release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Spark Classic
and Portable runners officially support Spark 3 (<a
href=https://issues.apache.org/jira/browse/BEAM-7093>BEAM-7093</a>).</li><li>Official
Java 11 supp [...]
To restore the old behavior, one can register
<code>FakeDeterministicFastPrimitivesCoder</code> with
<code>beam.coders.registry.register_fallback_coder(beam.coders.coders.FakeDeterministicFastPrimitivesCoder())</code>
or use the <code>allow_non_deterministic_key_coders</code> pipeline
option.</li></ul><h3 id=deprecations>Deprecations</h3><ul><li>Support for Flink
1.8 and 1.9 will be removed in the next release (2.30.0) (<a
href=https://issues.apache.org/jira/browse/BEAM-11948>BEAM-11948</a>).</li></ul><h3
id=known-issues>Known Issues</h3><ul><li>See a full list of open <a
href="https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20affectedVersion%20%3D%202.29.0%20ORDER%20BY%20priorit
[...]
diff --git a/website/generated-content/blog/beam-a-look-back/index.html
b/website/generated-content/blog/beam-a-look-back/index.html
index c5e08ca1d01..aa8f6bf2a57 100644
--- a/website/generated-content/blog/beam-a-look-back/index.html
+++ b/website/generated-content/blog/beam-a-look-back/index.html
@@ -36,7 +36,7 @@ and validation of its core value proposition of portability,
is the addition of
significant new <a href=/documentation/runners/capability-matrix/>runners</a>
(i.e. execution engines). We entered 2017 with Apache Flink, Apache Spark 1.x,
Google Cloud Dataflow, Apache Apex, and Apache Gearpump. In 2017, the following
-new and updated runners were developed:</p><ul><li>Apache Spark 2.x
update</li><li><a
href=https://www.ibm.com/blogs/bluemix/2017/10/streaming-analytics-updates-ibm-streams-runner-apache-beam-2-0/>IBM
Streams runner</a></li><li>MapReduce runner</li><li><a
href=http://jstorm.io/>JStorm runner</a></li></ul><p>In addition to runners,
Beam added new IO connectors, some notable ones being
+new and updated runners were developed:</p><ul><li>Apache Spark 2.x
update</li><li><a
href=https://www.ibm.com/blogs/bluemix/2017/10/streaming-analytics-updates-ibm-streams-runner-apache-beam-2-0/>IBM
Streams runner</a></li><li>MapReduce runner</li><li><a
href=https://github.com/alibaba/jstorm>JStorm runner</a></li></ul><p>In
addition to runners, Beam added new IO connectors, some notable ones being
the Cassandra, MQTT, AMQP, HBase/HCatalog, JDBC, Solr, Tika, Redis, and
Elasticsearch connectors. Beam’s IO connectors make it possible to read from or
write to data sources/sinks even when they are not natively supported by the
diff --git a/website/generated-content/blog/beam-summit-digital-2020/index.html
b/website/generated-content/blog/beam-summit-digital-2020/index.html
index 744c09d4bf3..980e24a6e34 100644
--- a/website/generated-content/blog/beam-summit-digital-2020/index.html
+++ b/website/generated-content/blog/beam-summit-digital-2020/index.html
@@ -22,7 +22,7 @@ function
openMenu(){addPlaceholder();blockScroll();}</script><div class="body__c
,
Matthias Baetens [<a
href=https://twitter.com/matthiasbaetens>@matthiasbaetens</a>]
&
-Maximilian Michels [<a
href=https://twitter.com/stadtlegende>@stadtlegende</a>]</span></div></header><div
class="arrow-list header-top-margin" itemprop=articleBody><p>As some of you
are already aware, the 2020 edition of the Beam Summit will be completely
<strong>digital and free</strong>. Beam Summit Digital will take place from
<strong>August 24th to 28th</strong>. The conference will be spread across the
course of one week with a couple of hours of program each day.</p><p><img
class=c [...]
+Maximilian Michels [<a
href=https://twitter.com/stadtlegende>@stadtlegende</a>]</span></div></header><div
class="arrow-list header-top-margin" itemprop=articleBody><p>As some of you
are already aware, the 2020 edition of the Beam Summit will be completely
<strong>digital and free</strong>. Beam Summit Digital will take place from
<strong>August 24th to 28th</strong>. The conference will be spread across the
course of one week with a couple of hours of program each day.</p><p><img
class=c [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/blog/beam-summit-europe-2019/index.html
b/website/generated-content/blog/beam-summit-europe-2019/index.html
index ff5cf67ca2c..e1d7ba46b91 100644
--- a/website/generated-content/blog/beam-summit-europe-2019/index.html
+++ b/website/generated-content/blog/beam-summit-europe-2019/index.html
@@ -18,7 +18,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you
looking for?");}
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog</p><p>2019/05/11</p></div><header class=post-header><h2
itemprop="name headline">Beam community update!</h1><div
class=post-info><span>Matthias Baetens [<a
href=https://twitter.com/matthiasbaetens>@matthiasbaetens</a>]</span></div></header><div
class [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog</p><p>2019/05/11</p></div><header class=post-header><h2
itemprop="name headline">Beam community update!</h1><div
class=post-info><span>Matthias Baetens [<a
href=https://twitter.com/matthiasbaetens>@matthiasbaetens</a>]</span></div></header><div
class [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/blog/index.html
b/website/generated-content/blog/index.html
index a411988b701..14fd7e13a43 100644
--- a/website/generated-content/blog/index.html
+++ b/website/generated-content/blog/index.html
@@ -70,7 +70,7 @@ and Stockholm had its second meetup at the start of May:
Big audience for the second @ApacheBeam meetup in Stockholm! Gleb, @kanterov
from @SpotifyEng kicking off the first talk with Beam SQL.#ApacheBeamStockholm
pic.twitter.com/fDqPPFh2gY
&mdash; Matthias Baetens 🌆 (@matthiasbaetens) 6 May 2019 Keep an eye out
for a meetup in Paris.
If you are interested in starting your own meetup, feel free to reach out!
Good places to start include our Slack channel, the dev and user mailing lists,
or the Apache Beam Twitter.
-Even if you can’t travel to these meetups, you can stay informed on the
happenings of the community. The talks and sessions from previous conferences
and meetups are archived on the Apache Beam YouTube channel. If you want your
session added to the channel, don’t hesitate to get in touch! And in case you
want to attend the next Beam event in style, you can also order your swag on
the Beam swag store
+Even if you can’t travel to these meetups, you can stay informed on the
happenings of the community. The talks and sessions from previous conferences
and meetups are archived on the Apache Beam YouTube channel. If you want your
session added to the channel, don’t hesitate to get in touch!
Summits The first summit of the year will be held in Berlin:
You can find more info on the website and read about the inaugural edition of
the Beam Summit Europe here. At these summits, you have the opportunity to meet
with other Apache Beam creators and users, get expert advice, learn from the
speaker sessions, and participate in workshops.
We strongly encourage you to get involved again this year! You can participate
in the following ways for the upcoming summit in Europe:
diff --git a/website/generated-content/blog/index.xml
b/website/generated-content/blog/index.xml
index 3e8e38321c1..f2be365441d 100644
--- a/website/generated-content/blog/index.xml
+++ b/website/generated-content/blog/index.xml
@@ -1361,7 +1361,7 @@ See the <a
href="/get-started/downloads/#2290-2021-04-15">download page</a
<h3 id="new-features--improvements">New Features / Improvements</h3>
<ul>
<li>DataFrame API now supports pandas 1.2.x (<a
href="https://issues.apache.org/jira/browse/BEAM-11531";>BEAM-11531</a>).</li>
-<li>Multiple DataFrame API bugfixes (<a
href="https://issues.apache/jira/browse/BEAM-12071";>BEAM-12071</a>, <a
href="https://issues.apache/jira/browse/BEAM-11929";>BEAM-11929</a>)</li>
+<li>Multiple DataFrame API bugfixes (<a
href="https://issues.apache.org/jira/browse/BEAM-12071";>BEAM-12071</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-11929";>BEAM-11929</a>)</li>
<li>DDL supported in SQL transforms (<a
href="https://issues.apache.org/jira/browse/BEAM-11850";>BEAM-11850</a>)</li>
<li>Upgrade Flink runner to Flink version 1.12.2 (<a
href="https://issues.apache.org/jira/browse/BEAM-11941";>BEAM-11941</a>)</li>
</ul>
@@ -2815,7 +2815,9 @@ alt="Beam Summit Digital 2020, August 24-28"></p>
<ol>
<li>Submit a proposal to talk. Please check out the <strong><a
href="https://sessionize.com/beam-digital-summit-2020/";>Call for
Papers</a></strong> and submit a talk. The deadline for submissions is
<em>June 15th</em>!</li>
<li>Register to join as an attendee. Registration is now open at the
<strong><a href="https://crowdcast.io/e/beamsummit";>registration
page</a></strong>. Registration is free!</li>
-<li>Consider sponsoring the event. If your company is interested in
engaging with members of the community please check out our <a
href="https://drive.google.com/open?id=1EbijvZKpkWwWyMryLY9sJfyZzZk1k44v";>sponsoring
prospectus</a>.</li>
+</ol>
+<!--- 3. Consider sponsoring the event. If your company is interested in
engaging with members of the community please check out our sponsoring
prospectus.--->
+<ol start="3">
<li>Help us get the word out. Please make sure to let your colleagues and
friends in the data engineering field (and beyond!) know about the Beam
Summit.</li>
</ol>
<h2 id="follow-up-and-more-information">Follow up and more
information</h2>
@@ -3994,7 +3996,7 @@ limitations under the License.
<script async src="https://platform.twitter.com/widgets.js";
charset="utf-8"></script>
<p>Keep an eye out for a meetup in <a
href="https://www.meetup.com/Paris-Apache-Beam-Meetup";>Paris</a>.</p>
<p>If you are interested in starting your own meetup, feel free <a
href="https://beam.apache.org/community/contact-us";>to reach out</a>! Good
places to start include our Slack channel, the dev and user mailing lists, or
the Apache Beam Twitter.</p>
-<p>Even if you can’t travel to these meetups, you can stay informed on the
happenings of the community. The talks and sessions from previous conferences
and meetups are archived on the <a
href="https://www.youtube.com/c/ApacheBeamYT";>Apache Beam YouTube
channel</a>. If you want your session added to the channel, don’t hesitate
to get in touch! And in case you want to attend the next Beam event in style,
you can also order your swag on the <a href="https://store-beam.myshopify
[...]
+<p>Even if you can’t travel to these meetups, you can stay informed on the
happenings of the community. The talks and sessions from previous conferences
and meetups are archived on the <a
href="https://www.youtube.com/c/ApacheBeamYT";>Apache Beam YouTube
channel</a>. If you want your session added to the channel, don’t hesitate
to get in touch!</p>
<h2 id="summits">Summits</h2>
<p>The first summit of the year will be held in Berlin:</p>
<p><img
src="https://img.evbuc.com/https%3A%2F%2Fcdn.evbuc.com%2Fimages%2F58635346%2F70962106775%2F1%2Foriginal.20190317-212619?w=800&auto=compress&rect=0%2C115%2C2666%2C1333&s=2680f5036dcad9177b027cce026c0224";
alt="Beam Summit Europe Banner" ></p>
diff --git
a/website/generated-content/blog/review-input-streaming-connectors/index.html
b/website/generated-content/blog/review-input-streaming-connectors/index.html
index b279658fef9..7cd484109de 100644
---
a/website/generated-content/blog/review-input-streaming-connectors/index.html
+++
b/website/generated-content/blog/review-input-streaming-connectors/index.html
@@ -21,8 +21,8 @@ function
blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog</p><p>2018/08/20</p></div><header class=post-header><h2
itemprop="name headline">A review of input streaming connectors</h1><div
class=post-info><span>Leonid Kuligin [<a
href=https://twitter.com/lkulighin>@lkulighin</a>]
&
Julien Phalip [<a
href=https://twitter.com/julienphalip>@julienphalip</a>]</span></div></header><div
class="arrow-list header-top-margin" itemprop=articleBody><p>In this post,
you’ll learn about the current state of support for input streaming
connectors in <a href=/>Apache Beam</a>. For more context, you’ll also
learn about the corresponding state of support in <a
href=https://spark.apache.org/>Apache Spark</a>.</p><p>With batch processing,
you might load data from any sourc [...]
-and <a
href=https://spark.apache.org/docs/latest/api/java/org/apache/spark/streaming/StreamingContext.html#textFileStream-java.lang.String->textFileStream</a></td></tr><tr><td>S3<br>(Using
the <code>s3://</code> URI)</td><td><a
href=https://beam.apache.org/releases/javadoc/2.38.0/org/apache/beam/sdk/io/FileIO.html>FileIO</a>
+ <a
href=https://beam.apache.org/releases/javadoc/2.38.0/org/apache/beam/sdk/io/aws/options/S3Options.html>S3Options</a></td></tr><tr><td
rowspan=3>Messaging Queues [...]
-and <a
href=https://spark.apache.org/docs/latest/api/python/pyspark.streaming.html#pyspark.streaming.StreamingContext.textFileStream>textFileStream</a></td></tr><tr><td
rowspan=2>Object stores</td><td>Google Cloud Storage</td><td><a
href=https://beam.apache.org/releases/pydoc/2.38.0/apache_beam.io.gcp.gcsio.html>io.gcp.gcsio</a></td><td
rowspan=2><a
href=https://spark.apache.org/docs/latest/api/python/pyspark.streaming.html#pyspark.streaming.StreamingContext.textFileStream>textFileStream
[...]
+and <a
href=https://spark.apache.org/docs/latest/api/java/org/apache/spark/streaming/StreamingContext.html#textFileStream-java.lang.String->textFileStream</a></td></tr><tr><td>S3<br>(Using
the <code>s3://</code> URI)</td><td><a
href=https://beam.apache.org/releases/javadoc/2.38.0/org/apache/beam/sdk/io/FileIO.html>FileIO</a>
+ <a
href=https://beam.apache.org/releases/javadoc/2.38.0/org/apache/beam/sdk/io/aws/options/S3Options.html>S3Options</a></td></tr><tr><td
rowspan=3>Messaging Queues [...]
+and <a
href=https://spark.apache.org/docs/latest/api/python/reference/api/pyspark.streaming.StreamingContext.textFileStream.html>textFileStream</a></td></tr><tr><td
rowspan=2>Object stores</td><td>Google Cloud Storage</td><td><a
href=https://beam.apache.org/releases/pydoc/2.38.0/apache_beam.io.gcp.gcsio.html>io.gcp.gcsio</a></td><td
rowspan=2><a
href=https://spark.apache.org/docs/latest/api/python/pyspark.streaming.html#pyspark.streaming.StreamingContext.textFileStream>textFileStream</a>
[...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/categories/blog/index.xml
b/website/generated-content/categories/blog/index.xml
index 15bd404fc54..326e1c205d3 100644
--- a/website/generated-content/categories/blog/index.xml
+++ b/website/generated-content/categories/blog/index.xml
@@ -1361,7 +1361,7 @@ See the <a
href="/get-started/downloads/#2290-2021-04-15">download page</a
<h3 id="new-features--improvements">New Features / Improvements</h3>
<ul>
<li>DataFrame API now supports pandas 1.2.x (<a
href="https://issues.apache.org/jira/browse/BEAM-11531";>BEAM-11531</a>).</li>
-<li>Multiple DataFrame API bugfixes (<a
href="https://issues.apache/jira/browse/BEAM-12071";>BEAM-12071</a>, <a
href="https://issues.apache/jira/browse/BEAM-11929";>BEAM-11929</a>)</li>
+<li>Multiple DataFrame API bugfixes (<a
href="https://issues.apache.org/jira/browse/BEAM-12071";>BEAM-12071</a>,
<a
href="https://issues.apache.org/jira/browse/BEAM-11929";>BEAM-11929</a>)</li>
<li>DDL supported in SQL transforms (<a
href="https://issues.apache.org/jira/browse/BEAM-11850";>BEAM-11850</a>)</li>
<li>Upgrade Flink runner to Flink version 1.12.2 (<a
href="https://issues.apache.org/jira/browse/BEAM-11941";>BEAM-11941</a>)</li>
</ul>
@@ -2815,7 +2815,9 @@ alt="Beam Summit Digital 2020, August 24-28"></p>
<ol>
<li>Submit a proposal to talk. Please check out the <strong><a
href="https://sessionize.com/beam-digital-summit-2020/";>Call for
Papers</a></strong> and submit a talk. The deadline for submissions is
<em>June 15th</em>!</li>
<li>Register to join as an attendee. Registration is now open at the
<strong><a href="https://crowdcast.io/e/beamsummit";>registration
page</a></strong>. Registration is free!</li>
-<li>Consider sponsoring the event. If your company is interested in
engaging with members of the community please check out our <a
href="https://drive.google.com/open?id=1EbijvZKpkWwWyMryLY9sJfyZzZk1k44v";>sponsoring
prospectus</a>.</li>
+</ol>
+<!--- 3. Consider sponsoring the event. If your company is interested in
engaging with members of the community please check out our sponsoring
prospectus.--->
+<ol start="3">
<li>Help us get the word out. Please make sure to let your colleagues and
friends in the data engineering field (and beyond!) know about the Beam
Summit.</li>
</ol>
<h2 id="follow-up-and-more-information">Follow up and more
information</h2>
@@ -3994,7 +3996,7 @@ limitations under the License.
<script async src="https://platform.twitter.com/widgets.js";
charset="utf-8"></script>
<p>Keep an eye out for a meetup in <a
href="https://www.meetup.com/Paris-Apache-Beam-Meetup";>Paris</a>.</p>
<p>If you are interested in starting your own meetup, feel free <a
href="https://beam.apache.org/community/contact-us";>to reach out</a>! Good
places to start include our Slack channel, the dev and user mailing lists, or
the Apache Beam Twitter.</p>
-<p>Even if you can’t travel to these meetups, you can stay informed on the
happenings of the community. The talks and sessions from previous conferences
and meetups are archived on the <a
href="https://www.youtube.com/c/ApacheBeamYT";>Apache Beam YouTube
channel</a>. If you want your session added to the channel, don’t hesitate
to get in touch! And in case you want to attend the next Beam event in style,
you can also order your swag on the <a href="https://store-beam.myshopify
[...]
+<p>Even if you can’t travel to these meetups, you can stay informed on the
happenings of the community. The talks and sessions from previous conferences
and meetups are archived on the <a
href="https://www.youtube.com/c/ApacheBeamYT";>Apache Beam YouTube
channel</a>. If you want your session added to the channel, don’t hesitate
to get in touch!</p>
<h2 id="summits">Summits</h2>
<p>The first summit of the year will be held in Berlin:</p>
<p><img
src="https://img.evbuc.com/https%3A%2F%2Fcdn.evbuc.com%2Fimages%2F58635346%2F70962106775%2F1%2Foriginal.20190317-212619?w=800&auto=compress&rect=0%2C115%2C2666%2C1333&s=2680f5036dcad9177b027cce026c0224";
alt="Beam Summit Europe Banner" ></p>
diff --git a/website/generated-content/contribute/become-a-committer/index.html
b/website/generated-content/contribute/become-a-committer/index.html
index 60c305ae165..5f97fe58173 100644
--- a/website/generated-content/contribute/become-a-committer/index.html
+++ b/website/generated-content/contribute/become-a-committer/index.html
@@ -24,9 +24,9 @@ function
openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi
<span><a
href=/contribute/attributes#knows-upholds-and-reinforces-the-responsibilities-of-an-apache-software-foundation-committer>Learn
more.</a></span></div></div></div><h3 id=process>Process</h3><p>The <a
href=https://www.apache.org/foundation/how-it-works.html#pmc-members>PMC</a>
makes someone a committer via nomination, discussion, and then majority vote.
We use data from as many sources as possible to inform our reasoning. Here are
-some examples:</p><ul><li><a
href=https://lists.apache.org/list.html?d...@beam.apache.org>dev@ archives</a>
and <a
href=https://lists.apache.org/trends.html?d...@beam.apache.org>statistics</a></li><li><a
href=https://lists.apache.org/list.html?u...@beam.apache.org>user@
archives</a> and <a
href=https://lists.apache.org/trends.html?u...@beam.apache.org>statistics</a></li><li><a
href=https://stackoverflow.com/questions/tagged/apache-beam><code>apache-beam</code>
StackOverflow tag</a></li><li [...]
+some examples:</p><ul><li><a
href=https://lists.apache.org/list.html?d...@beam.apache.org>dev@
archives</a></li><li><a
href=https://lists.apache.org/list.html?u...@beam.apache.org>user@
archives</a></li><li><a
href=https://stackoverflow.com/questions/tagged/apache-beam><code>apache-beam</code>
StackOverflow tag</a></li><li>Git metrics for <a
href=https://github.com/apache/beam/graphs/contributors>Beam</a></li><li>Code
reviews given and received on
<a href=https://github.com/apache/beam/pulls>Beam</a></li><li>Clear areas of
ownership (a runner, a DSL, IO connector, documentation,
-etc.)</li><li>Public events</li><li>Firsthand PMC testimonials</li></ul><div
class=feedback><p class=update>Last updated on 2021/02/24</p><h3>Have you found
everything you were looking for?</h3><p class=description>Was it all useful and
clear? Is there anything that you would like to change? Let us know!</p><button
class=load-button><a href="mailto:d...@beam.apache.org?subject=Beam Website
Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contai [...]
+etc.)</li><li>Public events</li><li>Firsthand PMC testimonials</li></ul><div
class=feedback><p class=update>Last updated on 2022/04/21</p><h3>Have you found
everything you were looking for?</h3><p class=description>Was it all useful and
clear? Is there anything that you would like to change? Let us know!</p><button
class=load-button><a href="mailto:d...@beam.apache.org?subject=Beam Website
Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contai [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/contribute/index.xml
b/website/generated-content/contribute/index.xml
index 5a47278c767..ca51f46faeb 100644
--- a/website/generated-content/contribute/index.xml
+++ b/website/generated-content/contribute/index.xml
@@ -1283,7 +1283,7 @@ ls -al /opt/apache/beam/third_party_licenses/ | wc -l
<li>Select repository <code>orgapachebeam-NNNN</code>.</li>
<li>Click the Close button.</li>
<li>When prompted for a description, enter “Apache Beam, version X, release
candidate Y”.</li>
-<li>Review all staged artifacts on <a
href="https://repository.apache.org/content/repositories/orgapachebeam-NNNN/";>https://repository.apache.org/content/repositories/orgapachebeam-NNNN/</a>.
+<li>Review all staged artifacts on
<code>https://repository.apache.org/content/repositories/orgapachebeam-NNNN/</code>.
They should contain all relevant parts for each module, including
<code>pom.xml</code>, jar, test jar, javadoc, etc.
Artifact names should follow <a
href="https://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.beam%22";>the
existing format</a> in which artifact name mirrors directory structure,
e.g., <code>beam-sdks-java-io-kafka</code>.
Carefully review any new artifacts.</li>
@@ -2116,8 +2116,8 @@ makes someone a committer via nomination, discussion, and
then majority vote.
We use data from as many sources as possible to inform our reasoning. Here are
some examples:</p>
<ul>
-<li><a
href="https://lists.apache.org/list.html?d...@beam.apache.org";>dev@
archives</a> and <a
href="https://lists.apache.org/trends.html?d...@beam.apache.org";>statistics</a></li>
-<li><a
href="https://lists.apache.org/list.html?u...@beam.apache.org";>user@
archives</a> and <a
href="https://lists.apache.org/trends.html?u...@beam.apache.org";>statistics</a></li>
+<li><a
href="https://lists.apache.org/list.html?d...@beam.apache.org";>dev@
archives</a></li>
+<li><a
href="https://lists.apache.org/list.html?u...@beam.apache.org";>user@
archives</a></li>
<li><a
href="https://stackoverflow.com/questions/tagged/apache-beam";><code>apache-beam</code>
StackOverflow tag</a></li>
<li>Git metrics for <a
href="https://github.com/apache/beam/graphs/contributors";>Beam</a></li>
<li>Code reviews given and received on
diff --git a/website/generated-content/contribute/release-guide/index.html
b/website/generated-content/contribute/release-guide/index.html
index 876578269e6..a0256339338 100644
--- a/website/generated-content/contribute/release-guide/index.html
+++ b/website/generated-content/contribute/release-guide/index.html
@@ -149,7 +149,7 @@ Need to verify all Python images by replacing
<code>${ver}</code> with each supp
ls -al /opt/apache/beam/third_party_licenses/ | wc -l
</code></pre><ul><li>For Java SDK images, there should be around 200
dependencies.</li></ul><pre><code>docker run --rm -it --entrypoint=/bin/bash
apache/beam_java${ver}_sdk:${RELEASE}_rc{RC_NUM}
ls -al /opt/apache/beam/third_party_licenses/ | wc -l
-</code></pre></li></ol></li><li>Publish staging artifacts<ol><li>Log in to the
<a href=https://repository.apache.org/#stagingRepositories>Apache Nexus</a>
website.</li><li>Navigate to Build Promotion -> Staging Repositories (in the
left sidebar).</li><li>Select repository
<code>orgapachebeam-NNNN</code>.</li><li>Click the Close button.</li><li>When
prompted for a description, enter “Apache Beam, version X, release candidate
Y”.</li><li>Review all staged artifacts on <a href=https://repos [...]
+</code></pre></li></ol></li><li>Publish staging artifacts<ol><li>Log in to the
<a href=https://repository.apache.org/#stagingRepositories>Apache Nexus</a>
website.</li><li>Navigate to Build Promotion -> Staging Repositories (in the
left sidebar).</li><li>Select repository
<code>orgapachebeam-NNNN</code>.</li><li>Click the Close button.</li><li>When
prompted for a description, enter “Apache Beam, version X, release candidate
Y”.</li><li>Review all staged artifacts on <code>https://reposit [...]
They should contain all relevant parts for each module, including
<code>pom.xml</code>, jar, test jar, javadoc, etc.
Artifact names should follow <a
href=https://search.maven.org/#search%7Cga%7C1%7Cg%3A%22org.apache.beam%22>the
existing format</a> in which artifact name mirrors directory structure, e.g.,
<code>beam-sdks-java-io-kafka</code>.
Carefully review any new artifacts.</li></ol></li></ol><h3
id=upload-release-candidate-to-pypi>Upload release candidate to
PyPi</h3><ul><li><p><strong>Script:</strong> <a
href=https://github.com/apache/beam/blob/master/release/src/main/scripts/deploy_release_candidate_pypi.sh>deploy_release_candidate_pypi.sh</a></p></li><li><p><strong>Usage</strong></p><pre><code>
./release/src/main/scripts/deploy_release_candidate_pypi.sh \
@@ -413,7 +413,7 @@ If you end up getting permissions errors ask on the mailing
list for assistance.
Ask other contributors to do the same.</p><p>Also, update <a
href=https://en.wikipedia.org/wiki/Apache_Beam>the Wikipedia article on Apache
Beam</a>.</p><h3 id=checklist-to-declare-the-process-completed>Checklist to
declare the process completed</h3><ol><li>Release announced on the user@
mailing list.</li><li>Blog post published, if applicable.</li><li>Release
recorded in reporter.apache.org.</li><li>Release announced on social
media.</li><li>Completion declared on the dev@ mailing list. [...]
Once you’ve finished the release, please take a step back and look what areas
of this process and be improved. Perhaps some part of the process can be
simplified.
Perhaps parts of this guide can be clarified.</p><p>If we have specific ideas,
please start a discussion on the dev@ mailing list and/or propose a pull
request to update this guide.
-Thanks!</p><div class=feedback><p class=update>Last updated on
2022/04/20</p><h3>Have you found everything you were looking for?</h3><p
class=description>Was it all useful and clear? Is there anything that you would
like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div class="footer__cols__col
foo [...]
+Thanks!</p><div class=feedback><p class=update>Last updated on
2022/04/21</p><h3>Have you found everything you were looking for?</h3><p
class=description>Was it all useful and clear? Is there anything that you would
like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div class="footer__cols__col
foo [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/documentation/index.xml
b/website/generated-content/documentation/index.xml
index 53fed2b1795..28a304604b3 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -8728,7 +8728,7 @@ package.</p>
Structs and pointers to structs default using Beam Schema Row encoding.
However, users can build and register custom coders with
<code>beam.RegisterCoder</code>.
You can find available Coder functions in the
-<a
href="https://pkg.go.dev/github.com/apache/beam/sdks/v2/go/pkg/beam/core/graph/coders";>coder</a>
+<a
href="https://pkg.go.dev/github.com/apache/beam/sdks/go/pkg/beam/core/graph/coder";>coder</a>
package.</p>
<blockquote>
<p>Note that coders do not necessarily have a 1:1 relationship with types.
For
@@ -14368,7 +14368,7 @@ export BEAM_WORKDIR=$PWD
git checkout origin/release-$BEAM_SDK_VERSION
</code></pre><ol start="2">
<li>
-<p>Customize the <code>Dockerfile</code> for a given language,
typically <code>sdks/&lt;language&gt;/container/Dockerfile</code>
directory (e.g. the <a
href="https://github.com/apache/beam/blob/master/sdks/python/container/Dockerfile";>Dockerfile
for Python</a>. If you&rsquo;re adding dependencies from <a
href="https://pypi.org/";>PyPI</a>, use <a
href="https://github.com/apache/beam/blob/master/sdks/python/container/base_image_requirements.txt";>&l
[...]
+<p>Customize the <code>Dockerfile</code> for a given language,
typically <code>sdks/&lt;language&gt;/container/Dockerfile</code>
directory (e.g. the <a
href="https://github.com/apache/beam/blob/master/sdks/python/container/Dockerfile";>Dockerfile
for Python</a>.</p>
</li>
<li>
<p>Return to the root Beam directory and run the Gradle
<code>docker</code> target for your image.</p>
@@ -16835,7 +16835,7 @@ a string, or use a
<a
href="https://developers.google.com/resources/api-libraries/documentation/bigquery/v2/java/latest/index.html?com/google/api/services/bigquery/model/TableReference.html";>TableReference</a>
</span>
<span class="language-py">
-<a
href="https://github.com/googleapis/google-cloud-python/blob/master/bigquery/google/cloud/bigquery/table.py#L153";>TableReference</a>
+<a
href="https://beam.apache.org/releases/pydoc/current/apache_beam.io.gcp.bigquery.html#table-references";>TableReference</a>
</span>
object.</p>
<h4 id="using-a-string">Using a string</h4>
diff --git
a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
index 4b6d3ff8bb9..0cc66115fb8 100644
---
a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
+++
b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
@@ -32,7 +32,7 @@ Project.</li><li><strong>Table ID</strong>: A BigQuery table
ID, which is unique
if you are using <a href=#using-time-partitioning>time-partitioned
tables</a>.</p><p>To specify a BigQuery table, you can use either the
table’s fully-qualified name as
a string, or use a
<span class=language-java><a
href=https://developers.google.com/resources/api-libraries/documentation/bigquery/v2/java/latest/index.html?com/google/api/services/bigquery/model/TableReference.html>TableReference</a></span>
-<span class=language-py><a
href=https://github.com/googleapis/google-cloud-python/blob/master/bigquery/google/cloud/bigquery/table.py#L153>TableReference</a></span>
+<span class=language-py><a
href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.gcp.bigquery.html#table-references>TableReference</a></span>
object.</p><h4 id=using-a-string>Using a string</h4><p>To specify a table with
a string, use the format
<code>[project_id]:[dataset_id].[table_id]</code> to specify the
fully-qualified BigQuery
table name.</p><div class="language-java snippet"><div class="notebook-skip
code-snippet"><a class=copy type=button data-bs-toggle=tooltip
data-bs-placement=bottom title="Copy to clipboard"><img
src=/images/copy-icon.svg></a><div class=highlight><pre class=chroma><code
class=language-java data-lang=java><span class=n>String</span> <span
class=n>tableSpec</span> <span class=o>=</span> <span
class=s>"clouddataflow-readonly:samples.weather_stations"</span><span
class=o>;</span></cod [...]
@@ -801,7 +801,7 @@ reads from a BigQuery table that has the
‘month’ and ‘tornado&
of the table schema, computes the number of tornadoes in each month, and
outputs the results to a BigQuery table.</p></li><li><p><a
href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/cookbook/filters.py>BigQuery
filters</a>
reads weather station data from a BigQuery table, manipulates BigQuery rows in
-memory, and writes the results to a BigQuery table.</p></li></ul><div
class=feedback><p class=update>Last updated on 2021/04/28</p><h3>Have you found
everything you were looking for?</h3><p class=description>Was it all useful and
clear? Is there anything that you would like to change? Let us know!</p><button
class=load-button><a href="mailto:d...@beam.apache.org?subject=Beam Website
Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><di [...]
+memory, and writes the results to a BigQuery table.</p></li></ul><div
class=feedback><p class=update>Last updated on 2022/04/21</p><h3>Have you found
everything you were looking for?</h3><p class=description>Was it all useful and
clear? Is there anything that you would like to change? Let us know!</p><button
class=load-button><a href="mailto:d...@beam.apache.org?subject=Beam Website
Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><di [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/documentation/io/testing/index.html
b/website/generated-content/documentation/io/testing/index.html
index 937632cb918..66c1cc09987 100644
--- a/website/generated-content/documentation/io/testing/index.html
+++ b/website/generated-content/documentation/io/testing/index.html
@@ -19,11 +19,11 @@ function
addPlaceholder(){$('input:text').attr('placeholder',"What are you looki
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Documentation</span></li><li><a
href=/documentation>Using the Documentation</a></li><li
class=section-nav-item--collapsible><span class=section-nav-lis [...]
-</code></pre><p>Example usage on HDFS filesystem and Direct
runner:</p><p>NOTE: Below setup will only work when /etc/hosts file contains
entries with hadoop namenode and hadoop datanodes external IPs. Please see
explanation in: <a
href=https://github.com/apache/beam/blob/master/.test-infra/kubernetes/hadoop/SmallITCluster/pkb-config.yml>Small
Cluster config file</a> and <a
href=https://github.com/apache/beam/blob/master/.test-infra/kubernetes/hadoop/LargeITCluster/pkb-config.yml>Large
Cl [...]
+</code></pre><p>Example usage on HDFS filesystem and Direct
runner:</p><p>NOTE: Below setup will only work when /etc/hosts file contains
entries with hadoop namenode and hadoop datanodes external IPs. Please see
explanation in: <a
href=https://github.com/apache/beam/blob/master/.test-infra/kubernetes/hadoop/SmallITCluster/hdfs-single-datanode-cluster.yml>Small
Cluster config file</a> and <a
href=https://github.com/apache/beam/blob/master/.test-infra/kubernetes/hadoop/LargeITCluster/hdfs-
[...]
./gradlew integrationTest -p sdks/java/io/file-based-io-tests
-DintegrationTestPipelineOptions='["--numberOfRecords=1000",
"--filenamePrefix=hdfs://HDFS_NAMENODE:9000/XMLIOIT",
"--hdfsConfiguration=[{\"fs.defaultFS\":\"hdfs://HDFS_NAMENODE:9000\",\"dfs.replication\":1,\"dfs.client.use.datanode.hostname\":\"true\"
}]" ]' -DintegrationTestRunner=direct -Dfilesystem=hdfs --tests
org.apache.beam.sdk.io.xml.XmlIOIT
</code></pre><p>Parameter descriptions:</p><table
class=table><thead><tr><td><strong>Option</strong></td><td><strong>Function</strong></td></tr></thead><tbody><tr><td>-p
sdks/java/io/file-based-io-tests/</td><td>Specifies the project submodule of
the I/O to
test.</td></tr><tr><td>-DintegrationTestPipelineOptions</td><td>Passes pipeline
options directly to the test being
run.</td></tr><tr><td>-DintegrationTestRunner</td><td>Runner to be used for
running the test. Currently possible option [...]
-If you modified/added new Jenkins job definitions in your Pull Request, run
the seed job before running the integration test (comment: “Run seed
job”).</p><h3 id=performance-testing-dashboard>Performance testing
dashboard</h3><p>As mentioned before, we measure the performance of IOITs by
gathering test execution times from Jenkins jobs that run periodically. The
consequent results are stored in a database (BigQuery), therefore we can
display them in a form of plots.</p><p>The [...]
+If you modified/added new Jenkins job definitions in your Pull Request, run
the seed job before running the integration test (comment: “Run seed
job”).</p><h3 id=performance-testing-dashboard>Performance testing
dashboard</h3><p>As mentioned before, we measure the performance of IOITs by
gathering test execution times from Jenkins jobs that run periodically. The
consequent results are stored in a database (BigQuery), therefore we can
display them in a form of plots.</p><p>The [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git
a/website/generated-content/documentation/programming-guide/index.html
b/website/generated-content/documentation/programming-guide/index.html
index 7fdd78cda6b..60df4f8d07e 100644
--- a/website/generated-content/documentation/programming-guide/index.html
+++ b/website/generated-content/documentation/programming-guide/index.html
@@ -2404,7 +2404,7 @@ package.</p><p class=language-go>Standard Go types like
<code>int</code>, <code>
Structs and pointers to structs default using Beam Schema Row encoding.
However, users can build and register custom coders with
<code>beam.RegisterCoder</code>.
You can find available Coder functions in the
-<a
href=https://pkg.go.dev/github.com/apache/beam/sdks/v2/go/pkg/beam/core/graph/coders>coder</a>
+<a
href=https://pkg.go.dev/github.com/apache/beam/sdks/go/pkg/beam/core/graph/coder>coder</a>
package.</p><blockquote><p>Note that coders do not necessarily have a 1:1
relationship with types. For
example, the Integer type can have multiple valid coders, and input and output
data can use different Integer coders. A transform might have Integer-typed
@@ -4334,7 +4334,7 @@ functions as shortcuts for single, unnamed inputs/outputs
or define a map for na
<span class=nx>outT</span> <span class=o>:=</span> <span
class=nx>beam</span><span class=p>.</span><span
class=nf>UnnamedOutput</span><span class=p>(</span><span
class=nx>typex</span><span class=p>.</span><span class=nf>New</span><span
class=p>(</span><span class=nx>reflectx</span><span class=p>.</span><span
class=nx>String</span><span class=p>))</span>
<span class=nx>res</span> <span class=o>:=</span> <span
class=nx>beam</span><span class=p>.</span><span
class=nf>CrossLanguage</span><span class=p>(</span><span class=nx>s</span><span
class=p>,</span> <span class=nx>urn</span><span class=p>,</span> <span
class=nx>payload</span><span class=p>,</span> <span
class=nx>expansionAddr</span><span class=p>,</span> <span
class=nx>beam</span><span class=p>.</span><span
class=nf>UnnamedInput</span><span class=p>(</span><span class=nx>inputPCol</spa
[...]
</code></pre></div></li><li><p>After the job has been submitted to the Beam
runner, shutdown the expansion service by
-terminating the expansion service process.</p></li></ol><h3
id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently,
portable runners such as Flink, Spark, and the direct runner can be used with
multi-language pipelines.</p><p>Dataflow supports multi-language pipelines
through the Dataflow Runner v2 backend architecture.</p><h3
id=x-lang-transform-tips-troubleshooting>13.4 Tips and
Troubleshooting</h3><p>For additional tips and troubleshooting information, see
<a href=ht [...]
+terminating the expansion service process.</p></li></ol><h3
id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently,
portable runners such as Flink, Spark, and the direct runner can be used with
multi-language pipelines.</p><p>Dataflow supports multi-language pipelines
through the Dataflow Runner v2 backend architecture.</p><h3
id=x-lang-transform-tips-troubleshooting>13.4 Tips and
Troubleshooting</h3><p>For additional tips and troubleshooting information, see
<a href=ht [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git
a/website/generated-content/documentation/resources/learning-resources/index.html
b/website/generated-content/documentation/resources/learning-resources/index.html
index 127d5b8db0d..58088da037a 100644
---
a/website/generated-content/documentation/resources/learning-resources/index.html
+++
b/website/generated-content/documentation/resources/learning-resources/index.html
@@ -18,13 +18,13 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you
looking for?");}
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Documentation</span></li><li><a
href=/documentation>Using the Documentation</a></li><li
class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Documentation</span></li><li><a
href=/documentation>Using the Documentation</a></li><li
class=section-nav-item--collapsible><span class=section-nav-lis [...]
that can help you to learn Apache Beam concepts and programming model hands-on.
Built based on <a href=https://www.jetbrains.com/education/>JetBrains
Educational Products</a>, Beam Katas
objective is to provide a series of structured hands-on learning experiences
for learners
to understand about Apache Beam and its SDKs by solving exercises with
gradually increasing
complexity. Beam Katas are available for both Java and Python SDKs.</p><h3
id=java-1>Java</h3><ul><li>Download <a
href="https://www.jetbrains.com/education/download/#section=idea";>IntelliJ
Edu</a></li><li>Upon opening the IDE, expand the “Learn and Teach”
menu, then select “Browse Courses”</li><li>Search for “Beam
Katas - Java”</li><li>Expand the “Advanced Settings” and
modify the “Location” and “Jdk” appropriately</ [...]
-You can try the available Apache Beam examples at <a
href=https://play.beam.apache.org>Beam Playground</a>.</li><li>Learn more about
how to add an Apache Beam example/test/kata into Beam Playground catalog <a
href=https://beam.apache.org/get-started/try-beam-playground/#how-to-add-new-examples>here</a>.</li></ul><h2
id=api-reference>API Reference</h2><ul><li><strong><a
href=https://beam.apache.org/documentation/sdks/javadoc/>Java API
Reference</a></strong> - Official API Reference for th [...]
+You can try the available Apache Beam examples at <a
href=https://play.beam.apache.org>Beam Playground</a>.</li><li>Learn more about
how to add an Apache Beam example/test/kata into Beam Playground catalog <a
href=https://beam.apache.org/get-started/try-beam-playground/#how-to-add-new-examples>here</a>.</li></ul><h2
id=api-reference>API Reference</h2><ul><li><strong><a
href=https://beam.apache.org/documentation/sdks/javadoc/>Java API
Reference</a></strong> - Official API Reference for th [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/documentation/runners/direct/index.html
b/website/generated-content/documentation/runners/direct/index.html
index 378826aef2a..813f25ed58b 100644
--- a/website/generated-content/documentation/runners/direct/index.html
+++ b/website/generated-content/documentation/runners/direct/index.html
@@ -18,7 +18,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you
looking for?");}
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Runners</span></li><li><a
href=/documentation/runners/capability-matrix/>Capability Matrix</a></li><li><a
href=/documentation/runners/direct/>Direct Ru [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Runners</span></li><li><a
href=/documentation/runners/capability-matrix/>Capability Matrix</a></li><li><a
href=/documentation/runners/direct/>Direct Ru [...]
<span class=o><</span><span class=n>groupId</span><span
class=o>></span><span class=n>org</span><span class=o>.</span><span
class=na>apache</span><span class=o>.</span><span class=na>beam</span><span
class=o></</span><span class=n>groupId</span><span class=o>></span>
<span class=o><</span><span class=n>artifactId</span><span
class=o>></span><span class=n>beam</span><span class=o>-</span><span
class=n>runners</span><span class=o>-</span><span class=n>direct</span><span
class=o>-</span><span class=n>java</span><span class=o></</span><span
class=n>artifactId</span><span class=o>></span>
<span class=o><</span><span class=n>version</span><span
class=o>></span><span class=n>2</span><span class=o>.</span><span
class=na>38</span><span class=o>.</span><span class=na>0</span><span
class=o></</span><span class=n>version</span><span class=o>></span>
@@ -29,7 +29,7 @@ function
openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi
interface for defaults and additional pipeline configuration options.</p><h2
id=additional-information-and-caveats>Additional information and
caveats</h2><h3 id=memory-considerations>Memory considerations</h3><p>Local
execution is limited by the memory available in your local environment. It is
highly recommended that you run your pipeline with data sets small enough to
fit in local memory. You can create a small in-memory data set using a <span
class=language-java><a href=https://beam.a [...]
By default, <code>targetParallelism</code> is the greater of the number of
available processors and 3.</p><p class=language-py>Number of threads or
subprocesses is defined by setting the <code>direct_num_workers</code> pipeline
option.
From 2.22.0, <code>direct_num_workers = 0</code> is supported. When
<code>direct_num_workers</code> is set to 0, it will set the number of
threads/subprocess to the number of cores of the machine where the pipeline is
running.</p><p class=language-py><strong>Setting running mode</strong></p><p
class=language-py>In Beam 2.19.0 and newer, you can use the
<code>direct_running_mode</code> pipeline option to set the running mode.
-<code>direct_running_mode</code> can be one of [<code>'in_memory'</code>,
<code>'multi_threading'</code>, <code>'multi_processing'</code>].</p><p
class=language-py><b>in_memory</b>: Runner and workers’ communication
happens in memory (not through gRPC). This is a default mode.</p><p
class=language-py><b>multi_threading</b>: Runner and workers communicate
through gRPC and each worker runs in a thread.</p><p
class=language-py><b>multi_processing</b>: Runner and workers communicate th
[...]
+<code>direct_running_mode</code> can be one of [<code>'in_memory'</code>,
<code>'multi_threading'</code>, <code>'multi_processing'</code>].</p><p
class=language-py><b>in_memory</b>: Runner and workers’ communication
happens in memory (not through gRPC). This is a default mode.</p><p
class=language-py><b>multi_threading</b>: Runner and workers communicate
through gRPC and each worker runs in a thread.</p><p
class=language-py><b>multi_processing</b>: Runner and workers communicate th
[...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/documentation/runners/jstorm/index.html
b/website/generated-content/documentation/runners/jstorm/index.html
index 6c569483445..4fc98058f86 100644
--- a/website/generated-content/documentation/runners/jstorm/index.html
+++ b/website/generated-content/documentation/runners/jstorm/index.html
@@ -18,15 +18,15 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you
looking for?");}
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Documentation</span></li><li><a
href=/documentation>Using the Documentation</a></li><li
class=section-nav-item--collapsible><span class=section-nav-lis [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Documentation</span></li><li><a
href=/documentation>Using the Documentation</a></li><li
class=section-nav-item--collapsible><span class=section-nav-lis [...]
<span class=o><</span><span class=n>groupId</span><span
class=o>></span><span class=n>org</span><span class=o>.</span><span
class=na>apache</span><span class=o>.</span><span class=na>beam</span><span
class=o></</span><span class=n>groupId</span><span class=o>></span>
<span class=o><</span><span class=n>artifactId</span><span
class=o>></span><span class=n>beam</span><span class=o>-</span><span
class=n>runners</span><span class=o>-</span><span class=n>jstorm</span><span
class=o></</span><span class=n>artifactId</span><span class=o>></span>
<span class=o><</span><span class=n>version</span><span
class=o>></span><span class=n>2</span><span class=o>.</span><span
class=na>38</span><span class=o>.</span><span class=na>0</span><span
class=o></</span><span class=n>version</span><span class=o>></span>
<span class=o></</span><span class=n>dependency</span><span
class=o>></span></code></pre></div></div></div><h3
id=deploying-jstorm-with-your-application>Deploying JStorm with your
application</h3><p>To run against a Standalone cluster, you can package your
program with all Beam dependencies into a fat jar, and then submit the topology
with the following command.</p><pre><code>jstorm jar WordCount.jar
org.apache.beam.examples.WordCount
--runner=org.apache.beam.runners.jstorm.JStormRunner
</code></pre><p>If you don’t want to package a fat jar, you can upload
the Beam dependencies onto all cluster
nodes(<code>$JSTORM_HOME/lib/ext/beam</code>) first.
When you submit a topology with argument <code>"--external-libs beam"</code>,
JStorm will load the Beam dependencies automatically.</p><pre><code>jstorm jar
WordCount.jar org.apache.beam.examples.WordCount --external-libs beam
--runner=org.apache.beam.runners.jstorm.JStormRunner
-</code></pre><p>To learn about deploying a JStorm cluster, please refer to <a
href=http://jstorm.io/QuickStart/Deploy/index.html>JStorm cluster
deploy</a></p><h2 id=pipeline-options-for-the-jstorm-runner>Pipeline options
for the JStorm Runner</h2><p>When executing your pipeline with the JStorm
Runner, you should consider the following pipeline options.</p><table
class="table table-bordered"><tr><th>Field</th><th>Description</th><th>Default
Value</th></tr><tr><td><code>runner</code></td>< [...]
-For testing on local mode, you can retreive the Beam metrics with the metrics
method of PipelineResult.</p><div class=feedback><p class=update>Last updated
on 2020/05/15</p><h3>Have you found everything you were looking for?</h3><p
class=description>Was it all useful and clear? Is there anything that you would
like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer cla [...]
+</code></pre><h2 id=pipeline-options-for-the-jstorm-runner>Pipeline options
for the JStorm Runner</h2><p>When executing your pipeline with the JStorm
Runner, you should consider the following pipeline options.</p><table
class="table table-bordered"><tr><th>Field</th><th>Description</th><th>Default
Value</th></tr><tr><td><code>runner</code></td><td>The pipeline runner to use.
This option allows you to determine the pipeline runner at runtime.</td><td>Set
to <code>JStormRunner</code> to ru [...]
+For testing on local mode, you can retreive the Beam metrics with the metrics
method of PipelineResult.</p><div class=feedback><p class=update>Last updated
on 2022/04/21</p><h3>Have you found everything you were looking for?</h3><p
class=description>Was it all useful and clear? Is there anything that you would
like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer cla [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git
a/website/generated-content/documentation/runtime/environments/index.html
b/website/generated-content/documentation/runtime/environments/index.html
index c8ff20034fa..701d82d7157 100644
--- a/website/generated-content/documentation/runtime/environments/index.html
+++ b/website/generated-content/documentation/runtime/environments/index.html
@@ -40,7 +40,7 @@ cd beam
export BEAM_WORKDIR=$PWD
git checkout origin/release-$BEAM_SDK_VERSION
-</code></pre><ol start=2><li><p>Customize the <code>Dockerfile</code> for a
given language, typically <code>sdks/<language>/container/Dockerfile</code>
directory (e.g. the <a
href=https://github.com/apache/beam/blob/master/sdks/python/container/Dockerfile>Dockerfile
for Python</a>. If you’re adding dependencies from <a
href=https://pypi.org/>PyPI</a>, use <a
href=https://github.com/apache/beam/blob/master/sdks/python/container/base_image_requirements.txt><code>base_image_require
[...]
+</code></pre><ol start=2><li><p>Customize the <code>Dockerfile</code> for a
given language, typically <code>sdks/<language>/container/Dockerfile</code>
directory (e.g. the <a
href=https://github.com/apache/beam/blob/master/sdks/python/container/Dockerfile>Dockerfile
for Python</a>.</p></li><li><p>Return to the root Beam directory and run the
Gradle <code>docker</code> target for your image.</p></li></ol><pre><code>cd
$BEAM_WORKDIR
# The default repository of each SDK
./gradlew :sdks:java:container:java8:docker
@@ -167,7 +167,7 @@ accessed by any third-party service, if
needed.</li><li>Local runners attempt to
images. If an image cannot be pulled locally (by the docker daemon),
you may see an log message like:<pre><code>Error response from daemon:
manifest for remote.repo/beam_python3.7_sdk:2.25.0-custom not found: manifest
unknown: ...
INFO:apache_beam.runners.portability.fn_api_runner.worker_handlers:Unable to
pull image...
-</code></pre></li></ul><div class=feedback><p class=update>Last updated on
2022/03/29</p><h3>Have you found everything you were looking for?</h3><p
class=description>Was it all useful and clear? Is there anything that you would
like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div class="footer__c [...]
+</code></pre></li></ul><div class=feedback><p class=update>Last updated on
2022/04/21</p><h3>Have you found everything you were looking for?</h3><p
class=description>Was it all useful and clear? Is there anything that you would
like to change? Let us know!</p><button class=load-button><a
href="mailto:d...@beam.apache.org?subject=Beam Website Feedback">SEND
FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div class="footer__c [...]
<a href=http://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div></div></div></footer></body></html>
\ No newline at end of file
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index 903c4c31ef9..e01db2b06ed 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.38.0/</loc><lastmod>2022-04-20T15:48:18-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-04-20T15:48:18-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-04-20T15:48:18-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-04-20T15:48:18-07:00</lastmod></url><url><loc>/blog/b
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.38.0/</loc><lastmod>2022-04-20T15:48:18-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-04-21T04:36:05-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-04-21T04:36:05-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-04-21T04:36:05-07:00</lastmod></url><url><loc>/blog/b
[...]
\ No newline at end of file
