This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 35c9699eb2a Publishing website 2023/05/15 16:17:03 at commit 05a1507
35c9699eb2a is described below
commit 35c9699eb2ac22c19b484d05955ab62d9694361e
Author: jenkins <bui...@apache.org>
AuthorDate: Mon May 15 16:17:03 2023 +0000
Publishing website 2023/05/15 16:17:03 at commit 05a1507
---
website/generated-content/blog/beam-2.47.0/index.html | 7 +++----
website/generated-content/blog/index.xml | 5 +----
website/generated-content/categories/blog/index.xml | 5 +----
website/generated-content/categories/release/index.xml | 5 +----
website/generated-content/documentation/index.xml | 4 ++--
website/generated-content/documentation/io/connectors/index.html | 2 +-
.../documentation/io/developing-io-java/index.html | 4 ++--
website/generated-content/documentation/io/io-standards/index.html | 2 +-
.../generated-content/documentation/ml/orchestration/index.html | 2 +-
website/generated-content/feed.xml | 5 +----
website/generated-content/sitemap.xml | 2 +-
11 files changed, 15 insertions(+), 28 deletions(-)
diff --git a/website/generated-content/blog/beam-2.47.0/index.html
b/website/generated-content/blog/beam-2.47.0/index.html
index e6c10c91f8a..fa1ff0347f8 100644
--- a/website/generated-content/blog/beam-2.47.0/index.html
+++ b/website/generated-content/blog/beam-2.47.0/index.html
@@ -23,12 +23,11 @@ function
blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog & release
</p><p>2023/05/10</p></div><header class=post-header><h2 itemprop="name
headline">Apache Beam 2.47.0</h1><div class=post-info><span>Jack R. McCluskey
[<a
href=https://twitter.com/jrmccluskey>@jrmccluskey</a>]</span></div></header><div
class="arrow-list header-top-margin" itemprop=articleBody><p>We are happy to
present the new 2.47.0 release of Beam.
This release includes both improvements and new functionality.
-See the <a href=/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D>download
page</a> for this release.</p><p>For more information on changes in 2.47.0,
check out the <a href=https://github.com/apache/beam/milestone/10>detailed
release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Apache Beam adds
Python 3.11 support (<a
href=https://github.com/apache/beam/issues/23848>#23848</a>).</li></ul><h2
id=ios>I/Os</h2><ul><li>Support for X source added (Java/Python) (<a
href=https://github.co [...]
+See the <a href=/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D>download
page</a> for this release.</p><p>For more information on changes in 2.47.0,
check out the <a href=https://github.com/apache/beam/milestone/10>detailed
release notes</a>.</p><h2 id=highlights>Highlights</h2><ul><li>Apache Beam adds
Python 3.11 support (<a
href=https://github.com/apache/beam/issues/23848>#23848</a>).</li></ul><h2
id=ios>I/Os</h2><ul><li>BigQuery Storage Write API is now available in Python
SDK via cross [...]
(Note that when doing multiple operations, it may be more efficient to
explicitly chain the operations
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid excessive
conversions.)</li><li>The Go SDK adds new transforms periodic.Impulse and
periodic.Sequence that extends support
-for slowly updating side input patterns. (<a
href=https://github.com/apache/beam/issues/23106>#23106</a>)</li><li>Python SDK
now requires <code>protobuf>=4.21.1,<4.23.0</code> and no longer supports
protobuf 3.x. (<a
href=https://github.com/apache/beam/pull/24599>#24599</a>)</li><li>Several
Google client libraries in Python SDK dependency chain were updated to latest
available major versions. (<a
href=https://github.com/apache/beam/pull/24599>#24599</a>)</li></ul><h2
id=breaking-chang [...]
-in response to the Google Cloud Debugger service <a
href=https://cloud.google.com/debugger/docs/deprecations>turning down</a>.
-(Java) (<a
href=https://github.com/apache/beam/issues/25959>#25959</a>).</li></ul><h2
id=bugfixes>Bugfixes</h2><ul><li>BigQuery sink in STORAGE_WRITE_API mode in
batch pipelines might result in data consistency issues during the handling of
other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For
more details see: <a
href=https://github.com/apache/beam/issues/26521>https://github.com/apache/beam/issues/26521</a></li></ul><h2
id=list-of-contributors>List of Contribu [...]
+for slowly updating side input patterns. (<a
href=https://github.com/apache/beam/issues/23106>#23106</a>)</li><li>Several
Google client libraries in Python SDK dependency chain were updated to latest
available major versions. (<a
href=https://github.com/apache/beam/pull/24599>#24599</a>)</li></ul><h2
id=breaking-changes>Breaking Changes</h2><ul><li>If a main session fails to
load, the pipeline will now fail at worker startup. (<a
href=https://github.com/apache/beam/issues/25401>#25401</a [...]
+in response to the Google Cloud Debugger service <a
href=https://cloud.google.com/debugger/docs/deprecations>turning down</a>.
(Java) (<a
href=https://github.com/apache/beam/issues/25959>#25959</a>).</li></ul><h2
id=bugfixes>Bugfixes</h2><ul><li>BigQuery sink in STORAGE_WRITE_API mode in
batch pipelines might result in data consistency issues during the handling of
other unrelated transient errors for Beam SDKs 2.35.0 - 2.46.0 (inclusive). For
more details see: <a href=https://github.com [...]
</p><p>2023/03/10</p></div><div class=post><p class=post-title>Apache Beam
2.46.0</p><p class=post-info>Danny McCormick</p></div></a><a class=post-card
href=/blog/beam-2.45.0/ data-categories="blog release"><div class="post-info
post-category"><p>blog & release
diff --git a/website/generated-content/blog/index.xml
b/website/generated-content/blog/index.xml
index 00b0c46539e..ea28672eacf 100644
--- a/website/generated-content/blog/index.xml
+++ b/website/generated-content/blog/index.xml
@@ -20,7 +20,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a
href="https://github.com/apache/beam/issues/X";>#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via
cross-language (<a
href="https://github.com/apache/beam/issues/21961";>#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to
Hbase (Java) (<a
href="https://github.com/apache/beam/issues/25830";>#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go)
(<a
href="https://github.com/apache/beam/issues/25779";>#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid
excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence
that extends support
for slowly updating side input patterns. (<a
href="https://github.com/apache/beam/issues/23106";>#23106</a>)</li>
-<li>Python SDK now requires
<code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer
supports protobuf 3.x. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were
updated to latest available major versions. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a
href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will
be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
-(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
+in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/categories/blog/index.xml
b/website/generated-content/categories/blog/index.xml
index 3141ad7cbc1..1497554f982 100644
--- a/website/generated-content/categories/blog/index.xml
+++ b/website/generated-content/categories/blog/index.xml
@@ -20,7 +20,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a
href="https://github.com/apache/beam/issues/X";>#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via
cross-language (<a
href="https://github.com/apache/beam/issues/21961";>#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to
Hbase (Java) (<a
href="https://github.com/apache/beam/issues/25830";>#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go)
(<a
href="https://github.com/apache/beam/issues/25779";>#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid
excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence
that extends support
for slowly updating side input patterns. (<a
href="https://github.com/apache/beam/issues/23106";>#23106</a>)</li>
-<li>Python SDK now requires
<code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer
supports protobuf 3.x. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were
updated to latest available major versions. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a
href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will
be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
-(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
+in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/categories/release/index.xml
b/website/generated-content/categories/release/index.xml
index 5a060d64af7..f8c10f9efbf 100644
--- a/website/generated-content/categories/release/index.xml
+++ b/website/generated-content/categories/release/index.xml
@@ -20,7 +20,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a
href="https://github.com/apache/beam/issues/X";>#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via
cross-language (<a
href="https://github.com/apache/beam/issues/21961";>#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to
Hbase (Java) (<a
href="https://github.com/apache/beam/issues/25830";>#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go)
(<a
href="https://github.com/apache/beam/issues/25779";>#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid
excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence
that extends support
for slowly updating side input patterns. (<a
href="https://github.com/apache/beam/issues/23106";>#23106</a>)</li>
-<li>Python SDK now requires
<code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer
supports protobuf 3.x. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were
updated to latest available major versions. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a
href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will
be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
-(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
+in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/documentation/index.xml
b/website/generated-content/documentation/index.xml
index 474d5e70824..10dd969163d 100644
--- a/website/generated-content/documentation/index.xml
+++ b/website/generated-content/documentation/index.xml
@@ -918,7 +918,7 @@ verifying some of the properties of your
<code>BoundedSource</code> implem
can use <code>SourceTestUtils</code> to increase your
implementation&rsquo;s test coverage
using a wide range of inputs with relatively few lines of code. For
examples that use <code>SourceTestUtils</code>, see the
-<a
href="https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/AvroSourceTest.java";>AvroSourceTest</a>
and
+<a
href="https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/AvroSourceTest.java";>AvroSourceTest</a>
and
<a
href="https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/TextIOReadTest.java";>TextIOReadTest</a>
source code.</p>
</li>
@@ -1183,7 +1183,7 @@ sinks that interact with files, including:</p>
implementations for examples:</p>
<ul>
<li><a
href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TextSink.java";>TextSink</a>
and</li>
-<li><a
href="https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/AvroSink.java";>AvroSink</a>.</li>
+<li><a
href="https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroSink.java";>AvroSink</a>.</li>
</ul>
<h2 id="ptransform-wrappers">PTransform wrappers</h2>
<p>When you create a source or sink that end-users will use, avoid exposing
your
diff --git a/website/generated-content/documentation/io/connectors/index.html
b/website/generated-content/documentation/io/connectors/index.html
index b2e42b338a6..93e9b4949be 100644
--- a/website/generated-content/documentation/io/connectors/index.html
+++ b/website/generated-content/documentation/io/connectors/index.html
@@ -23,7 +23,7 @@ function
blockScroll(){$("body").toggleClass("fixedPosition");}
function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Documentation</span></li><li><a
href=/documentation>Using the Documentation</a></li><li
class=section-nav-item--collapsible><span class=section-nav-lis [...]
<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/FileIO.html>native</a></td><td
class=present>✔
<a
href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.fileio.html>native</a></td><td>Not
available</td><td>Not available</td><td class=present>✔</td><td
class=present>✔</td></tr><tr><td>AvroIO</td><td class=present>✔</td><td
class=present>✔</td><td class=present>✔
-<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/io/AvroIO.html>native</a></td><td
class=present>✔
+<a
href=https://beam.apache.org/releases/javadoc/current/org/apache/beam/sdk/extensions/avro/io/AvroIO.html>native</a></td><td
class=present>✔
<a
href=https://beam.apache.org/releases/pydoc/current/apache_beam.io.avroio.html>native</a></td><td
class=present>✔
<a
href=https://pkg.go.dev/github.com/apache/beam/sdks/v2/go/pkg/beam/io/avroio>native</a></td><td
class=present>✔
<a
href=https://github.com/apache/beam/blob/master/sdks/typescript/src/apache_beam/io/avroio.ts>via
X-language</a></td><td class=present>✔</td><td
class=present>✔</td></tr><tr><td>TextIO</td><td class=present>✔</td><td
class=present>✔</td><td class=present>✔
diff --git
a/website/generated-content/documentation/io/developing-io-java/index.html
b/website/generated-content/documentation/io/developing-io-java/index.html
index 7dc884c3925..adfca5189b6 100644
--- a/website/generated-content/documentation/io/developing-io-java/index.html
+++ b/website/generated-content/documentation/io/developing-io-java/index.html
@@ -58,7 +58,7 @@ verifying some of the properties of your
<code>BoundedSource</code> implementati
can use <code>SourceTestUtils</code> to increase your implementation’s
test coverage
using a wide range of inputs with relatively few lines of code. For
examples that use <code>SourceTestUtils</code>, see the
-<a
href=https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/AvroSourceTest.java>AvroSourceTest</a>
and
+<a
href=https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/test/java/org/apache/beam/sdk/extensions/avro/io/AvroSourceTest.java>AvroSourceTest</a>
and
<a
href=https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/io/TextIOReadTest.java>TextIOReadTest</a>
source code.</p></li></ol><p>In addition, see the <a
href=/contribute/ptransform-style-guide/>PTransform style guide</a>
for Beam’s transform style guidance.</p><h2
id=implementing-the-source-interface>Implementing the Source
interface</h2><p>To create a data source for your pipeline, you must provide
the format-specific
@@ -194,7 +194,7 @@ and passes your <code>FileBasedSink</code> as a parameter.
A user should not nee
call <code>WriteFiles</code> directly.</p></li></ul><p>The
<code>FileBasedSink</code> abstract base class implements code that is common
to Beam
sinks that interact with files, including:</p><ul><li>Setting file headers and
footers</li><li>Sequential record writing</li><li>Setting the output MIME
type</li></ul><p><code>FileBasedSink</code> and its subclasses support writing
files to any Beam-supported
<code>FileSystem</code> implementations. See the following Beam-provided
<code>FileBasedSink</code>
-implementations for examples:</p><ul><li><a
href=https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TextSink.java>TextSink</a>
and</li><li><a
href=https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/AvroSink.java>AvroSink</a>.</li></ul><h2
id=ptransform-wrappers>PTransform wrappers</h2><p>When you create a source or
sink that end-users will use, avoid exposing your
+implementations for examples:</p><ul><li><a
href=https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TextSink.java>TextSink</a>
and</li><li><a
href=https://github.com/apache/beam/blob/master/sdks/java/extensions/avro/src/main/java/org/apache/beam/sdk/extensions/avro/io/AvroSink.java>AvroSink</a>.</li></ul><h2
id=ptransform-wrappers>PTransform wrappers</h2><p>When you create a source or
sink that end-users will use, avoid exposing your
source or sink code. To avoid exposing your sources and sinks to end-users,
your
new classes should be protected or private. Then, implement a user-facing
wrapper <code>PTransform</code>. By exposing your source or sink as a
transform, your
diff --git a/website/generated-content/documentation/io/io-standards/index.html
b/website/generated-content/documentation/io/io-standards/index.html
index d672d2a717b..c12b49c811a 100644
--- a/website/generated-content/documentation/io/io-standards/index.html
+++ b/website/generated-content/documentation/io/io-standards/index.html
@@ -95,7 +95,7 @@ function
openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi
BigQueryIO.write()
.withWriteConfig(StreamingInsertsConfig.withDetailedError()
-
.withExactlyOnce().etc..)</code></pre></div></div></p></td></tr><tr><td><p>class
IO.Write.withFormatFunction</td><td><p><strong>Discouraged - except for
dynamic destinations</strong><p>For sources that can receive Beam Row-typed
PCollections, the format function should not be necessary, because Beam should
be able to format the input data based on its schema.<p>For sinks providing
Dynamic Destination functionality, elements may carry data that helps dete [...]
+
.withExactlyOnce().etc..)</code></pre></div></div></p></td></tr><tr><td><p>class
IO.Write.withFormatFunction</td><td><p><strong>Discouraged - except for
dynamic destinations</strong><p>For sources that can receive Beam Row-typed
PCollections, the format function should not be necessary, because Beam should
be able to format the input data based on its schema.<p>For sinks providing
Dynamic Destination functionality, elements may carry data that helps dete [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div><div class="footer__cols__col
footer__cols__col__logos"><div class=footer__cols__col--group><div
class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git
a/website/generated-content/documentation/ml/orchestration/index.html
b/website/generated-content/documentation/ml/orchestration/index.html
index e2aa0c72dcb..3f4509d6d17 100644
--- a/website/generated-content/documentation/ml/orchestration/index.html
+++ b/website/generated-content/documentation/ml/orchestration/index.html
@@ -139,7 +139,7 @@ implementation:
help="Beam runner: DataflowRunner or DirectRunner.",
default="DirectRunner")
- return parser.parse_args()</code></pre></div></div><p>The implementation of
the <code>preprocess_dataset</code> function contains the Apache Beam pipeline
code and the Beam pipeline options that select the runner. The executed
preprocessing involves downloading the image bytes from their URL, converting
them to a Torch Tensor, and resizing to the desired size. The caption undergoes
a series of string manipulations to ensure that our model receives uniform
image descriptions. Tokenizati [...]
+ return parser.parse_args()</code></pre></div></div><p>The implementation of
the <code>preprocess_dataset</code> function contains the Apache Beam pipeline
code and the Beam pipeline options that select the runner. The executed
preprocessing involves downloading the image bytes from their URL, converting
them to a Torch Tensor, and resizing to the desired size. The caption undergoes
a series of string manipulations to ensure that our model receives uniform
image descriptions. Tokenizati [...]
# workflow rely on global context (e.g., a module imported at module level).
pipeline_options = PipelineOptions(
runner=beam_runner,
diff --git a/website/generated-content/feed.xml
b/website/generated-content/feed.xml
index 2e6dc21fc8f..9a327144a14 100644
--- a/website/generated-content/feed.xml
+++ b/website/generated-content/feed.xml
@@ -20,7 +20,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
</ul>
<h2 id="ios">I/Os</h2>
<ul>
-<li>Support for X source added (Java/Python) (<a
href="https://github.com/apache/beam/issues/X";>#X</a>).</li>
<li>BigQuery Storage Write API is now available in Python SDK via
cross-language (<a
href="https://github.com/apache/beam/issues/21961";>#21961</a>).</li>
<li>Added HbaseIO support for writing RowMutations (ordered by rowkey) to
Hbase (Java) (<a
href="https://github.com/apache/beam/issues/25830";>#25830</a>).</li>
<li>Added fileio transforms MatchFiles, MatchAll and ReadMatches (Go)
(<a
href="https://github.com/apache/beam/issues/25779";>#25779</a>).</li>
@@ -34,7 +33,6 @@ See the <a
href="/get-started/downloads/%7B$DOWNLOAD_ANCHOR%7D">download page
like <code>df | (Transform1 | Transform2 | ...)</code> to avoid
excessive conversions.)</li>
<li>The Go SDK adds new transforms periodic.Impulse and periodic.Sequence
that extends support
for slowly updating side input patterns. (<a
href="https://github.com/apache/beam/issues/23106";>#23106</a>)</li>
-<li>Python SDK now requires
<code>protobuf&gt;=4.21.1,&lt;4.23.0</code> and no longer
supports protobuf 3.x. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
<li>Several Google client libraries in Python SDK dependency chain were
updated to latest available major versions. (<a
href="https://github.com/apache/beam/pull/24599";>#24599</a>)</li>
</ul>
<h2 id="breaking-changes">Breaking Changes</h2>
@@ -46,8 +44,7 @@ for slowly updating side input patterns. (<a
href="https://github.com/apache/
<h2 id="deprecations">Deprecations</h2>
<ul>
<li>Cloud Debugger support and its pipeline options are deprecated and will
be removed in the next Beam version,
-in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
-(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
+in response to the Google Cloud Debugger service <a
href="https://cloud.google.com/debugger/docs/deprecations";>turning down</a>.
(Java) (<a
href="https://github.com/apache/beam/issues/25959";>#25959</a>).</li>
</ul>
<h2 id="bugfixes">Bugfixes</h2>
<ul>
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index 5e4020dd924..39665bc7809 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.47.0/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-05-15T08:35:42+02:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/blog/beam-2.47.0/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/blog/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/categories/</loc><lastmod>2023-05-15T17:56:33+02:00</lastmod></url><url><loc>/catego
[...]
\ No newline at end of file
