This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e8565ff7870 Publishing website 2022/11/16 22:17:26 at commit b952b41
e8565ff7870 is described below
commit e8565ff787098f14898f92f756e958599df51c95
Author: jenkins <bui...@apache.org>
AuthorDate: Wed Nov 16 22:17:26 2022 +0000
Publishing website 2022/11/16 22:17:26 at commit b952b41
---
website/generated-content/blog/splitatfraction-method/index.html | 2 +-
website/generated-content/blog/splittable-do-fn/index.html | 4 ++--
website/generated-content/documentation/runners/dataflow/index.html | 4 ++--
.../documentation/sdks/python-machine-learning/index.html | 2 +-
website/generated-content/sitemap.xml | 2 +-
5 files changed, 7 insertions(+), 7 deletions(-)
diff --git a/website/generated-content/blog/splitatfraction-method/index.html
b/website/generated-content/blog/splitatfraction-method/index.html
index cc81743d57b..7704b9d9f1e 100644
--- a/website/generated-content/blog/splitatfraction-method/index.html
+++ b/website/generated-content/blog/splitatfraction-method/index.html
@@ -19,7 +19,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you
looking for?");}
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog</p><p>2016/05/18</p></div><header class=post-header><h2
itemprop="name headline">Dynamic work rebalancing for Beam</h1><div
class=post-info><span>Dan Halperin</span></div></header><div class="arrow-list
header-top-margin" itemprop=articleBody><p>This [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div
class="body__contained center no__padding content-up"><article class=post
itemscope itemtype=http://schema.org/BlogPosting><div class=post-content><div
class=post-info><p>blog</p><p>2016/05/18</p></div><header class=post-header><h2
itemprop="name headline">Dynamic work rebalancing for Beam</h1><div
class=post-info><span>Dan Halperin</span></div></header><div class="arrow-list
header-top-margin" itemprop=articleBody><p>This [...]
</p><p>2022/10/17</p></div><div class=post><p class=post-title>Apache Beam
2.42.0</p><p class=post-info>Robert Burke</p></div></a><a class=post-card
href=/blog/hop-web-cloud/ data-categories=blog><div class="post-info
post-category"><p>blog</p><p>2022/10/15</p></div><div class=post><p
class=post-title>Apache Hop web version with Cloud Dataflow</p><p
class=post-info>Israel Herraiz</p></div></a></div></article></div><footer
class=footer><div class=footer__contained><div class=footer__co [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
diff --git a/website/generated-content/blog/splittable-do-fn/index.html
b/website/generated-content/blog/splittable-do-fn/index.html
index 6f9c3993ee1..ad659c0ea75 100644
--- a/website/generated-content/blog/splittable-do-fn/index.html
+++ b/website/generated-content/blog/splittable-do-fn/index.html
@@ -119,7 +119,7 @@ runner with information such as its estimated size (or its
generalization,
“backlog”), progress through reading the bundle, watermarks etc.
The runner
uses this information to tune the execution and control the breakdown of the
<code>Source</code> into bundles. For example, a slowly progressing large
bundle of a file
-may be <a
href=https://cloud.google.com/blog/big-data/2016/05/no-shard-left-behind-dynamic-work-rebalancing-in-google-cloud-dataflow>dynamically
+may be <a
href=https://cloud.google.com/blog/products/gcp/no-shard-left-behind-dynamic-work-rebalancing-in-google-cloud-dataflow>dynamically
split</a>
by a batch-focused runner before it becomes a straggler, and a latency-focused
streaming runner may control how many elements it reads from a source in each
@@ -155,7 +155,7 @@ this can be repeated forever.</li></ul><p><img
class=center-block src=/images/bl
a <code>@ProcessElement</code> call is going to take too long and become a
straggler, it
can split the restriction in some proportion so that the primary is short
enough
to not be a straggler, and can schedule the residual in parallel on another
-worker. For details, see <a
href=https://cloud.google.com/blog/big-data/2016/05/no-shard-left-behind-dynamic-work-rebalancing-in-google-cloud-dataflow>No
Shard Left
+worker. For details, see <a
href=https://cloud.google.com/blog/products/gcp/no-shard-left-behind-dynamic-work-rebalancing-in-google-cloud-dataflow>No
Shard Left
Behind</a>.</li></ul><p>Logically, the execution of an SDF on an element works
according to the
following diagram, where “magic” stands for the runner-specific
ability to split
the restrictions and schedule processing of residuals.</p><p><img
class=center-block src=/images/blog/splittable-do-fn/transform-expansion.png
alt="Execution of an SDF - pairing with a restriction, splitting
diff --git
a/website/generated-content/documentation/runners/dataflow/index.html
b/website/generated-content/documentation/runners/dataflow/index.html
index f74db7d6e86..663f2a78ad9 100644
--- a/website/generated-content/documentation/runners/dataflow/index.html
+++ b/website/generated-content/documentation/runners/dataflow/index.html
@@ -19,7 +19,7 @@
function addPlaceholder(){$('input:text').attr('placeholder',"What are you
looking for?");}
function endSearch(){var
search=document.querySelector(".searchBar");search.classList.add("disappear");var
icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");}
function blockScroll(){$("body").toggleClass("fixedPosition");}
-function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Runners</span></li><li><a
href=/documentation/runners/capability-matrix/>Capability Matrix</a></li><li><a
href=/documentation/runners/direct/>Direct Ru [...]
+function openMenu(){addPlaceholder();blockScroll();}</script><div
class="clearfix container-main-content"><div class="section-nav closed"
data-offset-top=90 data-offset-bottom=500><span class="section-nav-back
glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list
data-section-nav><li><span
class=section-nav-list-main-title>Runners</span></li><li><a
href=/documentation/runners/capability-matrix/>Capability Matrix</a></li><li><a
href=/documentation/runners/direct/>Direct Ru [...]
begin</em> section of the <a
href=https://cloud.google.com/dataflow/docs/quickstarts>Cloud Dataflow
quickstart</a>
for your chosen language.</p><ol><li>Select or create a Google Cloud Platform
Console project.</li><li>Enable billing for your project.</li><li>Enable the
required Google Cloud APIs: Cloud Dataflow, Compute Engine,
Stackdriver Logging, Cloud Storage, Cloud Storage JSON, and Cloud Resource
@@ -69,7 +69,7 @@ command).</p></li><li><p>Streaming jobs use a Google Compute
Engine <a href=http
of <code>n1-standard-2</code> or higher by default. You must not override
this, as
<code>n1-standard-2</code> is the minimum required machine type for running
streaming
jobs.</p></li><li><p>Streaming execution <a
href=https://cloud.google.com/dataflow/pricing>pricing</a>
-differs from batch execution.</p></li></ol><div class=feedback><p
class=update>Last updated on 2022/07/27</p><h3>Have you found everything you
were looking for?</h3><p class=description>Was it all useful and clear? Is
there anything that you would like to change? Let us know!</p><button
class=load-button><a href="mailto:d...@beam.apache.org?subject=Beam Website
Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols>< [...]
+differs from batch execution.</p></li></ol><div class=feedback><p
class=update>Last updated on 2022/11/16</p><h3>Have you found everything you
were looking for?</h3><p class=description>Was it all useful and clear? Is
there anything that you would like to change? Let us know!</p><button
class=load-button><a href="mailto:d...@beam.apache.org?subject=Beam Website
Feedback">SEND FEEDBACK</a></button></div></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols>< [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
| <a href=/privacy_policy>Privacy Policy</a>
| <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam
logo, and the Apache feather logo are either registered trademarks or
trademarks of The Apache Software Foundation. All other products or name brands
are trademarks of their respective holders, including The Apache Software
Foundation.</div></div><div class="footer__cols__col
footer__cols__col__logos"><div class=footer__cols__col--group><div
class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...]
\ No newline at end of file
diff --git
a/website/generated-content/documentation/sdks/python-machine-learning/index.html
b/website/generated-content/documentation/sdks/python-machine-learning/index.html
index 6b74761e22e..d092cef8a77 100644
---
a/website/generated-content/documentation/sdks/python-machine-learning/index.html
+++
b/website/generated-content/documentation/sdks/python-machine-learning/index.html
@@ -83,7 +83,7 @@ with pipeline as p:
| 'ProcessOutput' >> beam.ParDo(PostProcessor()))
</code></pre><p>If you need to use this object explicitly, include the
following line in your pipeline to import the object:</p><pre><code>from
apache_beam.ml.inference.base import PredictionResult
</code></pre><p>For more information, see the <a
href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/ml/inference/base.py#L65><code>PredictionResult</code>
documentation</a>.</p><h2 id=run-a-machine-learning-pipeline>Run a machine
learning pipeline</h2><p>For detailed instructions explaining how to build and
run a pipeline that uses ML models, see the
-<a
href=https://github.com/apache/beam/tree/master/sdks/python/apache_beam/examples/inference>Example
RunInference API pipelines</a> on GitHub.</p><h2 id=beam-java-sdk-support>Beam
Java SDK support</h2><p>The RunInference API is available with the Beam Java
SDK versions 2.41.0 and later through Apache Beam’s <a
href=https://beam.apache.org/documentation/programming-guide/#multi-language-pipelines>Multi-language
Pipelines framework</a>. For information about the Java wrapper transfo [...]
+<a
href=https://github.com/apache/beam/tree/master/sdks/python/apache_beam/examples/inference>Example
RunInference API pipelines</a> on GitHub.</p><h2 id=beam-java-sdk-support>Beam
Java SDK support</h2><p>The RunInference API is available with the Beam Java
SDK versions 2.41.0 and later through Apache Beam’s <a
href=https://beam.apache.org/documentation/programming-guide/#multi-language-pipelines>Multi-language
Pipelines framework</a>. For information about the Java wrapper transfo [...]
<a
href=/documentation/sdks/python-machine-learning/#batchelements-ptransform>BatchElements
PTransforms</a>. For an example, see our <a
href=https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/inference/pytorch_language_modeling.py>language
modeling example</a>.</p><h2 id=related-links>Related links</h2><ul><li><a
href=/documentation/transforms/python/elementwise/runinference>RunInference
transforms</a></li><li><a href=https://github.com/apache/beam/tree/master/sd
[...]
Pydoc</a></td></table><p><br><br><br></p></div></div><footer class=footer><div
class=footer__contained><div class=footer__cols><div class="footer__cols__col
footer__cols__col__logos"><div class=footer__cols__col__logo><img
src=/images/beam_logo_circle.svg class=footer__logo alt="Beam logo"></div><div
class=footer__cols__col__logo><img src=/images/apache_logo_circle.svg
class=footer__logo alt="Apache logo"></div></div><div class=footer-wrapper><div
class=wrapper-grid><div class=footer__co [...]
<a href=https://www.apache.org>The Apache Software Foundation</a>
diff --git a/website/generated-content/sitemap.xml
b/website/generated-content/sitemap.xml
index 824ab20c02d..5daea701796 100644
--- a/website/generated-content/sitemap.xml
+++ b/website/generated-content/sitemap.xml
@@ -1 +1 @@
-<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/categories/blog/</loc><lastmod>2022-11-10T17:26:15-05:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-11-10T17:26:15-05:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-11-10T17:26:15-05:00</lastmod></url><url><loc>/blog/ml-resources/</loc><lastmod>2022-11-10T17:26:15-05:00</lastmod></url><url><loc>/categ
[...]
\ No newline at end of file
+<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset
xmlns="http://www.sitemaps.org/schemas/sitemap/0.9";
xmlns:xhtml="http://www.w3.org/1999/xhtml";><url><loc>/categories/blog/</loc><lastmod>2022-11-16T09:32:46-05:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-11-16T09:32:46-05:00</lastmod></url><url><loc>/categories/</loc><lastmod>2022-11-16T09:32:46-05:00</lastmod></url><url><loc>/blog/ml-resources/</loc><lastmod>2022-11-10T17:26:15-05:00</lastmod></url><url><loc>/categ
[...]
\ No newline at end of file
