This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push: new 21d9a33c612 Publishing website 2022/06/22 16:18:06 at commit 242f8f3 21d9a33c612 is described below commit 21d9a33c612f7a75ecccf3c4149c2ca962947c6f Author: jenkins <bui...@apache.org> AuthorDate: Wed Jun 22 16:18:06 2022 +0000 Publishing website 2022/06/22 16:18:06 at commit 242f8f3 --- website/generated-content/documentation/index.xml | 11 +++++++++++ .../documentation/programming-guide/index.html | 7 +++++-- website/generated-content/sitemap.xml | 2 +- 3 files changed, 17 insertions(+), 3 deletions(-) diff --git a/website/generated-content/documentation/index.xml b/website/generated-content/documentation/index.xml index a88fa92c3b1..f7f440b5325 100644 --- a/website/generated-content/documentation/index.xml +++ b/website/generated-content/documentation/index.xml @@ -5364,6 +5364,17 @@ individual values) to a uni-map (unique keys to collections of values).</p> <span class="n">mapped</span><span class="o">.</span><span class="na">apply</span><span class="o">(</span><span class="n">GroupByKey</span><span class="o">.&lt;</span><span class="n">String</span><span class="o">,</span> <span class="n">String</span><span class="o">&gt;</span><span class="n">create</span><span class="o">());</span></code></pre></div> </div> </div> +<div class='language-go snippet'> +<div class="notebook-skip code-snippet"> +<a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard"> +<img src="/images/copy-icon.svg"/> +</a> +<div class="highlight"><pre class="chroma"><code class="language-go" data-lang="go"><span class="c1">// CreateAndSplit creates and returns a PCollection with &lt;K,V&gt; +</span><span class="c1">// from an input slice of stringPair (struct with K, V string fields). +</span><span class="c1"></span><span class="nx">pairs</span> <span class="o">:=</span> <span class="nf">CreateAndSplit</span><span class="p">(</span><span class="nx">s</span><span class="p">,</span> <span class="nx">input</span><span class="p">)</span> +<span class="nx">keyed</span> <span class="o">:=</span> <span class="nx">beam</span><span class="p">.</span><span class="nf">GroupByKey</span><span class="p">(</span><span class="nx">s</span><span class="p">,</span> <span class="nx">pairs</span><span class="p">)</span></code></pre></div> +</div> +</div> <h5 id="groupbykey-and-unbounded-pcollections">4.2.2.1 GroupByKey and unbounded PCollections</h5> <p>If you are using unbounded <code>PCollection</code>s, you must use either <a href="#setting-your-pcollections-windowing-function">non-global windowing</a> or an diff --git a/website/generated-content/documentation/programming-guide/index.html b/website/generated-content/documentation/programming-guide/index.html index c089d45aaab..8a032af91ba 100644 --- a/website/generated-content/documentation/programming-guide/index.html +++ b/website/generated-content/documentation/programming-guide/index.html @@ -635,7 +635,10 @@ individual values) to a uni-map (unique keys to collections of values).</p><p><s <span class=c1>// Apply GroupByKey to the PCollection mapped. </span><span class=c1>// Save the result as the PCollection reduced. </span><span class=c1></span><span class=n>PCollection</span><span class=o><</span><span class=n>KV</span><span class=o><</span><span class=n>String</span><span class=o>,</span> <span class=n>Iterable</span><span class=o><</span><span class=n>String</span><span class=o>>>></span> <span class=n>reduced</span> <span class=o>=</span> - <span class=n>mapped</span><span class=o>.</span><span class=na>apply</span><span class=o>(</span><span class=n>GroupByKey</span><span class=o>.<</span><span class=n>String</span><span class=o>,</span> <span class=n>String</span><span class=o>></span><span class=n>create</span><span class=o>());</span></code></pre></div></div></div><h5 id=groupbykey-and-unbounded-pcollections>4.2.2.1 GroupByKey and unbounded PCollections</h5><p>If you are using unbounded <code>PCollection</code>s, [...] + <span class=n>mapped</span><span class=o>.</span><span class=na>apply</span><span class=o>(</span><span class=n>GroupByKey</span><span class=o>.<</span><span class=n>String</span><span class=o>,</span> <span class=n>String</span><span class=o>></span><span class=n>create</span><span class=o>());</span></code></pre></div></div></div><div class="language-go snippet"><div class="notebook-skip code-snippet"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom titl [...] +</span><span class=c1>// from an input slice of stringPair (struct with K, V string fields). +</span><span class=c1></span><span class=nx>pairs</span> <span class=o>:=</span> <span class=nf>CreateAndSplit</span><span class=p>(</span><span class=nx>s</span><span class=p>,</span> <span class=nx>input</span><span class=p>)</span> +<span class=nx>keyed</span> <span class=o>:=</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>GroupByKey</span><span class=p>(</span><span class=nx>s</span><span class=p>,</span> <span class=nx>pairs</span><span class=p>)</span></code></pre></div></div></div><h5 id=groupbykey-and-unbounded-pcollections>4.2.2.1 GroupByKey and unbounded PCollections</h5><p>If you are using unbounded <code>PCollection</code>s, you must use either <a href=#setting-your-pcollections-windo [...] windowing</a> or an <a href=#triggers>aggregation trigger</a> in order to perform a <code>GroupByKey</code> or <a href=#cogroupbykey>CoGroupByKey</a>. This is because a bounded <code>GroupByKey</code> or @@ -4432,7 +4435,7 @@ functions as shortcuts for single, unnamed inputs/outputs or define a map for na <span class=nx>outT</span> <span class=o>:=</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>UnnamedOutput</span><span class=p>(</span><span class=nx>typex</span><span class=p>.</span><span class=nf>New</span><span class=p>(</span><span class=nx>reflectx</span><span class=p>.</span><span class=nx>String</span><span class=p>))</span> <span class=nx>res</span> <span class=o>:=</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>CrossLanguage</span><span class=p>(</span><span class=nx>s</span><span class=p>,</span> <span class=nx>urn</span><span class=p>,</span> <span class=nx>payload</span><span class=p>,</span> <span class=nx>expansionAddr</span><span class=p>,</span> <span class=nx>beam</span><span class=p>.</span><span class=nf>UnnamedInput</span><span class=p>(</span><span class=nx>inputPCol</spa [...] </code></pre></div></li><li><p>After the job has been submitted to the Beam runner, shutdown the expansion service by -terminating the expansion service process.</p></li></ol><h3 id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently, portable runners such as Flink, Spark, and the direct runner can be used with multi-language pipelines.</p><p>Dataflow supports multi-language pipelines through the Dataflow Runner v2 backend architecture.</p><h3 id=x-lang-transform-tips-troubleshooting>13.4 Tips and Troubleshooting</h3><p>For additional tips and troubleshooting information, see <a href=ht [...] +terminating the expansion service process.</p></li></ol><h3 id=x-lang-transform-runner-support>13.3. Runner Support</h3><p>Currently, portable runners such as Flink, Spark, and the direct runner can be used with multi-language pipelines.</p><p>Dataflow supports multi-language pipelines through the Dataflow Runner v2 backend architecture.</p><h3 id=x-lang-transform-tips-troubleshooting>13.4 Tips and Troubleshooting</h3><p>For additional tips and troubleshooting information, see <a href=ht [...] <a href=http://www.apache.org>The Apache Software Foundation</a> | <a href=/privacy_policy>Privacy Policy</a> | <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div><div class="footer__cols__col footer__cols__col__logos"><div class=footer__cols__col--group><div class=footer__cols__col__logo><a href=https://github.com/apache/beam><im [...] \ No newline at end of file diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index f74bde7c2e3..b323f570e58 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/case-studies/lyft/</loc><lastmod>2022-06-18T03:13:47+06:00</lastmod></url><url><loc>/blog/beam-2.39.0/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc> [...] \ No newline at end of file +<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/case-studies/lyft/</loc><lastmod>2022-06-18T03:13:47+06:00</lastmod></url><url><loc>/blog/beam-2.39.0/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2022-05-25T11:28:33-07:00</lastmod></url><url><loc> [...] \ No newline at end of file