This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push: new 654f9f5 Publishing website 2021/05/29 00:06:42 at commit dd15d59 654f9f5 is described below commit 654f9f512a0ce45bc1c2867f3e68886fbf1c88e5 Author: jenkins <bui...@apache.org> AuthorDate: Sat May 29 00:06:42 2021 +0000 Publishing website 2021/05/29 00:06:42 at commit dd15d59 --- website/generated-content/get-started/index.xml | 191 ++++++++++++--------- .../get-started/quickstart-java/index.html | 182 +++++++++++--------- website/generated-content/sitemap.xml | 2 +- 3 files changed, 210 insertions(+), 165 deletions(-) diff --git a/website/generated-content/get-started/index.xml b/website/generated-content/get-started/index.xml index 312daab..f08232d 100644 --- a/website/generated-content/get-started/index.xml +++ b/website/generated-content/get-started/index.xml @@ -1130,8 +1130,9 @@ limitations under the License. <nav id="TableOfContents"> <ul> <li><a href="#set-up-your-development-environment">Set up your Development Environment</a></li> -<li><a href="#get-the-wordcount-code">Get the WordCount Code</a></li> +<li><a href="#get-the-example-code">Get the Example Code</a></li> <li><a href="#optional-convert-from-maven-to-gradle-project">Optional: Convert from Maven to Gradle Project</a></li> +<li><a href="#get-sample-text">Get sample text</a></li> <li><a href="#run-a-pipeline">Run a pipeline</a> <ul> <li><a href="#run-wordcount-using-maven">Run WordCount Using Maven</a></li> @@ -1154,8 +1155,8 @@ limitations under the License. <p>Optional: Install <a href="https://gradle.org/install/">Gradle</a> if you would like to convert your Maven project into Gradle.</p> </li> </ol> -<h2 id="get-the-wordcount-code">Get the WordCount Code</h2> -<p>The easiest way to get a copy of the WordCount pipeline is to use the following command to generate a simple Maven project that contains Beam&rsquo;s WordCount examples and builds against the most recent Beam release:</p> +<h2 id="get-the-example-code">Get the Example Code</h2> +<p>Use the following command to generate a Maven project that contains Beam&rsquo;s WordCount examples and builds against the most recent Beam release:</p> <div class="snippet"> <div class="notebook-skip code-snippet without_switcher"> <a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard"> @@ -1188,7 +1189,7 @@ limitations under the License. -D interactiveMode=false</code></pre> </div> </div> -<p>This will create a directory <code>word-count-beam</code> that contains a simple <code>pom.xml</code> and a series of example pipelines that count words in text files.</p> +<p>This will create a <code>word-count-beam</code> directory that contains a <code>pom.xml</code> and several example pipelines that count words in text files.</p> <div class="snippet"> <div class="notebook-skip code-snippet without_switcher"> <a class="copy" type="button" data-bs-toggle="tooltip" data-bs-placement="bottom" title="Copy to clipboard"> @@ -1286,6 +1287,14 @@ args System.getProperty(&#34;exec.args&#34;, &#34;&#34;).split() </div> </li> </ol> +<h2 id="get-sample-text">Get sample text</h2> +<blockquote> +<p>If you&rsquo;re planning to use the DataflowRunner, you can skip this step. The runner will pull text directly from Google Cloud Storage.</p> +</blockquote> +<ol> +<li>In the <strong>word-count-beam</strong> directory, create a file called <strong>sample.txt</strong>.</li> +<li>Add some text to the file. For this example, you can use the text of Shakespeare&rsquo;s <a href="https://storage.cloud.google.com/apache-beam-samples/shakespeare/sonnets.txt">Sonnets</a>.</li> +</ol> <h2 id="run-a-pipeline">Run a pipeline</h2> <p>A single Beam pipeline can run on multiple Beam <a href="/documentation#runners">runners</a>, including the <a href="/documentation/runners/flink">FlinkRunner</a>, <a href="/documentation/runners/spark">SparkRunner</a>, <a href="/documentation/runners/nemo">NemoRunner</a>, <a href="/documentation/runners/jet">JetRunner</a>, or <a href="/documentation/runners/dataflow">DataflowRunner</a>. The <a href="/documentation/runners/direct">DirectRunner [...] <p>The general process for running a pipeline goes like this:</p> @@ -1309,7 +1318,7 @@ args System.getProperty(&#34;exec.args&#34;, &#34;&#34;).split() <img src="/images/copy-icon.svg"/> </a> <pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ --Dexec.args=&#34;--inputFile=/path/to/inputfile --output=counts&#34; -Pdirect-runner</code></pre> +-Dexec.args=&#34;--inputFile=sample.txt --output=counts&#34; -Pdirect-runner</code></pre> </div> </div> <div class="snippet"> @@ -1318,7 +1327,7 @@ args System.getProperty(&#34;exec.args&#34;, &#34;&#34;).split() <img src="/images/copy-icon.svg"/> </a> <pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ --Dexec.args=&#34;--runner=FlinkRunner --inputFile=/path/to/inputfile --output=counts&#34; -Pflink-runner</code></pre> +-Dexec.args=&#34;--runner=FlinkRunner --inputFile=sample.txt --output=counts&#34; -Pflink-runner</code></pre> </div> </div> <div class="snippet"> @@ -1328,7 +1337,7 @@ args System.getProperty(&#34;exec.args&#34;, &#34;&#34;).split() </a> <pre><code>$ mvn package exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ -Dexec.args=&#34;--runner=FlinkRunner --flinkMaster=&lt;flink master&gt; --filesToStage=target/word-count-beam-bundled-0.1.jar \ ---inputFile=/path/to/quickstart/pom.xml --output=/tmp/counts&#34; -Pflink-runner +--inputFile=sample.txt --output=/tmp/counts&#34; -Pflink-runner You can monitor the running job by visiting the Flink dashboard at http://&lt;flink master&gt;:8081</code></pre> </div> </div> @@ -1338,7 +1347,7 @@ You can monitor the running job by visiting the Flink dashboard at http://&l <img src="/images/copy-icon.svg"/> </a> <pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ --Dexec.args=&#34;--runner=SparkRunner --inputFile=/path/to/inputfile --output=counts&#34; -Pspark-runner</code></pre> +-Dexec.args=&#34;--runner=SparkRunner --inputFile=sample.txt --output=counts&#34; -Pspark-runner</code></pre> </div> </div> <div class="snippet"> @@ -1361,7 +1370,7 @@ $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ <img src="/images/copy-icon.svg"/> </a> <pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ --Dexec.args=&#34;--inputFile=/path/to/inputfile --output=/tmp/counts --runner=SamzaRunner&#34; -Psamza-runner</code></pre> +-Dexec.args=&#34;--inputFile=sample.txt --output=/tmp/counts --runner=SamzaRunner&#34; -Psamza-runner</code></pre> </div> </div> <div class="snippet"> @@ -1370,7 +1379,7 @@ $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ <img src="/images/copy-icon.svg"/> </a> <pre><code>$ mvn package -Pnemo-runner &amp;&amp; java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount \ ---runner=NemoRunner --inputFile=`pwd`/pom.xml --output=counts</code></pre> +--runner=NemoRunner --inputFile=`pwd`/sample.txt --output=counts</code></pre> </div> </div> <div class="snippet"> @@ -1380,7 +1389,7 @@ $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ </a> <pre><code>$ mvn package -Pjet-runner $ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount \ ---runner=JetRunner --jetLocalMode=3 --inputFile=`pwd`/pom.xml --output=counts</code></pre> +--runner=JetRunner --jetLocalMode=3 --inputFile=`pwd`/sample.txt --output=counts</code></pre> </div> </div> <p>For Windows PowerShell:</p> @@ -1390,7 +1399,7 @@ $ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordC <img src="/images/copy-icon.svg"/> </a> <pre><code>PS&gt; mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` --D exec.args=&#34;--inputFile=/path/to/inputfile --output=counts&#34; -P direct-runner</code></pre> +-D exec.args=&#34;--inputFile=sample.txt --output=counts&#34; -P direct-runner</code></pre> </div> </div> <div class="snippet"> @@ -1399,7 +1408,7 @@ $ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordC <img src="/images/copy-icon.svg"/> </a> <pre><code>PS&gt; mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` --D exec.args=&#34;--runner=FlinkRunner --inputFile=/path/to/inputfile --output=counts&#34; -P flink-runner</code></pre> +-D exec.args=&#34;--runner=FlinkRunner --inputFile=sample.txt --output=counts&#34; -P flink-runner</code></pre> </div> </div> <div class="snippet"> @@ -1409,7 +1418,7 @@ $ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordC </a> <pre><code>PS&gt; mvn package exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` -D exec.args=&#34;--runner=FlinkRunner --flinkMaster=&lt;flink master&gt; --filesToStage=.\target\word-count-beam-bundled-0.1.jar ` ---inputFile=C:\path\to\quickstart\pom.xml --output=C:\tmp\counts&#34; -P flink-runner +--inputFile=C:\path\to\quickstart\sample.txt --output=C:\tmp\counts&#34; -P flink-runner You can monitor the running job by visiting the Flink dashboard at http://&lt;flink master&gt;:8081</code></pre> </div> </div> @@ -1419,7 +1428,7 @@ You can monitor the running job by visiting the Flink dashboard at http://&l <img src="/images/copy-icon.svg"/> </a> <pre><code>PS&gt; mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` --D exec.args=&#34;--runner=SparkRunner --inputFile=/path/to/inputfile --output=counts&#34; -P spark-runner</code></pre> +-D exec.args=&#34;--runner=SparkRunner --inputFile=sample.txt --output=counts&#34; -P spark-runner</code></pre> </div> </div> <div class="snippet"> @@ -1442,7 +1451,7 @@ PS&gt; mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.Word <img src="/images/copy-icon.svg"/> </a> <pre><code>PS&gt; mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` --D exec.args=&#34;--inputFile=/path/to/inputfile --output=/tmp/counts --runner=SamzaRunner&#34; -P samza-runner</code></pre> +-D exec.args=&#34;--inputFile=sample.txt --output=/tmp/counts --runner=SamzaRunner&#34; -P samza-runner</code></pre> </div> </div> <div class="snippet"> @@ -1452,7 +1461,7 @@ PS&gt; mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.Word </a> <pre><code>PS&gt; mvn package -P nemo-runner -DskipTests PS&gt; java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount ` ---runner=NemoRunner --inputFile=`pwd`/pom.xml --output=counts</code></pre> +--runner=NemoRunner --inputFile=`pwd`/sample.txt --output=counts</code></pre> </div> </div> <div class="snippet"> @@ -1462,7 +1471,7 @@ PS&gt; java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examp </a> <pre><code>PS&gt; mvn package -P jet-runner PS&gt; java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount ` ---runner=JetRunner --jetLocalMode=3 --inputFile=$pwd/pom.xml --output=counts</code></pre> +--runner=JetRunner --jetLocalMode=3 --inputFile=$pwd/sample.txt --output=counts</code></pre> </div> </div> <h3 id="run-wordcount-using-gradle">Run WordCount Using Gradle</h3> @@ -1473,7 +1482,7 @@ PS&gt; java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examp <img src="/images/copy-icon.svg"/> </a> <pre><code>$ gradle clean execute -DmainClass=org.apache.beam.examples.WordCount \ --Dexec.args=&#34;--inputFile=/path/to/inputfile --output=counts&#34; -Pdirect-runner</code></pre> +-Dexec.args=&#34;--inputFile=sample.txt --output=counts&#34; -Pdirect-runner</code></pre> </div> </div> <div class="snippet"> @@ -1506,7 +1515,7 @@ PS&gt; java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examp <img src="/images/copy-icon.svg"/> </a> <pre><code>$ gradle clean execute -DmainClass=org.apache.beam.examples.WordCount \ --Dexec.args=&#34;--inputFile=/path/to/inputfile --output=counts&#34; -Pspark-runner</code></pre> +-Dexec.args=&#34;--inputFile=sample.txt --output=counts&#34; -Pspark-runner</code></pre> </div> </div> <div class="snippet"> @@ -1616,13 +1625,16 @@ PS&gt; java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examp <img src="/images/copy-icon.svg"/> </a> <pre><code>$ more counts* -api: 9 -bundled: 1 -old: 4 -Apache: 2 -The: 1 -limitations: 1 -Foundation: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> @@ -1632,13 +1644,16 @@ Foundation: 1 <img src="/images/copy-icon.svg"/> </a> <pre><code>$ more counts* -The: 1 -api: 9 -old: 4 -Apache: 2 -limitations: 1 -bundled: 1 -Foundation: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> @@ -1648,13 +1663,16 @@ Foundation: 1 <img src="/images/copy-icon.svg"/> </a> <pre><code>$ more /tmp/counts* -The: 1 -api: 9 -old: 4 -Apache: 2 -limitations: 1 -bundled: 1 -Foundation: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> @@ -1664,14 +1682,16 @@ Foundation: 1 <img src="/images/copy-icon.svg"/> </a> <pre><code>$ more counts* -beam: 27 -SF: 1 -fat: 1 -job: 1 -limitations: 1 -require: 1 -of: 11 -profile: 10 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> @@ -1681,14 +1701,16 @@ profile: 10 <img src="/images/copy-icon.svg"/> </a> <pre><code>$ gsutil cat gs://&lt;your-gcs-bucket&gt;/counts* -feature: 15 -smother&#39;st: 1 -revelry: 1 -bashfulness: 1 -Bashful: 1 -Below: 2 -deserves: 32 -barrenly: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> @@ -1698,13 +1720,16 @@ barrenly: 1 <img src="/images/copy-icon.svg"/> </a> <pre><code>$ more /tmp/counts* -api: 7 -are: 2 -can: 2 -com: 14 -end: 14 -for: 14 -has: 2 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> @@ -1714,14 +1739,16 @@ has: 2 <img src="/images/copy-icon.svg"/> </a> <pre><code>$ more counts* -cluster: 2 -handler: 1 -plugins: 9 -exclusions: 14 -finalName: 2 -Adds: 2 -java: 7 -xml: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> @@ -1731,16 +1758,16 @@ xml: 1 <img src="/images/copy-icon.svg"/> </a> <pre><code>$ more counts* -FlinkRunner: 1 -cleanupDaemonThreads: 2 -sdks: 4 -unit: 1 -Apache: 3 -IO: 2 -copyright: 1 -governing: 1 -overrides: 1 -YARN: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre> </div> </div> diff --git a/website/generated-content/get-started/quickstart-java/index.html b/website/generated-content/get-started/quickstart-java/index.html index 0b66e4c..1d00833 100644 --- a/website/generated-content/get-started/quickstart-java/index.html +++ b/website/generated-content/get-started/quickstart-java/index.html @@ -18,7 +18,7 @@ function addPlaceholder(){$('input:text').attr('placeholder',"What are you looking for?");} function endSearch(){var search=document.querySelector(".searchBar");search.classList.add("disappear");var icons=document.querySelector("#iconsBar");icons.classList.remove("disappear");} function blockScroll(){$("body").toggleClass("fixedPosition");} -function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Get started</span></li><li><a href=/get-started/beam-overview/>Beam Overview</a></li><li><a href=/get-started/tour-of-beam/>Tour of Beam</a></li><li><s [...] +function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfix container-main-content"><div class="section-nav closed" data-offset-top=90 data-offset-bottom=500><span class="section-nav-back glyphicon glyphicon-menu-left"></span><nav><ul class=section-nav-list data-section-nav><li><span class=section-nav-list-main-title>Get started</span></li><li><a href=/get-started/beam-overview/>Beam Overview</a></li><li><a href=/get-started/tour-of-beam/>Tour of Beam</a></li><li><s [...] -DarchetypeGroupId=org.apache.beam \ -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \ -DarchetypeVersion=2.29.0 \ @@ -34,7 +34,7 @@ function openMenu(){addPlaceholder();blockScroll();}</script><div class="clearfi -D artifactId=word-count-beam ` -D version="0.1" ` -D package=org.apache.beam.examples ` - -D interactiveMode=false</code></pre></div></div><p>This will create a directory <code>word-count-beam</code> that contains a simple <code>pom.xml</code> and a series of example pipelines that count words in text files.</p><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ cd word-count-beam/ + -D interactiveMode=false</code></pre></div></div><p>This will create a <code>word-count-beam</code> directory that contains a <code>pom.xml</code> and several example pipelines that count words in text files.</p><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ cd word-count-beam/ $ ls pom.xml src @@ -77,14 +77,14 @@ d----- 7/19/2018 11:00 PM subprocess classpath = sourceSets.main.runtimeClasspath systemProperties System.getProperties() args System.getProperty("exec.args", "").split() -}</code></pre></div></div></li><li>Rebuild your project by running:<div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ gradle build</code></pre></div></div></li></ol><h2 id=run-a-pipeline>Run a pipeline</h2><p>A single Beam pipeline can run on multiple Beam <a href=/documentation#runners>runners</a>, including the <a h [...] - -Dexec.args="--inputFile=/path/to/inputfile --output=counts" -Pdirect-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ - -Dexec.args="--runner=FlinkRunner --inputFile=/path/to/inputfile --output=counts" -Pflink-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn package exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ +}</code></pre></div></div></li><li>Rebuild your project by running:<div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ gradle build</code></pre></div></div></li></ol><h2 id=get-sample-text>Get sample text</h2><blockquote><p>If you’re planning to use the DataflowRunner, you can skip this step. The runner will pull [...] + -Dexec.args="--inputFile=sample.txt --output=counts" -Pdirect-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ + -Dexec.args="--runner=FlinkRunner --inputFile=sample.txt --output=counts" -Pflink-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn package exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ -Dexec.args="--runner=FlinkRunner --flinkMaster=<flink master> --filesToStage=target/word-count-beam-bundled-0.1.jar \ - --inputFile=/path/to/quickstart/pom.xml --output=/tmp/counts" -Pflink-runner + --inputFile=sample.txt --output=/tmp/counts" -Pflink-runner You can monitor the running job by visiting the Flink dashboard at http://<flink master>:8081</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ - -Dexec.args="--runner=SparkRunner --inputFile=/path/to/inputfile --output=counts" -Pspark-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>Make sure you complete the setup steps at /documentation/runners/dataflow/#setup + -Dexec.args="--runner=SparkRunner --inputFile=sample.txt --output=counts" -Pspark-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>Make sure you complete the setup steps at /documentation/runners/dataflow/#setup $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ -Dexec.args="--runner=DataflowRunner --project=<your-gcp-project> \ @@ -92,17 +92,17 @@ $ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ --gcpTempLocation=gs://<your-gcs-bucket>/tmp \ --inputFile=gs://apache-beam-samples/shakespeare/* --output=gs://<your-gcs-bucket>/counts" \ -Pdataflow-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \ - -Dexec.args="--inputFile=/path/to/inputfile --output=/tmp/counts --runner=SamzaRunner" -Psamza-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn package -Pnemo-runner && java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount \ - --runner=NemoRunner --inputFile=`pwd`/pom.xml --output=counts</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn package -Pjet-runner + -Dexec.args="--inputFile=sample.txt --output=/tmp/counts --runner=SamzaRunner" -Psamza-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn package -Pnemo-runner && java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount \ + --runner=NemoRunner --inputFile=`pwd`/sample.txt --output=counts</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ mvn package -Pjet-runner $ java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount \ - --runner=JetRunner --jetLocalMode=3 --inputFile=`pwd`/pom.xml --output=counts</code></pre></div></div><p>For Windows PowerShell:</p><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` - -D exec.args="--inputFile=/path/to/inputfile --output=counts" -P direct-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` - -D exec.args="--runner=FlinkRunner --inputFile=/path/to/inputfile --output=counts" -P flink-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn package exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` + --runner=JetRunner --jetLocalMode=3 --inputFile=`pwd`/sample.txt --output=counts</code></pre></div></div><p>For Windows PowerShell:</p><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` + -D exec.args="--inputFile=sample.txt --output=counts" -P direct-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` + -D exec.args="--runner=FlinkRunner --inputFile=sample.txt --output=counts" -P flink-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn package exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` -D exec.args="--runner=FlinkRunner --flinkMaster=<flink master> --filesToStage=.\target\word-count-beam-bundled-0.1.jar ` - --inputFile=C:\path\to\quickstart\pom.xml --output=C:\tmp\counts" -P flink-runner + --inputFile=C:\path\to\quickstart\sample.txt --output=C:\tmp\counts" -P flink-runner You can monitor the running job by visiting the Flink dashboard at http://<flink master>:8081</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` - -D exec.args="--runner=SparkRunner --inputFile=/path/to/inputfile --output=counts" -P spark-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>Make sure you complete the setup steps at /documentation/runners/dataflow/#setup + -D exec.args="--runner=SparkRunner --inputFile=sample.txt --output=counts" -P spark-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>Make sure you complete the setup steps at /documentation/runners/dataflow/#setup PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` -D exec.args="--runner=DataflowRunner --project=<your-gcp-project> ` @@ -110,86 +110,104 @@ PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCoun --gcpTempLocation=gs://<your-gcs-bucket>/tmp ` --inputFile=gs://apache-beam-samples/shakespeare/* --output=gs://<your-gcs-bucket>/counts" ` -P dataflow-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount ` - -D exec.args="--inputFile=/path/to/inputfile --output=/tmp/counts --runner=SamzaRunner" -P samza-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn package -P nemo-runner -DskipTests + -D exec.args="--inputFile=sample.txt --output=/tmp/counts --runner=SamzaRunner" -P samza-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn package -P nemo-runner -DskipTests PS> java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount ` - --runner=NemoRunner --inputFile=`pwd`/pom.xml --output=counts</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn package -P jet-runner + --runner=NemoRunner --inputFile=`pwd`/sample.txt --output=counts</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>PS> mvn package -P jet-runner PS> java -cp target/word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount ` - --runner=JetRunner --jetLocalMode=3 --inputFile=$pwd/pom.xml --output=counts</code></pre></div></div><h3 id=run-wordcount-using-gradle>Run WordCount Using Gradle</h3><p>For Unix shells (Instructions currently only available for Direct, Spark, and Dataflow):</p><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ g [...] - -Dexec.args="--inputFile=/path/to/inputfile --output=counts" -Pdirect-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>We are working on adding the instruction for this runner!</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher" [...] - -Dexec.args="--inputFile=/path/to/inputfile --output=counts" -Pspark-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ gradle clean execute -DmainClass=org.apache.beam.examples.WordCount \ + --runner=JetRunner --jetLocalMode=3 --inputFile=$pwd/sample.txt --output=counts</code></pre></div></div><h3 id=run-wordcount-using-gradle>Run WordCount Using Gradle</h3><p>For Unix shells (Instructions currently only available for Direct, Spark, and Dataflow):</p><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code> [...] + -Dexec.args="--inputFile=sample.txt --output=counts" -Pdirect-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>We are working on adding the instruction for this runner!</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a clas [...] + -Dexec.args="--inputFile=sample.txt --output=counts" -Pspark-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ gradle clean execute -DmainClass=org.apache.beam.examples.WordCount \ -Dexec.args="--project=<your-gcp-project> --inputFile=gs://apache-beam-samples/shakespeare/* \ --output=gs://<your-gcs-bucket>/counts" -Pdataflow-runner</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>We are working on adding the instruction for this runner!</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy ty [...] -api: 9 -bundled: 1 -old: 4 -Apache: 2 -The: 1 -limitations: 1 -Foundation: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ more counts* -The: 1 -api: 9 -old: 4 -Apache: 2 -limitations: 1 -bundled: 1 -Foundation: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ more /tmp/counts* -The: 1 -api: 9 -old: 4 -Apache: 2 -limitations: 1 -bundled: 1 -Foundation: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ more counts* -beam: 27 -SF: 1 -fat: 1 -job: 1 -limitations: 1 -require: 1 -of: 11 -profile: 10 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ gsutil cat gs://<your-gcs-bucket>/counts* -feature: 15 -smother'st: 1 -revelry: 1 -bashfulness: 1 -Bashful: 1 -Below: 2 -deserves: 32 -barrenly: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ more /tmp/counts* -api: 7 -are: 2 -can: 2 -com: 14 -end: 14 -for: 14 -has: 2 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ more counts* -cluster: 2 -handler: 1 -plugins: 9 -exclusions: 14 -finalName: 2 -Adds: 2 -java: 7 -xml: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><div class=snippet><div class="notebook-skip code-snippet without_switcher"><a class=copy type=button data-bs-toggle=tooltip data-bs-placement=bottom title="Copy to clipboard"><img src=/images/copy-icon.svg></a><pre><code>$ more counts* -FlinkRunner: 1 -cleanupDaemonThreads: 2 -sdks: 4 -unit: 1 -Apache: 3 -IO: 2 -copyright: 1 -governing: 1 -overrides: 1 -YARN: 1 +wrought: 2 +st: 32 +fresher: 1 +of: 351 +souls: 2 +CXVIII: 1 +reviewest: 1 +untold: 1 +th: 1 +single: 4 ...</code></pre></div></div><h2 id=next-steps>Next Steps</h2><ul><li>Learn more about the <a href=/documentation/sdks/java/>Beam SDK for Java</a> -and look through the <a href=https://beam.apache.org/releases/javadoc>Java SDK API reference</a>.</li><li>Walk through these WordCount examples in the <a href=/get-started/wordcount-example>WordCount Example Walkthrough</a>.</li><li>Take a self-paced tour through our <a href=/documentation/resources/learning-resources>Learning Resources</a>.</li><li>Dive in to some of our favorite <a href=/documentation/resources/videos-and-podcasts>Videos and Podcasts</a>.</li><li>Join the Beam <a href= [...] +and look through the <a href=https://beam.apache.org/releases/javadoc>Java SDK API reference</a>.</li><li>Walk through these WordCount examples in the <a href=/get-started/wordcount-example>WordCount Example Walkthrough</a>.</li><li>Take a self-paced tour through our <a href=/documentation/resources/learning-resources>Learning Resources</a>.</li><li>Dive in to some of our favorite <a href=/documentation/resources/videos-and-podcasts>Videos and Podcasts</a>.</li><li>Join the Beam <a href= [...] <a href=http://www.apache.org>The Apache Software Foundation</a> | <a href=/privacy_policy>Privacy Policy</a> | <a href=/feed.xml>RSS Feed</a><br><br>Apache Beam, Apache, Beam, the Beam logo, and the Apache feather logo are either registered trademarks or trademarks of The Apache Software Foundation. All other products or name brands are trademarks of their respective holders, including The Apache Software Foundation.</div></div></div></div></footer></body></html> \ No newline at end of file diff --git a/website/generated-content/sitemap.xml b/website/generated-content/sitemap.xml index 53a5b5d..9244361 100644 --- a/website/generated-content/sitemap.xml +++ b/website/generated-content/sitemap.xml @@ -1 +1 @@ -<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.29.0/</loc><lastmod>2021-04-15T20:51:50-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2021-04-15T20:51:50-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-04-15T20:51:50-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-05-25T17:22:37-07:00</lastmod></url><url><loc>/blog/b [...] \ No newline at end of file +<?xml version="1.0" encoding="utf-8" standalone="yes"?><urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9" xmlns:xhtml="http://www.w3.org/1999/xhtml"><url><loc>/blog/beam-2.29.0/</loc><lastmod>2021-04-15T20:51:50-07:00</lastmod></url><url><loc>/categories/blog/</loc><lastmod>2021-04-15T20:51:50-07:00</lastmod></url><url><loc>/blog/</loc><lastmod>2021-04-15T20:51:50-07:00</lastmod></url><url><loc>/categories/</loc><lastmod>2021-05-25T17:22:37-07:00</lastmod></url><url><loc>/blog/b [...] \ No newline at end of file