This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push: new 1116d93 Publishing website 2020/01/27 23:13:33 at commit fb5e0e6 1116d93 is described below commit 1116d935abe6bfa3d8ac3b82b92c9e701a20b258 Author: jenkins <bui...@apache.org> AuthorDate: Mon Jan 27 23:13:34 2020 +0000 Publishing website 2020/01/27 23:13:33 at commit fb5e0e6 --- .../documentation/runners/flink/index.html | 31 +++++++++++----------- 1 file changed, 16 insertions(+), 15 deletions(-) diff --git a/website/generated-content/documentation/runners/flink/index.html b/website/generated-content/documentation/runners/flink/index.html index 1e3081e..56b3f83 100644 --- a/website/generated-content/documentation/runners/flink/index.html +++ b/website/generated-content/documentation/runners/flink/index.html @@ -322,7 +322,7 @@ period.</p> <th>Artifact Id</th> </tr> <tr> - <td rowspan="3">2.17.0</td> + <td rowspan="3">2.17.0-2.18.0</td> <td>1.9.x</td> <td>beam-runners-flink-1.9</td> </tr> @@ -481,27 +481,30 @@ If you have a Flink <code class="highlighter-rouge">JobManager</code> running on <code class="highlighter-rouge">flinkMaster</code>. Otherwise an embedded Flink cluster will be started for the job. </span></p> -<p><span class="language-py"> -As of now you will need a copy of Apache Beam’s source code. You can -download it on the <a href="/get-started/downloads/">Downloads page</a>.</span></p> +<p><span class="language-py"></span></p> + +<p>Starting with Beam 2.18.0, pre-built Docker images are available at Docker Hub.</p> -<p>Pre-built Docker images are available at Docker-Hub: +<p>JobService: +<a href="https://hub.docker.com/r/apachebeam/flink1.7_job_server">Flink 1.7</a>, +<a href="https://hub.docker.com/r/apachebeam/flink1.8_job_server">Flink 1.8</a>, +<a href="https://hub.docker.com/r/apachebeam/flink1.9_job_server">Flink 1.9</a>.</p> + +<p>Beam SDK: <a href="https://hub.docker.com/r/apachebeam/python2.7_sdk">Python 2.7</a>, <a href="https://hub.docker.com/r/apachebeam/python3.5_sdk">Python 3.5</a>, <a href="https://hub.docker.com/r/apachebeam/python3.6_sdk">Python 3.6</a>, <a href="https://hub.docker.com/r/apachebeam/python3.7_sdk">Python 3.7</a>.</p> <p>To run a pipeline on an embedded Flink cluster: -</span></p> +<!-- Span implictly ended --></p> -<p><span class="language-py">1. Start the JobService endpoint: <code class="highlighter-rouge">./gradlew :runners:flink:1.9:job-server:runShadow</code> +<p><span class="language-py">1. Start the JobService endpoint: <code class="highlighter-rouge">docker run --net=host apachebeam/flink1.9_job_server:latest</code> </span></p> <p><span class="language-py"> The JobService is the central instance where you submit your Beam pipeline to. The JobService will create a Flink job for the pipeline and execute the job. -To execute the job on a Flink cluster, the Beam JobService needs to be -provided with the Flink JobManager address. </span></p> <p><span class="language-py">2. Submit the Python pipeline to the above endpoint by using the <code class="highlighter-rouge">PortableRunner</code>, <code class="highlighter-rouge">job_endpoint</code> set to <code class="highlighter-rouge">localhost:8099</code> (this is the default address of the JobService), and <code class="highlighter-rouge">environment_type</code> set to <code class="highlighter-rouge">LOOPBACK</code>. For example: @@ -520,13 +523,13 @@ provided with the Flink JobManager address. </code></pre></div></div> <p><span class="language-py"> -To run on a separate <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.8/tutorials/local_setup.html">Flink cluster</a>: +To run on a separate <a href="https://ci.apache.org/projects/flink/flink-docs-release-1.9/getting-started/tutorials/local_setup.html">Flink cluster</a>: </span></p> <p><span class="language-py">1. Start a Flink cluster which exposes the Rest interface on <code class="highlighter-rouge">localhost:8081</code> by default. </span></p> -<p><span class="language-py">2. Start JobService with Flink Rest endpoint: <code class="highlighter-rouge">./gradlew :runners:flink:1.9:job-server:runShadow -PflinkMasterUrl=localhost:8081</code>. +<p><span class="language-py">2. Start JobService with Flink Rest endpoint: <code class="highlighter-rouge">docker run --net=host apachebeam/flink1.9_job_server:latest --flink-master=localhost:8081</code>. </span></p> <p><span class="language-py">3. Submit the pipeline as above. @@ -535,7 +538,7 @@ See <a href="/roadmap/portability/#sdk-harness-config">here</a> for details. </span></p> <p><span class="language-py">Steps 2 and 3 can be automated in Python by using the <code class="highlighter-rouge">FlinkRunner</code>, -plus the optional <code class="highlighter-rouge">flink_version</code> and <code class="highlighter-rouge">flink_master</code>* options, e.g.: +plus the optional <code class="highlighter-rouge">flink_version</code> and <code class="highlighter-rouge">flink_master</code> options, e.g.: </span></p> <div class="language-py highlighter-rouge"><div class="highlight"><pre class="highlight"><code><span class="kn">import</span> <span class="nn">apache_beam</span> <span class="k">as</span> <span class="n">beam</span> @@ -543,7 +546,7 @@ plus the optional <code class="highlighter-rouge">flink_version</code> and <code <span class="n">options</span> <span class="o">=</span> <span class="n">PipelineOptions</span><span class="p">([</span> <span class="s">"--runner=FlinkRunner"</span><span class="p">,</span> - <span class="s">"--flink_version=1.8"</span><span class="p">,</span> + <span class="s">"--flink_version=1.9"</span><span class="p">,</span> <span class="s">"--flink_master=localhost:8081"</span><span class="p">,</span> <span class="s">"--environment_type=LOOPBACK"</span> <span class="p">])</span> @@ -551,8 +554,6 @@ plus the optional <code class="highlighter-rouge">flink_version</code> and <code <span class="o">...</span> </code></pre></div></div> -<p>* Note: For Beam versions < 2.17.0, use <code class="highlighter-rouge">flink_master_url</code> instead of <code class="highlighter-rouge">flink_master</code>.</p> - <h2 id="additional-information-and-caveats">Additional information and caveats</h2> <h3 id="monitoring-your-job">Monitoring your job</h3>