This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push: new 998226e Publishing website 2019/05/13 20:34:23 at commit abece47 998226e is described below commit 998226ec57c0f49d799591bd2430c2dbf021b9f8 Author: jenkins <bui...@apache.org> AuthorDate: Mon May 13 20:34:24 2019 +0000 Publishing website 2019/05/13 20:34:23 at commit abece47 --- .../contribute/release-guide/index.html | 12 +++---- .../documentation/dsls/sql/shell/index.html | 6 ++-- .../documentation/runners/flink/index.html | 6 ++-- .../documentation/sdks/java/euphoria/index.html | 4 +-- .../sdks/java/testing/nexmark/index.html | 40 +++++++++++----------- .../roadmap/portability/index.html | 8 ++--- 6 files changed, 38 insertions(+), 38 deletions(-) diff --git a/website/generated-content/contribute/release-guide/index.html b/website/generated-content/contribute/release-guide/index.html index 26895f1..0b42ee8 100644 --- a/website/generated-content/contribute/release-guide/index.html +++ b/website/generated-content/contribute/release-guide/index.html @@ -1356,31 +1356,31 @@ Thanks everyone! <p>Java Quickstart Validation</p> <p>Direct Runner:</p> - <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-runners-direct-java:runQuickstartJavaDirect \ + <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :runners:direct-java:runQuickstartJavaDirect \ -Prepourl=https://repository.apache.org/content/repositories/orgapachebeam-${KEY} \ -Pver=${RELEASE_VERSION} </code></pre> </div> <p>Apex Local Runner</p> - <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-runners-apex:runQuickstartJavaApex \ + <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :runners:apex:runQuickstartJavaApex \ -Prepourl=https://repository.apache.org/content/repositories/orgapachebeam${KEY} \ -Pver=${RELEASE_VERSION} </code></pre> </div> <p>Flink Local Runner</p> - <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-runners-flink_2.11:runQuickstartJavaFlinkLocal \ + <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :runners:flink:1.5:runQuickstartJavaFlinkLocal \ -Prepourl=https://repository.apache.org/content/repositories/orgapachebeam-${KEY} \ -Pver=${RELEASE_VERSION} </code></pre> </div> <p>Spark Local Runner</p> - <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-runners-spark:runQuickstartJavaSpark \ + <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :runners:spark:runQuickstartJavaSpark \ -Prepourl=https://repository.apache.org/content/repositories/orgapachebeam-${KEY} \ -Pver=${RELEASE_VERSION} </code></pre> </div> <p>Dataflow Runner</p> - <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-runners-google-cloud-dataflow-java:runQuickstartJavaDataflow \ + <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :runners:google-cloud-dataflow-java:runQuickstartJavaDataflow \ -Prepourl=https://repository.apache.org/content/repositories/orgapachebeam-${KEY} \ -Pver= ${RELEASE_VERSION}\ -PgcpProject=${YOUR_GCP_PROJECT} \ @@ -1414,7 +1414,7 @@ export GOOGLE_APPLICATION_CREDENTIALS=${PATH_TO_YOUR_KEY_JSON} </code></pre> </div> <p>Run</p> - <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-runners-google-cloud-dataflow-java:runMobileGamingJavaDataflow \ + <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :runners:google-cloud-dataflow-java:runMobileGamingJavaDataflow \ -Prepourl=https://repository.apache.org/content/repositories/orgapachebeam-${KEY} \ -Pver= ${RELEASE_VERSION}\ -PgcpProject=${YOUR_GCP_PROJECT} \ diff --git a/website/generated-content/documentation/dsls/sql/shell/index.html b/website/generated-content/documentation/dsls/sql/shell/index.html index fbeb9be..01d9bc7 100644 --- a/website/generated-content/documentation/dsls/sql/shell/index.html +++ b/website/generated-content/documentation/dsls/sql/shell/index.html @@ -278,7 +278,7 @@ limitations under the License. <p>To use Beam SQL shell, you must first clone the <a href="https://github.com/apache/beam">Beam SDK repository</a>. Then, from the root of the repository clone, execute the following commands to run the shell:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew -p sdks/java/extensions/sql/shell -Pbeam.sql.shell.bundled=':beam-runners-flink_2.11,:beam-sdks-java-io-kafka' installDist +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew -p sdks/java/extensions/sql/shell -Pbeam.sql.shell.bundled=':runners:flink:1.5,:sdks:java:io:kafka' installDist ./sdks/java/extensions/sql/shell/build/install/beam-sdks-java-extensions-sql-shell/bin/beam-sdks-java-extensions-sql-shell </code></pre> @@ -370,7 +370,7 @@ No rows affected (0.042 seconds) <li> <p>Make sure the SQL shell includes the desired runner. Add the corresponding project id to the <code class="highlighter-rouge">-Pbeam.sql.shell.bundled</code> parameter of the Gradle invocation (<a href="https://github.com/apache/beam/blob/master/sdks/java/extensions/sql/shell/build.gradle">source code</a>, <a href="https://github.com/apache/beam/blob/master/settings.gradle">project ids</a>). For example, use the following command to include Flink runner and KafkaIO:</p> - <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew -p sdks/java/extensions/sql/shell -Pbeam.sql.shell.bundled=':beam-runners-flink_2.11,:beam-sdks-java-io-kafka' installDist + <div class="highlighter-rouge"><pre class="highlight"><code>./gradlew -p sdks/java/extensions/sql/shell -Pbeam.sql.shell.bundled=':runners:flink:1.5,:sdks:java:io:kafka' installDist </code></pre> </div> @@ -399,7 +399,7 @@ No rows affected (0.042 seconds) <p>You can also build your own standalone package for SQL shell using <code class="highlighter-rouge">distZip</code> or <code class="highlighter-rouge">distTar</code> tasks. For example:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew -p sdks/java/extensions/sql/shell -Pbeam.sql.shell.bundled=':beam-runners-flink_2.11,:beam-sdks-java-io-kafka' distZip +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew -p sdks/java/extensions/sql/shell -Pbeam.sql.shell.bundled=':runners:flink:1.5,:sdks:java:io:kafka' distZip ls ./sdks/java/extensions/sql/shell/build/distributions/ beam-sdks-java-extensions-sql-shell-2.6.0-SNAPSHOT.tar beam-sdks-java-extensions-sql-shell-2.6.0-SNAPSHOT.zip diff --git a/website/generated-content/documentation/runners/flink/index.html b/website/generated-content/documentation/runners/flink/index.html index d7c21b3..7603f75 100644 --- a/website/generated-content/documentation/runners/flink/index.html +++ b/website/generated-content/documentation/runners/flink/index.html @@ -442,10 +442,10 @@ download it on the <a href="/get-started/downloads/">Downloads page</a>. In the available. </span></p> -<p><span class="language-py">1. <em>Only required once:</em> Build the SDK harness container: <code class="highlighter-rouge">./gradlew :beam-sdks-python-container:docker</code> +<p><span class="language-py">1. <em>Only required once:</em> Build the SDK harness container: <code class="highlighter-rouge">./gradlew :sdks:python:container:docker</code> </span></p> -<p><span class="language-py">2. Start the JobService endpoint: <code class="highlighter-rouge">./gradlew :beam-runners-flink_2.11-job-server:runShadow</code> +<p><span class="language-py">2. Start the JobService endpoint: <code class="highlighter-rouge">./gradlew :runners:flink:1.5:job-server:runShadow</code> </span></p> <p><span class="language-py"> @@ -475,7 +475,7 @@ To run on a separate <a href="https://ci.apache.org/projects/flink/flink-docs-re <p><span class="language-py">1. Start a Flink cluster which exposes the Rest interface on <code class="highlighter-rouge">localhost:8081</code> by default. </span></p> -<p><span class="language-py">2. Start JobService with Flink Rest endpoint: <code class="highlighter-rouge">./gradlew :beam-runners-flink_2.11-job-server:runShadow -PflinkMasterUrl=localhost:8081</code>. +<p><span class="language-py">2. Start JobService with Flink Rest endpoint: <code class="highlighter-rouge">./gradlew :runners:flink:1.5:job-server:runShadow -PflinkMasterUrl=localhost:8081</code>. </span></p> <p><span class="language-py">3. Submit the pipeline as above. diff --git a/website/generated-content/documentation/sdks/java/euphoria/index.html b/website/generated-content/documentation/sdks/java/euphoria/index.html index c38eeab..47dc379 100644 --- a/website/generated-content/documentation/sdks/java/euphoria/index.html +++ b/website/generated-content/documentation/sdks/java/euphoria/index.html @@ -405,11 +405,11 @@ the API as a high level DSL over Beam Java SDK and share our effort with the com <p>First step to build any operator is to give it a name through <code class="highlighter-rouge">named()</code> method. The name is propagated through system and can latter be used when debugging.</p> <h3 id="coders-and-types">Coders and Types</h3> -<p>Beam’s Java SDK requires developers to supply <code class="highlighter-rouge">Coder</code> for custom element type in order to have a way of materializing elements. Euphoria allows to use <a href="https://github.com/EsotericSoftware/kryo">Kryo</a> as a way of serialization. The <a href="https://github.com/EsotericSoftware/kryo">Kryo</a> is located in <code class="highlighter-rouge">:beam-sdks-java-extensions-kryo</code> module.</p> +<p>Beam’s Java SDK requires developers to supply <code class="highlighter-rouge">Coder</code> for custom element type in order to have a way of materializing elements. Euphoria allows to use <a href="https://github.com/EsotericSoftware/kryo">Kryo</a> as a way of serialization. The <a href="https://github.com/EsotericSoftware/kryo">Kryo</a> is located in <code class="highlighter-rouge">:sdks:java:extensions:kryo</code> module.</p> <div class="language-groovy highlighter-rouge"><pre class="highlight"><code><span class="c1">//gradle</span> <span class="n">dependencies</span> <span class="o">{</span> - <span class="n">compile</span> <span class="s2">"org.apache.beam:beam-sdks-java-extensions-kryo:${beam.version}"</span> + <span class="n">compile</span> <span class="s2">"org.apache.beam:sdks:java:extensions:kryo:${beam.version}"</span> <span class="o">}</span> </code></pre> </div> diff --git a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html index 922f701..3499be2 100644 --- a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html +++ b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html @@ -448,8 +448,8 @@ to this, the necessary dependencies must be configured.</p> The command line to pass to the Nexmark main program. -P nexmark.runner -The Gradle project name of the runner, such as ":beam-runners-direct-java" or -":beam-runners-flink. The project names can be found in the root +The Gradle project name of the runner, such as ":runners:direct-java" or +":runners:flink:1.5. The project names can be found in the root `settings.gradle`. </code></pre> </div> @@ -835,8 +835,8 @@ SMOKE suite can make sure there is nothing broken in the Nexmark suite.</p> <p>Batch Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-direct-java" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:direct-java" \ -Pnexmark.args=" --runner=DirectRunner --streaming=false @@ -850,8 +850,8 @@ SMOKE suite can make sure there is nothing broken in the Nexmark suite.</p> <p>Streaming Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-direct-java" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:direct-java" \ -Pnexmark.args=" --runner=DirectRunner --streaming=true @@ -871,8 +871,8 @@ configure logging.</p> <p>Batch Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-spark" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:spark" \ -Pnexmark.args=" --runner=SparkRunner --suite=SMOKE @@ -885,8 +885,8 @@ configure logging.</p> <p>Streaming Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-spark" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:spark" \ -Pnexmark.args=" --runner=SparkRunner --suite=SMOKE @@ -901,8 +901,8 @@ configure logging.</p> <p>Batch Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-flink_2.11" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:flink:1.5" \ -Pnexmark.args=" --runner=FlinkRunner --suite=SMOKE @@ -916,8 +916,8 @@ configure logging.</p> <p>Streaming Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-flink_2.11" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:flink:1.5" \ -Pnexmark.args=" --runner=FlinkRunner --suite=SMOKE @@ -933,8 +933,8 @@ configure logging.</p> <p>Batch Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-apex" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:apex" \ -Pnexmark.args=" --runner=ApexRunner --suite=SMOKE @@ -947,8 +947,8 @@ configure logging.</p> <p>Streaming Mode:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ - -Pnexmark.runner=":beam-runners-apex" \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ + -Pnexmark.runner=":runners:apex" \ -Pnexmark.args=" --runner=ApexRunner --suite=SMOKE @@ -972,7 +972,7 @@ PUBSUB_TOPCI=<existing pubsub topic> <p>Launch:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:run \ +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:run \ -Pnexmark.runner=":beam-runners-google-cloud-dataflow" \ -Pnexmark.args=" --runner=DataflowRunner @@ -1016,7 +1016,7 @@ PUBSUB_TOPCI=<existing pubsub topic> <p>Building package:</p> -<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :beam-sdks-java-nexmark:assemble +<div class="highlighter-rouge"><pre class="highlight"><code>./gradlew :sdks:java:testing:nexmark:assemble </code></pre> </div> diff --git a/website/generated-content/roadmap/portability/index.html b/website/generated-content/roadmap/portability/index.html index 2472ebb..f527b04 100644 --- a/website/generated-content/roadmap/portability/index.html +++ b/website/generated-content/roadmap/portability/index.html @@ -385,14 +385,14 @@ for details.</p> To run a basic Python wordcount (in batch mode) with embedded Flink or Spark:</p> <ol> - <li>Run once to build the SDK harness container: <code class="highlighter-rouge">./gradlew :beam-sdks-python-container:docker</code></li> + <li>Run once to build the SDK harness container: <code class="highlighter-rouge">./gradlew :sdks:python:container:docker</code></li> <li>Choose one: <ul> - <li>Start the Flink portable JobService endpoint: <code class="highlighter-rouge">./gradlew :beam-runners-flink_2.11-job-server:runShadow</code></li> - <li>Or start the Spark portable JobService endpoint: <code class="highlighter-rouge">./gradlew :beam-runners-spark-job-server:runShadow</code></li> + <li>Start the Flink portable JobService endpoint: <code class="highlighter-rouge">./gradlew :runners:flink:1.5:job-server:runShadow</code></li> + <li>Or start the Spark portable JobService endpoint: <code class="highlighter-rouge">./gradlew :runners:spark:job-server:runShadow</code></li> </ul> </li> - <li>Submit the wordcount pipeline to above endpoint: <code class="highlighter-rouge">./gradlew :beam-sdks-python:portableWordCount -PjobEndpoint=localhost:8099 -PenvironmentType=LOOPBACK</code></li> + <li>Submit the wordcount pipeline to above endpoint: <code class="highlighter-rouge">./gradlew :sdks:python:portableWordCount -PjobEndpoint=localhost:8099 -PenvironmentType=LOOPBACK</code></li> </ol> <p>To run the pipeline in streaming mode (currently only supported on Flink): <code class="highlighter-rouge">./gradlew :beam-sdks-python:portableWordCount -PjobEndpoint=localhost:8099 -Pstreaming</code></p>