This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git
commit e90fe6947fa8cf27051c82ef95b2b1aba40e7459 Author: Mergebot <merge...@apache.org> AuthorDate: Mon Jul 16 21:45:43 2018 +0000 Prepare repository for deployment. --- content/contribute/release-guide/index.html | 1 - content/documentation/programming-guide/index.html | 8 ++-- .../runners/capability-matrix/index.html | 52 +++++++++++----------- .../get-started/mobile-gaming-example/index.html | 2 +- 4 files changed, 31 insertions(+), 32 deletions(-) diff --git a/content/contribute/release-guide/index.html b/content/contribute/release-guide/index.html index 2ea2749..198d55a 100644 --- a/content/contribute/release-guide/index.html +++ b/content/contribute/release-guide/index.html @@ -682,7 +682,6 @@ git commit -m "Moving to ${NEXT_VERSION_IN_BASE_BRANCH}-SNAPSHOT on master branc <p>Update Java runner specific configurations in release branch:</p> <ul> <li><a href="https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/build.gradle">beam/runners/google-cloud-dataflow-java/build.gradle</a>: change value of ‘dataflow.container_version’ to ‘beam-release_version_number’(e.g, ‘beam-master-20180601’ to ‘beam-2.5.0’)</li> - <li><a href="https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/pom.xml">beam/runners/google-cloud-dataflow-java/pom.xml</a>: change value of ‘version’ field (e.g, ‘2.5.0-SNAPSHOT’ to ‘2.5.0’)</li> </ul> <h3 id="start-a-snapshot-build">Start a snapshot build</h3> diff --git a/content/documentation/programming-guide/index.html b/content/documentation/programming-guide/index.html index ac21bf4..466338e 100644 --- a/content/documentation/programming-guide/index.html +++ b/content/documentation/programming-guide/index.html @@ -392,14 +392,14 @@ read or write data to various external storage systems.</p> <p>A typical Beam driver program works as follows:</p> <ul> - <li>Create a <code class="highlighter-rouge">Pipeline</code> object and set the pipeline execution options, including + <li><strong>Create</strong> a <code class="highlighter-rouge">Pipeline</code> object and set the pipeline execution options, including the Pipeline Runner.</li> <li>Create an initial <code class="highlighter-rouge">PCollection</code> for pipeline data, either using the IOs to read data from an external storage system, or using a <code class="highlighter-rouge">Create</code> transform to build a <code class="highlighter-rouge">PCollection</code> from in-memory data.</li> - <li>Apply <strong>PTransforms</strong> to each <code class="highlighter-rouge">PCollection</code>. Transforms can change, filter, + <li><strong>Apply</strong> <code class="highlighter-rouge">PTransforms</code> to each <code class="highlighter-rouge">PCollection</code>. Transforms can change, filter, group, analyze, or otherwise process the elements in a <code class="highlighter-rouge">PCollection</code>. A -transform creates a new output <code class="highlighter-rouge">PCollection</code> <em>without consuming the input +transform creates a new output <code class="highlighter-rouge">PCollection</code> <em>without modifying the input collection</em>. A typical pipeline applies subsequent transforms to the each new output <code class="highlighter-rouge">PCollection</code> in turn until processing is complete. However, note that a pipeline does not have to be a single straight line of transforms applied @@ -1554,7 +1554,7 @@ of integers.</p> behavior is to return a <code class="highlighter-rouge">PCollection</code> containing one item. That item’s value comes from the accumulator in the combine function that you specified when applying <code class="highlighter-rouge">Combine</code>. For example, the Beam provided sum combine function returns -a zero value (the sum of an empty input), while the max combine function returns +a zero value (the sum of an empty input), while the min combine function returns a maximal or infinite value.</p> <p>To have <code class="highlighter-rouge">Combine</code> instead return an empty <code class="highlighter-rouge">PCollection</code> if the input is empty, diff --git a/content/documentation/runners/capability-matrix/index.html b/content/documentation/runners/capability-matrix/index.html index 7509698..b6e32f5 100644 --- a/content/documentation/runners/capability-matrix/index.html +++ b/content/documentation/runners/capability-matrix/index.html @@ -1570,7 +1570,7 @@ limitations under the License. </tr> <tr class="cap-summary"> - <th class="cap-summary color-capability format-capability" style="color:#ec3">Splittable DoFn</th> + <th class="cap-summary color-capability format-capability" style="color:#ec3">Splittable DoFn (SDF)</th> @@ -1592,7 +1592,7 @@ limitations under the License. - <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!-- + <td width="25%" class="cap-summary" style="background-color:#ec3;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -1605,12 +1605,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>~</b></center> +<center><b>✓</b></center> </td> - <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap-summary" style="background-color:#ec3;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -1623,12 +1623,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>✕</b></center> +<center><b>✓</b></center> </td> - <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -1641,12 +1641,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>✕</b></center> +<center><b>~</b></center> </td> - <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -1659,12 +1659,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>✕</b></center> +<center><b>~</b></center> </td> - <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -1677,7 +1677,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>✕</b></center> +<center><b>~</b></center> </td> @@ -1736,7 +1736,7 @@ limitations under the License. - <td width="25%" class="cap-summary" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap-summary" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -1749,7 +1749,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>✕</b></center> +<center><b>~</b></center> </td> </tr> @@ -6905,7 +6905,7 @@ limitations under the License. </tr> <tr class="cap"> - <th class="cap color-capability format-capability" style="color:#ec3">Splittable DoFn</th> + <th class="cap color-capability format-capability" style="color:#ec3">Splittable DoFn (SDF)</th> @@ -6927,7 +6927,7 @@ limitations under the License. - <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!-- + <td width="25%" class="cap" style="background-color:#ec3;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -6940,12 +6940,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>Partially: supported in streaming mode</b></center><br />Supports checkpointing (sequentially processing an element over several, potentially infinitely many calls). Does not yet support autotuning features of the Source API. +<center><b>Yes: </b></center><br />Does not yet support autotuning features of the Source API. </td> - <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap" style="background-color:#ec3;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -6958,12 +6958,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>No: implementation in streaming mode coming soon</b></center><br /> +<center><b>Yes: </b></center><br /> </td> - <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -6976,12 +6976,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>No: not implemented</b></center><br /> +<center><b>Partially: supports bounded-per-element SDFs</b></center><br /> </td> - <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -6994,12 +6994,12 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>No: implementation in streaming mode coming soon</b></center><br /> +<center><b>Partially: supports bounded-per-element SDFs</b></center><br />implementation in streaming mode coming soon </td> - <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -7012,7 +7012,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>No: not implemented</b></center><br /> +<center><b>Partially: supports bounded-per-element SDFs</b></center><br /> </td> @@ -7071,7 +7071,7 @@ limitations under the License. - <td width="25%" class="cap" style="background-color:#ddd;border-color:#ca1"><!-- + <td width="25%" class="cap" style="background-color:#fe5;border-color:#ca1"><!-- Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file except in compliance with the License. You may obtain a copy of the License at @@ -7084,7 +7084,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License. --> -<center><b>No: not implemented</b></center><br /> +<center><b>Partially: supports bounded-per-element SDFs</b></center><br /> </td> </tr> diff --git a/content/get-started/mobile-gaming-example/index.html b/content/get-started/mobile-gaming-example/index.html index 192b8a0..177cfe9 100644 --- a/content/get-started/mobile-gaming-example/index.html +++ b/content/get-started/mobile-gaming-example/index.html @@ -967,7 +967,7 @@ late results.</em></p> <p>Let’s suppose scoring in our game depends on the speed at which a user can “click” on their phone. <code class="highlighter-rouge">GameStats</code>’s abuse detection analyzes each user’s score data to detect if a user has an abnormally high “click rate” and thus an abnormally high score. This might indicate that the game is being played by a bot that operates significantly faster than a human could play.</p> -<p>To determine whether or not a score is “abnormally” high, <code class="highlighter-rouge">GameStats</code> calculates the average of every score in that fixed-time window, and then checks each score individual score against the average score multiplied by an arbitrary weight factor (in our case, 2.5). Thus, any score more than 2.5 times the average is deemed to be the product of spam. The <code class="highlighter-rouge">GameStats</code> pipeline tracks a list of “spam” users and filte [...] +<p>To determine whether or not a score is “abnormally” high, <code class="highlighter-rouge">GameStats</code> calculates the average of every score in that fixed-time window, and then checks each individual score against the average score multiplied by an arbitrary weight factor (in our case, 2.5). Thus, any score more than 2.5 times the average is deemed to be the product of spam. The <code class="highlighter-rouge">GameStats</code> pipeline tracks a list of “spam” users and filters tho [...] <p>Since the average depends on the pipeline data, we need to calculate it, and then use that calculated data in a subsequent <code class="highlighter-rouge">ParDo</code> transform that filters scores that exceed the weighted value. To do this, we can pass the calculated average to as a <a href="/documentation/programming-guide/#side-inputs">side input</a> to the filtering <code class="highlighter-rouge">ParDo</code>.</p>