[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 150f2687fc3cd37dcc5b7d5d1ded5508498d9546
Author: Mergebot 
AuthorDate: Tue Oct 16 15:14:35 2018 +

Prepare repository for deployment.
---
 .../io/built-in/google-bigquery/index.html | 1367 
 content/documentation/io/built-in/index.html   |4 +-
 2 files changed, 1369 insertions(+), 2 deletions(-)

diff --git a/content/documentation/io/built-in/google-bigquery/index.html 
b/content/documentation/io/built-in/google-bigquery/index.html
new file mode 100644
index 000..32820de
--- /dev/null
+++ b/content/documentation/io/built-in/google-bigquery/index.html
@@ -0,0 +1,1367 @@
+
+
+
+
+  
+
+
+  
+  
+  
+  Google BigQuery IO
+  
+  https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
+  
+  https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
+  
+  
+  
+  
+  
+  https://beam.apache.org/documentation/io/built-in/google-bigquery/; 
data-proofer-ignore>
+  
+  https://beam.apache.org/feed.xml;>
+  
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new 
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+  
+
+
+  
+
+
+
+
+  
+Toggle navigation
+
+
+
+  
+
+  
+
+  
+
+
+
+
+
+  
+
+  Get Started
+
+
+  Documentation
+
+
+  SDKS
+
+
+  RUNNERS
+
+
+  Contribute
+
+
+  Community
+
+Blog
+  
+  
+
+  https://www.apache.org/foundation/press/kit/feather_small.png; alt="Apache 
Logo" style="height:20px;">
+  
+http://www.apache.org/;>ASF Homepage
+http://www.apache.org/licenses/;>License
+http://www.apache.org/security/;>Security
+http://www.apache.org/foundation/thanks.html;>Thanks
+http://www.apache.org/foundation/sponsorship.html;>Sponsorship
+https://www.apache.org/foundation/policies/conduct;>Code of 
Conduct
+  
+
+  
+
+
+
+
+  
+
+
+  
+
+
+Documentation
+Using the Documentation
+Beam Execution Model
+
+  Pipeline development lifecycle
+
+  
+Design Your 
Pipeline
+Create Your 
Pipeline
+Test Your 
Pipeline
+  
+
+
+  Beam programming guide
+
+  
+Overview
+Pipelines
+
+  PCollections
+
+  
+Creating 
a PCollection
+PCollection
 characteristics
+  
+
+
+  Transforms
+
+  
+Applying 
transforms
+
+  Core Beam transforms
+
+  
+ParDo
+GroupByKey
+CoGroupByKey
+Combine
+Flatten
+Partition
+  
+
+
+Requirements
 for user code
+Side 
inputs
+Additional 
outputs
+Composite 
transforms
+  
+
+
+  Pipeline I/O
+
+  
+Using I/O 
transforms
+Built-in I/O 
transforms
+Authoring new I/O 
transforms
+Testing I/O 
transforms
+  
+
+
+  Data encoding and type safety
+
+  
+Data 
encoding basics
+Specifying 
coders
+Default
 coders and the CoderRegistry
+  
+
+
+  Windowing
+
+  
+Windowing 
basics
+Provided 
windowing functions
+Setting
 your PCollection’s windowing function
+Watermarks 
and late data
+Adding
 timestamps to a PCollection’s elements
+  
+
+
+  Triggers
+
+  
+Trigger 
basics
+Event time 
triggers and the default trigger
+Processing 
time triggers
+Data-driven 
triggers
+Setting a 
trigger
+Composite 
triggers
+  
+
+Additional Resources
+  
+
+
+  
+
+  
+
+  
+
+
+
+
+
+  Before you start
+  BigQuery basics
+
+  Table names
+  Table rows
+  Schemas
+
+  
+  Reading from BigQuery
+
+  Reading from a table
+  Reading with a query 
string
+
+  
+  Writing to BigQuery
+
+  Create disposition
+  Write disposition
+  Creating a table schema
+  Setting the insertion 
method
+  Writing to a table
+  Using dynamic 
destinations
+  Using time partitioning
+
+  
+  Limitations
+  Additional examples
+
+  Java cookbook examples
+  Java complete examples
+  Python cookbook 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 0c4dd7c3f9a08d0c4a92e5454de13347c1d8db00
Author: Mergebot 
AuthorDate: Wed Oct 10 18:11:16 2018 +

Prepare repository for deployment.
---
 content/community/contact-us/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/community/contact-us/index.html 
b/content/community/contact-us/index.html
index 21b26b0..af3b843 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/contact-us/index.html
@@ -226,7 +226,7 @@ whichever one seems best!
 
 
   https://s.apache.org/beam-slack-channel;>Slack
-  Chat with users and developers (https://s.apache.org/slack-invite;>Join)
+  Chat with users and developers on channel #beam (https://s.apache.org/slack-invite;>Join)
 
   
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit b1a61a48da7c38e4c4de86a9ab2ca5c6fadedc91
Author: Mergebot 
AuthorDate: Mon Oct 8 20:59:35 2018 +

Prepare repository for deployment.
---
 content/blog/2018/06/26/beam-2.5.0.html|  2 +-
 content/blog/2018/10/03/beam-2.7.0.html|  4 ++--
 content/blog/index.html|  2 +-
 content/contribute/dependencies/index.html |  2 +-
 content/contribute/index.html  |  2 +-
 content/contribute/release-guide/index.html|  3 +++
 content/contribute/runner-guide/index.html |  2 +-
 .../documentation/dsls/sql/create-external-table/index.html| 10 +-
 content/documentation/io/testing/index.html|  6 +++---
 content/feed.xml   |  6 +++---
 content/get-started/quickstart-java/index.html |  4 ++--
 content/get-started/quickstart-py/index.html   |  2 +-
 content/get-started/wordcount-example/index.html   |  2 +-
 13 files changed, 25 insertions(+), 22 deletions(-)

diff --git a/content/blog/2018/06/26/beam-2.5.0.html 
b/content/blog/2018/06/26/beam-2.5.0.html
index e054124..32a2531 100644
--- a/content/blog/2018/06/26/beam-2.5.0.html
+++ b/content/blog/2018/06/26/beam-2.5.0.html
@@ -165,7 +165,7 @@ please check the detailed release notes.
 New Features / Improvements
 
 Go SDK support
-The Go SDK has been officially accepted into the project, after an 
incubation period and community effort. Go pipelines run on Dataflow runner. 
More details are https://beam.apache.org/documentation/sdks/go/;>here.
+The Go SDK has been officially accepted into the project, after an 
incubation period and community effort. Go pipelines run on Dataflow runner. 
More details are here.
 
 Parquet support
 Support for Apache Parquet format was added. It uses Parquet 1.10 release 
which, thanks to AvroParquerWriter’s API changes, allows FileIO.Sink 
implementation.
diff --git a/content/blog/2018/10/03/beam-2.7.0.html 
b/content/blog/2018/10/03/beam-2.7.0.html
index df816da..9476ed0 100644
--- a/content/blog/2018/10/03/beam-2.7.0.html
+++ b/content/blog/2018/10/03/beam-2.7.0.html
@@ -159,7 +159,7 @@ limitations under the License.
 -->
 
 We are happy to present the new 2.7.0 release of Beam. This release 
includes both improvements and new functionality.
-See the https://beam.apache.org/get-started/downloads/#270-2018-10-02;>download 
page for this release.
+See the download page for 
this release.
 For more information on changes in 2.7.0, check out the
 https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12343654;>detailed
 release notes.
 
@@ -186,7 +186,7 @@ For more information on changes in 2.7.0, check out the
 
   Experimental support for Python on local Flink runner for simple
 examples, see latest information here:
-https://beam.apache.org/contribute/portability/#status.
+/contribute/portability/#status.
 
 
 Miscellaneous Fixes
diff --git a/content/blog/index.html b/content/blog/index.html
index ad88fa9..24639b1 100644
--- a/content/blog/index.html
+++ b/content/blog/index.html
@@ -159,7 +159,7 @@ limitations under the License.
 -->
 
 We are happy to present the new 2.7.0 release of Beam. This release 
includes both improvements and new functionality.
-See the https://beam.apache.org/get-started/downloads/#270-2018-10-02;>download 
page for this release.
+See the download page for 
this release.
 
 
 
diff --git a/content/contribute/dependencies/index.html 
b/content/contribute/dependencies/index.html
index 5a613d1..9d15b6b 100644
--- a/content/contribute/dependencies/index.html
+++ b/content/contribute/dependencies/index.html
@@ -304,7 +304,7 @@ limitations under the License.
 
 Dependency updates and 
backwards compatibility
 
-Beam releases https://beam.apache.org/get-started/downloads/;>adhere to semantic 
versioning. Hence, community members should take care when updating 
dependencies. Minor version updates to dependencies should be backwards 
compatible in most cases. Some updates to dependencies though may result in 
backwards incompatible API or functionality changes to Beam. PR reviewers and 
committers should take care to detect any dependency updates that could 
potentially introduce backwar [...]
+Beam releases adhere to semantic 
versioning. Hence, community members should take care when updating 
dependencies. Minor version updates to dependencies should be backwards 
compatible in most cases. Some updates to dependencies though may result in 
backwards incompatible API or functionality changes to Beam. PR reviewers and 
committers should take care to detect any dependency updates that could 
potentially introduce 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit c76fdb7cc9dbbada93708bbf1017e703549b8214
Author: Mergebot 
AuthorDate: Thu Oct 4 18:56:29 2018 +

Prepare repository for deployment.
---
 content/contribute/postcommits-policies/index.html | 3 +--
 1 file changed, 1 insertion(+), 2 deletions(-)

diff --git a/content/contribute/postcommits-policies/index.html 
b/content/contribute/postcommits-policies/index.html
index 275e837..44fa0db 100644
--- a/content/contribute/postcommits-policies/index.html
+++ b/content/contribute/postcommits-policies/index.html
@@ -261,8 +261,7 @@ community follows these post-commit test policies:
 I found a test failure
 
 
-  Create a https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20test-failures;>JIRA
 issue
-and assign it to yourself.
+  Create a https://s.apache.org/beam-test-failure;>JIRA issue 
and assign it to yourself.
   Do high level triage of the failure.
   Assign the 
JIRA issue to a relevant person.
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 214ffd0a73207c0ac49f27910963316869d7dea6
Author: Mergebot 
AuthorDate: Thu Oct 4 04:15:01 2018 +

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 2af7e88..5a0eec3 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -570,8 +570,9 @@ instructions.
 Attention: Only PMC has permission to perform this. If you 
are not a PMC, please ask for help in dev@ mailing list.
 
 
-  In JIRA, navigate to the https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions;>Beam  Administration  
Versions.
-  Add a new release: choose the next minor version number compared to the 
one currently underway, select today’s date as the Start Date, and choose Add.
+  In JIRA, navigate to https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions;>Beam  Administration  
Versions.
+  Add a new release. Choose the next minor version number after the 
version currently underway, select the release cut date (today’s date) as the 
Start Date, and choose Add.
+  At the end of the release, go to the same page and mark the recently 
released version as released. Use the ... menu and choose Release.
 
 
 Triage release-blocking issues 
in JIRA

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 5122163694da52d36c6ce7f7a943c7a141020ba8
Author: Mergebot 
AuthorDate: Wed Oct 3 20:03:19 2018 +

Prepare repository for deployment.
---
 .../2018/10/03/beam-2.7.0.html}| 287 +++--
 content/blog/index.html|  32 +++
 content/feed.xml   | 174 ++---
 content/get-started/downloads/index.html   |   2 +
 content/index.html |  10 +-
 5 files changed, 213 insertions(+), 292 deletions(-)

diff --git a/content/index.html b/content/blog/2018/10/03/beam-2.7.0.html
similarity index 56%
copy from content/index.html
copy to content/blog/2018/10/03/beam-2.7.0.html
index bf13aa1..df816da 100644
--- a/content/index.html
+++ b/content/blog/2018/10/03/beam-2.7.0.html
@@ -28,9 +28,8 @@
   
   
   
-  Apache Beam
-  
+  Apache Beam 2.7.0
+  
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
   
   https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
@@ -39,7 +38,7 @@
   
   
   
-  https://beam.apache.org/; data-proofer-ignore>
+  https://beam.apache.org/blog/2018/10/03/beam-2.7.0.html; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   
@@ -52,7 +51,7 @@
   
 
 
-  
+  
 
+
+
+
+http://schema.org/BlogPosting;>
+
+  
+Apache Beam 2.7.0
+Oct 3, 2018 •
+   Charles Chen 
+  
+
+  
+
+  
+
-
-  
-
-  
-
-  
-Apache Beam: An advanced unified programming model
-  
-  
-Implement batch and streaming data processing jobs that run on any 
execution engine.
-  
-  
-Learn more
-Download Beam SDK 2.7.0
-  
-  
-Java 
Quickstart
-Python 
Quickstart
-   Go 
Quickstart
-  
-
-  
-  
-
-  
-The latest from the blog
-  
-  
-
-
-  Beam Summit Europe 
2018
-  Aug 21, 2018
-
-
-
-  A review of input 
streaming connectors
-  Aug 20, 2018
-
-
-
-  Apache Beam 
2.6.0
-  Aug 10, 2018
-
-
-  
-
-  
-
-  
-
 
-
-  
-All about Apache Beam
-  
-  
-
-
-  
-Unified
-  
-  
-Use a single programming model for both batch and streaming use cases.
-  
-
-
-
-  
-Portable
-  
-  
-Execute pipelines on multiple execution environments.
-  
-
-
-
-  
-Extensible
-  
-  
-Write and share new SDKs, IO connectors, and transformation libraries.
-  
-
-
-  
-
+We are happy to present the new 2.7.0 release of Beam. This release 
includes both improvements and new functionality.
+See the https://beam.apache.org/get-started/downloads/#270-2018-10-02;>download 
page for this release.
+For more information on changes in 2.7.0, check out the
+https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12343654;>detailed
 release notes.
 
-
-
-
-
-
+New Features / Improvements
 
-
-  
-Works with
-  
-  
-
-
-  http://apex.apache.org;>
-
-
-
-  http://flink.apache.org;>
-
-
-
-  http://spark.apache.org/;>
-
-
-
-  https://cloud.google.com/dataflow/;>
-
-
-
-  http://gearpump.apache.org/;>
-
-
-
-  http://samza.apache.org/;>
-
-
-  
-
+New I/Os
 
-
-  
-
-  Testimonials
-
-
-  
-  
-
-  A framework that delivers the flexibility and advanced functionality 
our customers need.
-
-
-  
-  
-–Talend
-  
-
-  
-  
-  
-
-  Apache Beam has powerful semantics that solve real-world challenges 
of stream processing.
-
-
-  
-  
-–PayPal
-  
-
-  
-  
-  
-
-  Apache Beam represents a principled approach for analyzing data 
streams.
-
-
-  
-  
-–data Artisans
-  
-
-  
-  
-
-
-  Beam is an open source community and contributions are greatly 
appreciated!
-  If you’d like to contribute, please see the Contribute section.
-
-  
-
+
+  KuduIO
+  Amazon SNS sink
+  Amazon SqsIO
+
+
+Dependency Upgrades
+
+
+  Apache Calcite dependency upgraded to 1.17.0
+  Apache Derby dependency upgraded to 10.14.2.0
+  Apache HTTP components upgraded (see release notes).
+
+

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 3a5943e7bdbeefb881999ca1d91d7c08d2233b3e
Author: Mergebot 
AuthorDate: Wed Oct 3 19:55:57 2018 +

Prepare repository for deployment.
---
 content/contribute/testing/index.html | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/content/contribute/testing/index.html 
b/content/contribute/testing/index.html
index 2c27a71..a616019 100644
--- a/content/contribute/testing/index.html
+++ b/content/contribute/testing/index.html
@@ -336,13 +336,13 @@ desired configurations.
 NeedsRunner is a category of tests that require a Beam runner. To run
 NeedsRunner tests:
 
-$ ./gradlew 
:runners:direct-java:needsRunnerTests
+$ ./gradlew 
beam-runners-direct-java:needsRunnerTests
 
 
 
 To run a single NeedsRunner test use the test property, e.g.
 
-$ ./gradlew 
:runners:direct-java:needsRunnerTests --tests 
org.apache.beam.sdk.transforms.MapElementsTest.testMapBasic
+$ ./gradlew 
beam-runners-direct-java:needsRunnerTests --tests 
org.apache.beam.sdk.transforms.MapElementsTest.testMapBasic
 
 
 
@@ -352,7 +352,7 @@ NeedsRunner tests:
 sdks/java/io/google-cloud-platform) can 
be executed with the gradle test
 command:
 
-$ ./gradlew 
sdks:java:io:google-cloud-platform:test --tests 
org.apache.beam.sdk.io.gcp.spanner.SpannerIOWriteTest
+$ ./gradlew 
beam-sdks-java-io-google-cloud-platform:test --tests 
org.apache.beam.sdk.io.gcp.spanner.SpannerIOWriteTest
 
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit ad9a0859c3b6dad3e860e89cb56e0769b731fda8
Author: Mergebot 
AuthorDate: Wed Oct 3 19:22:45 2018 +

Prepare repository for deployment.
---
 content/documentation/dsls/sql/select/index.html | 825 +--
 1 file changed, 784 insertions(+), 41 deletions(-)

diff --git a/content/documentation/dsls/sql/select/index.html 
b/content/documentation/dsls/sql/select/index.html
index b35adca..a07cd08 100644
--- a/content/documentation/dsls/sql/select/index.html
+++ b/content/documentation/dsls/sql/select/index.html
@@ -222,6 +222,75 @@
 
 
 
+
+  SQL Syntax
+  SELECT list
+
+  SELECT *
+  SELECT expression
+  SELECT expression.*
+  SELECT modifiers
+  Aliases
+
+  
+  FROM clause
+
+  Syntax
+  Subqueries
+  Aliases
+
+  
+  JOIN types
+
+  Syntax
+  [INNER] JOIN
+  CROSS JOIN
+  FULL [OUTER] JOIN
+  LEFT [OUTER] JOIN
+  RIGHT [OUTER] JOIN
+  ON clause
+  USING clause
+  Sequences of JOINs
+
+  
+  WHERE clause
+
+  Syntax
+
+  
+  GROUP BY clause
+
+  Syntax
+
+  
+  HAVING clause
+
+  Syntax
+
+  
+  Set operators
+
+  Syntax
+  UNION
+  INTERSECT
+  EXCEPT
+
+  
+  LIMIT clause and OFFSET 
clause
+
+  Syntax
+
+  
+  WITH clause
+  Aliases
+
+  Explicit alias syntax
+  Explicit alias 
visibility
+  Ambiguous aliases
+  Implicit aliases
+
+  
+
 
 
   
@@ -256,62 +325,736 @@ batch/streaming model:
   Windowing 
 Triggering
 
 
-Below is a curated grammar of the supported syntax in Beam SQL
+Query statements scan one or more tables or expressions and return the 
computed
+result rows. This topic describes the syntax for SQL queries in Beam.
+
+SQL Syntax
 
-query:
-   {
-  select
-  |   query UNION [ ALL ] query
-  |   query MINUS [ ALL ] query
-  |   query INTERSECT [ ALL ] query
-   }
-[ ORDER BY orderItem [, orderItem ]* LIMIT count [OFFSET offset] ]
+query_statement:
+[ WITH with_query_name AS ( query_expr ) [, ...] ]
+query_expr
 
-orderItem:
-  expression [ ASC | DESC ]
+query_expr:
+{ select | ( query_expr ) | query_expr set_op query_expr }
+[ LIMIT count [ OFFSET skip_rows ] ]
 
 select:
-  SELECT
-  { * | projectItem [, projectItem ]* }
-  FROM tableExpression
-  [ WHERE booleanExpression ]
-  [ GROUP BY { groupItem [, groupItem ]* } ]
-  [ HAVING booleanExpression ]
+SELECT  [{ ALL | DISTINCT }]
+{ [ expression. ]* [ EXCEPT ( column_name [, ...] ) ]
+[ REPLACE ( expression [ AS ] column_name [, ...] ) ]
+| expression [ [ AS ] alias ] } [, ...]
+[ FROM from_item  [, ...] ]
+[ WHERE bool_expression ]
+[ GROUP BY { expression [, ...] | ROLLUP ( expression [, ...] ) } ]
+[ HAVING bool_expression ]
+
+set_op:
+UNION { ALL | DISTINCT } | INTERSECT DISTINCT | EXCEPT DISTINCT
+
+from_item: {
+table_name [ [ AS ] alias ] |
+join |
+( query_expr ) [ [ AS ] alias ]
+with_query_name [ [ AS ] alias ]
+}
+
+join:
+from_item [ join_type ] JOIN from_item
+[ { ON bool_expression | USING ( join_column [, ...] ) } ]
+
+join_type:
+{ INNER | CROSS | FULL [OUTER] | LEFT [OUTER] | RIGHT [OUTER] }
+
+
+
+Notation:
+
+
+  Square brackets “[ ]” indicate optional clauses.
+  Parentheses “( )” indicate literal parentheses.
+  
+
+  
+
+  The vertical bar “
+  ” indicates a logical OR.
+
+  
+
+  
+  Curly braces “{ }” enclose a set of options.
+  A comma followed by an ellipsis within square brackets “[, … ]”
+indicates that the preceding item can repeat in a comma-separated list.
+
+
+SELECT list
+
+Syntax:
+
+SELECT  [{ ALL | 
DISTINCT }]
+{ [ expression. ]*
+| expression [ [ AS ] alias ] } [, ...]
+
+
+
+The SELECT list defines the columns 
that the query will return. Expressions in
+the SELECT list can refer to columns in 
any of the from_items in its
+corresponding FROM clause.
+
+Each item in the SELECT list is one 
of:
+
+
+  *
+  expression
+  expression.*
+
+
+SELECT *
+
+SELECT *, often referred to as 
select star, produces one output column for
+each column that is visible after executing the full query.
+
+SELECT * FROM 
(SELECT 'apple' AS fruit, 'carrot' AS vegetable);
+
++---+---+
+| fruit | vegetable |
++---+---+
+| apple | carrot|
++---+---+
+
+
+
+SELECT expression
+
+Items in a SELECT list can be 
expressions. These expressions evaluate to a
+single value and produce one output column, with an optional explicit alias.
+
+If the expression does not have an explicit alias, it receives an implicit 
alias
+according to the rules for implicit aliases, 
if possible.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit fb27d25e53e157a5297258308f46529d2c8e036e
Author: Mergebot 
AuthorDate: Wed Oct 3 17:29:22 2018 +

Prepare repository for deployment.
---
 content/contribute/dependencies/index.html | 22 +-
 1 file changed, 13 insertions(+), 9 deletions(-)

diff --git a/content/contribute/dependencies/index.html 
b/content/contribute/dependencies/index.html
index dd97540..5a613d1 100644
--- a/content/contribute/dependencies/index.html
+++ b/content/contribute/dependencies/index.html
@@ -200,7 +200,7 @@
 
 
   Identifying outdated 
dependencies
-  JIRA Automation
+  JIRA Issue Automation
   Upgrading 
identified outdated dependencies
   Dependency 
updates and backwards compatibility
 
@@ -259,17 +259,21 @@ limitations under the License.
 
 These kind of urgently required upgrades might not get automatically picked 
up by the Jenkins job for few months. So Beam community has to act to identify 
such issues and perform upgrades early.
 
-JIRA Automation
+JIRA Issue Automation
 
 In order to track the dependency upgrade process, JIRA tickets will be 
created per significant outdated dependency based on the report. A bot named 
Beam Jira Bot was created for managing JIRA issues. Beam community 
agrees on the following policies that creates and updates issues.
 
-  Issues will be named as “Beam Dependency Update Request:  
".
-  Issues will be created under the component “dependencies”
-  Issues will be assigned to the primary owner of the dependencies, who 
are mentioned in the dependency ownership files. (https://github.com/apache/beam/blob/master/ownership/JAVA_DEPENDENCY_OWNERS.yaml;>Java
 Dependency Owners and https://github.com/apache/beam/blob/master/ownership/PYTHON_DEPENDENCY_OWNERS.yaml;>Python
 Dependency Owners)
-  If more than one owners found for a dependency, the first owner will be 
picked as the primary owner, the others will be pinged in the issue’s 
description.
-  If no owners found, leave the assignee empty. The component lead is 
responsible for triaging the issue.
-  Avoid creating duplicate issues. Updating the descriptions of the open 
issues created by the previous dependency check.
-  The dependency sometimes is not able to be upgraded, the issue should be 
closed as “won’t fix”. And, the bot should avoid recreating issues 
with “won’t fix”.
+  Title (summary) of the issues will be in the format “Beam Dependency 
Update Request: " where  is the dependency artifact 
name.
+  Issues will be created under the component “dependencies”.
+  Owners of dependencies will be notified by tagging the corresponding 
JIRA IDs mentioned in the ownership files in the issue description. See https://github.com/apache/beam/blob/master/ownership/JAVA_DEPENDENCY_OWNERS.yaml;>Java
 Dependency Owners and https://github.com/apache/beam/blob/master/ownership/PYTHON_DEPENDENCY_OWNERS.yaml;>Python
 Dependency Owners for current owners for Java SDK and Python SDK 
dependencies respectively.
+  Automated tool will not create duplicate issues for the same dependency. 
Instead the tool will look for an existing JIRA when one has to be created for 
a given dependency and description of the JIRA will be updated with latest 
information, for example, current version of the dependency.
+  If a Beam community member determines that a given dependency should not 
be upgraded the corresponding JIRA issue can be closed with a fix version 
specified.
+  Automated tool will reopen a JIRA for a given dependency when one of 
following conditions is met:
+
+  Next SDK release is for a fix version mentioned in the JIRA.
+  Six months and three or more minor releases have 
passed since the JIRA was closed.
+
+  
 
 
 Upgrading identified 
outdated dependencies

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit b62563db8243e26a194868c07a47251fd5c0591a
Author: Mergebot 
AuthorDate: Wed Oct 3 17:26:05 2018 +

Prepare repository for deployment.
---
 content/get-started/downloads/index.html | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/content/get-started/downloads/index.html 
b/content/get-started/downloads/index.html
index 7a1ca7d..ef1648f 100644
--- a/content/get-started/downloads/index.html
+++ b/content/get-started/downloads/index.html
@@ -276,9 +276,9 @@ versions denoted 0.x.y.
 Releases
 
 2.6.0 (2018-08-08)
-Official https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip;>source
 code download
-https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512;>SHA-512
-https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip.asc;>signature.
+Official https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip;>source
 code download
+https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512;>SHA-512
+https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.asc;>signature.
 
 https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12343392;>Release
 notes.
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 87fb41e690d2196528de6230d54cf103f451c2b6
Author: Mergebot 
AuthorDate: Wed Sep 26 21:49:08 2018 +

Prepare repository for deployment.
---
 content/contribute/index.html  | 2 +-
 content/documentation/programming-guide/index.html | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index f4a3af3..099c100 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -618,7 +618,7 @@ When submitting a new PR, please tag https://github.com/robbesneyders;>
 Work to support the next LTS release of Java is in progress. For more 
details about the scope and info on the various tasks please see the JIRA 
ticket.
 
 
-  JIRA: https://issues.apache.org/jira/issues/BEAM-2530;>BEAM-2530
+  JIRA: https://issues.apache.org/jira/browse/BEAM-2530;>BEAM-2530
   Contact: mailto:ieme...@gmail.com;>Ismaël Mejía
 
 
diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index eb7ccb6..ea57f77 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -2902,7 +2902,7 @@ least 10 minutes:
 
 from apache_beam import window
 session_windowed_items = (
-items | 'window'  beam.WindowInto(window.Sessions(10)))
+items | 'window'  beam.WindowInto(window.Sessions(10 
* 60)))
 
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 0d2d038b60e2eba5378963bf429a058b39018726
Author: Mergebot 
AuthorDate: Tue Sep 25 18:04:29 2018 +

Prepare repository for deployment.
---
 content/get-started/quickstart-go/index.html | 3 +++
 content/get-started/wordcount-example/index.html | 9 +
 2 files changed, 12 insertions(+)

diff --git a/content/get-started/quickstart-go/index.html 
b/content/get-started/quickstart-go/index.html
index 8a2435a..dbfae68 100644
--- a/content/get-started/quickstart-go/index.html
+++ b/content/get-started/quickstart-go/index.html
@@ -245,11 +245,14 @@ $ wordcount --input PATH_TO_INPUT_FILE --output 
counts
 
 
 $ 
go install github.com/apache/beam/sdks/go/examples/wordcount
+# As part of the initial setup, for non linux users - install package unix 
before run
+$ go get -u golang.org/x/sys/unix
 $ wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \
 --output gs://your-gcs-bucket/counts \
 --runner dataflow \
 --project your-gcp-project \
 --temp_location gs://your-gcs-bucket/tmp/ \
+--staging_location gs://your-gcs-bucket/binaries/ \
 
--worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515
 
 
diff --git a/content/get-started/wordcount-example/index.html 
b/content/get-started/wordcount-example/index.html
index 0b8d502..7878541 100644
--- a/content/get-started/wordcount-example/index.html
+++ b/content/get-started/wordcount-example/index.html
@@ -689,11 +689,14 @@ $ wordcount --input PATH_TO_INPUT_FILE --output 
counts
 
 
 $ 
go install github.com/apache/beam/sdks/go/examples/wordcount
+# As part of the initial setup, for non linux users - install package unix 
before run
+$ go get -u golang.org/x/sys/unix
 $ wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \
 --output gs://your-gcs-bucket/counts \
 --runner dataflow \
 --project your-gcp-project \
 --temp_location gs://your-gcs-bucket/tmp/ \
+--staging_location gs://your-gcs-bucket/binaries/ \
 
--worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515
 
 
@@ -1009,11 +1012,14 @@ $ debugging_wordcount --input 
PATH_TO_INPUT_FILE --output counts
 
 
 $ 
go install github.com/apache/beam/sdks/go/examples/debugging_wordcount
+# As part of the initial setup, for non linux users - install package unix 
before run
+$ go get -u golang.org/x/sys/unix
 $ debugging_wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \
   --output gs://your-gcs-bucket/counts \
   --runner dataflow \
   --project your-gcp-project \
   --temp_location gs://your-gcs-bucket/tmp/ \
+  --staging_location 
gs://your-gcs-bucket/binaries/ \
   
--worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515
 
 
@@ -1343,11 +1349,14 @@ $ windowed_wordcount --input PATH_TO_INPUT_FILE 
--output counts
 
 
 $ 
go install github.com/apache/beam/sdks/go/examples/windowed_wordcount
+# As part of the initial setup, for non linux users - install package unix 
before run
+$ go get -u golang.org/x/sys/unix
 $ windowed_wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \
 --output gs://your-gcs-bucket/counts \
 --runner dataflow \
 --project your-gcp-project \
 --temp_location gs://your-gcs-bucket/tmp/ \
+--staging_location gs://your-gcs-bucket/binaries/ \
 
--worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e5d9fe360dde8fbfb784f921bfb9c8bd9b7111e7
Author: Mergebot 
AuthorDate: Tue Sep 25 15:08:51 2018 +

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index a2cb0ec..2af7e88 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -723,7 +723,7 @@ sed -i -e "s/'beam-master-.*'/'beam-${RELEASE}'/g" 
runners/google-cloud-dataflow
 
 Start a snapshot build
 
-Start a build of https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_NightlySnapshot/;>the
 nightly snapshot against master branch.
+Start a build of https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_Gradle_NightlySnapshot/;>the
 nightly snapshot against master branch.
 Some processes, including our archetype tests, rely on having a live SNAPSHOT 
of the current version
 from the master branch. Once the 
release branch is cut, these SNAPSHOT versions are no longer found,
 so builds will be broken until a new snapshot is available.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 7e2601bc6c819f922f34b1f29e573015c03eb3ea
Author: Mergebot 
AuthorDate: Mon Sep 24 22:23:22 2018 +

Prepare repository for deployment.
---
 content/contribute/index.html  | 2 +-
 content/documentation/programming-guide/index.html | 1 +
 2 files changed, 2 insertions(+), 1 deletion(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index 1d30ae8..f4a3af3 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -300,7 +300,7 @@ to ask to be added as a contributor in the Beam issue 
tracker.
 https://github.com/apache/beam;>https://github.com/apache/beam. To
 contribute, follow the usual GitHub process: fork the repo, make your changes,
 and open a pull request and @mention a reviewer. If you have more than one 
commit
-in your change, you many be asked to rebase and squash the commits.
+in your change, you may be asked to rebase and squash the commits.
 If you are unfamiliar with this workflow, GitHub maintains these helpful 
guides:
 
 
diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index eb8719b..eb7ccb6 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -1845,6 +1845,7 @@ determined by the input data, or depend on a different 
branch of your pipeline.<
   PCollectionString wordsBelowCutOff =
   words.apply(ParDo
   .of(new DoFnString, 
String() {
+  @ProcessElement
   public void processElement(@Element String word, OutputReceiverString out, ProcessContext c// In our DoFn, access the side input.
 int lengthCutOff 
= c.sideInput(maxWordLengthCutOffView);

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 6f2163a50e0e08d2bce5fa780d25e785dff02e4a
Author: Mergebot 
AuthorDate: Mon Sep 24 20:56:25 2018 +

Prepare repository for deployment.
---
 content/documentation/programming-guide/index.html | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index 6093382..eb8719b 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -2873,12 +2873,12 @@ into fixed windows, each one minute in length:
 7.3.2. Sliding time windows
 
 The following example code shows how to apply Window to divide a PCollection
-into sliding time windows. Each window is 30 minutes in length, and a new 
window
+into sliding time windows. Each window is 30 seconds in length, and a new 
window
 begins every five seconds:
 
 
PCollectionString items 
= ...;
 PCollectionString slidingWindowedItems = items.apply(
-Window.Stringinto(SlidingWindows.of(Duration.standardMinutes(30)).everyWindow.Stringinto(SlidingWindows.of(Duration.standardSeconds(30)).every
 
 from apache_beam import window

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit ef7b80dff9533acf57dcf5cb0aea889f1b455df7
Author: Mergebot 
AuthorDate: Mon Sep 24 17:27:41 2018 +

Prepare repository for deployment.
---
 content/get-started/wordcount-example/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/get-started/wordcount-example/index.html 
b/content/get-started/wordcount-example/index.html
index 82f3bd0..0b8d502 100644
--- a/content/get-started/wordcount-example/index.html
+++ b/content/get-started/wordcount-example/index.html
@@ -1319,7 +1319,7 @@ python -m apache_beam.examples.windowed_wordcount --input 
YOUR_INPUT_FILE \
 To view the full code in Python, see
 https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/windowed_wordcount.py;>windowed_wordcount.py.
 
-To run this example in Python:
+To run this example in Go:
 
 $ go 
install github.com/apache/beam/sdks/go/examples/windowed_wordcount
 $ windowed_wordcount --input PATH_TO_INPUT_FILE --output counts

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 70bdfaf46c74a0feab03946ac512b9c5e4712c8b
Author: Mergebot 
AuthorDate: Thu Sep 20 23:18:36 2018 +

Prepare repository for deployment.
---
 content/blog/2018/06/26/beam-2.5.0.html| 16 +-
 content/blog/2018/08/10/beam-2.6.0.html| 16 +-
 .../08/20/review-input-streaming-connectors.html   | 16 +-
 content/blog/2018/08/21/beam-summit-europe.html| 16 +-
 content/blog/index.html| 56 +++
 content/community/youtube-channel/index.html   | 16 +-
 content/documentation/dsls/sql/lexical/index.html  | 16 +-
 .../documentation/io/built-in/hcatalog/index.html  | 16 +-
 content/documentation/runners/samza/index.html | 16 +-
 content/feed.xml   | 64 --
 10 files changed, 236 insertions(+), 12 deletions(-)

diff --git a/content/blog/2018/06/26/beam-2.5.0.html 
b/content/blog/2018/06/26/beam-2.5.0.html
index 562cf68..e054124 100644
--- a/content/blog/2018/06/26/beam-2.5.0.html
+++ b/content/blog/2018/06/26/beam-2.5.0.html
@@ -144,7 +144,21 @@
   
 
   
-We are glad to present the new 2.5.0 release of Beam. This release 
includes
+
+
+We are glad to present the new 2.5.0 release of Beam. This release includes
 multiple fixes and new functionalities.  For more information
 please check the detailed release notes.
 
diff --git a/content/blog/2018/08/10/beam-2.6.0.html 
b/content/blog/2018/08/10/beam-2.6.0.html
index dc4b766..9c80b96 100644
--- a/content/blog/2018/08/10/beam-2.6.0.html
+++ b/content/blog/2018/08/10/beam-2.6.0.html
@@ -144,7 +144,21 @@
   
 
   
-We are glad to present the new 2.6.0 release of Beam.
+
+
+We are glad to present the new 2.6.0 release of Beam.
 This release includes multiple fixes and new functionality, such as new 
features in SQL and portability.
 We also spent a significant amount of time automating the release and fixing 
continuous integration. For more information, check the
 https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12343392;>release
 notes.
diff --git a/content/blog/2018/08/20/review-input-streaming-connectors.html 
b/content/blog/2018/08/20/review-input-streaming-connectors.html
index 1bdde6d..2e9c8bb 100644
--- a/content/blog/2018/08/20/review-input-streaming-connectors.html
+++ b/content/blog/2018/08/20/review-input-streaming-connectors.html
@@ -144,7 +144,21 @@
   
 
   
-In this post, you’ll learn about the current state of support for input 
streaming connectors in Apache Beam. For more context, you’ll 
also learn about the corresponding state of support in https://spark.apache.org/;>Apache Spark.
+
+
+In this post, you’ll learn about the current state of support for input 
streaming connectors in Apache Beam. For more context, you’ll 
also learn about the corresponding state of support in https://spark.apache.org/;>Apache Spark.
 
 With batch processing, you might load data from any source, including a 
database system. Even if there are no specific SDKs available for those 
database systems, you can often resort to using a https://en.wikipedia.org/wiki/Java_Database_Connectivity;>JDBC 
driver. With streaming, implementing a proper data pipeline is arguably more 
challenging as generally fewer source types are available. For that reason, 
this article particularly focuses on the streaming use case.
 
diff --git a/content/blog/2018/08/21/beam-summit-europe.html 
b/content/blog/2018/08/21/beam-summit-europe.html
index db5f28c..2b59791 100644
--- a/content/blog/2018/08/21/beam-summit-europe.html
+++ b/content/blog/2018/08/21/beam-summit-europe.html
@@ -144,7 +144,21 @@
   
 
   
-With a growing community of contributors and users, the Apache Beam 
project is organising the first European Beam Summit.
+
+
+With a growing community of contributors and users, the Apache Beam project 
is organising the first European Beam Summit.
 
 We are happy to invite you to this event, which will take place in 
London on October 1st and 2nd of 2018. 

 
diff --git a/content/blog/index.html b/content/blog/index.html
index 23508c8..f3c8774 100644
--- a/content/blog/index.html
+++ b/content/blog/index.html
@@ -144,6 +144,20 @@ for the project.
  Matthias Baetens [https://twitter.com/matthiasbaetens;>@matthiasbaetens]
 
 
+
+
 With a growing community of contributors and users, the Apache Beam project 
is organising the first European Beam Summit.
 
 We are happy to invite you to this event, which will take place in 
London on October 1st and 2nd of 2018.
@@ -163,6 +177,20 @@ Read more<
  Leonid Kuligin [https://twitter.com/lkulighin;>@lkulighin]  
Julien Phalip [https://twitter.com/julienphalip;>@julienphalip]
 
 
+
+
 In this post, you’ll learn about the current state of support 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit c427295a6ab1e611352bdb6935e7102dcd957c2b
Author: Mergebot 
AuthorDate: Tue Sep 18 16:46:04 2018 +

Prepare repository for deployment.
---
 content/documentation/runners/flink/index.html | 50 +++---
 1 file changed, 38 insertions(+), 12 deletions(-)

diff --git a/content/documentation/runners/flink/index.html 
b/content/documentation/runners/flink/index.html
index 4add34a..84e579b 100644
--- a/content/documentation/runners/flink/index.html
+++ b/content/documentation/runners/flink/index.html
@@ -168,6 +168,7 @@
 
   Flink Runner 
prerequisites and setup
 
+  Version Compatibility
   Specify your dependency
 
   
@@ -200,6 +201,8 @@ limitations under the License.
 -->
 Using the Apache Flink Runner
 
+The old Flink Runner will eventually be replaced by the Portable Runner 
which enables to run pipelines in other languages than Java. Please see the Portability page for the latest state.
+
 
   Adapt for:
   
@@ -227,27 +230,50 @@ limitations under the License.
 
 If you want to use the local execution mode with the Flink runner to don’t 
have to complete any setup.
 
-To use the Flink Runner for executing on a cluster, you have to setup a 
Flink cluster by following the Flink https://ci.apache.org/projects/flink/flink-docs-release-1.1/quickstart/setup_quickstart.html;>setup
 quickstart.
+To use the Flink Runner for executing on a cluster, you have to setup a 
Flink cluster by following the Flink https://ci.apache.org/projects/flink/flink-docs-stable/quickstart/setup_quickstart.html;>setup
 quickstart.
 
-To find out which version of Flink you need you can run this command to 
check the version of the Flink dependency that your project is using:
-$ mvn 
dependency:tree -Pflink-runner |grep flink
-...
-[INFO] |  +- org.apache.flink:flink-streaming-java_2.10:jar:1.2.1:runtime
-...
-
-
-Here, we would need Flink 1.2.1. Please also note the Scala version in the 
dependency name. In this case we need to make sure to use a Flink cluster with 
Scala version 2.10.
+Version Compatibility
+
+The Flink cluster version has to match the version used by the FlinkRunner. 
To find out which version of Flink please see the table below:
+
+
+
+  Beam version
+  Flink version
+
+
+  2.7.0, 2.6.0
+  1.5.x
+
+
+  2.5.0, 2.4.0, 2.3.0
+  1.4.x
+
+
+  2.2.0
+  1.3.x with Scala 2.10
+
+
+  2.2.0, 2.1.x
+  1.3.x with Scala 2.10
+
+
+  2.0.0
+  1.2.x with Scala 2.10
+
+
+
+For retrieving the right version, see the https://flink.apache.org/downloads.html;>Flink downloads page.
 
-For more information, the https://ci.apache.org/projects/flink/flink-docs-release-1.1/;>Flink 
Documentation can be helpful.
+For more information, the https://ci.apache.org/projects/flink/flink-docs-stable/;>Flink 
Documentation can be helpful.
 
 Specify your dependency
 
 When using Java, you must specify your 
dependency on the Flink Runner in your pom.xml.
 dependency
   groupIdorg.apache.beam/groupId
-  artifactIdbeam-runners-flink_2.10/artifactId
+  artifactIdbeam-runners-flink_2.11/artifactId
   version2.6.0/version
-  scoperuntime/scope
 /dependency
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 12681395165403103c9f315161814f7610a7786b
Author: Mergebot 
AuthorDate: Tue Sep 18 10:36:32 2018 +

Prepare repository for deployment.
---
 content/contribute/index.html | 11 +++
 1 file changed, 7 insertions(+), 4 deletions(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index cb22c5d..1d30ae8 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -203,7 +203,6 @@
   Contributing code
 
   Building  Testing
-  Developing with an IDE
   Pull requests
   Developing with the Python 
SDK
 
@@ -372,11 +371,15 @@ $ ./gradlew -p runners/flink check
 
 We run integration and performance test using https://jenkins.io/;>Jenkins. The job definitions are available in 
the https://github.com/apache/beam/tree/master/.test-infra/jenkins;>Beam 
GitHub repository.
 
-Developing with an IDE
+Troubleshooting
 
-Generate an IDEA project .ipr file with:
+You might get an OutOfMemoryException during the Gradle build. If you have 
more memory
+available, you can try to increase the memory allocation of the Gradle JVM. 
Otherwise,
+disabling parallel test execution reduces memory consumption. In the root of 
the Beam
+source, edit the gradle.properties file 
and add/modify the following lines:
 
-$ ./gradlew idea
+org.gradle.parallel=false
+org.gradle.jvmargs=-Xmx2g -XX:MaxPermSize=512m
 
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e8bf9691b333692453c36c59c11df2da0bc861c7
Author: Mergebot 
AuthorDate: Thu Sep 13 07:03:26 2018 +

Prepare repository for deployment.
---
 content/contribute/index.html | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index b2767bf..cb22c5d 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -199,6 +199,7 @@
 
 
 
+  Permissions
   Contributing code
 
   Building  Testing
@@ -281,6 +282,15 @@ run?)
 For a list of open starter tasks, check
 https://s.apache.org/beam-starter-tasks;>https://s.apache.org/beam-starter-tasks.
 
+Permissions
+
+For the https://issues.apache.org/jira/projects/BEAM/issues;>Beam 
issue tracker (JIRA), 
+anyone can access it and browse issues. Anyone can register an account and 
login 
+to create issues or add comments. Only contributors can be assigned issues. If 
+you want to be assigned issues, a PMC member can add you to the project 
contributor
+group.  Email the dev@ mailing list
+to ask to be added as a contributor in the Beam issue tracker.
+
 Contributing code
 
 Discussons about contributing code to beam  happens on the dev@ mailing list. Introduce yourself!

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 3f3e62d19c385cfff7da5149c901bd1ba655fbae
Author: Mergebot 
AuthorDate: Fri Sep 7 23:55:54 2018 +

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html | 17 +++--
 1 file changed, 15 insertions(+), 2 deletions(-)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 00e5c6c..a2cb0ec 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -293,6 +293,7 @@ limitations under the License.
 
   
   Access to Apache Nexus 
repository
+  Submit
 your GPG public key into MIT PGP Public Key Server
   Website development setup
   Register to PyPI
 
@@ -424,6 +425,9 @@ limitations under the License.
 
 To prepare for each release, you should audit the project status in the 
JIRA issue tracker, and do necessary bookkeeping. Finally, you should create a 
release branch from which individual release candidates will be built.
 
+NOTE: If you are using https://help.github.com/articles/securing-your-account-with-two-factor-authentication-2fa/;>GitHub
 two-factor authentication and haven’t configure HTTPS access, 
+please follow https://help.github.com/articles/creating-a-personal-access-token-for-the-command-line/;>the
 guide to configure command line access.
+
 One-time setup instructions
 
 GPG Key
@@ -546,6 +550,10 @@ export GPG_AGENT_INFO
   
 
 
+Submit your 
GPG public key into MIT PGP Public Key Server
+In order to make yourself have right permission to stage java artifacts in 
Apache Nexus staging repository, 
+please submit your GPG public key into http://pgp.mit.edu:11371/;>MIT 
PGP Public Key Server.
+
 Website development setup
 
 Prepare to update the Beam website by following the website development
@@ -559,7 +567,7 @@ instructions.
 
 When contributors resolve an issue in JIRA, they are tagging it with a 
release that will contain their changes. With the release currently underway, 
new issues should be resolved against a subsequent future release. Therefore, 
you should create a release item for this subsequent release, as follows:
 
-Attention: Only committer has permission to perform this.
+Attention: Only PMC has permission to perform this. If you 
are not a PMC, please ask for help in dev@ mailing list.
 
 
   In JIRA, navigate to the https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions;>Beam  Administration  
Versions.
@@ -916,7 +924,12 @@ the version number has changed, download a new version of 
the corresponding
   Tasks included
 
   Run gradle release to create rc tag and push source release into 
github repo.
-  Run gradle publish to push java artifacts into Maven staging 
repo.
+  
+Run gradle publish to push java artifacts into Maven staging 
repo.
+
+NOTE: In order to public staging artifacts, you 
need to goto the staging repo to close the staging repository on Apache Nexus. 
+When prompted for a description, enter “Apache Beam, version X, release 
candidate Y”.
+  
   Stage source release into dist.apache.org dev https://dist.apache.org/repos/dist/dev/beam/;>repo.
   Stage,sign and hash python binaries into dist.apache.ord dev repo 
python dir
   Create a PR to update beam-site, changes includes:

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 32712a7a3ff7842575a78a9f7d2f551784d481b6
Author: Mergebot 
AuthorDate: Thu Sep 6 05:43:58 2018 +

Prepare repository for deployment.
---
 content/contribute/portability/index.html | 8 
 1 file changed, 4 insertions(+), 4 deletions(-)

diff --git a/content/contribute/portability/index.html 
b/content/contribute/portability/index.html
index cb90344..a39d239 100644
--- a/content/contribute/portability/index.html
+++ b/content/contribute/portability/index.html
@@ -426,12 +426,13 @@ for details.
 To run a basic Python wordcount (in batch mode) with embedded Flink:
 
 
-  Run once to build the SDK harness container: ./gradlew -p sdks/python/container
-docker
+  Run once to build the SDK harness container: ./gradlew 
:beam-sdks-python-container:docker
   Start the Flink portable JobService endpoint: ./gradlew 
:beam-runners-flink_2.11-job-server:runShadow
-  Submit the wordcount pipeline to above endpoint: ./gradlew 
:beam-sdks-python:portableWordCount
+  Submit the wordcount pipeline to above endpoint: ./gradlew :beam-sdks-python:portableWordCount 
-PjobEndpoint=localhost:8099
 
 
+To run the pipeline in streaming mode: ./gradlew :beam-sdks-python:portableWordCount 
-PjobEndpoint=localhost:8099 -Pstreaming
+
 To run on a separate https://ci.apache.org/projects/flink/flink-docs-release-1.5/quickstart/setup_quickstart.html;>Flink
 cluster:
 
 
@@ -442,7 +443,6 @@ docker
   Submit the pipeline.
 
 
-Note: A subset of the functionality is also supported in streaming mode; 
use --streaming in the command line to 
enable it.
 
   
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 3adb0c6f504df0fc04477e8dddb36077eeebfc3d
Author: Mergebot 
AuthorDate: Wed Sep 5 20:59:24 2018 +

Prepare repository for deployment.
---
 content/contribute/design-documents/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/design-documents/index.html 
b/content/contribute/design-documents/index.html
index 505efbb..fb2559e 100644
--- a/content/contribute/design-documents/index.html
+++ b/content/contribute/design-documents/index.html
@@ -275,7 +275,7 @@ limitations under the License.
   Error Reporting Callback (WIP) [https://docs.google.com/document/d/1o2VXwCL97k3G-1BR9RSKNc6XtJTIA6SEKPMne91S67Y;>doc]
   Snapshotting and Updating Beam Pipelines [https://docs.google.com/document/d/1UWhnYPgui0gUYOsuGcCjLuoOUlGA4QaY91n8p3wz9MY;>doc]
   Requiring PTransform to set a coder on its resulting collections [https://lists.apache.org/thread.html/1dde0b5a93c2983cbab5f68ce7c74580102f5bb2baaa816585d7eabb@%3Cdev.beam.apache.org%3E;>mail]
-  [PROPOSAL] Support of @RequiresStableInput annotation [https://docs.google.com/document/d/117yRKbbcEdm3eIKB_26BHOJGmHSZl1YNoF0RqWGtqAM;>doc],
 [https://lists.apache.org/thread.html/ae3c838df060e47148439d1dad818d5e927b2a25ff00cc4153221dff@%3Cdev.beam.apache.org%3E;>mail]
+  Support of @RequiresStableInput annotation [https://docs.google.com/document/d/117yRKbbcEdm3eIKB_26BHOJGmHSZl1YNoF0RqWGtqAM;>doc],
 [https://lists.apache.org/thread.html/ae3c838df060e47148439d1dad818d5e927b2a25ff00cc4153221dff@%3Cdev.beam.apache.org%3E;>mail]
   [PROPOSAL] @onwindowexpiration [https://lists.apache.org/thread.html/1dab7f17c97378e665928b6cbd887dc7be93390ab26c593ee49a@%3Cdev.beam.apache.org%3E;>mail]
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 5a00fd9a0d3de646f5a4d4cea554d3930e0231e8
Author: Mergebot 
AuthorDate: Wed Sep 5 20:55:27 2018 +

Prepare repository for deployment.
---
 content/contribute/index.html | 36 
 1 file changed, 36 insertions(+)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index c6f1426..b2767bf 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -207,6 +207,12 @@
   Developing with the Python 
SDK
 
   
+  Reviews
+
+  Finding reviewers
+  Adding yourself as a 
reviewer
+
+  
   Contributing to the 
website
   Works in progress
 
@@ -479,6 +485,36 @@ $ python setup.py sdist
 
 
 
+Reviews
+
+Reviewers for https://github.com/apache/beam;>apache/beam are 
listed in
+Prow-style OWNERS files. A description of these files can be found
+https://go.k8s.io/owners;>here.
+
+Finding reviewers
+
+Currently this is a manual process. Tracking bug for automating this:
+https://issues.apache.org/jira/browse/BEAM-4790;>BEAM-4790.
+
+For each file to be reviewed, look for an OWNERS file in its directory. 
Pick a
+single reviewer from that file. If the directory doesn’t contain an OWNERS 
file,
+go up a directory. Keep going until you find one. Try to limit the number of
+reviewers to 2 per PR if possible, to minimize reviewer load.
+
+Adding yourself as a reviewer
+
+Find the deepest sub-directory that contains the files you want to be a 
reviewer
+for and add your Github username under reviewers in the OWNERS file (create a
+new OWNERS file if necessary).
+
+The Beam project currently only uses the reviewers key in OWNERS and no other
+features, as reviewer selection is still a manual process.
+
+
+
 Contributing to the website
 
 The Beam website is in the https://github.com/apache/beam-site;>Beam Site GitHub

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 2aca6fa7a6d7be380f1fb5fc941a2edbc29b805c
Author: Mergebot 
AuthorDate: Wed Sep 5 20:52:02 2018 +

Prepare repository for deployment.
---
 content/contribute/eclipse/index.html | 10 +-
 1 file changed, 1 insertion(+), 9 deletions(-)

diff --git a/content/contribute/eclipse/index.html 
b/content/contribute/eclipse/index.html
index 6ee2b6d..480e7f2 100644
--- a/content/contribute/eclipse/index.html
+++ b/content/contribute/eclipse/index.html
@@ -227,15 +227,7 @@ limitations under the License.
 Eclipse Tips
 
 
-  These are best-effort community-contributed tips, and are not…
-
-  
-… guaranteed to work with any particular Eclipse setup.
-… the only or best way to work.
-… an endorsement of Eclipse over alternatives.
-  
-
-  Mastering Eclipse is, ultimately, your responsibility.
+  These are best-effort community-contributed tips, and are not guaranteed 
to work with any particular Eclipse setup.
 
 
 Eclipse version

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 7a7561660612a9561be7107fd3fc92a9e2eb4a5f
Author: Mergebot 
AuthorDate: Wed Sep 5 20:48:19 2018 +

Prepare repository for deployment.
---
 content/contribute/portability/index.html | 5 +++--
 1 file changed, 3 insertions(+), 2 deletions(-)

diff --git a/content/contribute/portability/index.html 
b/content/contribute/portability/index.html
index bae564b..cb90344 100644
--- a/content/contribute/portability/index.html
+++ b/content/contribute/portability/index.html
@@ -417,7 +417,7 @@ their respective components.
 Status
 
 MVP in progress (near completion for Flink runner). See the
-https://docs.google.com/spreadsheets/d/1KDa_FGn1ShjomGd-UUDOhuh2q73de2tPz6BqHpzqvNI/edit?usp=sharing;>Portability
 support table
+https://s.apache.org/apache-beam-portability-support-table;>Portability 
support table
 for details.
 
 Running Python wordcount on 
Flink
@@ -437,7 +437,8 @@ docker
 
   Start local Flink cluster
   Create shaded JobService jar: ./gradlew 
:beam-runners-flink_2.11-job-server:installShadowDist
-  Start JobService with Flink web service endpoint: java -jar 
./runners/flink/job-server/build/install/beam-runners-flink_2.11-job-server-shadow/lib/beam-runners-flink_2.11-job-server-*.jar
 "--job-host=localhost:8099" "--artifacts-dir=/tmp/flink-artifacts" 
"--flink-master-url=localhost:8081"
+  Optional optimization step: Place the generated JobServer Jar beam/runners/flink/job-server/build/libs/beam-runners-flink_2.11-job-server-2.7.0-SNAPSHOT.jar
 in flink/lib and change class loading 
order for Flink by adding classloader.resolve-order: parent-first to 
conf/flink-conf.yaml.
+  Start JobService with Flink web service endpoint: ./gradlew 
:beam-runners-flink_2.11-job-server:runShadow 
-PflinkMasterUrl=localhost:8081
   Submit the pipeline.
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 27eac2e570dac5df1a1767f9e6aa19851d8a2dd8
Author: Mergebot 
AuthorDate: Wed Sep 5 20:44:19 2018 +

Prepare repository for deployment.
---
 content/contribute/intellij/index.html | 10 +-
 1 file changed, 1 insertion(+), 9 deletions(-)

diff --git a/content/contribute/intellij/index.html 
b/content/contribute/intellij/index.html
index 5da99be..c4de113 100644
--- a/content/contribute/intellij/index.html
+++ b/content/contribute/intellij/index.html
@@ -225,15 +225,7 @@ limitations under the License.
 IntelliJ Tips
 
 
-  These are best-effort community-contributed tips, and are not…
-
-  
-… guaranteed to work with any particular IntelliJ setup.
-… the only or best way to work.
-… an endorsement of IntelliJ over alternatives.
-  
-
-  Mastering IntelliJ is, ultimately, your responsibility.
+  These are best-effort community-contributed tips, and are not guaranteed 
to work with any particular IntelliJ setup.
 
 
 Create a working Gradle module

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 423f9e8e70fca762385f58e85743a62b87ffb3d0
Author: Mergebot 
AuthorDate: Thu Aug 23 19:16:24 2018 +

Prepare repository for deployment.
---
 .../2018/08/21/beam-summit-europe.html}| 265 ++---
 content/blog/index.html|  19 +
 content/feed.xml   | 639 ++---
 content/images/blog/Facebook-AD.png| Bin 0 -> 1275709 bytes
 content/index.html |  10 +-
 5 files changed, 124 insertions(+), 809 deletions(-)

diff --git a/content/index.html 
b/content/blog/2018/08/21/beam-summit-europe.html
similarity index 53%
copy from content/index.html
copy to content/blog/2018/08/21/beam-summit-europe.html
index 33e68cf..db5f28c 100644
--- a/content/index.html
+++ b/content/blog/2018/08/21/beam-summit-europe.html
@@ -28,9 +28,8 @@
   
   
   
-  Apache Beam
-  
+  Beam Summit Europe 2018
+  
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
   
   https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
@@ -39,7 +38,7 @@
   
   
   
-  https://beam.apache.org/; data-proofer-ignore>
+  https://beam.apache.org/blog/2018/08/21/beam-summit-europe.html; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   
@@ -52,7 +51,7 @@
   
 
 
-  
+  
 
-
-  
-
-  
-
-  
-Apache Beam: An advanced unified programming model
-  
-  
-Implement batch and streaming data processing jobs that run on any 
execution engine.
-  
-  
-Learn more
-Download Beam SDK 2.6.0
-  
-  
-Java 
Quickstart
-Python 
Quickstart
-   Go 
Quickstart
-  
-
-  
-  
-
-  
-The latest from the blog
-  
-  
-
-
-  A review of input 
streaming connectors
-  Aug 20, 2018
-
-
-
-  Apache Beam 
2.6.0
-  Aug 10, 2018
-
-
-
-  Apache Beam 
2.5.0
-  Jun 26, 2018
-
-
-  
-
-  
-
-  
-
 
-
-  
-All about Apache Beam
-  
-  
-
-
-  
-Unified
-  
-  
-Use a single programming model for both batch and streaming use cases.
-  
-
-
-
-  
-Portable
-  
-  
-Execute pipelines on multiple execution environments.
-  
-
-
-
-  
-Extensible
-  
-  
-Write and share new SDKs, IO connectors, and transformation libraries.
-  
-
-
-  
-
 
-
-
-
-
-
 
-
-  
-Works with
-  
-  
-
-
-  http://apex.apache.org;>
-
-
-
-  http://flink.apache.org;>
-
-
-
-  http://spark.apache.org/;>
-
-
-
-  https://cloud.google.com/dataflow/;>
-
-
-
-  http://gearpump.apache.org/;>
-
-
-
-  http://samza.apache.org/;>
-
-
-  
-
+http://schema.org/BlogPosting;>
 
-
-  
-
-  Testimonials
-
-
+  
+Beam Summit Europe 
2018
+Aug 21, 2018 •
+   Matthias Baetens [https://twitter.com/matthiasbaetens;>@matthiasbaetens]
   
-  
-
-  A framework that delivers the flexibility and advanced functionality 
our customers need.
-
-
-  
-  
-–Talend
-  
-
-  
-  
-  
-
-  Apache Beam has powerful semantics that solve real-world challenges 
of stream processing.
-
-
-  
-  
-–PayPal
-  
-
-  
-  
-  
-
-  Apache Beam represents a principled approach for analyzing data 
streams.
-
-
-  
-  
-–data Artisans
-  
-
-  
-  
-
-
-  Beam is an open source community and contributions are greatly 
appreciated!
-  If you’d like to contribute, please see the Contribute section.
-
-  
-
+
+  
+
+  
+With a growing community of contributors and users, the Apache Beam 
project is organising the first European Beam Summit.
+
+We are happy to invite you to this event, which will take place in 
London on October 1st and 2nd of 2018. 

+
+
+
+What is the Beam Summit 2018?
+The summit is a 2 day, multi-track event.
+
+During the first day we’ll host sessions to share use cases from companies 
using Apache Beam, community driven talks, and a session to discuss the 
project’s roadmap (from the main partners in the project as well as all users 
planning to contribute to the project 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit d3a72da435f1e18b8b4bc5546263d35e956e5942
Author: Mergebot 
AuthorDate: Mon Aug 20 22:05:32 2018 +

Prepare repository for deployment.
---
 content/community/policies/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/community/policies/index.html 
b/content/community/policies/index.html
index 16bd65e..bf74714 100644
--- a/content/community/policies/index.html
+++ b/content/community/policies/index.html
@@ -202,7 +202,7 @@ limitations under the License.
 
 Apache Beam makes minor releases every 6 weeks. Apache Beam has a https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7seouanigd0%40group.calendar.google.com;>calendar
 for cutting the next release branch. After a release branch is cut, the 
community works quickly to finalize that release.
 
-Apache Beam aims to make 8 releases in a 12 month period. To accommodate 
users with longer upgrade cycles, some of these releases will be tagged as long 
term support (LTS) releases. Starting with the 2.7.0 release, every fourth 
release will be a LTS release. LTS releases receive patches to fix major issues 
for 12 months, starting from the release’s initial release date. LTS releases 
are considered deprecated after 12 months. Non-LTS releases do not receive 
patches and are considered d [...]
+Apache Beam aims to make 8 releases in a 12 month period. To accommodate 
users with longer upgrade cycles, some of these releases will be tagged as long 
term support (LTS) releases. LTS releases receive patches to fix major issues 
for 12 months, starting from the release’s initial release date. There will be 
at least one new LTS release in a 12 month period, and LTS releases are 
considered deprecated after 12 months. The community will mark a release as a 
LTS release based on various  [...]
 
 It is up to the Apache Beam community to decide whether an identified issue 
is a major issue that warrants a patch release. Some examples of major issues 
are high severity security issues and high risk data integrity issues.
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 7bb066d2985e4267552c0463109c06c9a7d1ab2e
Author: Mergebot 
AuthorDate: Mon Aug 20 21:42:55 2018 +

Prepare repository for deployment.
---
 .../08/20/review-input-streaming-connectors.html   | 436 +
 content/blog/index.html|  17 +
 content/feed.xml   | 300 ++
 content/index.html |  10 +-
 4 files changed, 686 insertions(+), 77 deletions(-)

diff --git a/content/blog/2018/08/20/review-input-streaming-connectors.html 
b/content/blog/2018/08/20/review-input-streaming-connectors.html
new file mode 100644
index 000..1bdde6d
--- /dev/null
+++ b/content/blog/2018/08/20/review-input-streaming-connectors.html
@@ -0,0 +1,436 @@
+
+
+
+
+  
+
+
+  
+  
+  
+  A review of input streaming connectors
+  
+  https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
+  
+  https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
+  
+  
+  
+  
+  
+  https://beam.apache.org/blog/2018/08/20/review-input-streaming-connectors.html;
 data-proofer-ignore>
+  
+  https://beam.apache.org/feed.xml;>
+  
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new 
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+  
+
+
+  
+
+
+
+
+  
+Toggle navigation
+
+
+
+  
+
+  
+
+  
+
+
+
+
+
+  
+
+  Get Started
+
+
+  Documentation
+
+
+  SDKS
+
+
+  RUNNERS
+
+
+  Contribute
+
+
+  Community
+
+Blog
+  
+  
+
+  https://www.apache.org/foundation/press/kit/feather_small.png; alt="Apache 
Logo" style="height:20px;">
+  
+http://www.apache.org/;>ASF Homepage
+http://www.apache.org/licenses/;>License
+http://www.apache.org/security/;>Security
+http://www.apache.org/foundation/thanks.html;>Thanks
+http://www.apache.org/foundation/sponsorship.html;>Sponsorship
+https://www.apache.org/foundation/policies/conduct;>Code of 
Conduct
+  
+
+  
+
+
+
+
+  
+
+
+
+http://schema.org/BlogPosting;>
+
+  
+A review of input 
streaming connectors
+Aug 20, 2018 •
+   Leonid Kuligin [https://twitter.com/lkulighin;>@lkulighin] 
 Julien Phalip [https://twitter.com/julienphalip;>@julienphalip]
+  
+
+  
+
+  
+In this post, you’ll learn about the current state of support for input 
streaming connectors in Apache Beam. For more context, you’ll 
also learn about the corresponding state of support in https://spark.apache.org/;>Apache Spark.
+
+With batch processing, you might load data from any source, including a 
database system. Even if there are no specific SDKs available for those 
database systems, you can often resort to using a https://en.wikipedia.org/wiki/Java_Database_Connectivity;>JDBC 
driver. With streaming, implementing a proper data pipeline is arguably more 
challenging as generally fewer source types are available. For that reason, 
this article particularly focuses on the streaming use case.
+
+Connectors for Java
+
+Beam has an official Java SDK and 
has several execution engines, called runners. In most cases it 
is fairly easy to transfer existing Beam pipelines written in Java or Scala to 
a Spark environment by using the Spark 
Runner.
+
+Spark is written in Scala and has a https://spark.apache.org/docs/latest/api/java/;>Java API. Spark’s 
source code compiles to https://en.wikipedia.org/wiki/Java_(programming_language)#Java_JVM_and_Bytecode">Java
 bytecode and the binaries are run by a https://en.wikipedia.org/wiki/Java_virtual_machine;>Java Virtual 
Machine. Scala code is interoperable with Java and therefore has native 
compatibility with Java libraries (and vice versa).
+
+Spark offers two approaches to streaming: https://spark.apache.org/docs/latest/streaming-programming-guide.html;>Discretized
 Streaming (or DStreams) and https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html;>Structured
 Streaming. DStreams are a basic abstraction that represents a continuous 
series of https://spark.apache.org/docs/latest/rdd-programming-guide.html;>Resilient
 Distributed Datasets (or RDDs). Structured Str [...]
+
+Spark Structured Streaming supports 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 2bf7d7d73b4cbadc76e4543306586abd583d3ea7
Author: Mergebot 
AuthorDate: Mon Aug 20 20:23:04 2018 +

Prepare repository for deployment.
---
 content/documentation/programming-guide/index.html | 125 +++--
 1 file changed, 88 insertions(+), 37 deletions(-)

diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index ade9977..6093382 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -456,8 +456,8 @@ potentially include information such as your project ID or 
a location for
 storing files.
 
 When you run the pipeline on a runner of your choice, a copy of the
-PipelineOptions will be available to your code. For example, you can read
-PipelineOptions from a DoFn’s Context.
+PipelineOptions will be available to your code. For example, if you add a 
PipelineOptions parameter
+to a DoFn’s @ProcessElement method, it 
will be populated by the system.
 
 2.1.1. Setting PipelineOptions from command-line 
arguments
 
@@ -971,9 +971,13 @@ look like this:
 Inside your DoFn subclass, you’ll write a method annotated 
with
 @ProcessElement where you provide the 
actual processing logic. You don’t need
 to manually extract the elements from the input collection; the Beam SDKs 
handle
-that for you. Your @ProcessElement 
method should accept an object of type
-ProcessContext. The ProcessContext object gives you access to an 
input
-element and a method for emitting an output element:
+that for you. Your @ProcessElement 
method should accept a parameter tagged with
+@Element, which will be populated with 
the input element. In order to output
+elements, the method can also take a parameter of type OutputReceiver which
+provides a method for emitting elements. The parameter types must match the 
input
+and output types of your DoFn or the 
framework will raise an error. Note: @Element and
+OutputReceiver were introduced in Beam 2.5.0; if using an earlier release of 
Beam, a
+ProcessContext parameter should be used instead.
 
 Inside your DoFn 
subclass, you’ll write a method process 
where you provide
 the actual processing logic. You don’t need to manually extract the elements
@@ -984,11 +988,9 @@ method.
 
 static class ComputeWordLengthFn extends DoFnString, 
Integer {
   @ProcessElement
-  public void processElement(ProcessContext c) {
-// Get the input element from ProcessContext.
-String word = c.element();
-// Use ProcessContext.output to emit the output 
element.
-c.output(word.length());
+  public void processElement(@Element String word, OutputReceiverInteger out) {
+// Use OutputReceiver.output to emit the output 
element.
+out.output(word.length());
   }
 }
 
@@ -1002,8 +1004,8 @@ method.
 
 
   Note: If the elements in your input PCollection are key/value pairs, you
-can access the key or value by using ProcessContext.element().getKey() or
-ProcessContext.element().getValue(), 
respectively.
+can access the key or value by using element.getKey() or
+element.getValue(), respectively.
 
 
 A given DoFn instance generally gets 
invoked one or more times to process some
@@ -1020,10 +1022,10 @@ following requirements:
 
 
   You should not in any way modify an element returned by
-ProcessContext.element() or ProcessContext.sideInput() (the incoming
+the @Element annotation or ProcessContext.sideInput() (the incoming
 elements from the input collection).
-  Once you output a value using ProcessContext.output() or
-ProcessContext.sideOutput(), you should 
not modify that value in any way.
+  Once you output a value using OutputReceiver.output() you should not modify
+that value in any way.
 
 
 4.2.1.3. Lightweight DoFns and other 
abstractions
@@ -1047,8 +1049,8 @@ elements from the input collection).
   "ComputeWordLengths",  
   // the transform name
   ParDo.of(new DoFnString, Integer() {  
  // a DoFn as an anonymous inner class instance
   @ProcessElement
-  public void processElement(ProcessContext c) {
-c.output(c.element().length());
+  public void processElement(@Element String word, OutputReceiverInteger out) {
+out.output(word.length());
   }
 }));
 
@@ -1756,7 +1758,9 @@ state dependency in your user code.
 Beam SDKs are not thread-safe.
 
 
-In addition, it’s recommended that you make your function object 
idempotent.
+In addition, it’s recommended that you make your function object 
idempotent.
+Non-idempotent functions are supported by Beam, but require additional
+thought to ensure correctness when there are external side effects.
 
 
   Note: These requirements apply to subclasses of DoFn (a function object
@@ -1802,10 +1806,10 @@ function may be accessed from different threads.
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 6a90c609d5c7acceb2665331b1b2a3a8d1da82c2
Author: Mergebot 
AuthorDate: Mon Aug 20 19:06:37 2018 +

Prepare repository for deployment.
---
 content/contribute/become-a-committer/index.html   |   6 +-
 content/contribute/committer-guide/index.html  |   6 +-
 content/contribute/dependencies/index.html |   6 +-
 content/contribute/design-documents/index.html |   6 +-
 content/contribute/docker-images/index.html|   6 +-
 content/contribute/eclipse/index.html  |   6 +-
 content/contribute/index.html  |  15 +-
 content/contribute/intellij/index.html |   6 +-
 content/contribute/portability/index.html  |   6 +-
 content/contribute/postcommits-guides/index.html   |   6 +-
 .../postcommits-policies-details/index.html|   6 +-
 content/contribute/postcommits-policies/index.html |   6 +-
 .../index.html | 113 +++--
 .../index.html | 184 ++---
 .../contribute/ptransform-style-guide/index.html   |   6 +-
 content/contribute/release-guide/index.html|   6 +-
 content/contribute/runner-guide/index.html |   6 +-
 content/contribute/testing/index.html  |  85 +-
 .../contribute/website-contributions/index.html|   6 +-
 content/images/precommit_durations.png | Bin 0 -> 45673 bytes
 content/images/precommit_graph_queuing_time.png| Bin 0 -> 25809 bytes
 21 files changed, 315 insertions(+), 172 deletions(-)

diff --git a/content/contribute/become-a-committer/index.html 
b/content/contribute/become-a-committer/index.html
index 1ccffc9..0c910c5 100644
--- a/content/contribute/become-a-committer/index.html
+++ b/content/contribute/become-a-committer/index.html
@@ -151,6 +151,9 @@
 
   
 Testing guide
+
+  Pre-commit Slowness 
Triage Guide
+
 PTransform style 
guide
 Runner authoring guide
 Portability Framework
@@ -162,7 +165,8 @@
 
   Policies
   
-Post-commit tests 
policies
+Pre-commit test 
policies
+Post-commit test 
policies
   
 
 
diff --git a/content/contribute/committer-guide/index.html 
b/content/contribute/committer-guide/index.html
index 58e5ed5..3ad43d6 100644
--- a/content/contribute/committer-guide/index.html
+++ b/content/contribute/committer-guide/index.html
@@ -151,6 +151,9 @@
 
   
 Testing guide
+
+  Pre-commit Slowness 
Triage Guide
+
 PTransform style 
guide
 Runner authoring guide
 Portability Framework
@@ -162,7 +165,8 @@
 
   Policies
   
-Post-commit tests 
policies
+Pre-commit test 
policies
+Post-commit test 
policies
   
 
 
diff --git a/content/contribute/dependencies/index.html 
b/content/contribute/dependencies/index.html
index a4a306f..dd97540 100644
--- a/content/contribute/dependencies/index.html
+++ b/content/contribute/dependencies/index.html
@@ -151,6 +151,9 @@
 
   
 Testing guide
+
+  Pre-commit Slowness 
Triage Guide
+
 PTransform style 
guide
 Runner authoring guide
 Portability Framework
@@ -162,7 +165,8 @@
 
   Policies
   
-Post-commit tests 
policies
+Pre-commit test 
policies
+Post-commit test 
policies
   
 
 
diff --git a/content/contribute/design-documents/index.html 
b/content/contribute/design-documents/index.html
index 93e2fab..505efbb 100644
--- a/content/contribute/design-documents/index.html
+++ b/content/contribute/design-documents/index.html
@@ -151,6 +151,9 @@
 
   
 Testing guide
+
+  Pre-commit Slowness 
Triage Guide
+
 PTransform style 
guide
 Runner authoring guide
 Portability Framework
@@ -162,7 +165,8 @@
 
   Policies
   
-Post-commit tests 
policies
+Pre-commit test 
policies
+Post-commit test 
policies
   
 
 
diff --git a/content/contribute/docker-images/index.html 
b/content/contribute/docker-images/index.html
index dc3c803..b19985f 100644
--- a/content/contribute/docker-images/index.html
+++ b/content/contribute/docker-images/index.html
@@ -151,6 +151,9 @@
 
   
 Testing guide
+
+  Pre-commit Slowness 
Triage Guide
+
 PTransform style 
guide
 Runner authoring guide
 Portability Framework
@@ -162,7 +165,8 @@
 
   Policies
   
-Post-commit tests 
policies
+Pre-commit test 
policies
+Post-commit test 
policies
   
 
 
diff --git a/content/contribute/eclipse/index.html 
b/content/contribute/eclipse/index.html
index 6e26d29..6ee2b6d 100644
--- a/content/contribute/eclipse/index.html
+++ b/content/contribute/eclipse/index.html
@@ -151,6 +151,9 @@
 
   
 Testing guide
+
+  Pre-commit Slowness 
Triage Guide
+
 PTransform style 
guide
 Runner authoring guide
 Portability Framework
@@ -162,7 +165,8 @@
 
   Policies
   
-   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 7981cfc4e0656d3ecff68bb99a6908e8ae584cf9
Author: Mergebot 
AuthorDate: Wed Aug 15 18:06:41 2018 +

Prepare repository for deployment.
---
 content/community/policies/index.html | 8 +++-
 1 file changed, 7 insertions(+), 1 deletion(-)

diff --git a/content/community/policies/index.html 
b/content/community/policies/index.html
index 50b19d6..16bd65e 100644
--- a/content/community/policies/index.html
+++ b/content/community/policies/index.html
@@ -200,7 +200,13 @@ limitations under the License.
 
 Releases
 
-Apache Beam makes minor releases every 6 weeks. Apache Beam has a https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7seouanigd0%40group.calendar.google.com;>calendar
 for cutting the next release branch. Once a release branch is cut, the 
community works quickly to finalize that release.
+Apache Beam makes minor releases every 6 weeks. Apache Beam has a https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7seouanigd0%40group.calendar.google.com;>calendar
 for cutting the next release branch. After a release branch is cut, the 
community works quickly to finalize that release.
+
+Apache Beam aims to make 8 releases in a 12 month period. To accommodate 
users with longer upgrade cycles, some of these releases will be tagged as long 
term support (LTS) releases. Starting with the 2.7.0 release, every fourth 
release will be a LTS release. LTS releases receive patches to fix major issues 
for 12 months, starting from the release’s initial release date. LTS releases 
are considered deprecated after 12 months. Non-LTS releases do not receive 
patches and are considered d [...]
+
+It is up to the Apache Beam community to decide whether an identified issue 
is a major issue that warrants a patch release. Some examples of major issues 
are high severity security issues and high risk data integrity issues.
+
+If you wish to report a security vulnerability, please contact mailto:secur...@apache.org;>secur...@apache.org. Apache Beam follows 
the typical https://apache.org/security/committers.html#vulnerability-handling;>Apache
 vulnerability handling process.
 
   
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 86b7d03cc938f925f63aa4f3fb72d19b794f2fc1
Author: Mergebot 
AuthorDate: Wed Aug 15 01:25:30 2018 +

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html | 11 +++
 1 file changed, 11 insertions(+)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 70bc951..69d6c39 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -326,6 +326,7 @@ limitations under the License.
   Create Pydoc
 
   
+  Build and stage python 
wheels
   Checklist to proceed 
to the next step
 
   
@@ -894,6 +895,8 @@ the version number has changed, download a new version of 
the corresponding
 
 For this step, we recommend you using automation script to create a RC, but 
you still can perform all steps manually if you want.
 
+BUT the final step of rc creation is Build and stage python wheels, which need to 
done manually.
+
 Run 
build_release_candidate.sh to create RC
 
   
@@ -1089,6 +1092,14 @@ candidate into the source tree of the website.
 
 Finally, propose a pull request with these changes. (Don’t merge before 
finalizing the release.)
 
+Build and stage python wheels
+
+There is a wrapper repo https://github.com/apache/beam-wheels;>beam-wheels to help build 
python wheels.
+
+If you are interested in how it works, please refer to the https://github.com/apache/beam-wheels#structure;>structure 
section.
+
+Please follow the https://github.com/apache/beam-wheels#user-guide;>user guide to build 
python wheels.
+
 Checklist to proceed to the 
next step
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit a80a30b9b8764e1cf0b6db7eba38efcb56305c9b
Author: Mergebot 
AuthorDate: Tue Aug 14 23:35:47 2018 +

Prepare repository for deployment.
---
 .../capability/2016/03/17/capability-matrix.html   |  19 +-
 .../2016/04/03/presentation-materials.html |  19 +-
 .../sdk/2016/02/25/python-sdk-now-public.html  |  19 +-
 content/beam/release/2016/06/15/first-release.html |  19 +-
 .../2016/10/11/strata-hadoop-world-and-beam.html   |  19 +-
 .../update/website/2016/02/22/beam-has-a-logo.html |  19 +-
 .../blog/2016/05/18/splitAtFraction-method.html|  19 +-
 .../05/27/where-is-my-pcollection-dot-map.html |  19 +-
 .../2016/06/13/flink-batch-runner-milestone.html   |  19 +-
 content/blog/2016/08/03/six-months.html|  19 +-
 content/blog/2016/10/20/test-stream.html   |  19 +-
 content/blog/2017/01/09/added-apex-runner.html |  19 +-
 content/blog/2017/01/10/beam-graduates.html|  19 +-
 .../blog/2017/02/01/graduation-media-recap.html|  19 +-
 content/blog/2017/02/13/stateful-processing.html   |  19 +-
 content/blog/2017/03/16/python-sdk-release.html|  19 +-
 .../blog/2017/05/17/beam-first-stable-release.html |  19 +-
 content/blog/2017/08/16/splittable-do-fn.html  |  19 +-
 content/blog/2017/08/28/timely-processing.html |  19 +-
 content/blog/2018/01/09/beam-a-look-back.html  |  19 +-
 content/blog/2018/02/19/beam-2.3.0.html|  19 +-
 content/blog/2018/06/26/beam-2.5.0.html|  19 +-
 content/blog/2018/08/10/beam-2.6.0.html|  88 +++--
 content/blog/index.html| 437 +++--
 content/feed.xml   |  67 ++--
 25 files changed, 230 insertions(+), 780 deletions(-)

diff --git a/content/beam/capability/2016/03/17/capability-matrix.html 
b/content/beam/capability/2016/03/17/capability-matrix.html
index c60c8d0..7cfe288 100644
--- a/content/beam/capability/2016/03/17/capability-matrix.html
+++ b/content/beam/capability/2016/03/17/capability-matrix.html
@@ -137,21 +137,10 @@
 
   
 Clarifying & Formalizing 
Runner Capabilities
-Mar 17, 2016 • 
- Frances Perry [https://twitter.com/francesjperry;>@francesjperry]  Tyler Akidau 
[https://twitter.com/takidau;>@takidau]
-
+Mar 17, 2016 •
+   Frances Perry [https://twitter.com/francesjperry;>@francesjperry]  Tyler Akidau 
[https://twitter.com/takidau;>@takidau]
+  
+
   
 
   
diff --git a/content/beam/capability/2016/04/03/presentation-materials.html 
b/content/beam/capability/2016/04/03/presentation-materials.html
index d383fdf..1dda77b 100644
--- a/content/beam/capability/2016/04/03/presentation-materials.html
+++ b/content/beam/capability/2016/04/03/presentation-materials.html
@@ -137,21 +137,10 @@
 
   
 Apache Beam Presentation 
Materials
-Apr 3, 2016 • 
- Frances Perry [https://twitter.com/francesjperry;>@francesjperry]  Tyler Akidau 
[https://twitter.com/takidau;>@takidau]
-
+Apr 3, 2016 •
+   Frances Perry [https://twitter.com/francesjperry;>@francesjperry]  Tyler Akidau 
[https://twitter.com/takidau;>@takidau]
+  
+
   
 
   
diff --git a/content/beam/python/sdk/2016/02/25/python-sdk-now-public.html 
b/content/beam/python/sdk/2016/02/25/python-sdk-now-public.html
index a948eaa..511a719 100644
--- a/content/beam/python/sdk/2016/02/25/python-sdk-now-public.html
+++ b/content/beam/python/sdk/2016/02/25/python-sdk-now-public.html
@@ -137,21 +137,10 @@
 
   
 Dataflow Python SDK is now 
public!
-Feb 25, 2016 • 
- James Malone [https://twitter.com/chimerasaurus;>@chimerasaurus]
-
+Feb 25, 2016 •
+   James Malone [https://twitter.com/chimerasaurus;>@chimerasaurus]
+  
+
   
 
   
diff --git a/content/beam/release/2016/06/15/first-release.html 
b/content/beam/release/2016/06/15/first-release.html
index effd2b7..b47cc9c 100644
--- a/content/beam/release/2016/06/15/first-release.html
+++ b/content/beam/release/2016/06/15/first-release.html
@@ -137,21 +137,10 @@
 
   
 The first release of 
Apache Beam!
-Jun 15, 2016 • 
- Davor Bonaci [https://twitter.com/BonaciDavor;>@BonaciDavor]
-
+Jun 15, 2016 •
+   Davor Bonaci [https://twitter.com/BonaciDavor;>@BonaciDavor]
+  
+
   
 
   
diff --git a/content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html 
b/content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html
index bbd5e60..73f6fe1 100644
--- a/content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html
+++ b/content/beam/update/2016/10/11/strata-hadoop-world-and-beam.html
@@ -137,21 +137,10 @@
 
   
 Strata+Hadoop World and 
Beam
-Oct 11, 2016 • 
- Jesse Anderson [https://twitter.com/jessetanderson;>@jessetanderson]
-
+Oct 11, 2016 •
+   Jesse Anderson 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit d246d3d26d3e8c3b088bfb54bd371aa6cdcd9a49
Author: Mergebot 
AuthorDate: Tue Aug 14 19:58:09 2018 +

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html | 570 
 1 file changed, 414 insertions(+), 156 deletions(-)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 06d0a3b..70bc951 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -208,23 +208,17 @@
   Create a new version in 
JIRA
   Triage 
release-blocking issues in JIRA
   Review Release Notes in 
JIRA
-  Verify that a Release 
Build Works
-  Update and Verify 
Javadoc
   Create a 
release branch in apache/beam repository
-  Update the Python SDK 
version
-  Update release 
specific configurations
   Start a snapshot build
+  Verify that a Release 
Build Works
+  Update and Verify 
Javadoc
   Checklist to 
proceed to the next step
 
   
   Build a release candidate
 
-  Build and 
stage Java artifacts with Gradle
-  Stage source 
release on dist.apache.org
-  Stage python 
binaries on dist.apache.org
-  Build the Pydoc API 
reference
-  Propose a pull 
request for website updates
-  Checklist to 
proceed to the next step
+  Run 
build_release_candidate.sh to create RC
+  Run all steps manually
 
   
   Vote on the release 
candidate
@@ -289,7 +283,11 @@ limitations under the License.
   
   Prepare for the release
   One-time setup instructions   
 
-  GPG Key
+  GPG Key 
   
+  Use 
preparation_before_release.sh to setup GPG
+  Run all commands manually
+
+  
   Access to Apache Nexus 
repository
   Website development setup
   Register to PyPI
@@ -298,29 +296,47 @@ limitations under the License.
   Create a new version in 
JIRA
   Triage 
release-blocking issues in JIRA
   Review Release Notes in 
JIRA
-  Verify that a Release Build 
Works
+  Create a 
release branch in apache/beam repository
+  Use 
cut_release_branch.sh to cut a release branch
+  Run all steps manually
+
+  
+  Start a snapshot build
+  Run 
start_snapshot_build.sh to trigger build
+  Do all operations manually
+
+  
+  Verify that a Release Build 
Works
+  Run 
verify_release_build.sh to verity a release build
+  Run all commands manually
+
+  
   Update and Verify Javadoc
-  Create a 
release branch in apache/beam repository
-  Update the Python SDK 
version
-  Update release 
specific configurations
-  Start a snapshot build
   Checklist to proceed 
to the next step
 
   
   Build a release candidate

-  Build and stage 
Java artifacts with Gradle
-  Stage source release on 
dist.apache.org
-  Stage python binaries 
on dist.apache.org
-  Build the Pydoc API 
reference
-  Propose a pull 
request for website updates
-  Create 
Pydoc
+  Run 
build_release_candidate.sh to create RC
+  Run all steps manually

+  Build and stage 
Java artifacts with Gradle
+  Stage source release on 
dist.apache.org
+  Stage python binaries 
on dist.apache.org
+  Build the Pydoc API 
reference
+  Propose a pull 
request for website updates
+  Create Pydoc
+
+  
+  Checklist to proceed 
to the next step
 
   
-  Checklist to proceed 
to the next step
 
   
   Vote on the release 
candidate
-  Run validation tests
+  Run validation tests
+  Run validations 
using run_rc_validation.sh
+  Run validations manually
+
+  
   Checklist to 
proceed to the finalization step
 
   
@@ -409,53 +425,90 @@ limitations under the License.
 
 You need to have a GPG key to sign the release artifacts. Please be aware 
of the ASF-wide https://www.apache.org/dev/release-signing.html;>release signing 
guidelines. If you don’t have a GPG key associated with your Apache 
account, please create one according to the guidelines.
 
-Get more entropy for creating a GPG key
+There are 2 ways to configure your GPG key for release, either using 
release automation script(which is recommended), 
+or running all commands manually.
 
-sudo apt-get 
install rng-tools
-sudo rngd -r /dev/urandom
+Use 
preparation_before_release.sh to setup GPG
+
+  
+Script: https://github.com/apache/beam/blob/master/release/src/main/scripts/preparation_before_release.sh;>preparation_before_release.sh
+  
+  

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 6de1aefb97bd1666bedb9fe100a8fa1d75430d01
Author: Mergebot 
AuthorDate: Sun Aug 12 20:29:06 2018 +

Prepare repository for deployment.
---
 content/contribute/index.html | 35 ++-
 1 file changed, 22 insertions(+), 13 deletions(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index e0a26ae..b014e5e 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -308,22 +308,23 @@ Software Foundation (ASF).
 
 Building  Testing
 
-We use Gradle to orchestrate building and testing.
+We use the https://gradle.org/;>Gradle Build Tool.
 
-You do not need to install gradle, but you do need a Java SDK installed.
-You can develop on Linux, macOS, or Microsoft Windows. There have been
-issues noted when developing using Windows; feel free to contribute fixes
-to make it easier.
+You do not need to install Gradle, but you do need a Java SDK installed. 
You can develop on Linux, macOS, or Microsoft Windows. There have been issues 
noted when developing using Windows; feel free to contribute fixes to make it 
easier.
 
-The entire set of tests can be run with this command at the root of the git
-repository.
+Familiarize yourself with the project structure. At the root of the git 
repository, run:
+
+$ ./gradlew 
projects
+
+
+
+Run the entire set of tests with:
 
 $ ./gradlew check
 
 
 
-You can limit testing to a particular module and Gradle will build just the
-necessary things to run those tests. For example:
+You can limit testing to a particular module. Gradle will build just the 
necessary things to run those tests. For example:
 
 $ ./gradlew -p 
sdks/go check
 $ ./gradlew -p sdks/java/io/cassandra check
@@ -331,18 +332,26 @@ $ ./gradlew -p runners/flink check
 
 
 
-You can see what build tasks are available with
+Examine the available tasks in a project. For the default set of tasks, 
use:
 
 $ ./gradlew tasks
 
 
 
-or for a module,
+For a given module, use:
 
 $ ./gradlew 
sdks/java/io/cassandra tasks
 
 
 
+For an exhaustive list of tasks, use:
+
+$ ./gradlew tasks 
--all
+
+
+
+We run integration and performance test using https://jenkins.io/;>Jenkins. The job definitions are available in 
the https://github.com/apache/beam/tree/master/.test-infra/jenkins;>Beam 
GitHub repository.
+
 Developing with an IDE
 
 Generate an IDEA project .ipr file with:
@@ -360,7 +369,7 @@ This will automatically link the pull request to the 
issue.
 
 Pull requests can only be merged by a
 https://people.apache.org/phonebook.html?unix=beam;>beam 
committer.
-To find a committer for your area, look for similar code merges or ask on 
+To find a committer for your area, look for similar code merges or ask on
 d...@beam.apache.org
 
 Use @mention in the pull request to notify the reviewer.
@@ -441,7 +450,7 @@ $
 Or use tox commands to run the lint 
tasks:
 
 $ tox -e py27-lint 
   # For python 2.7
-$ tox -e py3-lint # For python 3 
+$ tox -e py3-lint # For python 3
 $ tox -e py27-lint3   # For python 2-3 compatibility
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 7c561185f26728de9e321c5cb80ef8751a6779d9
Author: Mergebot 
AuthorDate: Sat Aug 11 01:49:18 2018 +

Prepare repository for deployment.
---
 .../2018/08/10/beam-2.6.0.html}| 283 ++---
 content/blog/index.html|  81 ++
 content/feed.xml   | 152 ++-
 content/index.html |  10 +-
 4 files changed, 241 insertions(+), 285 deletions(-)

diff --git a/content/index.html b/content/blog/2018/08/10/beam-2.6.0.html
similarity index 56%
copy from content/index.html
copy to content/blog/2018/08/10/beam-2.6.0.html
index cc857a1..eb7c18c 100644
--- a/content/index.html
+++ b/content/blog/2018/08/10/beam-2.6.0.html
@@ -28,9 +28,8 @@
   
   
   
-  Apache Beam
-  
+  Apache Beam 2.6.0
+  
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
   
   https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
@@ -39,7 +38,7 @@
   
   
   
-  https://beam.apache.org/; data-proofer-ignore>
+  https://beam.apache.org/blog/2018/08/10/beam-2.6.0.html; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   
@@ -52,7 +51,7 @@
   
 
 
-  
+  
 
+
+
+
+http://schema.org/BlogPosting;>
+
+  
+Apache Beam 2.6.0
+Aug 10, 2018 • 
-
-  
-
-  
-
-  
-Apache Beam: An advanced unified programming model
-  
-  
-Implement batch and streaming data processing jobs that run on any 
execution engine.
-  
-  
-Learn more
-Download Beam SDK 2.6.0
-  
-  
-Java 
Quickstart
-Python 
Quickstart
-   Go 
Quickstart
-  
-
-  
-  
-
-  
-The latest from the blog
-  
-  
-
-
-  Apache Beam 
2.5.0
-  Jun 26, 2018
-
-
-
-  Apache Beam 
2.3.0
-  Feb 19, 2018
-
-
-
-  Apache Beam: A Look 
Back at 2017
-  Jan 9, 2018
-
-
-  
-
-  
-
-  
-
+  
+
+  
 
-
-  
-All about Apache Beam
-  
-  
-
-
-  
-Unified
-  
-  
-Use a single programming model for both batch and streaming use cases.
-  
-
-
-
-  
-Portable
-  
-  
-Execute pipelines on multiple execution environments.
-  
-
-
-
-  
-Extensible
-  
-  
-Write and share new SDKs, IO connectors, and transformation libraries.
-  
-
-
-  
-
+  
+Apache Beam version 2.6.0
 
-
-
-
-
-
+We are glad to present the new 2.6.0 release of Beam. This release includes 
multiple fixes and new functionalities. Specifically, we spent a significant 
amount of time trying to automate the release, and fix the continuous 
integration. We also have significant new features in SQL, and portability. 
Please go ahead and take a look at the following highlights:
 
-
-  
-Works with
-  
-  
-
-
-  http://apex.apache.org;>
-
-
-
-  http://flink.apache.org;>
-
-
-
-  http://spark.apache.org/;>
-
-
-
-  https://cloud.google.com/dataflow/;>
-
-
-
-  http://gearpump.apache.org/;>
-
-
-
-  http://samza.apache.org/;>
-
-
-  
-
+For more information, please, check the detailed https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12343392;>release
 notes.
 
-
-  
-
-  Testimonials
-
-
-  
-  
-
-  A framework that delivers the flexibility and advanced functionality 
our customers need.
-
-
-  
-  
-–Talend
-  
-
-  
-  
-  
-
-  Apache Beam has powerful semantics that solve real-world challenges 
of stream processing.
-
-
-  
-  
-–PayPal
-  
-
-  
-  
-  
-
-  Apache Beam represents a principled approach for analyzing data 
streams.
-
-
-  
-  
-–data Artisans
-  
-
-  
-  
-
-
-  Beam is an open source community and contributions are greatly 
appreciated!
-  If you’d like to contribute, please see the Contribute section.
-
-  
-
+New Features / Improvements
+
+gRPC/Protobuf shading
+
+
+  gRPC/protobuf is now shaded in the majority of Apache Beam Java modules. 
A few modules which expose gRPC/protobuf on the API surface still maintain a 
direct dependency.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit cb6ac224c31033402fa5880cf24a9fba5c88bb2b
Author: Mergebot 
AuthorDate: Thu Aug 9 22:11:59 2018 +

Prepare repository for deployment.
---
 content/documentation/dsls/sql/overview/index.html |  2 +-
 .../documentation/dsls/sql/walkthrough/index.html  | 28 +-
 2 files changed, 12 insertions(+), 18 deletions(-)

diff --git a/content/documentation/dsls/sql/overview/index.html 
b/content/documentation/dsls/sql/overview/index.html
index 2d0c8b4..fcd5879 100644
--- a/content/documentation/dsls/sql/overview/index.html
+++ b/content/documentation/dsls/sql/overview/index.html
@@ -256,7 +256,7 @@ big data processing with some streaming enhancements. 
Calcite provides the
 basic dialect underlying Beam SQL. We have added additional extensions to
 make it easy to leverage Beam’s unified batch/streaming model and support
 for complex data types.
-  BeamSql:
 
+  SqlTransform:
 
 the interface for creating PTransforms 
from SQL queries.
   Row:
 the type of elements that Beam SQL operates on. A PCollectionRow plays the role of a 
table.
diff --git a/content/documentation/dsls/sql/walkthrough/index.html 
b/content/documentation/dsls/sql/walkthrough/index.html
index 0b58348..0ba1520 100644
--- a/content/documentation/dsls/sql/walkthrough/index.html
+++ b/content/documentation/dsls/sql/walkthrough/index.html
@@ -224,7 +224,7 @@
 
 
   Row
-  BeamSql transform
+  SqlTransform
 
 
 
@@ -265,9 +265,9 @@ Types for more details on supported primitive data 
types.
   
 From in-memory data (typically for unit testing).
 
-Note: you have to explicitly specify the Row coder. In this example we’re doing it by 
calling Create.of(..).withCoder():
+Note: you have to explicitly specify the Row coder. In this example we’re doing it by 
calling Create.of(..):
 
-// Define the record type (i.e., 
schema).
+// Define the schema for the 
records.
 Schema appSchema = 
 Schema
   .builder()
@@ -293,10 +293,7 @@ Types for more details on supported primitive data 
types.
 
 
   
-  
-From a PCollectionT of records of some other 
type  (i.e.  T is not already a 
Row), by applying a ParDo that converts input records to Row format.
-
-Note: you have to manually set the coder of the result 
by calling setCoder(appSchema.getRowCoder()):
+  From a PCollectionT of records of some other 
type  (i.e.  T is not already a 
Row), by applying a ParDo that converts input records to Row format:
 // An example POJO class.
 class AppPojo {
   Integer appId;
@@ -330,21 +327,18 @@ Types for more details on supported primitive data 
types.
   // Output the Row representing the current 
POJO
   c.output(appRow);
 }
-  }))
-  .setCoder(appSchema.getRowCoder());
+  }));
 
 
   
-  
-As an output of another BeamSql query. Details in the next 
section.
-  
+  As an output of another SqlTransform. Details in the next 
section.
 
 
-Once you have a PCollectionRow in hand, you may use 
the BeamSql APIs to apply SQL queries to 
it.
+Once you have a PCollectionRow in hand, you may use 
SqlTransform to apply SQL queries to 
it.
 
-BeamSql transform
+SqlTransform
 
-BeamSql.query(queryString) method is 
the only API to create a PTransform
+SqlTransform.query(queryString) method is 
the only API to create a PTransform
 from a string representation of the SQL query. You can apply this PTransform
 to either a single PCollection or a 
PCollectionTuple which holds multiple
 PCollections:
@@ -352,7 +346,7 @@ to either a single PCollection or a 
   when applying to a single PCollection it can be referenced via the table 
name PCOLLECTION in the query:
 PCollectionRow 
filteredNames = testApps.apply(
-BeamSql.query(
+SqlTransform.query(
   "SELECT appId, description, rowtime "
 + "FROM PCOLLECTION "
 + "WHERE id=1"));
@@ -386,7 +380,7 @@ to either a single PCollection or a // and average rating per app 
 // by joining two PCollections
 PCollectionRow output 
= namesAndFoods.apply(
-BeamSql.query(
+SqlTransform.query(
 "SELECT Names.appId, COUNT(Reviews.rating), 
AVG(Reviews.rating)"
 + "FROM Apps INNER JOIN 
Reviews ON Apps.appId == Reviews.appId"));
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f5fde017245530c5d2c4e23edd6f81ab0c8f450a
Author: Mergebot 
AuthorDate: Thu Aug 9 16:56:32 2018 +

Prepare repository for deployment.
---
 content/documentation/runners/apex/index.html | 34 ++-
 1 file changed, 18 insertions(+), 16 deletions(-)

diff --git a/content/documentation/runners/apex/index.html 
b/content/documentation/runners/apex/index.html
index 71e95fc..4aaf9f1 100644
--- a/content/documentation/runners/apex/index.html
+++ b/content/documentation/runners/apex/index.html
@@ -167,8 +167,7 @@
 
 
   Apex Runner prerequisites
-  Running wordcount using 
Apex Runner
-  Checking output
+  Running wordcount with 
Apex
   Montoring progress of your 
job
 
 
@@ -195,6 +194,9 @@ limitations under the License.
 
 http://apex.apache.org/;>Apache Apex is a stream processing 
platform and framework for low-latency, high-throughput and fault-tolerant 
analytics applications on Apache Hadoop. Apex has a unified streaming 
architecture and can be used for real-time and batch processing.
 
+The following instructions are for running Beam pipelines with Apex on a 
YARN cluster.
+They are not required for Apex in embedded mode (see quickstart).
+
 Apex Runner prerequisites
 
 You may set up your own Hadoop cluster. Beam does not require anything 
extra to launch the pipelines on YARN.
@@ -203,21 +205,20 @@ The Apex CLI can be http://apex.apache.org/docs/apex/apex_development_s
 obtained as http://www.atrato.io/blog/2017/04/08/apache-apex-cli/;>binary build.
 For more download options see http://apex.apache.org/downloads.html;>distribution information on the 
Apache Apex website.
 
-Running wordcount using Apex 
Runner
+Running wordcount with Apex
 
-Put data for processing into HDFS:
-hdfs dfs -mkdir -p 
/tmp/input/
-hdfs dfs -put pom.xml /tmp/input/
+Typically the build environment is separate from the target YARN cluster. 
In such case, it is necessary to build a fat jar that will include all 
dependencies. Ensure that hadoop.version 
in pom.xml matches the version of your 
YARN cluster and then build the jar file:
+mvn package 
-Papex-runner
 
 
 
-The output directory should not exist on HDFS:
-hdfs dfs -rm -r -f 
/tmp/output/
+Copy the resulting target/word-count-beam-bundled-0.1.jar to the 
cluster and submit the application using:
+java -cp 
word-count-beam-bundled-0.1.jar org.apache.beam.examples.WordCount 
--inputFile=/etc/profile --output=/tmp/counts --embeddedExecution=false 
--configFile=beam-runners-apex.properties --runner=ApexRunner
 
 
 
-Run the wordcount example (example project needs to be modified to 
include HDFS file provider)
-mvn compile 
exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount 
-Dexec.args="--inputFile=/tmp/input/pom.xml --output=/tmp/output/ 
--runner=ApexRunner --embeddedExecution=false 
--configFile=beam-runners-apex.properties" -Papex-runner
+If the build environment is setup as cluster client, it is possible to run 
the example directly:
+mvn compile 
exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount 
-Dexec.args="--inputFile=/etc/profile --output=/tmp/counts --runner=ApexRunner 
--embeddedExecution=false --configFile=beam-runners-apex.properties" 
-Papex-runner
 
 
 
@@ -233,12 +234,8 @@ 
apex.application.*.operator.*.attr.TIMEOUT_WINDOW_COUNT=1200
 
 
 
-Checking output
-
-Check the output of the pipeline in the HDFS location.
-hdfs dfs -ls 
/tmp/output/
-
-
+This example uses local files. To use a distributed file system (HDFS, S3 
etc.),
+it is necessary to augment the build to include the respective file system 
provider.
 
 Montoring progress of your job
 
@@ -249,6 +246,11 @@ 
apex.application.*.operator.*.attr.TIMEOUT_WINDOW_COUNT=1200
   Apex command-line interface: http://apex.apache.org/docs/apex/apex_cli/#apex-cli-commands;>Using the 
Apex CLI to get running application information.
 
 
+Check the output of the pipeline:
+ls /tmp/counts*
+
+
+
   
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit b90f11fbf7201092cfa450638a8ad595753153e9
Author: Mergebot 
AuthorDate: Thu Aug 9 05:54:35 2018 +

Prepare repository for deployment.
---
 content/contribute/portability/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/portability/index.html 
b/content/contribute/portability/index.html
index 09d0e57..55330dd 100644
--- a/content/contribute/portability/index.html
+++ b/content/contribute/portability/index.html
@@ -433,7 +433,7 @@ docker
 
   Start local Flink cluster
   Create shaded JobService jar: ./gradlew 
:beam-runners-flink_2.11-job-server:installShadowDist
-  Start JobService with Flink web service endpoint: java -jar 
./runners/flink/job-server/build/install/beam-runners-flink_2.11-job-server-shadow/lib/beam-runners-flink_2.11-job-server-*.jar--job-host=localhost:8099"
 "--artifacts-dir=/tmp/flink-artifacts" 
"--flink-master-url=localhost:8081"
+  Start JobService with Flink web service endpoint: java -jar 
./runners/flink/job-server/build/install/beam-runners-flink_2.11-job-server-shadow/lib/beam-runners-flink_2.11-job-server-*.jar
 "--job-host=localhost:8099" "--artifacts-dir=/tmp/flink-artifacts" 
"--flink-master-url=localhost:8081"
   Submit the pipeline.
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 559710980b4ae0ce91713c627f3051561e512782
Author: Mergebot 
AuthorDate: Thu Aug 9 00:30:39 2018 +

Prepare repository for deployment.
---
 content/contribute/index.html | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index 7a5ad79..e0a26ae 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -398,7 +398,7 @@ This installs Python from source and includes the test and 
gcp dependencies.
 
 $ virtualenv env
 $ . ./env/bin/activate
-(env) $ pip install .[gcp,test]
+(env) $ pip install -e .[gcp,test]
 
 
 
@@ -406,7 +406,7 @@ $ . ./env/bin/activate
 
  
c:\Python27\python.exe -m virtualenv
  env\Scripts\activate
-(env)  pip install .[gcp,test]
+(env)  pip install -e .[gcp,test]
 
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 582961ed7829d896ea683f2f2ca3d9ac8e4b656e
Author: Mergebot 
AuthorDate: Wed Aug 8 23:33:33 2018 +

Prepare repository for deployment.
---
 .../dsls/sql/aggregate-functions/index.html|   1 +
 .../documentation/dsls/sql/create-table/index.html |   1 +
 .../documentation/dsls/sql/data-types/index.html   |   1 +
 content/documentation/dsls/sql/joins/index.html|   1 +
 content/documentation/dsls/sql/lexical/index.html  |   1 +
 content/documentation/dsls/sql/overview/index.html |   1 +
 .../dsls/sql/scalar-functions/index.html   |   1 +
 content/documentation/dsls/sql/select/index.html   |   1 +
 content/documentation/dsls/sql/set/index.html  |   1 +
 .../sql/shell}/index.html  | 205 ++---
 .../dsls/sql/user-defined-functions/index.html |   1 +
 .../documentation/dsls/sql/walkthrough/index.html  |   1 +
 .../dsls/sql/windowing-and-triggering/index.html   |   1 +
 .../sdks/feature-comparison/index.html |   1 +
 content/documentation/sdks/go/index.html   |   1 +
 .../documentation/sdks/java-extensions/index.html  |   1 +
 .../documentation/sdks/java-thirdparty/index.html  |   1 +
 .../documentation/sdks/java/euphoria/index.html|   1 +
 content/documentation/sdks/java/index.html |   1 +
 content/documentation/sdks/java/nexmark/index.html |   1 +
 .../documentation/sdks/python-custom-io/index.html |   1 +
 .../sdks/python-pipeline-dependencies/index.html   |   1 +
 .../documentation/sdks/python-streaming/index.html |   1 +
 .../sdks/python-type-safety/index.html |   1 +
 content/documentation/sdks/python/index.html   |   1 +
 25 files changed, 125 insertions(+), 104 deletions(-)

diff --git a/content/documentation/dsls/sql/aggregate-functions/index.html 
b/content/documentation/dsls/sql/aggregate-functions/index.html
index 5fa8c55..ce77ea5 100644
--- a/content/documentation/dsls/sql/aggregate-functions/index.html
+++ b/content/documentation/dsls/sql/aggregate-functions/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/create-table/index.html 
b/content/documentation/dsls/sql/create-table/index.html
index 8980917..c40550c 100644
--- a/content/documentation/dsls/sql/create-table/index.html
+++ b/content/documentation/dsls/sql/create-table/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/data-types/index.html 
b/content/documentation/dsls/sql/data-types/index.html
index 251e2ce..c52c50a 100644
--- a/content/documentation/dsls/sql/data-types/index.html
+++ b/content/documentation/dsls/sql/data-types/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/joins/index.html 
b/content/documentation/dsls/sql/joins/index.html
index eca1027..0cd17e2 100644
--- a/content/documentation/dsls/sql/joins/index.html
+++ b/content/documentation/dsls/sql/joins/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/lexical/index.html 
b/content/documentation/dsls/sql/lexical/index.html
index aa8a39d..15cf06c 100644
--- a/content/documentation/dsls/sql/lexical/index.html
+++ b/content/documentation/dsls/sql/lexical/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/overview/index.html 
b/content/documentation/dsls/sql/overview/index.html
index 70d832a..2d0c8b4 100644
--- a/content/documentation/dsls/sql/overview/index.html
+++ b/content/documentation/dsls/sql/overview/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/scalar-functions/index.html 
b/content/documentation/dsls/sql/scalar-functions/index.html
index daaba3e..781e07c 100644
--- a/content/documentation/dsls/sql/scalar-functions/index.html
+++ b/content/documentation/dsls/sql/scalar-functions/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/select/index.html 
b/content/documentation/dsls/sql/select/index.html
index 813d209..1d77b77 100644
--- a/content/documentation/dsls/sql/select/index.html
+++ b/content/documentation/dsls/sql/select/index.html
@@ -183,6 +183,7 @@
   
 Overview
 Walkthrough
+Shell
 
   SQL Reference
 
diff --git a/content/documentation/dsls/sql/set/index.html 
b/content/documentation/dsls/sql/set/index.html
index 3611b4b..144c71a 100644
--- 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 24a85883546224ab289e7fc68857c2b869355c52
Author: Mergebot 
AuthorDate: Wed Aug 8 23:30:00 2018 +

Prepare repository for deployment.
---
 content/get-started/quickstart-go/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/get-started/quickstart-go/index.html 
b/content/get-started/quickstart-go/index.html
index 19a4dda..8a2435a 100644
--- a/content/get-started/quickstart-go/index.html
+++ b/content/get-started/quickstart-go/index.html
@@ -216,7 +216,7 @@ limitations under the License.
 
 The Beam SDK for Go requires go 
version 1.10 or newer. It can be downloaded https://golang.org/;>here. Check that you have version 1.10 by 
running:
 
-$ go --version
+$ go version
 
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 10c772af8655ba7df8b9a74fb5c6cab727eea934
Author: Mergebot 
AuthorDate: Wed Aug 8 23:23:01 2018 +

Prepare repository for deployment.
---
 content/get-started/downloads/index.html | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/content/get-started/downloads/index.html 
b/content/get-started/downloads/index.html
index 8afd92a..7a1ca7d 100644
--- a/content/get-started/downloads/index.html
+++ b/content/get-started/downloads/index.html
@@ -283,9 +283,9 @@ versions denoted 0.x.y.
 https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12343392;>Release
 notes.
 
 2.5.0 (2018-06-06)
-Official https://dist.apache.org/repos/dist/release/beam/2.5.0/apache-beam-2.5.0-source-release.zip;>source
 code download
-https://dist.apache.org/repos/dist/release/beam/2.5.0/apache-beam-2.5.0-source-release.zip.sha512;>SHA-512
-https://dist.apache.org/repos/dist/release/beam/2.5.0/apache-beam-2.5.0-source-release.zip.asc;>signature.
+Official https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip;>source
 code download
+https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip.sha512;>SHA-512
+https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip.asc;>signature.
 
 https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12342847;>Release
 notes.
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 625137a4ef51cbce219628d3ffc59282b9b7b6cf
Author: Mergebot 
AuthorDate: Wed Aug 8 20:10:24 2018 +

Prepare repository for deployment.
---
 content/get-started/downloads/index.html | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/content/get-started/downloads/index.html 
b/content/get-started/downloads/index.html
index bcbb1df..8afd92a 100644
--- a/content/get-started/downloads/index.html
+++ b/content/get-started/downloads/index.html
@@ -182,7 +182,7 @@
   API stability
   Releases
 
-  2.6.0 (2018-07-31)
+  2.6.0 (2018-08-08)
   2.5.0 (2018-06-06)
   2.4.0 (2018-03-20)
   2.3.0 (2018-01-30)
@@ -275,7 +275,7 @@ versions denoted 0.x.y.
 
 Releases
 
-2.6.0 (2018-07-31)
+2.6.0 (2018-08-08)
 Official https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip;>source
 code download
 https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512;>SHA-512
 https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip.asc;>signature.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit a763a756679965650b554d0c1a24a5b3630a78ef
Author: Mergebot 
AuthorDate: Mon Aug 6 23:23:55 2018 +

Prepare repository for deployment.
---
 content/documentation/sdks/java/nexmark/index.html | 4 
 1 file changed, 4 insertions(+)

diff --git a/content/documentation/sdks/java/nexmark/index.html 
b/content/documentation/sdks/java/nexmark/index.html
index 96349f1..9ef1dbe 100644
--- a/content/documentation/sdks/java/nexmark/index.html
+++ b/content/documentation/sdks/java/nexmark/index.html
@@ -1042,6 +1042,8 @@ PUBSUB_TOPCI=existing pubsub topic
 
 https://apache-beam-testing.appspot.com/explore?dashboard=5138380291571712;>Nexmark
 performance spark runner
 
+https://apache-beam-testing.appspot.com/explore?dashboard=5670405876482048;>Nexmark
 performance dataflow runner
+
 Output size dashboards links
 
 https://apache-beam-testing.appspot.com/explore?dashboard=5099379773931520;>Nexmark
 output size direct runner
@@ -1050,6 +1052,8 @@ PUBSUB_TOPCI=existing pubsub topic
 
 https://apache-beam-testing.appspot.com/explore?dashboard=5163657986048000;>Nexmark
 output size spark runner
 
+https://apache-beam-testing.appspot.com/explore?dashboard=5647201107705856;>Nexmark
 output size dataflow runner
+
 
   
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e568ceabc4cf5f1dda5d6cc1b0655e74048e92a2
Author: Mergebot 
AuthorDate: Fri Aug 3 14:23:13 2018 +

Prepare repository for deployment.
---
 .../io/built-in/{ => hcatalog}/index.html  | 288 +++--
 content/documentation/io/built-in/index.html   |   2 +-
 2 files changed, 148 insertions(+), 142 deletions(-)

diff --git a/content/documentation/io/built-in/index.html 
b/content/documentation/io/built-in/hcatalog/index.html
similarity index 63%
copy from content/documentation/io/built-in/index.html
copy to content/documentation/io/built-in/hcatalog/index.html
index 1ae8922..69f36af 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/hcatalog/index.html
@@ -28,7 +28,7 @@
   
   
   
-  Built-in I/O Transforms
+  Apache HCatalog InputFormat IO
   
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
@@ -39,7 +39,7 @@
   
   
   
-  https://beam.apache.org/documentation/io/built-in/; data-proofer-ignore>
+  https://beam.apache.org/documentation/io/built-in/hcatalog/; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit b572094450e08ba4f4a8e4181c6dbe61d1003481
Author: Mergebot 
AuthorDate: Fri Aug 3 07:28:48 2018 +

Prepare repository for deployment.
---
 content/documentation/io/built-in/index.html | 5 +
 1 file changed, 1 insertion(+), 4 deletions(-)

diff --git a/content/documentation/io/built-in/index.html 
b/content/documentation/io/built-in/index.html
index 9a8de18..1ae8922 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/index.html
@@ -310,6 +310,7 @@ limitations under the License.
 Apache Hadoop 
InputFormat
 https://github.com/apache/beam/tree/master/sdks/java/io/hbase;>Apache 
HBase
 https://github.com/apache/beam/tree/master/sdks/java/io/hcatalog;>Apache 
Hive (HCatalog)
+https://github.com/apache/beam/tree/master/sdks/java/io/kudu;>Apache 
Kudu
 https://github.com/apache/beam/tree/master/sdks/java/io/solr;>Apache 
Solr
 https://github.com/apache/beam/tree/master/sdks/java/io/elasticsearch;>Elasticsearch
 (v2.x and v5.x)
 https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery;>Google
 BigQuery
@@ -362,10 +363,6 @@ limitations under the License.
 https://issues.apache.org/jira/browse/BEAM-3788;>BEAM-3788
   
   
-Apache KuduJava
-https://issues.apache.org/jira/browse/BEAM-2661;>BEAM-2661
-
-  
 Apache SqoopJava
 https://issues.apache.org/jira/browse/BEAM-67;>BEAM-67
   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit bcb7061eb21de36e7ea353d4337fef6537e6db48
Author: Mergebot 
AuthorDate: Wed Aug 1 21:09:18 2018 +

Prepare repository for deployment.
---
 content/contribute/testing/index.html | 273 +-
 1 file changed, 5 insertions(+), 268 deletions(-)

diff --git a/content/contribute/testing/index.html 
b/content/contribute/testing/index.html
index 85a50d8..333a387 100644
--- a/content/contribute/testing/index.html
+++ b/content/contribute/testing/index.html
@@ -28,7 +28,7 @@
   
   
   
-  Beam Testing Guide
+  Beam Testing
   
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
@@ -195,13 +195,6 @@
 
 
 
-  Overview
-  Testing Matrix
-
-  Java SDK
-  Python SDK
-
-  
   Testing Scenarios
 
   Precommit
@@ -251,267 +244,11 @@ See the License for the specific language governing 
permissions and
 limitations under the License.
 -->
 
-Beam Testing Documentation
-
-
-  Overview
-  Testing 
Matrix
-  Java SDK
-  Python 
SDK
-
-  
-  Testing 
Scenarios
-  Precommit
-  Postcommit
-
-  
-  Testing 
Types
-  Unit
-  How to run Python unit 
tests
-  How to run Java NeedsRunner 
tests
-
-  
-  ValidatesRunner
-  E2E
-
-  
-  Testing 
Systems
-  E2E Testing Framework
-  ValidatesRunner Tests
-  Effective use of 
the TestPipeline JUnit rule
-  API Surface testing
-
-  
-  Best 
practices for writing tests
-  Aim for one failure path
-  Avoid non-deterministic 
code
-  Use descriptive test names
-  Use a pre-commit test if 
possible
-
-  
-
+Beam Testing
 
-Overview
-
-Apache Beam is a rapidly-maturing software project with a strong
-commitment to testing. Consequently, it has many testing-related needs. It
-requires precommit tests to ensure code going into the repository meets a
-certain quality bar and it requires ongoing postcommit tests to make sure that
-more subtle changes which escape precommit are nonetheless caught. This 
document
-outlines how to write tests, which tests are appropriate where, and when tests
-are run, with some additional information about the testing systems at the
-bottom.
-
-If you’re writing tests, take a look at the testing matrix first, find what 
you
-want to test, then look into the “Scenarios” and “Types” sections below for 
more
-details on those testing types.
-
-Testing Matrix
-
-Java SDK
-
-
-  
-   Component to Test
-   
-   Test Scenario
-   
-   Tool to Use
-   
-   Link to Example
-   
-   Type
-   
-   Runs In
-   
-  
-   BoundedSource
-   
-   Correctly Reads Input
-   
-   https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/SourceTestUtils.java#L128;>SourceTestUtils.readFromSource
-   
-   https://github.com/apache/beam/blob/84a0dd1714028370befa80dea16f720edce05252/sdks/java/core/src/test/java/org/apache/beam/sdk/io/TextIOTest.java#L972;>TextIOTest
-   
-   Unit
-   
-   Precommit, Postcommit
-   
-  /tr
-  
-   
-   
-   Correct Initial Splitting
-   
-   https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/SourceTestUtils.java#L201;>SourceTestUtils.assertSourcesEqualReferenceSource
-   
-   https://github.com/apache/beam/blob/8b1e64a668489297e11926124c4eee6c8f69a3a7/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigtable/BigtableIOTest.java#L339;>BigtableTest
-   
-   Unit
-   
-   Precommit, Postcommit
-   
-  
-  
-   
-   
-   Correct Dynamic Splitting
-   
-   https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/testing/SourceTestUtils.java#L541;>SourceTestUtils.
 assertSplitAtFractionExhaustive
-   
-   https://github.com/apache/beam/blob/84a0dd1714028370befa80dea16f720edce05252/sdks/java/core/src/test/java/org/apache/beam/sdk/io/TextIOTest.java#L1021;>TextIOTest
-   
-   Unit
-   
-   Precommit, Postcommit
-   
-  
-  
-   Transform
-   
-   Correctness
-   
-   @NeedsRunner Test
-   
-   https://github.com/apache/beam/blob/master/sdks/java/core/src/test/java/org/apache/beam/sdk/transforms/ParDoTest.java#L1199;>ParDoTest
-   
-   @NeedsRunner
-   
-   
-   
-  
-  
-   Example Pipeline
-   
-   Verify Behavior on Each Runner
-   
-   E2E Test
-   
-   https://github.com/apache/beam/blob/master/examples/java/src/test/java/org/apache/beam/examples/WordCountIT.java#L76;>WordCountIT
-   
-   E2E
-   
-   Postcommit (Except WordCountIT)
-   
-  
-  
-   Source/Sink with external resource
-   
-   External Resource Faked
-   
-   Unit / @NeedsRunner Test
-   
-   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 6d7fd1a3fe225a73e08c32f6ec15e78868252913
Author: Mergebot 
AuthorDate: Fri Jul 27 21:29:05 2018 +

Prepare repository for deployment.
---
 content/contribute/become-a-committer/index.html   |   6 +
 content/contribute/committer-guide/index.html  |   6 +
 content/contribute/dependencies/index.html |   6 +
 content/contribute/design-documents/index.html |   6 +
 content/contribute/docker-images/index.html|   6 +
 content/contribute/eclipse/index.html  |   6 +
 content/contribute/index.html  |   6 +
 content/contribute/intellij/index.html |   6 +
 content/contribute/portability/index.html  |   6 +
 .../index.html | 151 ++---
 .../index.html | 122 +
 .../{eclipse => postcommits-policies}/index.html   | 151 ++---
 .../contribute/ptransform-style-guide/index.html   |   6 +
 content/contribute/release-guide/index.html|   6 +
 content/contribute/runner-guide/index.html |   6 +
 content/contribute/testing/index.html  | 105 ++
 .../contribute/website-contributions/index.html|   6 +
 17 files changed, 389 insertions(+), 218 deletions(-)

diff --git a/content/contribute/become-a-committer/index.html 
b/content/contribute/become-a-committer/index.html
index 2a9bbc0..1ccffc9 100644
--- a/content/contribute/become-a-committer/index.html
+++ b/content/contribute/become-a-committer/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/committer-guide/index.html 
b/content/contribute/committer-guide/index.html
index 72770da..58e5ed5 100644
--- a/content/contribute/committer-guide/index.html
+++ b/content/contribute/committer-guide/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/dependencies/index.html 
b/content/contribute/dependencies/index.html
index 57c2c13..a4a306f 100644
--- a/content/contribute/dependencies/index.html
+++ b/content/contribute/dependencies/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/design-documents/index.html 
b/content/contribute/design-documents/index.html
index eee9c3b..93e2fab 100644
--- a/content/contribute/design-documents/index.html
+++ b/content/contribute/design-documents/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/docker-images/index.html 
b/content/contribute/docker-images/index.html
index ec15c74..dc3c803 100644
--- a/content/contribute/docker-images/index.html
+++ b/content/contribute/docker-images/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/eclipse/index.html 
b/content/contribute/eclipse/index.html
index 5545811..6e26d29 100644
--- a/content/contribute/eclipse/index.html
+++ b/content/contribute/eclipse/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/index.html b/content/contribute/index.html
index 580062e..7a5ad79 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/intellij/index.html 
b/content/contribute/intellij/index.html
index 449b20f..f35bbfa 100644
--- a/content/contribute/intellij/index.html
+++ b/content/contribute/intellij/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/portability/index.html 
b/content/contribute/portability/index.html
index f0f247d..09d0e57 100644
--- a/content/contribute/portability/index.html
+++ b/content/contribute/portability/index.html
@@ -160,6 +160,12 @@
   
 
 
+  Policies
+  
+Post-commit tests 
policies
+  
+
+
   Committers
 
   
diff --git a/content/contribute/website-contributions/index.html 
b/content/contribute/postcommits-guides/index.html
similarity index 79%
copy from content/contribute/website-contributions/index.html
copy to content/contribute/postcommits-guides/index.html
index 7c52811..be19269 100644
--- a/content/contribute/website-contributions/index.html
+++ b/content/contribute/postcommits-guides/index.html
@@ -28,7 +28,7 @@
   
   
   
-  Beam Website Contributions
+  Post-commit tests processes guides
   
   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 8a7108dddbb79882c4a5909d41a6c1574ba5eb4e
Author: Mergebot 
AuthorDate: Tue Jul 24 23:46:13 2018 +

Prepare repository for deployment.
---
 content/contribute/dependencies/index.html | 18 --
 1 file changed, 16 insertions(+), 2 deletions(-)

diff --git a/content/contribute/dependencies/index.html 
b/content/contribute/dependencies/index.html
index 9cb343b..57c2c13 100644
--- a/content/contribute/dependencies/index.html
+++ b/content/contribute/dependencies/index.html
@@ -190,6 +190,7 @@
 
 
   Identifying outdated 
dependencies
+  JIRA Automation
   Upgrading 
identified outdated dependencies
   Dependency 
updates and backwards compatibility
 
@@ -238,7 +239,7 @@ limitations under the License.
 
 A big part of keeping dependencies up to date involves identifying outdated 
dependencies of Beam that the community should try to upgrade.
 
-Beam currently executes a weekly Jenkins job that tries to identify 
outdated dependencies for various SDKs. This Jenkins job generates a weekly 
report that is shared in Beam dev list. In the future we hope to automatically 
create JIRAs based on this report.
+Beam currently executes a weekly Jenkins job that tries to identify 
outdated dependencies for various SDKs. This Jenkins job generates a weekly 
report that is shared in Beam dev list.
 
 In addition to this, Beam community members might identify other critical 
dependency updates that have to be manually performed. For example,
 
@@ -248,6 +249,19 @@ limitations under the License.
 
 These kind of urgently required upgrades might not get automatically picked 
up by the Jenkins job for few months. So Beam community has to act to identify 
such issues and perform upgrades early.
 
+JIRA Automation
+
+In order to track the dependency upgrade process, JIRA tickets will be 
created per significant outdated dependency based on the report. A bot named 
Beam Jira Bot was created for managing JIRA issues. Beam community 
agrees on the following policies that creates and updates issues.
+
+  Issues will be named as “Beam Dependency Update Request:  
".
+  Issues will be created under the component “dependencies”
+  Issues will be assigned to the primary owner of the dependencies, who 
are mentioned in the dependency ownership files. (https://github.com/apache/beam/blob/master/ownership/JAVA_DEPENDENCY_OWNERS.yaml;>Java
 Dependency Owners and https://github.com/apache/beam/blob/master/ownership/PYTHON_DEPENDENCY_OWNERS.yaml;>Python
 Dependency Owners)
+  If more than one owners found for a dependency, the first owner will be 
picked as the primary owner, the others will be pinged in the issue’s 
description.
+  If no owners found, leave the assignee empty. The component lead is 
responsible for triaging the issue.
+  Avoid creating duplicate issues. Updating the descriptions of the open 
issues created by the previous dependency check.
+  The dependency sometimes is not able to be upgraded, the issue should be 
closed as “won’t fix”. And, the bot should avoid recreating issues 
with “won’t fix”.
+
+
 Upgrading identified 
outdated dependencies
 
 After outdated dependencies are identified, Beam community has to act to 
upgrade the dependencies regularly. Beam community has agreed on following 
policies regarding upgrading dependencies.
@@ -268,7 +282,7 @@ limitations under the License.
 
 Dependency declarations may identify owners that are responsible 
for upgrading respective dependencies.
 
-Owners can be mentioned in a comment. Blocking JIRAs will be initially 
assigned to these owners (if available). Release manager may choose to 
re-assign these JIRAs. A dependency may have more than one declared owner and 
in this case the JIRA will be assigned to one of the owners mentioned.
+Owners can be mentioned in the yaml files. Blocking JIRAs will be initially 
assigned to these owners (if available). Release manager may choose to 
re-assign these JIRAs. A dependency may have more than one declared owner and 
in this case the JIRA will be assigned to one of the owners mentioned.
 
 Dependencies of Java SDK components that may cause issues to other 
components if leaked should be vendored.
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 6a757d6e7dd0d13d37fd6803807349375f71d284
Author: Mergebot 
AuthorDate: Tue Jul 24 00:24:05 2018 +

Prepare repository for deployment.
---
 content/get-started/quickstart-java/index.html | 5 -
 1 file changed, 5 deletions(-)

diff --git a/content/get-started/quickstart-java/index.html 
b/content/get-started/quickstart-java/index.html
index 2a3993a..15c6a77 100644
--- a/content/get-started/quickstart-java/index.html
+++ b/content/get-started/quickstart-java/index.html
@@ -319,11 +319,6 @@ d-7/19/2018  11:00 PMsubprocess
 
 
 
-PS mvn compile exec:java -D 
exec.mainClass=org.apache.beam.examples.WordCount `
- -D exec.args="--inputFile=pom.xml --output=counts" -P direct-runner
-
-
-
 $ mvn 
compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
  -Dexec.args="--inputFile=pom.xml --output=counts --runner=ApexRunner" 
-Papex-runner
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e26fcbe915094063eae2d65f1dd9dfa40bdaac54
Author: Mergebot 
AuthorDate: Mon Jul 23 18:57:37 2018 +

Prepare repository for deployment.
---
 content/get-started/quickstart-java/index.html | 93 +-
 1 file changed, 91 insertions(+), 2 deletions(-)

diff --git a/content/get-started/quickstart-java/index.html 
b/content/get-started/quickstart-java/index.html
index eb293de..2a3993a 100644
--- a/content/get-started/quickstart-java/index.html
+++ b/content/get-started/quickstart-java/index.html
@@ -229,7 +229,7 @@ limitations under the License.
 
 The easiest way to get a copy of the WordCount pipeline is to use the 
following command to generate a simple Maven project that contains Beam’s 
WordCount examples and builds against the most recent Beam release:
 
-$ mvn 
archetype:generate \
+$ mvn 
archetype:generate \
   -DarchetypeGroupId=org.apache.beam \
   -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \
   -DarchetypeVersion=2.5.0 \
@@ -241,9 +241,21 @@ limitations under the License.
 
 
 
+PS mvn archetype:generate `
+ -D archetypeGroupId=org.apache.beam `
+ -D archetypeArtifactId=beam-sdks-java-maven-archetypes-examples `
+ -D archetypeVersion=2.5.0 `
+ -D groupId=org.example `
+ -D artifactId=word-count-beam `
+ -D version="0.1" `
+ -D package=org.apache.beam.examples `
+ -D interactiveMode=false
+
+
+
 This will create a directory word-count-beam that contains a simple pom.xml and a series of example pipelines that 
count words in text files.
 
-$ cd 
word-count-beam/
+$ cd 
word-count-beam/
 
 $ ls
 pom.xmlsrc
@@ -254,6 +266,32 @@ MinimalWordCount.java  WordCount.java
 
 
 
+PS cd .\word-count-beam
+
+PS dir
+
+... 
+ 
+ModeLastWriteTime Length Name  
  
+- --   
  
+d-7/19/2018  11:00 PMsrc   
  
+-a7/19/2018  11:00 PM  16051 pom.xml
+
+PS dir .\src\main\java\org\apache\beam\examples
+
+...
+ModeLastWriteTime Length Name  
  
+- --   
  
+d-7/19/2018  11:00 PMcommon
  
+d-7/19/2018  11:00 PMcomplete  
  
+d-7/19/2018  11:00 PMsubprocess
  
+-a7/19/2018  11:00 PM   7073 DebuggingWordCount.java   
  
+-a7/19/2018  11:00 PM   5945 MinimalWordCount.java 
  
+-a7/19/2018  11:00 PM   9490 WindowedWordCount.java
  
+-a7/19/2018  11:00 PM   7662 WordCount.java
+
+
+
 For a detailed introduction to the Beam concepts used in these examples, 
see the WordCount Example 
Walkthrough. Here, we’ll just focus on executing WordCount.java.
 
 Run WordCount
@@ -274,11 +312,18 @@ MinimalWordCount.java WordCount.java
   Run your first WordCount pipeline.
 
 
+For Unix shells:
+
 $ 
mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
  -Dexec.args="--inputFile=pom.xml --output=counts" -Pdirect-runner
 
 
 
+PS mvn compile exec:java -D 
exec.mainClass=org.apache.beam.examples.WordCount `
+ -D exec.args="--inputFile=pom.xml --output=counts" -P direct-runner
+
+
+
 $ mvn 
compile exec:java -Dexec.mainClass=org.apache.beam.examples.WordCount \
  -Dexec.args="--inputFile=pom.xml --output=counts --runner=ApexRunner" 
-Papex-runner
 
@@ -316,6 +361,50 @@ $ mvn compile exec:java 
-Dexec.mainClass=org.apache.beam.examples.WordCount \
  -Dexec.args="--inputFile=pom.xml --output=/tmp/counts 
--runner=SamzaRunner" -Psamza-runner
 
 
+For Windows PowerShell:
+
+PS mvn compile exec:java -D 
exec.mainClass=org.apache.beam.examples.WordCount `
+ -D exec.args="--inputFile=pom.xml --output=counts" -P direct-runner
+
+
+
+PS 
mvn compile exec:java -D exec.mainClass=org.apache.beam.examples.WordCount `
+ -D exec.args="--inputFile=pom.xml --output=counts --runner=ApexRunner" -P 
apex-runner
+
+
+
+PS mvn compile exec:java -D 
exec.mainClass=org.apache.beam.examples.WordCount `
+ -D exec.args="--runner=FlinkRunner --inputFile=pom.xml --output=counts" -P 
flink-runner
+
+
+
+PS mvn package exec:java -D 
exec.mainClass=org.apache.beam.examples.WordCount `
+ -D exec.args="--runner=FlinkRunner 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 7cbd122113c98ce7438388e9f7d2489b03a20e1e
Author: Mergebot 
AuthorDate: Mon Jul 23 07:58:35 2018 +

Prepare repository for deployment.
---
 content/contribute/portability/index.html | 32 ---
 1 file changed, 29 insertions(+), 3 deletions(-)

diff --git a/content/contribute/portability/index.html 
b/content/contribute/portability/index.html
index 30b3958..f0f247d 100644
--- a/content/contribute/portability/index.html
+++ b/content/contribute/portability/index.html
@@ -226,7 +226,10 @@ limitations under the License.
   Development

   Roadmap
   Issues
-  Status
+  Status
+  Running Python wordcount on 
Flink
+
+  
 
   
 
@@ -364,7 +367,7 @@ portably.
 for remaining execution-side features, so that any pipeline from
 any SDK can run portably on any runner. These features include side
 inputs
-[https://issues.apache.org/jira/browse/BEAM-2863;>BEAM-2863], User
+[https://issues.apache.org/jira/browse/BEAM-2863;>BEAM-2863], 
User state [https://issues.apache.org/jira/browse/BEAM-2862;>BEAM-2862], User
 timers
 [https://issues.apache.org/jira/browse/BEAM-2925;>BEAM-2925],
 Splittable DoFn
@@ -403,10 +406,33 @@ their respective components.
 
 Status
 
-MVP in progress. See the
+MVP in progress (near completion for Flink runner). See the
 https://docs.google.com/spreadsheets/d/1KDa_FGn1ShjomGd-UUDOhuh2q73de2tPz6BqHpzqvNI/edit?usp=sharing;>Portability
 support table
 for details.
 
+Running Python wordcount on 
Flink
+
+The Flink runner is currently the only runner to support portable pipeline 
execution.
+To run a basic Python wordcount (in batch mode) with embedded Flink:
+
+
+  Run once to build the SDK harness container: ./gradlew -p sdks/python/container
+docker
+  Start the Flink portable JobService endpoint: ./gradlew 
:beam-runners-flink_2.11-job-server:runShadow
+  Submit the wordcount pipeline to above endpoint: ./gradlew 
:beam-sdks-python:portableWordCount
+
+
+To run on a separate https://ci.apache.org/projects/flink/flink-docs-release-1.5/quickstart/setup_quickstart.html;>Flink
 cluster:
+
+
+  Start local Flink cluster
+  Create shaded JobService jar: ./gradlew 
:beam-runners-flink_2.11-job-server:installShadowDist
+  Start JobService with Flink web service endpoint: java -jar 
./runners/flink/job-server/build/install/beam-runners-flink_2.11-job-server-shadow/lib/beam-runners-flink_2.11-job-server-*.jar--job-host=localhost:8099"
 "--artifacts-dir=/tmp/flink-artifacts" 
"--flink-master-url=localhost:8081"
+  Submit the pipeline.
+
+
+Note: A subset of the functionality is also supported in streaming mode; 
use --streaming in the command line to 
enable it.
+
   
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 671e21752bd93ffba5dd2d86f08d64697e26cc30
Author: Mergebot 
AuthorDate: Mon Jul 23 07:32:25 2018 +

Prepare repository for deployment.
---
 content/documentation/sdks/java/nexmark/index.html | 62 ++
 1 file changed, 62 insertions(+)

diff --git a/content/documentation/sdks/java/nexmark/index.html 
b/content/documentation/sdks/java/nexmark/index.html
index dc3a5b5..96349f1 100644
--- a/content/documentation/sdks/java/nexmark/index.html
+++ b/content/documentation/sdks/java/nexmark/index.html
@@ -263,6 +263,13 @@
   Running 
query 0 on a Spark cluster with Apache Hadoop YARN
 
   
+  Nexmark dashboards
+
+  Dashboards content
+  Performance dashboards 
links
+  Output size dashboards 
links
+
+  
 
 
 
@@ -989,6 +996,61 @@ PUBSUB_TOPCI=existing pubsub topic
 
 
 
+Nexmark dashboards
+Below dashboards are used as a CI mechanism to detect no-regression on the 
Beam components. They are not supposed to be benchmark comparision of the 
runners or engines. Especially because:
+
+  Parameters of the runners are not the same
+  Nexmark is run with the runners in local (most of the time embedded) 
mode
+  Nexmark runs on a shared machine that also run all the CI and build.
+  Runners have different support of the Beam model
+  Runners have different strengths that make comparison difficult:
+
+  Some runners were designed to be batch oriented, others streaming 
oriented
+  Some are designed towards sub-second latency, others support 
auto-scaling
+
+  
+
+
+Dashboards content
+At each commit on master, Nexmark suites are run and plots are created on 
the graphs.
+
+There are 2 kinds of dashboards:
+
+  one for performances (run times of the queries)
+  one for the size of the output PCollection (which should be 
constant)
+
+
+There are dashboards for these runners (others to come):
+
+  spark
+  flink
+  direct runner
+
+
+Each dashboard contains:
+
+  graphs in batch mode
+  graphs in streaming mode
+  graphs for the 13 queries.
+
+
+Performance dashboards links
+
+https://apache-beam-testing.appspot.com/explore?dashboard=5084698770407424;>Nexmark
 performance direct runner
+
+https://apache-beam-testing.appspot.com/explore?dashboard=5699257587728384;>Nexmark
 performance flink runner
+
+https://apache-beam-testing.appspot.com/explore?dashboard=5138380291571712;>Nexmark
 performance spark runner
+
+Output size dashboards links
+
+https://apache-beam-testing.appspot.com/explore?dashboard=5099379773931520;>Nexmark
 output size direct runner
+
+https://apache-beam-testing.appspot.com/explore?dashboard=5731568492478464;>Nexmark
 output size flink runner
+
+https://apache-beam-testing.appspot.com/explore?dashboard=5163657986048000;>Nexmark
 output size spark runner
+
+
   
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 0d45033cb6950c05eb1777cc54049b7c413b82bb
Author: Mergebot 
AuthorDate: Mon Jul 23 05:20:03 2018 +

Prepare repository for deployment.
---
 content/community/contact-us/index.html|  1 +
 content/community/logos/index.html |  1 +
 .../community/{contact-us => policies}/index.html  | 50 +-
 .../community/presentation-materials/index.html|  1 +
 content/community/youtube-channel/index.html   |  1 +
 5 files changed, 14 insertions(+), 40 deletions(-)

diff --git a/content/community/contact-us/index.html 
b/content/community/contact-us/index.html
index 08e51aa..21b26b0 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/contact-us/index.html
@@ -138,6 +138,7 @@
 
 Community
 Contact Us
+Policies
 YouTube channel
 
   Promotion
diff --git a/content/community/logos/index.html 
b/content/community/logos/index.html
index 5b739dc..a7da129 100644
--- a/content/community/logos/index.html
+++ b/content/community/logos/index.html
@@ -138,6 +138,7 @@
 
 Community
 Contact Us
+Policies
 YouTube channel
 
   Promotion
diff --git a/content/community/contact-us/index.html 
b/content/community/policies/index.html
similarity index 86%
copy from content/community/contact-us/index.html
copy to content/community/policies/index.html
index 08e51aa..50b19d6 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/policies/index.html
@@ -28,7 +28,7 @@
   
   
   
-  Contact Us
+  Policies
   
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
@@ -39,7 +39,7 @@
   
   
   
-  https://beam.apache.org/community/contact-us/; 
data-proofer-ignore>
+  https://beam.apache.org/community/policies/; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 98ecf887ed01b37de60cc3ef1cdf0a8a88fe5f85
Author: Mergebot 
AuthorDate: Fri Jul 20 22:01:00 2018 +

Prepare repository for deployment.
---
 content/get-started/quickstart-py/index.html | 37 ++--
 content/js/language-switch.js|  1 +
 2 files changed, 20 insertions(+), 18 deletions(-)

diff --git a/content/get-started/quickstart-py/index.html 
b/content/get-started/quickstart-py/index.html
index b74852c..f761339 100644
--- a/content/get-started/quickstart-py/index.html
+++ b/content/get-started/quickstart-py/index.html
@@ -256,10 +256,11 @@ limitations under the License.
 If you do not have pip version 7.0.0 
or newer, run the following command to
 install it. This command might require administrative privileges.
 
-pip install --upgrade pip
+pip 
install --upgrade pip
 
 
-PS python -m 
pip install --upgrade pip
+
+PS python -m pip install --upgrade pip
 
 
 
@@ -270,10 +271,11 @@ for initial experiments. If you do not have virt
 newer, run the following command to install it. This command might require
 administrative privileges.
 
-pip install --upgrade virtualenv
+pip 
install --upgrade virtualenv
 
 
-PS python -m 
pip install --upgrade virtualenv
+
+PS python -m pip install --upgrade virtualenv
 
 
 
@@ -281,10 +283,11 @@ administrative privileges.
 setuptools is installed on your 
machine. If you do not have setuptools
 version 17.1 or newer, run the following command to install it.
 
-pip install --upgrade setuptools
+pip 
install --upgrade setuptools
 
 
-PS python -m 
pip install --upgrade setuptools
+
+PS python -m pip install --upgrade setuptools
 
 
 
@@ -294,10 +297,11 @@ version 17.1 or newer, run the following command to 
install it.
 
 A virtual environment is a directory tree containing its own Python 
distribution. To create a virtual environment, create a directory and run:
 
-virtualenv /path/to/directory
+virtualenv /path/to/directory
 
 
-PS virtualenv 
C:\path\to\directory
+
+PS virtualenv C:\path\to\directory
 
 
 
@@ -307,12 +311,11 @@ environment’s directories.
 
 To activate a virtual environment in Bash, run:
 
-{.unix}
-. 
/path/to/directory/bin/activate
+. 
/path/to/directory/bin/activate
 
 
-{.powershell}
-PS 
C:\path\to\directory\Scripts\activate.ps1
+
+PS C:\path\to\directory\Scripts\activate.ps1
 
 
 
@@ -324,10 +327,11 @@ environment’s directories.
 
 Install the latest Python SDK from PyPI:
 
-pip install apache-beam
+pip 
install apache-beam
 
 
-PS python -m 
pip install apache-beam
+
+PS python -m pip install apache-beam
 
 
 
@@ -369,10 +373,7 @@ environment’s directories.
 
 For example, run wordcount.py with 
the following command:
 
-python -m apache_beam.examples.wordcount --input 
/path/to/inputfile --output /path/to/write/counts
-
-
-python -m 
apache_beam.examples.wordcount --input C:\path\to\inputfile --output 
C:\path\to\write\counts
+python -m apache_beam.examples.wordcount --input 
/path/to/inputfile --output /path/to/write/counts
 
 
 
diff --git a/content/js/language-switch.js b/content/js/language-switch.js
index 3e7c9e7..6c30e88 100644
--- a/content/js/language-switch.js
+++ b/content/js/language-switch.js
@@ -127,4 +127,5 @@ $(document).ready(function() {
 
 Switcher({"class-prefix":"language","default":"java"}).render();
 Switcher({"class-prefix":"runner","default":"direct"}).render();
+Switcher({"class-prefix":"shell","default":"unix"}).render();
 });

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f28f99c2d686b7f91b982f4532a948a63c5ff037
Author: Mergebot 
AuthorDate: Fri Jul 20 20:51:01 2018 +

Prepare repository for deployment.
---
 content/community/contact-us/index.html | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/content/community/contact-us/index.html 
b/content/community/contact-us/index.html
index bad1306..08e51aa 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/contact-us/index.html
@@ -205,15 +205,15 @@ whichever one seems best!
   
 
   https://lists.apache.org/list.html?u...@beam.apache.org;>user@ 
mailing list
-  User support and questions (mailto:user-subscr...@beam.apache.org;>Subscribe)
+  User support and questions (mailto:user-subscr...@beam.apache.org;>Subscribe, mailto:user-unsubscr...@beam.apache.org;>Unsubscribe)
 
 
   https://lists.apache.org/list.html?d...@beam.apache.org;>dev@ mailing 
list
-  Development discussions (mailto:dev-subscr...@beam.apache.org;>Subscribe)
+  Development discussions (mailto:dev-subscr...@beam.apache.org;>Subscribe, mailto:dev-unsubscr...@beam.apache.org;>Unsubscribe)
 
 
   https://lists.apache.org/list.html?commits@beam.apache.org;>commits@ 
mailing list
-  Firehose of commits, bugs, pull requests, etc. (mailto:commits-subscr...@beam.apache.org;>Subscribe)
+  Firehose of commits, bugs, pull requests, etc. (mailto:commits-subscr...@beam.apache.org;>Subscribe, mailto:commits-unsubscr...@beam.apache.org;>Unsubscribe)
 
 
   https://issues.apache.org/jira/browse/BEAM;>JIRA bug 
tracker

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 990b9eb77d0c0eba7aa95bf7e82d7572e8ed9e48
Author: Mergebot 
AuthorDate: Fri Jul 20 20:42:35 2018 +

Prepare repository for deployment.
---
 content/documentation/io/built-in/index.html |  8 --
 content/get-started/quickstart-py/index.html | 37 ++--
 2 files changed, 36 insertions(+), 9 deletions(-)

diff --git a/content/documentation/io/built-in/index.html 
b/content/documentation/io/built-in/index.html
index a4aa05f..9a8de18 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/index.html
@@ -358,6 +358,10 @@ limitations under the License.
 https://issues.apache.org/jira/browse/BEAM-607;>BEAM-607
   
   
+Apache KafkaPython
+https://issues.apache.org/jira/browse/BEAM-3788;>BEAM-3788
+  
+  
 Apache KuduJava
 https://issues.apache.org/jira/browse/BEAM-2661;>BEAM-2661
 
@@ -390,8 +394,8 @@ limitations under the License.
 https://issues.apache.org/jira/browse/BEAM-1946;>BEAM-1946
   
   
-Apache KafkaPython
-https://issues.apache.org/jira/browse/BEAM-3788;>BEAM-3788
+Amazon SQSJava
+https://issues.apache.org/jira/browse/BEAM-4828;>BEAM-4828
   
 
 
diff --git a/content/get-started/quickstart-py/index.html 
b/content/get-started/quickstart-py/index.html
index a504f20..b74852c 100644
--- a/content/get-started/quickstart-py/index.html
+++ b/content/get-started/quickstart-py/index.html
@@ -256,7 +256,10 @@ limitations under the License.
 If you do not have pip version 7.0.0 
or newer, run the following command to
 install it. This command might require administrative privileges.
 
-pip install 
--upgrade pip
+pip install --upgrade pip
+
+
+PS python -m 
pip install --upgrade pip
 
 
 
@@ -267,7 +270,10 @@ for initial experiments. If you do not have virt
 newer, run the following command to install it. This command might require
 administrative privileges.
 
-pip install 
--upgrade virtualenv
+pip install --upgrade virtualenv
+
+
+PS python -m 
pip install --upgrade virtualenv
 
 
 
@@ -275,7 +281,10 @@ administrative privileges.
 setuptools is installed on your 
machine. If you do not have setuptools
 version 17.1 or newer, run the following command to install it.
 
-pip install 
--upgrade setuptools
+pip install --upgrade setuptools
+
+
+PS python -m 
pip install --upgrade setuptools
 
 
 
@@ -285,7 +294,10 @@ version 17.1 or newer, run the following command to 
install it.
 
 A virtual environment is a directory tree containing its own Python 
distribution. To create a virtual environment, create a directory and run:
 
-virtualenv 
/path/to/directory
+virtualenv /path/to/directory
+
+
+PS virtualenv 
C:\path\to\directory
 
 
 
@@ -295,11 +307,16 @@ environment’s directories.
 
 To activate a virtual environment in Bash, run:
 
+{.unix}
 . 
/path/to/directory/bin/activate
 
 
+{.powershell}
+PS 
C:\path\to\directory\Scripts\activate.ps1
+
+
 
-That is, source the script bin/activate under the virtual environment 
directory you created.
+That is, execute the activate script 
under the virtual environment directory you created.
 
 For instructions using other shells, see the https://virtualenv.pypa.io/en/stable/userguide/#activate-script;>virtualenv
 documentation.
 
@@ -307,7 +324,10 @@ environment’s directories.
 
 Install the latest Python SDK from PyPI:
 
-pip install 
apache-beam
+pip install apache-beam
+
+
+PS python -m 
pip install apache-beam
 
 
 
@@ -349,7 +369,10 @@ environment’s directories.
 
 For example, run wordcount.py with 
the following command:
 
-python -m apache_beam.examples.wordcount --input 
/path/to/inputfile --output /path/to/write/counts
+python -m apache_beam.examples.wordcount --input 
/path/to/inputfile --output /path/to/write/counts
+
+
+python -m 
apache_beam.examples.wordcount --input C:\path\to\inputfile --output 
C:\path\to\write\counts
 
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 7fa3a82d039ab2a8e3a9e0695592c62708bc6a96
Author: Mergebot 
AuthorDate: Wed Jul 18 23:36:22 2018 +

Prepare repository for deployment.
---
 content/contribute/intellij/index.html | 5 +
 1 file changed, 5 insertions(+)

diff --git a/content/contribute/intellij/index.html 
b/content/contribute/intellij/index.html
index 38a88c2..449b20f 100644
--- a/content/contribute/intellij/index.html
+++ b/content/contribute/intellij/index.html
@@ -292,6 +292,11 @@ modules as they are not configured for Checkstyle 
validation.
 
 Code Style
 
+Note: As of release 2.6.0 uniform formatting for Java and Groovy code is 
automated by the build
+through the https://github.com/diffplug/spotless/tree/master/plugin-gradle;>Spotless 
Gradle plugin.
+Instead of relying on the IDE, now you can run ./gradlew spotlessApply
+to reformat changes prior to commit.
+
 IntelliJ supports code styles within the IDE. Use one or both of the 
following
 to ensure your code style matches the project’s checkstyle enforcements.
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f851f5acf447f46f2bedf7a43c466cb3f5003cc7
Author: Mergebot 
AuthorDate: Wed Jul 18 23:29:55 2018 +

Prepare repository for deployment.
---
 content/get-started/downloads/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/get-started/downloads/index.html 
b/content/get-started/downloads/index.html
index dac771d..7cbe8d3 100644
--- a/content/get-started/downloads/index.html
+++ b/content/get-started/downloads/index.html
@@ -290,7 +290,7 @@ versions denoted 0.x.y.
 2.4.0 (2018-03-20)
 Official https://archive.apache.org/dist/beam/2.4.0/apache-beam-2.4.0-source-release.zip;>source
 code download
 
-https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12341608;>Release
 notes.
+https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527version=12342682;>Release
 notes.
 
 2.3.0 (2018-01-30)
 Official https://archive.apache.org/dist/beam/2.3.0/apache-beam-2.3.0-source-release.zip;>source
 code download.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 10148e1d402e4c8c31e20f89f9ae1ed72b782387
Author: Mergebot 
AuthorDate: Wed Jul 18 21:52:35 2018 +

Prepare repository for deployment.
---
 content/get-started/wordcount-example/index.html | 40 ++--
 1 file changed, 24 insertions(+), 16 deletions(-)

diff --git a/content/get-started/wordcount-example/index.html 
b/content/get-started/wordcount-example/index.html
index 7844c32..57b5597 100644
--- a/content/get-started/wordcount-example/index.html
+++ b/content/get-started/wordcount-example/index.html
@@ -199,7 +199,7 @@
   
   WindowedWordCount example
 
-  Unbounded and 
bounded pipeline input modes
+  Unbounded and bounded 
datasets
   Adding timestamps to 
data
   Windowing
   Reusing 
PTransforms over windowed PCollections
@@ -207,7 +207,7 @@
   
   StreamingWordCount example
 
-  Reading an unbounded data 
set
+  Reading an unbounded 
dataset
   Writing unbounded 
results
 
   
@@ -259,14 +259,14 @@ limitations under the License.
 
   
   WindowedWordCount example

-  Unbounded and 
bounded pipeline input modes
+  Unbounded and bounded 
datasets
   Adding timestamps to data
   Windowing
   Reusing 
PTransforms over windowed PCollections
 
   
   StreamingWordCount example

-  Reading an unbounded data 
set
+  Reading an unbounded 
dataset
   Writing unbounded results
 
   
@@ -414,7 +414,7 @@ nested transforms (which is a PCollection.
 PCollection is a special class, 
provided by the Beam SDK, that you can use to
-represent a data set of virtually any size, including unbounded data sets.
+represent a dataset of virtually any size, including unbounded datasets.
 
 
 
@@ -1173,12 +1173,11 @@ or DEBUG significantly increases the amount of logs 
output.
 PAssertassert_that
 is a set of convenient PTransforms in the style of Hamcrest’s collection
 matchers that can be used when writing pipeline level tests to validate the
-contents of PCollections. Asserts are best used in unit tests with small data
-sets.
+contents of PCollections. Asserts are best used in unit tests with small 
datasets.
 
 The passert 
package contains convenient PTransforms that can be used when
 writing pipeline level tests to validate the contents of PCollections. Asserts
-are best used in unit tests with small data sets.
+are best used in unit tests with small datasets.
 
 The following example verifies that the set of 
filtered words matches our
 expected counts. The assert does not produce any output, and the pipeline only
@@ -1223,7 +1222,7 @@ examples did, but introduces several advanced 
concepts.
 New Concepts:
 
 
-  Unbounded and bounded pipeline input modes
+  Unbounded and bounded datasets
   Adding timestamps to data
   Windowing
   Reusing PTransforms over windowed PCollections
@@ -1360,12 +1359,21 @@ $ windowed_wordcount --input 
gs://dataflow-samples/shakespeare/kinglear.txt \
 To view the full code in Go, see
 https://github.com/apache/beam/blob/master/sdks/go/examples/windowed_wordcount/windowed_wordcount.go;>windowed_wordcount.go.
 
-Unbounded and bounded 
pipeline input modes
+Unbounded and bounded datasets
 
 Beam allows you to create a single pipeline that can handle both bounded and
-unbounded types of input. If your input has a fixed number of elements, it’s
-considered a ‘bounded’ data set. If your input is continuously updating, then
-it’s considered ‘unbounded’ and you must use a runner that supports 
streaming.
+unbounded datasets. If your dataset has a fixed number of elements, it is a 
bounded
+dataset and all of the data can be processed together. For bounded datasets,
+the question to ask is “Do I have all of the data?” If data continuously
+arrives (such as an endless stream of game scores in the
+https://beam.apache.org/get-started/mobile-gaming-example/;>Mobile 
gaming example,
+it is an unbounded dataset. An unbounded dataset is never available for
+processing at any one time, so the data must be processed using a streaming
+pipeline that runs continuously. The dataset will only be complete up to a
+certain point, so the question to ask is “Up until what point do I have all of
+the data?” Beam uses windowing
+to divide a continuously updating dataset into logical windows of finite size.
+If your input is unbounded, you must use a runner that supports streaming.
 
 If your pipeline’s input is bounded, then all downstream PCollections will 
also be
 bounded. Similarly, if the input is unbounded, then all downstream PCollections
@@ -1532,7 +1540,7 @@ frequency count of the words seen in each 15 second 
window.
 New Concepts:
 
 
-  Reading an unbounded data set
+  Reading an unbounded dataset
   Writing unbounded results
 
 
@@ -1593,9 +1601,9 @@ python -m 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit d153419c8a0c085608b8ea9686e8c973849ec525
Author: Mergebot 
AuthorDate: Tue Jul 17 21:34:44 2018 +

Prepare repository for deployment.
---
 content/contribute/intellij/index.html | 8 
 1 file changed, 4 insertions(+), 4 deletions(-)

diff --git a/content/contribute/intellij/index.html 
b/content/contribute/intellij/index.html
index 31ae7c1..38a88c2 100644
--- a/content/contribute/intellij/index.html
+++ b/content/contribute/intellij/index.html
@@ -228,6 +228,8 @@ limitations under the License.
 
 Create a working Gradle module
 
+(as of Intellij 2018.1.6)
+
 
   Create an empty IntelliJ project outside of the Beam source tree.
   Under Project Structure  Project, select a Project SDK.
@@ -240,14 +242,13 @@ from the list.
   Tick the following boxes.
 
   Create separate module per source set
-  Store generated project files externally
   Use default gradle wrapper
 
   
 
   
-  Delegate build actions to Gradle by going to Settings  Build, 
Execution,
-Deployment  Build Tools  Gradle and checking “Delegate IDE build/run
+  Delegate build actions to Gradle by going to Preferences/Settings  
Build, Execution,
+Deployment  Build Tools  Gradle  Runner and checking “Delegate IDE 
build/run
 actions to gradle”.
 
 
@@ -309,7 +310,6 @@ plugin
   
 
 
-
   
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 0e17f9034c50924ea365ae89b3afe2c6b2092a1a
Author: Mergebot 
AuthorDate: Tue Jul 17 18:50:12 2018 +

Prepare repository for deployment.
---
 .../documentation/dsls/sql/walkthrough/index.html  | 41 +++---
 1 file changed, 21 insertions(+), 20 deletions(-)

diff --git a/content/documentation/dsls/sql/walkthrough/index.html 
b/content/documentation/dsls/sql/walkthrough/index.html
index 3e258df..750cb9f 100644
--- a/content/documentation/dsls/sql/walkthrough/index.html
+++ b/content/documentation/dsls/sql/walkthrough/index.html
@@ -253,10 +253,10 @@ limitations under the License.
 Before applying a SQL query to a PCollection, the data in the collection must
 be in Row format. A Row represents a single, immutable record in a 
Beam SQL
 PCollection. The names and types of the 
fields/columns in the row are defined
-by its associated RowType.
-For SQL queries, you should use the RowSqlType.builder()
 to create
-RowTypes, it allows creating schemas 
with all supported SQL types (see Data
-Types for more details on supported primitive data types).
+by its associated Schema.
+You can use the Schema.builder()
 to create
+Schemas. See Data
+Types for more details on supported primitive data types.
 
 A PCollectionRow can be 
obtained multiple ways, for example:
 
@@ -267,18 +267,18 @@ Types for more details on supported primitive data 
types).
 Note: you have to explicitly specify the Row coder. In this example we’re doing it by 
calling Create.of(..).withCoder():
 
 // Define the record type (i.e., 
schema).
-RowType appType = 
-RowSqlType
+Schema appSchema = 
+Schema
   .builder()
-  .withIntegerField("appId")
-  .withVarcharField("description")
-  .withTimestampField("rowtime")
+  .addInt32Field("appId")
+  .addStringField("description")
+  .addDateTimeField("rowtime")
   .build();
 
 // Create a concrete row with that type.
 Row row = 
 Row
-  .withRowType(appType)
+  .withSchema(appSchema)
   .addValues(1, "Some cool app", new Date())
   .build();
 
@@ -288,14 +288,14 @@ Types for more details on supported primitive data 
types).
   .in(p)
   .apply(Create
 .of(row)
-.withCoder(appType.getRowCoder()));
+.withCoder(appSchema.getRowCoder()));
 
 
   
   
 From a PCollectionT of records of some other 
type  (i.e.  T is not already a 
Row), by applying a ParDo that converts input records to Row format.
 
-Note: you have to manually set the coder of the result 
by calling setCoder(appType.getRowCoder()):
+Note: you have to manually set the coder of the result 
by calling setCoder(appSchema.getRowCoder()):
 // An example POJO class.
 class AppPojo {
   Integer appId;
@@ -315,11 +315,11 @@ Types for more details on supported primitive data 
types).
   // Get the current POJO instance
   AppPojo pojo = c.element();
 
-  // Create a Row with the appType schema 
+  // Create a Row with the appSchema schema 
   // and values from the current POJO
   Row appRow = 
 Row
-  .withRowType(appType)
+  .withSchema(appSchema)
   .addValues(
 pojo.appId, 
 pojo.description, 
@@ -330,7 +330,7 @@ Types for more details on supported primitive data 
types).
   c.output(appRow);
 }
   }))
-  .setCoder(appType.getRowCoder());
+  .setCoder(appSchema.getRowCoder());
 
 
   
@@ -363,12 +363,13 @@ to either a single PCollection or a For example, you can join two PCollections:
 // Create the schema for reviews
-RowType reviewType = 
-RowSqlType.
-  .withIntegerField("appId")
-  .withIntegerField("reviewerId")
+Schema reviewSchema = 
+Schema.
+  .builder()
+  .addInt32Field("appId")
+  .addInt32Field("reviewerId")
   .withFloatField("rating")
-  .withTimestampField("rowtime")
+  .addDateTimeField("rowtime")
   .build();
 
 // Obtain the reviews records with this schema

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f82a1d7db7cf10849ed33efd05272815c266e20c
Author: Mergebot 
AuthorDate: Tue Jul 17 08:11:05 2018 +

Prepare repository for deployment.
---
 content/documentation/io/testing/index.html | 224 +---
 1 file changed, 204 insertions(+), 20 deletions(-)

diff --git a/content/documentation/io/testing/index.html 
b/content/documentation/io/testing/index.html
index fd032bb..78a9192 100644
--- a/content/documentation/io/testing/index.html
+++ b/content/documentation/io/testing/index.html
@@ -272,6 +272,7 @@
   Goals
   Integration 
tests, data stores, and Kubernetes
   Running integration 
tests
+  Performance testing 
dashboard
   Implementing Integration 
Tests
 
   
@@ -433,9 +434,9 @@ limitations under the License.
 
 The high level steps for running an integration test are:
 
-  Set up the data store corresponding to the test being run
-  Run the test, passing it connection info from the just created data 
store
-  Clean up the data store
+  Set up the data store corresponding to the test being run.
+  Run the test, passing it connection info from the just created data 
store.
+  Clean up the data store.
 
 
 Since setting up data stores and running the tests involves a number of 
steps, and we wish to time these tests when running performance benchmarks, we 
use PerfKit Benchmarker to manage the process end to end. With a single 
command, you can go from an empty Kubernetes cluster to a running integration 
test.
@@ -447,21 +448,29 @@ limitations under the License.
 Prerequisites:
 
   https://github.com/GoogleCloudPlatform/PerfKitBenchmarker;>Install 
PerfKit Benchmarker
-  Have a running Kubernetes cluster you can connect to locally using 
kubectl
+  Have a running Kubernetes cluster you can connect to locally using 
kubectl. We recommend using Google Kubernetes Engine - it’s proven working for 
all the use cases we tested.
 
 
-You won’t need to invoke PerfKit Benchmarker directly. Run ./gradlew performanceTest in project’s root 
directory, passing appropriate kubernetes scripts depending on the network 
you’re using (local network or remote one).
+You won’t need to invoke PerfKit Benchmarker directly. Run ./gradlew performanceTest task in project’s 
root directory, passing kubernetes scripts of your choice (located in 
.test_infra/kubernetes directory). It will setup PerfKitBenchmarker for you.
 
-Example run with the direct runner:
+Example run with the https://beam.apache.org/documentation/runners/direct/;>Direct 
runner:
 ./gradlew 
performanceTest -DpkbLocation="/Users/me/PerfKitBenchmarker/pkb.py" 
-DintegrationTestPipelineOptions='["--numberOfRecords=1000"]' 
-DitModule=sdks/java/io/jdbc/ 
-DintegrationTest=org.apache.beam.sdk.io.jdbc.JdbcIOIT 
-DkubernetesScripts="/Users/me/beam/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml"
 
-DbeamITOptions="/Users/me/beam/.test-infra/kubernetes/postgres/pkb-config-local.yml"
 -DintegrationTest [...]
 
 
 
-Example run with the Cloud Dataflow runner:
-/gradlew 
performanceTest -DpkbLocation="/Users/me/PerfKitBenchmarker/pkb.py" 
-DintegrationTestPipelineOptions='["--numberOfRecords=1000", 
"--project=GOOGLE_CLOUD_PROJECT", "--tempRoot=GOOGLE_STORAGE_BUCKET"]' 
-DitModule=sdks/java/io/jdbc/ 
-DintegrationTest=org.apache.beam.sdk.io.jdbc.JdbcIOIT 
-DkubernetesScripts="/Users/me/beam/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml"
 -DbeamITOptions="/Users/me/beam/.t [...]
+Example run with the https://beam.apache.org/documentation/runners/dataflow/;>Google Cloud 
Dataflow runner:
+./gradlew 
performanceTest -DpkbLocation="/Users/me/PerfKitBenchmarker/pkb.py" 
-DintegrationTestPipelineOptions='["--numberOfRecords=1000", 
"--project=GOOGLE_CLOUD_PROJECT", "--tempRoot=GOOGLE_STORAGE_BUCKET"]' 
-DitModule=sdks/java/io/jdbc/ 
-DintegrationTest=org.apache.beam.sdk.io.jdbc.JdbcIOIT 
-DkubernetesScripts="/Users/me/beam/.test-infra/kubernetes/postgres/postgres-service-for-local-dev.yml"
 -DbeamITOptions="/Users/me/beam/. [...]
 
 
 
+Example run with the HDFS filesystem and Cloud Dataflow runner:
+
+./gradlew 
performanceTest -DpkbLocation="/Users/me/PerfKitBenchmarker/pkb.py" 
-DintegrationTestPipelineOptions='["--numberOfRecords=10", 
"--project=GOOGLE_CLOUD_PROJECT", "--tempRoot=GOOGLE_STORAGE_BUCKET"]' 
-DitModule=sdks/java/io/file-based-io-tests/ 
-DintegrationTest=org.apache.beam.sdk.io.text.TextIOIT 
-DkubernetesScripts=".test-infra/kubernetes/hadoop/LargeITCluster/hdfs-multi-datanode-cluster.yml,.test-infra/kubernetes
 [...]
+
+
+
+NOTE: When using Direct runner along with HDFS cluster, please set export HADOOP_USER_NAME=root before runnning 
performanceTest task.
+
 Parameter descriptions:
 
 
@@ -485,7 +494,7 @@ limitations under the License.
 
  

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 136a2fd5b9211f216a402cbc33e78621669f903d
Author: Mergebot 
AuthorDate: Tue Jul 17 08:05:40 2018 +

Prepare repository for deployment.
---
 content/contribute/design-documents/index.html | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/content/contribute/design-documents/index.html 
b/content/contribute/design-documents/index.html
index 44251dd..eee9c3b 100644
--- a/content/contribute/design-documents/index.html
+++ b/content/contribute/design-documents/index.html
@@ -307,6 +307,9 @@ limitations under the License.
   Beam DSL_SQL branch API review [https://s.apache.org/beam-sql-dsl-api-review;>doc]
   Complex Types Support for Beam SQL DDL [https://lists.apache.org/thread.html/c494e521cb6865b1ae19a68e8e653afc562df7744e8d08087249cbe0@%3Cdev.beam.apache.org%3E;>mail]
   [SQL] Reject unsupported inputs to Joins [https://lists.apache.org/thread.html/e7a442fa9cf6b76a5b435493170508f6c42fb9ccef9bcef434424f79@%3Cdev.beam.apache.org%3E;>mail]
+  Integrating runners  IO [https://docs.google.com/document/d/1ZFVlnldrIYhUgOfxIT2JcmTFFSWTl4HwAnQsnwiNL1g;>doc]
+  Beam SQL Pipeline Options [https://docs.google.com/document/d/1UTsSBuruJRfGnVOS9eXbQI6NauCD4WnSAPgA_Y0zjdk;>doc]
+  Unbounded limit [https://docs.google.com/document/d/13zeTewHH9nfwhSlcE4x77WQwr1U2Z4sTiNRjOXUj2aw;>doc]
 
 
 Portability

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e90fe6947fa8cf27051c82ef95b2b1aba40e7459
Author: Mergebot 
AuthorDate: Mon Jul 16 21:45:43 2018 +

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html|  1 -
 content/documentation/programming-guide/index.html |  8 ++--
 .../runners/capability-matrix/index.html   | 52 +++---
 .../get-started/mobile-gaming-example/index.html   |  2 +-
 4 files changed, 31 insertions(+), 32 deletions(-)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 2ea2749..198d55a 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -682,7 +682,6 @@ git commit -m "Moving to 
${NEXT_VERSION_IN_BASE_BRANCH}-SNAPSHOT on master branc
 Update Java runner specific configurations in release branch:
 
   https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/build.gradle;>beam/runners/google-cloud-dataflow-java/build.gradle:
 change value of ‘dataflow.container_version’ to 
‘beam-release_version_number’(e.g, ‘beam-master-20180601’ to ‘beam-2.5.0’)
-  https://github.com/apache/beam/blob/master/runners/google-cloud-dataflow-java/pom.xml;>beam/runners/google-cloud-dataflow-java/pom.xml:
 change value of ‘version’ field (e.g, ‘2.5.0-SNAPSHOT’ to ‘2.5.0’)
 
 
 Start a snapshot build
diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index ac21bf4..466338e 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -392,14 +392,14 @@ read or write data to various external storage 
systems.
 A typical Beam driver program works as follows:
 
 
-  Create a Pipeline object and set 
the pipeline execution options, including
+  Create a Pipeline object and set the pipeline execution 
options, including
 the Pipeline Runner.
   Create an initial PCollection for 
pipeline data, either using the IOs
 to read data from an external storage system, or using a Create transform to
 build a PCollection from in-memory 
data.
-  Apply PTransforms to each PCollection. Transforms can change, filter,
+  Apply PTransforms to each PCollection. Transforms can change, filter,
 group, analyze, or otherwise process the elements in a PCollection. A
-transform creates a new output PCollection without consuming the input
+transform creates a new output PCollection without modifying the input
 collection. A typical pipeline applies subsequent transforms to the each 
new
 output PCollection in turn until 
processing is complete. However, note that
 a pipeline does not have to be a single straight line of transforms applied
@@ -1554,7 +1554,7 @@ of integers.
 behavior is to return a PCollection 
containing one item. That item’s value
 comes from the accumulator in the combine function that you specified when
 applying Combine. For example, the Beam 
provided sum combine function returns
-a zero value (the sum of an empty input), while the max combine function 
returns
+a zero value (the sum of an empty input), while the min combine function 
returns
 a maximal or infinite value.
 
 To have Combine instead return an 
empty PCollection if the input is empty,
diff --git a/content/documentation/runners/capability-matrix/index.html 
b/content/documentation/runners/capability-matrix/index.html
index 7509698..b6e32f5 100644
--- a/content/documentation/runners/capability-matrix/index.html
+++ b/content/documentation/runners/capability-matrix/index.html
@@ -1570,7 +1570,7 @@ limitations under the License.
   
   
   
-Splittable DoFn
+Splittable DoFn (SDF)
 
 
 
@@ -1592,7 +1592,7 @@ limitations under the License.
 
 
 
-
-~
+
 
 
 
 
-
-
+
 
 
 
 
-
-
+~
 
 
 
 
-
-
+~
 
 
 
 
-
-
+~
 
 
 
@@ -1736,7 +1736,7 @@ limitations under the License.
 
 
 
-
-
+~
 
 
   
@@ -6905,7 +6905,7 @@ limitations under the License.
   
   
   
-Splittable DoFn
+Splittable DoFn (SDF)
 
 
 
@@ -6927,7 +6927,7 @@ limitations under the License.
 
 
 
-
-Partially: supported in streaming modeSupports 
checkpointing (sequentially processing an element over several, potentially 
infinitely many calls). Does not yet support autotuning features of the Source 
API.
+Yes: Does not yet support autotuning features of 
the Source API.
 
 
 
 
-
-No: implementation in streaming mode coming soon
+Yes: 
 
 
 
 
-
-No: not implemented
+Partially: supports bounded-per-element SDFs
 
 
 
 
-
-No: implementation in streaming mode coming soon
+Partially: supports bounded-per-element SDFsimplementation in streaming mode coming soon
 
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f254995cbab58b220274876712c1df48fbd37c5d
Author: Mergebot 
AuthorDate: Thu Jul 5 01:02:13 2018 -0700

Prepare repository for deployment.
---
 content/community/contact-us/index.html|  1 +
 content/community/logos/index.html |  1 +
 .../community/presentation-materials/index.html|  1 +
 .../{contact-us => youtube-channel}/index.html | 87 +-
 4 files changed, 39 insertions(+), 51 deletions(-)

diff --git a/content/community/contact-us/index.html 
b/content/community/contact-us/index.html
index d20a8b6..bad1306 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/contact-us/index.html
@@ -138,6 +138,7 @@
 
 Community
 Contact Us
+YouTube channel
 
   Promotion
 
diff --git a/content/community/logos/index.html 
b/content/community/logos/index.html
index 220ab50..5b739dc 100644
--- a/content/community/logos/index.html
+++ b/content/community/logos/index.html
@@ -138,6 +138,7 @@
 
 Community
 Contact Us
+YouTube channel
 
   Promotion
 
diff --git a/content/community/presentation-materials/index.html 
b/content/community/presentation-materials/index.html
index 5ceff84..8e4ad6c 100644
--- a/content/community/presentation-materials/index.html
+++ b/content/community/presentation-materials/index.html
@@ -138,6 +138,7 @@
 
 Community
 Contact Us
+YouTube channel
 
   Promotion
 
diff --git a/content/community/contact-us/index.html 
b/content/community/youtube-channel/index.html
similarity index 82%
copy from content/community/contact-us/index.html
copy to content/community/youtube-channel/index.html
index d20a8b6..c5ea7ef 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/youtube-channel/index.html
@@ -28,7 +28,7 @@
   
   
   
-  Contact Us
+  Beam YouTube channel
   
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
@@ -39,7 +39,7 @@
   
   
   
-  https://beam.apache.org/community/contact-us/; 
data-proofer-ignore>
+  https://beam.apache.org/community/youtube-channel/; data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 3c0970fa24399c37cf39d7d577f67175b2836930
Author: Mergebot 
AuthorDate: Thu Jul 5 00:41:50 2018 -0700

Prepare repository for deployment.
---
 content/documentation/runners/flink/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/documentation/runners/flink/index.html 
b/content/documentation/runners/flink/index.html
index 63b23b6..2594619 100644
--- a/content/documentation/runners/flink/index.html
+++ b/content/documentation/runners/flink/index.html
@@ -273,7 +273,7 @@ limitations under the License.
   --filesToStage=target/word-count-beam--bundled-0.1.jar"
 
 
-If you have a Flink JobManager 
running on your local machine you can give localhost:6123 for
+If you have a Flink JobManager 
running on your local machine you can give localhost:8081 for
 flinkMaster.
 
 Pipeline options for the Flink 
Runner

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit b42fda3e3237a0dae6ddb39b7d34fb2960cc8461
Author: Mergebot 
AuthorDate: Mon Jul 2 21:33:03 2018 -0700

Prepare repository for deployment.
---
 content/documentation/dsls/sql/create-table/index.html | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/content/documentation/dsls/sql/create-table/index.html 
b/content/documentation/dsls/sql/create-table/index.html
index c7c1e02..a8aa955 100644
--- a/content/documentation/dsls/sql/create-table/index.html
+++ b/content/documentation/dsls/sql/create-table/index.html
@@ -373,8 +373,8 @@ LOCATION '[PROJECT_ID]:[DATASET].[TABLE]'
 
 Read Mode
 
-Not supported. BigQueryI/O is currently limited to write access only in Beam
-SQL.
+Beam SQL supports reading columns with simple types (simpleType) and arrays of simple
+types (ARRAYsimpleType).
 
 Write Mode
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e4990b6324433bbadaa170892b833601de243126
Author: Mergebot 
AuthorDate: Sat Jun 30 21:26:07 2018 -0700

Prepare repository for deployment.
---
 .../2018/06/26/beam-2.5.0.html}| 313 -
 content/blog/index.html|  30 ++
 content/feed.xml   | 156 ++
 content/index.html |  10 +-
 4 files changed, 250 insertions(+), 259 deletions(-)

diff --git a/content/index.html b/content/blog/2018/06/26/beam-2.5.0.html
similarity index 56%
copy from content/index.html
copy to content/blog/2018/06/26/beam-2.5.0.html
index d37f1cd..fe2f393 100644
--- a/content/index.html
+++ b/content/blog/2018/06/26/beam-2.5.0.html
@@ -28,9 +28,8 @@
   
   
   
-  Apache Beam
-  
+  Apache Beam 2.5.0
+  
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
   
   https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
@@ -39,7 +38,7 @@
   
   
   
-  https://beam.apache.org/; data-proofer-ignore>
+  https://beam.apache.org/blog/2018/06/26/beam-2.5.0.html; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   
@@ -52,7 +51,7 @@
   
 
 
-  
+  
 
+
+
+
+http://schema.org/BlogPosting;>
+
+  
+Apache Beam 2.5.0
+Jun 26, 2018 • 
-
-  
-
-  
-
-  
-Apache Beam: An advanced unified programming model
-  
-  
-Implement batch and streaming data processing jobs that run on any 
execution engine.
-  
-  
-Learn more
-Download Beam SDK 2.5.0
-  
-  
-Java 
Quickstart
-Python 
Quickstart
-   Go 
Quickstart
-  
-
-  
-  
-
-  
-The latest from the blog
-  
-  
-
-
-  Apache Beam 
2.3.0
-  Feb 19, 2018
-
-
-
-  Apache Beam: A Look 
Back at 2017
-  Jan 9, 2018
-
-
-
-  Timely (and 
Stateful) Processing with Apache Beam
-  Aug 28, 2017
-
-
-  
-
-  
-
-  
-
+ Alexey Romanenko [https://twitter.com/alexromdev;>@alexromdev]
+
+  
 
-
-  
-All about Apache Beam
-  
-  
-
-
-  
-Unified
-  
-  
-Use a single programming model for both batch and streaming use cases.
-  
-
-
-
-  
-Portable
-  
-  
-Execute pipelines on multiple execution environments.
-  
-
-
-
-  
-Extensible
-  
-  
-Write and share new SDKs, IO connectors, and transformation libraries.
-  
-
-
-  
-
+  
+We are glad to present the new 2.5.0 release of Beam. This release 
includes
+multiple fixes and new functionalities.  For more information
+please check the detailed release notes.
 
-
-
-
-
-
+New Features / Improvements
 
-
-  
-Works with
-  
-  
-
-
-  http://apex.apache.org;>
-
-
-
-  http://flink.apache.org;>
-
-
-
-  http://spark.apache.org/;>
-
-
-
-  https://cloud.google.com/dataflow/;>
-
-
-
-  http://gearpump.apache.org/;>
-
-
-
-  http://samza.apache.org/;>
-
-
-  
-
+Go SDK support
+The Go SDK has been officially accepted into the project, after an 
incubation period and community effort. Go pipelines run on Dataflow runner. 
More details are https://beam.apache.org/documentation/sdks/go/;>here.
 
-
-  
-
-  Testimonials
-
-
-  
-  
-
-  A framework that delivers the flexibility and advanced functionality 
our customers need.
-
-
-  
-  
-–Talend
-  
-
-  
-  
-  
-
-  Apache Beam has powerful semantics that solve real-world challenges 
of stream processing.
-
-
-  
-  
-–PayPal
-  
-
-  
-  
-  
-
-  Apache Beam represents a principled approach for analyzing data 
streams.
-
-
-  
-  
-–data Artisans
-  
-
-  
-  
-
-
-  Beam is an open source community and contributions are greatly 
appreciated!
-  If you’d like to contribute, please see the Contribute section.
-
-  
-
+Parquet support
+Support for Apache Parquet format was added. It uses Parquet 1.10 release 
which, thanks to AvroParquerWriter’s API changes, allows FileIO.Sink 
implementation.
+
+Performance/Integration Tests
+
+  Added new integration tests - 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit a7fb0bdde19372913b3df44f6a0c894858eb37b3
Author: Mergebot 
AuthorDate: Fri Jun 29 17:07:25 2018 -0700

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index 0fb48de..2ea2749 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -1253,6 +1253,8 @@ mvn compile exec:java 
-Dexec.mainClass=org.apache.beam.examples.complete.game.in
 
 Copy the source release from the dev 
repository to the release repository at 
dist.apache.org using Subversion.
 
+Move last release artifacts from dist.apache.org to archive.apache.org using Subversion. Then 
update download address for last release version, https://github.com/apache/beam-site/pull/478;>example PR.
+
 Git tag
 
 Create and push a new signed tag for the released version by copying the 
tag for the final release candidate, as follows:

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 8aaf8224451fd81f6e5d7e542556a5018d28a42b
Author: Mergebot 
AuthorDate: Thu Jun 28 20:42:30 2018 -0700

Prepare repository for deployment.
---
 content/contribute/eclipse/index.html | 2 +-
 content/contribute/index.html | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/content/contribute/eclipse/index.html 
b/content/contribute/eclipse/index.html
index 1bf4c2e..3d5d8f5 100644
--- a/content/contribute/eclipse/index.html
+++ b/content/contribute/eclipse/index.html
@@ -297,7 +297,7 @@ plugin.
 Code Style
 
 Eclipse supports code styles within the IDE. Use one or both of the 
following
-to ensure your code style matches the project’s checkstyle enforcements.
+to ensure your code style matches the project’s checkstyle enforcement.
 
 
   The simplest way to have uniform code style is to use the https://github.com/google/google-java-format#eclipse;>Google
diff --git a/content/contribute/index.html b/content/contribute/index.html
index 929ccee..ab2450d 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -388,7 +388,7 @@ properly test your code.
 The following commands should be run in the sdks/python directory.
 This installs Python from source and includes the test and gcp 
dependencies.
 
-On macOS/Linix:
+On macOS/Linux:
 
 $ virtualenv env
 $ . ./env/bin/activate

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit e534020ca801484e152110234e70683fbb5c37d5
Author: Mergebot 
AuthorDate: Thu Jun 28 20:17:57 2018 -0700

Prepare repository for deployment.
---
 content/community/contact-us/index.html | 1 +
 1 file changed, 1 insertion(+)

diff --git a/content/community/contact-us/index.html 
b/content/community/contact-us/index.html
index df4bbf4..348e89d 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/contact-us/index.html
@@ -229,6 +229,7 @@ whichever one seems best!
   
 
 
+If you wish to report a security vulnerability, please contact mailto:secur...@apache.org;>secur...@apache.org. Apache Beam follows 
the typical https://apache.org/security/committers.html#vulnerability-handling;>Apache
 vulnerability handling process.
 
   
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 1843b62822fcd233099b942e7d5b41dc01137e73
Author: Mergebot 
AuthorDate: Thu Jun 28 16:13:01 2018 -0700

Prepare repository for deployment.
---
 .../dsls/sql/statements/create-table/index.html| 425 -
 content/documentation/programming-guide/index.html | 103 ++---
 .../get-started/mobile-gaming-example/index.html   |  96 +++--
 3 files changed, 526 insertions(+), 98 deletions(-)

diff --git a/content/documentation/dsls/sql/statements/create-table/index.html 
b/content/documentation/dsls/sql/statements/create-table/index.html
index 36d67a7..99f6091 100644
--- a/content/documentation/dsls/sql/statements/create-table/index.html
+++ b/content/documentation/dsls/sql/statements/create-table/index.html
@@ -226,6 +226,47 @@
 
 
 
+
+  Syntax
+  BigQuery
+
+  Syntax
+  Read Mode
+  Write Mode
+  Schema
+  Example
+
+  
+  Pub/Sub
+
+  Syntax
+  Read Mode
+  Write Mode
+  Schema
+  Supported Payload
+  Example
+
+  
+  Kafka
+
+  Syntax
+  Read Mode
+  Write Mode
+  Supported Payload
+  Schema
+
+  
+  Text
+
+  Syntax
+  Read Mode
+  Write Mode
+  Supported Payload
+  Schema
+  Example
+
+  
+
 
 
   
@@ -247,27 +288,387 @@ limitations under the License.
 
 CREATE TABLE
 
-Beam is not a storage system but reads and writes from other storage 
systems.
-You register those systems with a CREATE 
TABLE statement that includes a schema
-as well as a number of extended clauses:
+Beam SQL’s CREATE TABLE statement 
registers a virtual table that maps to an
+https://beam.apache.org/documentation/io/built-in/;>external storage 
system.
+For some storage systems, CREATE TABLE 
does not create a physical table until
+a write occurs. After the physical table exists, you can access the table with
+the SELECT, JOIN, and INSERT INTO statements.
+
+The CREATE TABLE statement includes 
a schema and extended clauses.
+
+Syntax
+
+CREATE TABLE [ IF 
NOT EXISTS ] tableName (tableElement [, tableElement ]*)
+TYPE type
+[LOCATION location]
+[TBLPROPERTIES tblProperties]
+
+simpleType: TINYINT | SMALLINT | INTEGER | BIGINT | FLOAT | DOUBLE | DECIMAL | 
BOOLEAN | DATE | TIME | TIMESTAMP | CHAR | VARCHAR
+
+fieldType: simpleType | MAPsimpleType, fieldType | 
ARRAYfieldType | ROWtableElement [, tableElement ]*
+
+tableElement: columnName fieldType [ NOT NULL ]
+
+
+
+
+  IF NOT EXISTS: Optional. If the 
table is already registered, Beam SQL
+ignores the statement instead of returning an error.
+  tableName: The case sensitive 
name of the table to create and register,
+specified as an
+https://beam.apache.org/documentation/dsls/sql/lexical/#identifiers;>Identifier.
+The table name does not need to match the name in the underlying data
+storage system.
+  tableElement: columnName fieldType [ 
NOT NULL ]
+
+  columnName: The case 
sensitive name of the column, specified as a
+backtick_quoted_expression.
+  fieldType: The field’s type, 
specified as one of the following types:
+
+  simpleType: TINYINT, SMALLINT, INTEGER, BIGINT, FLOAT,
+DOUBLE, DECIMAL, BOOLEAN, DATE, TIME, TIMESTAMP, CHAR,
+VARCHAR
+  MAPsimpleType, 
fieldType
+  ARRAYfieldType
+  ROWtableElement [, 
tableElement ]*
+
+  
+  NOT NULL: Optional. Indicates 
that the column is not nullable.
+
+  
+  type: The I/O transform that 
backs the virtual table, specified as an
+https://beam.apache.org/documentation/dsls/sql/lexical/#identifiers;>Identifier
+with one of the following values:
+
+  bigquery
+  pubsub
+  kafka
+  text
+
+  
+  location: The I/O specific 
location of the underlying table, specified as
+a https://beam.apache.org/documentation/dsls/sql/lexical/#string-literals;>String
+Literal.
+See the I/O specific sections for location format requirements.
+  tblProperties: The I/O specific 
quoted key value JSON object with extra
+configuration, specified as a https://beam.apache.org/documentation/dsls/sql/lexical/#string-literals;>String
+Literal.
+See the I/O specific sections for tblProperties format requirements.
+
+
+BigQuery
+
+Syntax
+
+CREATE TABLE [ IF 
NOT EXISTS ] tableName (tableElement [, tableElement ]*)
+TYPE bigquery
+LOCATION '[PROJECT_ID]:[DATASET].[TABLE]'
+
+
+
+
+  LOCATION:Location of the table in 
the BigQuery CLI format.
+
+  PROJECT_ID: ID of the Google 
Cloud Project
+  DATASET: BigQuery Dataset 
ID
+  TABLE: BigQuery Table ID 
within the Dataset
+
+  
+
+
+Read Mode
+
+Not supported. BigQueryI/O is currently limited to write access only in Beam
+SQL.
+
+Write Mode
+
+if the table does not exist, Beam creates the table specified in location 
when
+the first record is written. If the table does exist, 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit c5948ced1b5f0d6bf8f4d68ed5701147bb9847d0
Author: Mergebot 
AuthorDate: Wed Jun 27 12:05:41 2018 -0700

Prepare repository for deployment.
---
 .../dsls/sql/aggregate-functions/index.html|   3 +-
 .../documentation/dsls/sql/data-types/index.html   |   3 +-
 content/documentation/dsls/sql/joins/index.html|   3 +-
 content/documentation/dsls/sql/lexical/index.html  | 736 +
 content/documentation/dsls/sql/overview/index.html |   3 +-
 .../dsls/sql/scalar-functions/index.html   |   3 +-
 .../dsls/sql/statements/create-table/index.html|   3 +-
 .../dsls/sql/statements/select/index.html  |   3 +-
 .../dsls/sql/user-defined-functions/index.html |   3 +-
 .../documentation/dsls/sql/walkthrough/index.html  |   3 +-
 .../dsls/sql/windowing-and-triggering/index.html   |   3 +-
 .../sdks/feature-comparison/index.html |   3 +-
 content/documentation/sdks/go/index.html   |   3 +-
 .../documentation/sdks/java-extensions/index.html  |   3 +-
 .../documentation/sdks/java-thirdparty/index.html  |   3 +-
 .../documentation/sdks/java/euphoria/index.html|   3 +-
 content/documentation/sdks/java/index.html |   3 +-
 content/documentation/sdks/java/nexmark/index.html |   3 +-
 .../documentation/sdks/python-custom-io/index.html |   3 +-
 .../sdks/python-pipeline-dependencies/index.html   |   3 +-
 .../documentation/sdks/python-streaming/index.html |   3 +-
 .../sdks/python-type-safety/index.html |   3 +-
 content/documentation/sdks/python/index.html   |   3 +-
 23 files changed, 780 insertions(+), 22 deletions(-)

diff --git a/content/documentation/dsls/sql/aggregate-functions/index.html 
b/content/documentation/dsls/sql/aggregate-functions/index.html
index 5f68089..63ddb57 100644
--- a/content/documentation/dsls/sql/aggregate-functions/index.html
+++ b/content/documentation/dsls/sql/aggregate-functions/index.html
@@ -140,7 +140,8 @@
 
   
 Data types
-   
+Lexical 
structure
+
   Statements
 
   
diff --git a/content/documentation/dsls/sql/data-types/index.html 
b/content/documentation/dsls/sql/data-types/index.html
index 62cc6bd..e4dc4d9 100644
--- a/content/documentation/dsls/sql/data-types/index.html
+++ b/content/documentation/dsls/sql/data-types/index.html
@@ -140,7 +140,8 @@
 
   
 Data types
-   
+Lexical 
structure
+
   Statements
 
   
diff --git a/content/documentation/dsls/sql/joins/index.html 
b/content/documentation/dsls/sql/joins/index.html
index 6e54db7..b4085ae 100644
--- a/content/documentation/dsls/sql/joins/index.html
+++ b/content/documentation/dsls/sql/joins/index.html
@@ -140,7 +140,8 @@
 
   
 Data types
-   
+Lexical 
structure
+
   Statements
 
   
diff --git a/content/documentation/dsls/sql/lexical/index.html 
b/content/documentation/dsls/sql/lexical/index.html
new file mode 100644
index 000..6a753ff
--- /dev/null
+++ b/content/documentation/dsls/sql/lexical/index.html
@@ -0,0 +1,736 @@
+
+
+  
+  
+  
+  
+  Beam SQL: Lexical Structure
+  
+  https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
+  
+  https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
+  
+  
+  
+  
+  
+  https://beam.apache.org/documentation/dsls/sql/lexical/; 
data-proofer-ignore>
+  
+  https://beam.apache.org/feed.xml;>
+  
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new 
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+  
+
+
+  
+
+
+  
+Toggle navigation
+
+
+
+  
+
+  
+
+  
+
+
+
+
+
+  
+
+  Get Started
+
+
+  Documentation
+
+
+  SDKS
+
+
+  RUNNERS
+
+
+  Contribute
+
+
+  Community
+
+Blog
+  
+  
+
+  https://www.apache.org/foundation/press/kit/feather_small.png; alt="Apache 
Logo" style="height:20px;">
+  
+http://www.apache.org/;>ASF Homepage
+http://www.apache.org/licenses/;>License
+http://www.apache.org/security/;>Security
+http://www.apache.org/foundation/thanks.html;>Thanks
+http://www.apache.org/foundation/sponsorship.html;>Sponsorship
+

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 92a3957d24e04a63c3a4dad8b9959d3712018270
Author: Mergebot 
AuthorDate: Thu Jun 21 23:02:35 2018 -0700

Prepare repository for deployment.
---
 content/community/contact-us/index.html|   6 +-
 content/contribute/become-a-committer/index.html   |   1 +
 content/contribute/committer-guide/index.html  |   1 +
 .../{portability => dependencies}/index.html   | 230 +
 content/contribute/design-documents/index.html |   1 +
 content/contribute/docker-images/index.html|   1 +
 content/contribute/eclipse/index.html  |   1 +
 content/contribute/index.html  |   1 +
 content/contribute/intellij/index.html |   1 +
 content/contribute/portability/index.html  |   1 +
 .../contribute/ptransform-style-guide/index.html   |   1 +
 content/contribute/release-guide/index.html|   1 +
 content/contribute/runner-guide/index.html |   1 +
 content/contribute/testing/index.html  |   1 +
 .../contribute/website-contributions/index.html|   1 +
 content/get-started/downloads/index.html   |  20 +-
 16 files changed, 76 insertions(+), 193 deletions(-)

diff --git a/content/community/contact-us/index.html 
b/content/community/contact-us/index.html
index 98242a5..60adf84 100644
--- a/content/community/contact-us/index.html
+++ b/content/community/contact-us/index.html
@@ -154,10 +154,8 @@ whichever one seems best!
 
   
 
- 
-If you wish to report a security vulnerability, please contact mailto:secur...@apache.org;>secur...@apache.org.
-Apache Beam follows the typical https://apache.org/security/committers.html#vulnerability-handling;>Apache
 vulnerability handling process.
- 
+
+
   
 
 
diff --git a/content/contribute/become-a-committer/index.html 
b/content/contribute/become-a-committer/index.html
index 3d17119..cc9817e 100644
--- a/content/contribute/become-a-committer/index.html
+++ b/content/contribute/become-a-committer/index.html
@@ -108,6 +108,7 @@
 Portability Framework
 Docker images
 Design documents
+Dependencies guide
   
 
 
diff --git a/content/contribute/committer-guide/index.html 
b/content/contribute/committer-guide/index.html
index 1206e88..10a5c4d 100644
--- a/content/contribute/committer-guide/index.html
+++ b/content/contribute/committer-guide/index.html
@@ -108,6 +108,7 @@
 Portability Framework
 Docker images
 Design documents
+Dependencies guide
   
 
 
diff --git a/content/contribute/portability/index.html 
b/content/contribute/dependencies/index.html
similarity index 50%
copy from content/contribute/portability/index.html
copy to content/contribute/dependencies/index.html
index 0e20980..20719ae 100644
--- a/content/contribute/portability/index.html
+++ b/content/contribute/dependencies/index.html
@@ -4,7 +4,7 @@
   
   
   
-  Portability Framework
+  Dependencies Guide
   
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
@@ -15,7 +15,7 @@
   
   
   
-  https://beam.apache.org/contribute/portability/; 
data-proofer-ignore>
+  https://beam.apache.org/contribute/dependencies/; data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit f002e355d04990cdb10245a9c0b54ac1be158ac7
Author: Mergebot 
AuthorDate: Mon Jun 18 13:27:15 2018 -0700

Prepare repository for deployment.
---
 content/contribute/design-documents/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/design-documents/index.html 
b/content/contribute/design-documents/index.html
index 669fa3e..3e934bb 100644
--- a/content/contribute/design-documents/index.html
+++ b/content/contribute/design-documents/index.html
@@ -190,7 +190,7 @@
   Error Reporting Callback (WIP) [https://docs.google.com/document/d/1o2VXwCL97k3G-1BR9RSKNc6XtJTIA6SEKPMne91S67Y;>doc]
   Snapshotting and Updating Beam Pipelines [https://docs.google.com/document/d/1UWhnYPgui0gUYOsuGcCjLuoOUlGA4QaY91n8p3wz9MY;>doc]
   Requiring PTransform to set a coder on its resulting collections [https://lists.apache.org/thread.html/1dde0b5a93c2983cbab5f68ce7c74580102f5bb2baaa816585d7eabb@%3Cdev.beam.apache.org%3E;>mail]
-  [PROPOSAL] “Requires deterministic input” [https://lists.apache.org/thread.html/ae3c838df060e47148439d1dad818d5e927b2a25ff00cc4153221dff@%3Cdev.beam.apache.org%3E;>mail]
+  [PROPOSAL] Support of @RequiresStableInput annotation [https://docs.google.com/document/d/117yRKbbcEdm3eIKB_26BHOJGmHSZl1YNoF0RqWGtqAM;>doc],
 [https://lists.apache.org/thread.html/ae3c838df060e47148439d1dad818d5e927b2a25ff00cc4153221dff@%3Cdev.beam.apache.org%3E;>mail]
   [PROPOSAL] @onwindowexpiration [https://lists.apache.org/thread.html/1dab7f17c97378e665928b6cbd887dc7be93390ab26c593ee49a@%3Cdev.beam.apache.org%3E;>mail]
 
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit d1077abd5103a1ec95922e6a9be46363ca2297cc
Author: Mergebot 
AuthorDate: Fri Jun 15 08:17:59 2018 -0700

Prepare repository for deployment.
---
 content/documentation/programming-guide/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index 1fc81da..e6c745c 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -2429,7 +2429,7 @@ The following table shows the standard mapping:
 
 6.2.1. Looking up a default coder
 
-You can use the method CoderRegistry.getDefaultCoder to determine the 
default
+You can use the method CoderRegistry.getCoder to determine the default
 Coder for a Java type. You can access the CoderRegistry for a given pipeline
 by using the method Pipeline.getCoderRegistry. This allows you to 
determine
 (or set) the default Coder for a Java type on a per-pipeline basis: i.e. “for

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 538236b2995a2f27208d2805b1a24f4e37c05422
Author: Mergebot 
AuthorDate: Fri Jun 15 02:07:58 2018 -0700

Prepare repository for deployment.
---
 content/documentation/sdks/java/nexmark/index.html | 37 --
 1 file changed, 35 insertions(+), 2 deletions(-)

diff --git a/content/documentation/sdks/java/nexmark/index.html 
b/content/documentation/sdks/java/nexmark/index.html
index 608c819..0894b02 100644
--- a/content/documentation/sdks/java/nexmark/index.html
+++ b/content/documentation/sdks/java/nexmark/index.html
@@ -186,6 +186,7 @@
   Direct runner 
specific configuration
   Flink runner specific 
configuration
   Spark runner specific 
configuration
+  Kafka 
source/sink configuration parameters
 
   
   Current status
@@ -362,12 +363,12 @@ The Gradle project name of the runner, such as 
":beam-runners-direct-java" or
 
 Test data is deterministically synthesized on demand. The test
 data may be synthesized in the same pipeline as the query itself,
-or may be published to Pub/Sub.
+or may be published to Pub/Sub or Kafka.
 
 The query results may be:
 
 
-  Published to Pub/Sub.
+  Published to Pub/Sub or Kafka.
   Written to text files as plain text.
   Written to text files using an Avro encoding.
   Sent to BigQuery.
@@ -451,6 +452,38 @@ or may be published to Pub/Sub.
 
 
 
+Kafka source/sink 
configuration parameters
+
+Set Kafka host/ip (for example, “localhost:9092”):
+
+--bootstrapServers=kafka host/ip 
+
+
+
+Write results into Kafka topic:
+
+--sinkType=KAFKA
+
+
+
+Set topic name which will be used for benchmark results:
+
+--kafkaResultsTopic=topic name
+
+
+
+Write or/and read events into/from Kafka topic:
+
+--sourceType=KAFKA
+
+
+
+Set topic name which will be used for benchmark events:
+
+--kafkaTopic=topic name
+
+
+
 Current status
 
 These tables contain statuses of the queries runs in the different runners. 
Google Cloud Dataflow and Apache Gearpump statuses are yet to come.

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 68ab342a93cb37a3eb90e551e3eb0258cb69606f
Author: Mergebot 
AuthorDate: Fri Jun 15 02:04:35 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html | 21 +
 1 file changed, 21 insertions(+)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index 864acdc..4a8ce28 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -151,6 +151,8 @@
   Euphoria Java 8 DSL
   Improving the 
contributor experience
   Beam SQL
+  Add benchmarks 
to continuous integration
+  Extract metrics 
in a runner agnostic way
 
   
   Stale pull requests
@@ -518,6 +520,25 @@ and testing, etc.
   Contact: mailto:k...@apache.org;>Kenneth Knowles
 
 
+Add benchmarks to continuous 
integration
+
+Run Nexmark benchmark queries after each commit for Spark, Flink and Direct 
Runner and export response times to performance dashboards
+
+
+  JIRA: https://issues.apache.org/jira/browse/BEAM-4225;>nexmark-perfkit
+  Contact: mailto:echauc...@apache.org;>Etienne Chauchot
+
+
+Extract metrics in a runner 
agnostic way
+
+Metrics are pushed by the runners to configurable sinks (HTTP REST sink 
available).
+It is already enabled in Filnk and Spark runner. Work is in progress for 
Dataflow
+
+
+  JIRA: https://issues.apache.org/jira/browse/BEAM-3310;>runner-agnostic-metrics
+  Contact: mailto:echauc...@apache.org;>Etienne Chauchot
+
+
 Stale pull requests
 
 The community will close stale pull requests in order to keep the project

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 8e72ae4e6a30fb3e9088e565e7f36361575bb683
Author: Mergebot 
AuthorDate: Mon Jun 11 21:53:41 2018 -0700

Prepare repository for deployment.
---
 content/documentation/io/built-in/index.html | 4 
 1 file changed, 4 insertions(+)

diff --git a/content/documentation/io/built-in/index.html 
b/content/documentation/io/built-in/index.html
index a40af1f..4891e2d 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/index.html
@@ -315,6 +315,10 @@
 RestIOJava
 https://issues.apache.org/jira/browse/BEAM-1946;>BEAM-1946
   
+  
+Apache KafkaPython
+https://issues.apache.org/jira/browse/BEAM-3788;>BEAM-3788
+  
 
 
   

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 0fbf549bd8dfc84e242525aaf7ceba331146b7e8
Author: Mergebot 
AuthorDate: Fri Jun 8 16:07:06 2018 -0700

Prepare repository for deployment.
---
 content/contribute/release-guide/index.html | 250 
 1 file changed, 185 insertions(+), 65 deletions(-)

diff --git a/content/contribute/release-guide/index.html 
b/content/contribute/release-guide/index.html
index b26a5d8..bb0c973 100644
--- a/content/contribute/release-guide/index.html
+++ b/content/contribute/release-guide/index.html
@@ -143,7 +143,7 @@
   Review Release Notes in 
JIRA
   Verify that a Release 
Build Works
   Update and Verify 
Javadoc
-  Create a release branch
+  Create a 
release branch in apache/beam repository
   Update the Python SDK 
version
   Update release 
specific configurations
   Start a snapshot build
@@ -152,8 +152,9 @@
   
   Build a release candidate
 
-  Build and stage 
Java artifacts with Maven
+  Build and 
stage Java artifacts with Gradle
   Stage source 
release on dist.apache.org
+  Stage python 
binaries on dist.apache.org
   Build the Pydoc API 
reference
   Propose a pull 
request for website updates
   Checklist to 
proceed to the next step
@@ -217,7 +218,7 @@
   Review Release Notes in 
JIRA
   Verify that a Release Build 
Works
   Update and Verify Javadoc
-  Create a release branch
+  Create a 
release branch in apache/beam repository
   Update the Python SDK 
version
   Update release 
specific configurations
   Start a snapshot build
@@ -225,8 +226,9 @@
 
   
   Build a release candidate

-  Build and stage 
Java artifacts with Maven
+  Build and stage 
Java artifacts with Gradle
   Stage source release on 
dist.apache.org
+  Stage python binaries 
on dist.apache.org
   Build the Pydoc API 
reference
   Propose a pull 
request for website updates
   Create 
Pydoc
@@ -323,6 +325,19 @@
 
 You need to have a GPG key to sign the release artifacts. Please be aware 
of the ASF-wide https://www.apache.org/dev/release-signing.html;>release signing 
guidelines. If you don’t have a GPG key associated with your Apache 
account, please create one according to the guidelines.
 
+Get more entropy for creating a GPG key
+
+sudo apt-get 
install rng-tools
+sudo rngd -r /dev/urandom
+
+
+
+Create a GPG key
+
+gpg 
--full-generate-key
+
+
+
 Determine your Apache GPG Key and Key ID, as follows:
 
 gpg --list-keys
@@ -402,6 +417,8 @@ instructions.
 
 When contributors resolve an issue in JIRA, they are tagging it with a 
release that will contain their changes. With the release currently underway, 
new issues should be resolved against a subsequent future release. Therefore, 
you should create a release item for this subsequent release, as follows:
 
+Attention: Only committer has permission to perform this.
+
 
   In JIRA, navigate to the https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions;>Beam  Administration  
Versions.
   Add a new release: choose the next minor version number compared to the 
one currently underway, select today’s date as the Start Date, and choose Add.
@@ -438,12 +455,66 @@ instructions.
 
 Verify that a Release Build 
Works
 
-Run mvn -Prelease clean install to 
ensure that the build processes that are specific to that
-profile are in good shape.
+Pre-installation for python build
+
+  
+Install pip
+
+curl 
https://bootstrap.pypa.io/get-pip.py -o get-pip.py
+python get-pip.py
+
+
+  
+  
+Install virtualenv
+
+pip install 
--upgrade virtualenv
+
+
+  
+  
+Cython
+
+sudo pip 
install cython
+sudo apt-get install gcc
+sudo apt-get install python-dev
+
+
+Make sure your time alias to 
/usr/bin/time, if not:
+  
+
+
+sudo apt-get 
install time
+alias time='/usr/bin/time'
+
+
+
+Run gradle release build
+
+
+  
+Clean current workspace
+
+git clean -fdx 
+./gradlew clean
+
+
+  
+  Unlock the secret key
+gpg --output 
~/doc.sig --sign ~/.bashrc
+
+
+  
+  Run build command
+./gradlew 
build -PisRelease --no-parallel --scan --stacktrace
+
+
+  
+
 
 Update and Verify Javadoc
 
-The build with -Prelease creates the 
combined Javadoc for the release in sdks/java/javadoc.
+The build with -PisRelease creates 
the combined Javadoc for the release in sdks/java/javadoc.
 
 The file sdks/java/javadoc/ant.xml 
file contains a list of modules to include
 in and exclude, plus a list of offline URLs that populate links from Beam’s
@@ -464,9 +535,11 @@ the version number has changed, download a new version of 
the corresponding
   
 
 
-Create a release branch
+Create a release 
branch in apache/beam repository
+
+Attention: Only committer has permission to create release 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 4b67f984e78cfb02eabb37cbd1ca2c72798b8d3b
Author: Mergebot 
AuthorDate: Fri Jun 8 15:03:35 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html | 153 --
 1 file changed, 131 insertions(+), 22 deletions(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index e173165..864acdc 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -131,7 +131,9 @@
   Contributing code
 
   Building  Testing
-  Testing the Python SDK
+  Developing with an IDE
+  Pull requests
+  Developing with the Python 
SDK
 
   
   Contributing to the 
website
@@ -147,6 +149,7 @@
   Next Java LTS 
version support (Java 11 / 18.9)
   IO Performance Testing
   Euphoria Java 8 DSL
+  Improving the 
contributor experience
   Beam SQL
 
   
@@ -164,8 +167,12 @@
 There are lots of opportunities:
 
 
-  write new examples
+  ask or answer questions on u...@beam.apache.org or
+https://stackoverflow.com/questions/tagged/apache-beam;>stackoverflow
+  review proposed design ideas on d...@beam.apache.org
   improve the documentation
+  contribute https://issues.apache.org/jira/projects/BEAM/issues;>bug reports
+  write new examples
   add new user-facing libraries (new statistical libraries, new IO 
connectors,
 etc)
   improve your favorite language SDK (Java, Python, Go, etc)
@@ -173,6 +180,7 @@ etc)
 Cloud Dataflow, etc)
   work on the core programming model (what is a Beam pipeline and how does 
it
 run?)
+  improve the developer experience on Windows
 
 
 Most importantly, if you have an idea of how to contribute, then do it!
@@ -180,30 +188,37 @@ run?)
 For a list of open starter tasks, check
 https://s.apache.org/beam-starter-tasks;>https://s.apache.org/beam-starter-tasks.
 
-And, of course, we would love if you contact us and introduce yourself.
-
 Contributing code
 
+Discussons about contributing code to beam  happens on the dev@ mailing list. Introduce yourself!
+
+Questions can be asked on the #beam 
channel of the ASF slack. Introduce yourself!
+
 Coding happens at
 https://github.com/apache/beam;>https://github.com/apache/beam. To
 contribute, follow the usual GitHub process: fork the repo, make your changes,
-and open a pull request. If you are unfamiliar with this workflow, GitHub
-maintains these helpful guides:
+and open a pull request and @mention a reviewer. If you have more than one 
commit
+in your change, you many be asked to rebase and squash the commits.
+If you are unfamiliar with this workflow, GitHub maintains these helpful 
guides:
 
 
   https://guides.github.com/introduction/git-handbook/;>Git 
Handbook
   https://guides.github.com/activities/forking/;>Forking a 
repository
 
 
-If your change is large, it is a good idea to discuss it on the dev@ mailing list (you may 
be asked to create a design doc
+If your change is large or it is your first change, it is a good idea to
+discuss it on the dev@ mailing list
+
+For large changes (you may be asked to create a design doc
 (https://s.apache.org/beam-design-doc-template;>template,
-https://s.apache.org/beam-design-docs;>examples)). You will also
-need to submit a signed https://www.apache.org/licenses/icla.pdf;>Individual Contributor License
+https://s.apache.org/beam-design-docs;>examples)).
+
+Documentation happens at https://github.com/apache/beam-site;>https://github.com/apache/beam-site
+and contributions are welcome.
+
+Large contributions require a signed https://www.apache.org/licenses/icla.pdf;>Individual Contributor License
 Agreement (ICLA) to the Apache
-Software Foundation (ASF).  The purpose of this agreement is to clearly define
-the terms under which intellectual property has been contributed to the ASF and
-thereby allow us to defend the project should there be a legal dispute
-regarding the software at some future time.
+Software Foundation (ASF).
 
 If you are contributing a PTransform 
to Beam, we have an extensive
 PTransform Style Guide.
@@ -212,6 +227,11 @@ regarding the software at some future time.
 
 We use Gradle to orchestrate building and testing.
 
+You do not need to install gradle, but you do need a Java SDK installed.
+You can develop on Linux, macOS, or Microsoft Windows. There have been
+issues noted when developing using Windows; feel free to contribute fixes
+to make it easier.
+
 The entire set of tests can be run with this command at the root of the git
 repository.
 
@@ -228,38 +248,121 @@ $ ./gradlew -p runners/flink check
 
 
 
-Testing the Python SDK
+You can see what build tasks are available with
+
+$ ./gradlew tasks
+
+
+
+or for a module,
+
+$ ./gradlew 
sdks/java/io/cassandra tasks
+
+
+
+Developing with an IDE
+
+Generate an IDEA project .ipr file with:
+
+$ 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit d12aaff5414d49e424b88b197e7d68f70ec88b77
Author: Mergebot 
AuthorDate: Fri Jun 8 13:46:58 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html | 12 
 1 file changed, 12 insertions(+)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index 08291ff..e173165 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -147,6 +147,7 @@
   Next Java LTS 
version support (Java 11 / 18.9)
   IO Performance Testing
   Euphoria Java 8 DSL
+  Beam SQL
 
   
   Stale pull requests
@@ -397,6 +398,17 @@ When submitting a new PR, please tag https://github.com/robbesneyders;>
   Contact: mailto:david.mora...@gmail.com;>David Moravek
 
 
+Beam SQL
+
+Beam SQL has lots of areas to contribute: support for new operators, new
+connectors, performance measurement and improvement, more full specification
+and testing, etc.
+
+
+  JIRA: https://issues.apache.org/jira/issues/?filter=12343977;>dsl-sql
+  Contact: mailto:k...@apache.org;>Kenneth Knowles
+
+
 Stale pull requests
 
 The community will close stale pull requests in order to keep the project

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 1f618cdf01e35011c79db9d571aec2107ee62cf0
Author: Mergebot 
AuthorDate: Wed Jun 6 20:19:19 2018 -0700

Prepare repository for deployment.
---
 content/documentation/programming-guide/index.html | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/content/documentation/programming-guide/index.html 
b/content/documentation/programming-guide/index.html
index 03aada3..1fc81da 100644
--- a/content/documentation/programming-guide/index.html
+++ b/content/documentation/programming-guide/index.html
@@ -2429,7 +2429,8 @@ The following table shows the standard mapping:
 
 6.2.1. Looking up a default coder
 
-You can use the method CoderRegistry.getCoder to determine the 
default Coder for a Java type. You can access the CoderRegistry for a given pipeline
+You can use the method CoderRegistry.getDefaultCoder to determine the 
default
+Coder for a Java type. You can access the CoderRegistry for a given pipeline
 by using the method Pipeline.getCoderRegistry. This allows you to 
determine
 (or set) the default Coder for a Java type on a per-pipeline basis: i.e. “for
 this pipeline, verify that Integer values are encoded using

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit c46fc1ea2bf04ba8f22d439bea53c91fc34b2264
Author: Mergebot 
AuthorDate: Tue Jun 5 11:03:53 2018 -0700

Prepare repository for deployment.
---
 content/contribute/become-a-committer/index.html   |   1 +
 content/contribute/committer-guide/index.html  |   1 +
 content/contribute/design-documents/index.html | 354 +
 content/contribute/docker-images/index.html|   1 +
 content/contribute/eclipse/index.html  |   1 +
 content/contribute/index.html  |   1 +
 content/contribute/intellij/index.html |   1 +
 content/contribute/portability/index.html  |   1 +
 .../contribute/ptransform-style-guide/index.html   |   1 +
 content/contribute/release-guide/index.html|   1 +
 content/contribute/runner-guide/index.html |   1 +
 content/contribute/testing/index.html  |   1 +
 .../contribute/website-contributions/index.html|   1 +
 13 files changed, 366 insertions(+)

diff --git a/content/contribute/become-a-committer/index.html 
b/content/contribute/become-a-committer/index.html
index 5f8c08d..3d17119 100644
--- a/content/contribute/become-a-committer/index.html
+++ b/content/contribute/become-a-committer/index.html
@@ -107,6 +107,7 @@
 Runner authoring guide
 Portability Framework
 Docker images
+Design documents
   
 
 
diff --git a/content/contribute/committer-guide/index.html 
b/content/contribute/committer-guide/index.html
index 699d7e6..1206e88 100644
--- a/content/contribute/committer-guide/index.html
+++ b/content/contribute/committer-guide/index.html
@@ -107,6 +107,7 @@
 Runner authoring guide
 Portability Framework
 Docker images
+Design documents
   
 
 
diff --git a/content/contribute/design-documents/index.html 
b/content/contribute/design-documents/index.html
new file mode 100644
index 000..669fa3e
--- /dev/null
+++ b/content/contribute/design-documents/index.html
@@ -0,0 +1,354 @@
+
+
+  
+  
+  
+  
+  Beam Design Documents
+  
+  https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
+  
+  https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js";>
+  
+  
+  
+  
+  
+  https://beam.apache.org/contribute/design-documents/; data-proofer-ignore>
+  
+  https://beam.apache.org/feed.xml;>
+  
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new 
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+  
+
+
+  
+
+
+  
+Toggle navigation
+
+
+
+  
+
+  
+
+  
+
+
+
+
+
+  
+
+  Get Started
+
+
+  Documentation
+
+
+  SDKS
+
+
+  RUNNERS
+
+
+  Contribute
+
+
+  Community
+
+Blog
+  
+  
+
+  https://www.apache.org/foundation/press/kit/feather_small.png; alt="Apache 
Logo" style="height:20px;">
+  
+http://www.apache.org/;>ASF Homepage
+http://www.apache.org/licenses/;>License
+http://www.apache.org/security/;>Security
+http://www.apache.org/foundation/thanks.html;>Thanks
+http://www.apache.org/foundation/sponsorship.html;>Sponsorship
+https://www.apache.org/foundation/policies/conduct;>Code of 
Conduct
+  
+
+  
+
+
+
+
+  
+
+
+  
+Contribute
+Get started contributing
+
+  IDE tips
+
+  
+IntelliJ Tips
+Eclipse Tips
+  
+
+
+  Technical Docs
+
+  
+Testing guide
+PTransform style 
guide
+Runner authoring guide
+Portability Framework
+Docker images
+Design documents
+  
+
+
+  Committers
+
+  
+Become a committer
+Committer guide
+Release guide
+  
+
+
+  
+
+  
+
+  
+
+
+
+  Documents by category
+
+  Project Incubation (2016)
+  Beam Model
+  IO / Filesystem
+  Metrics
+  Runners
+  SQL / Schema
+  Portability
+  Build / Testing
+  Python
+  Go
+
+  
+  Other
+
+
+
+  
+
+  
+Design Documents
+This is a collection of documents that may or may not be up to date.
+
+Documents by category
+Project Incubation (2016)
+
+  Technical Vision [https://docs.google.com/document/d/1UyAeugHxZmVlQ5cEWo_eOPgXNQA1oD-rGooWOSwAqh8/edit;>doc],
 

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 69d9535c5df3ce01f14fcad599b8ec06ff7b10fd
Author: Mergebot 
AuthorDate: Fri Jun 1 11:14:13 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html  | 11 +++
 .../sdks/java/{ => euphoria}/index.html| 85 --
 content/documentation/sdks/java/index.html |  1 +
 3 files changed, 74 insertions(+), 23 deletions(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index 199eba5..fe5c767 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -145,6 +145,7 @@
   Python 3 Support
   Next Java LTS 
version support (Java 11 / 18.9)
   IO Performance Testing
+  Euphoria Java 8 DSL
 
   
   Stale pull requests
@@ -385,6 +386,16 @@ When submitting a new PR, please tag https://github.com/robbesneyders;>
 
 If you’re willing to help in this area, tag the following people in PRs: https://github.com/chamikaramj;>@chamikaramj, https://github.com/dariuszaniszewski;>@DariuszAniszewski, https://github.com/lgajowy;>@lgajowy, https://github.com/szewi;>@szewi, https://github.com/kkucharc;>@kkucharc
 
+Euphoria Java 8 DSL
+
+Easy to use Java 8 DSL for the Beam Java SDK. Provides a high-level 
abstraction of Beam transformations, which is both easy to read and write. Can 
be used as a complement to existing Beam pipelines (convertible back and 
forth). You can have a glimpse of the API at WordCount 
example.
+
+
+  Feature branch: https://github.com/apache/beam/tree/dsl-euphoria;>dsl-euphoria
+  JIRA: https://issues.apache.org/jira/browse/BEAM-4366?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-euphoria;>dsl-euphoria
 / https://issues.apache.org/jira/browse/BEAM-3900;>BEAM-3900
+  Contact: mailto:david.mora...@gmail.com;>David Moravek
+
+
 Stale pull requests
 
 The community will close stale pull requests in order to keep the project
diff --git a/content/documentation/sdks/java/index.html 
b/content/documentation/sdks/java/euphoria/index.html
similarity index 58%
copy from content/documentation/sdks/java/index.html
copy to content/documentation/sdks/java/euphoria/index.html
index f765157..8b39173 100644
--- a/content/documentation/sdks/java/index.html
+++ b/content/documentation/sdks/java/euphoria/index.html
@@ -4,7 +4,7 @@
   
   
   
-  Beam Java SDK
+  Euphoria Java 8 DSL
   
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
@@ -15,7 +15,7 @@
   
   
   
-  https://beam.apache.org/documentation/sdks/java/; data-proofer-ignore>
+  https://beam.apache.org/documentation/sdks/java/euphoria/; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 2d0d08bda29e420f0ef4855f3d9e08068ae46edb
Author: Mergebot 
AuthorDate: Wed May 30 09:06:12 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html | 16 
 1 file changed, 16 insertions(+)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index c42bcd3..199eba5 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -144,6 +144,7 @@
   Go SDK
   Python 3 Support
   Next Java LTS 
version support (Java 11 / 18.9)
+  IO Performance Testing
 
   
   Stale pull requests
@@ -369,6 +370,21 @@ When submitting a new PR, please tag https://github.com/robbesneyders;>
   Contact: mailto:ieme...@gmail.com;>Ismaël Mejía
 
 
+IO Performance Testing
+
+We are also working on writing Performance Tests for IOs and developing a 
Performance Testing Framework for them. Contributions are welcome in the 
following areas:
+
+
+  developing more IO Performance Tests (IOITs)
+  providing necessary kubernetes infrastructure (eg. for databases or 
filesystems to be used in tests)
+  running Performance Tests on runners other than Dataflow and Direct
+  improving existing Performance Testing Framework and it’s 
documentation
+
+
+See the https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests;>documentation
 and the https://docs.google.com/document/d/1dA-5s6OHiP_cz-NRAbwapoKF5MEC1wKps4A5tFbIPKE/edit?usp=sharing;>initial
 proposal(for file based tests).
+
+If you’re willing to help in this area, tag the following people in PRs: https://github.com/chamikaramj;>@chamikaramj, https://github.com/dariuszaniszewski;>@DariuszAniszewski, https://github.com/lgajowy;>@lgajowy, https://github.com/szewi;>@szewi, https://github.com/kkucharc;>@kkucharc
+
 Stale pull requests
 
 The community will close stale pull requests in order to keep the project

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 1e6aec3583b0f9a9753ef3b155ea423b3aa552e5
Author: Mergebot 
AuthorDate: Tue May 29 14:05:48 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html | 4 +++-
 1 file changed, 3 insertions(+), 1 deletion(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index 2c4ef13..c42bcd3 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -191,7 +191,9 @@ maintains these helpful guides:
   https://guides.github.com/activities/forking/;>Forking a 
repository
 
 
-If your change is large, it is a good idea to discuss it on the dev@ mailing list. You will 
also
+If your change is large, it is a good idea to discuss it on the dev@ mailing list (you may 
be asked to create a design doc
+(https://s.apache.org/beam-design-doc-template;>template,
+https://s.apache.org/beam-design-docs;>examples)). You will also
 need to submit a signed https://www.apache.org/licenses/icla.pdf;>Individual Contributor License
 Agreement (ICLA) to the Apache
 Software Foundation (ASF).  The purpose of this agreement is to clearly define

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 6ddc75097eb179f9591c8cbe7196679cb5d2da7c
Author: Mergebot 
AuthorDate: Fri May 25 02:47:21 2018 -0700

Prepare repository for deployment.
---
 content/documentation/io/built-in/index.html | 5 +
 1 file changed, 1 insertion(+), 4 deletions(-)

diff --git a/content/documentation/io/built-in/index.html 
b/content/documentation/io/built-in/index.html
index f6904ce..a40af1f 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/index.html
@@ -221,6 +221,7 @@
 https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io/TFRecordIO.java;>TFRecordIO
 https://github.com/apache/beam/blob/master/sdks/java/io/xml/src/main/java/org/apache/beam/sdk/io/xml/XmlIO.java;>XmlIO
 https://github.com/apache/beam/blob/master/sdks/java/io/tika/src/main/java/org/apache/beam/sdk/io/tika/TikaIO.java;>TikaIO
+https://github.com/apache/beam/blob/master/sdks/java/io/parquet/src/main/java/org/apache/beam/sdk/io/parquet/ParquetIO.java;>ParquetIO
   
   
 https://github.com/apache/beam/tree/master/sdks/java/io/kinesis;>Amazon 
Kinesis
@@ -287,10 +288,6 @@
 https://issues.apache.org/jira/browse/BEAM-2661;>BEAM-2661
 
   
-Apache ParquetJava
-https://issues.apache.org/jira/browse/BEAM-214;>BEAM-214
-  
-  
 Apache SqoopJava
 https://issues.apache.org/jira/browse/BEAM-67;>BEAM-67
   

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit ab852cfec820b33268ac51c19e7bf9f4542f21e6
Author: Mergebot 
AuthorDate: Fri May 25 02:11:07 2018 -0700

Prepare repository for deployment.
---
 content/documentation/io/built-in/index.html | 3 ++-
 1 file changed, 2 insertions(+), 1 deletion(-)

diff --git a/content/documentation/io/built-in/index.html 
b/content/documentation/io/built-in/index.html
index 131f7cc..f6904ce 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/index.html
@@ -226,7 +226,7 @@
 https://github.com/apache/beam/tree/master/sdks/java/io/kinesis;>Amazon 
Kinesis
 https://github.com/apache/beam/tree/master/sdks/java/io/amqp;>AMQP
 https://github.com/apache/beam/tree/master/sdks/java/io/kafka;>Apache 
Kafka
-https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/io;>Google
 Cloud PubSub
+https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/pubsub;>Google
 Cloud Pub/Sub
 https://github.com/apache/beam/tree/master/sdks/java/io/jms;>JMS
 https://github.com/apache/beam/tree/master/sdks/java/io/mqtt;>MQTT
   
@@ -256,6 +256,7 @@
 https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/vcfio.py;>vcfio
   
   
+https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/pubsub.py;>Google
 Cloud Pub/Sub
   
   
 https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery.py;>Google
 BigQuery

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit c41d6d51116f5bf64a2a921d16deff6b3d40c2d3
Author: Mergebot 
AuthorDate: Fri May 25 02:00:25 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html | 10 ++
 1 file changed, 10 insertions(+)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index e8d2491..2c4ef13 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -143,6 +143,7 @@
   Tez Runner
   Go SDK
   Python 3 Support
+  Next Java LTS 
version support (Java 11 / 18.9)
 
   
   Stale pull requests
@@ -357,6 +358,15 @@ across Java, Python, and Go, and every Beam runner.
 Contributions are welcome! If you are interested to help, you can select a 
subpackage to port and assign yourself the corresponding issue. Comment on the 
issue if you cannot assign it yourself.
 When submitting a new PR, please tag https://github.com/robbesneyders;>@RobbeSneyders, https://github.com/aaltay;>@aaltay, and https://github.com/tvalentyn;>@tvalentyn.
 
+Next Java LTS version 
support (Java 11 / 18.9)
+
+Work to support the next LTS release of Java is in progress. For more 
details about the scope and info on the various tasks please see the JIRA 
ticket.
+
+
+  JIRA: https://issues.apache.org/jira/issues/BEAM-2530;>BEAM-2530
+  Contact: mailto:ieme...@gmail.com;>Ismaël Mejía
+
+
 Stale pull requests
 
 The community will close stale pull requests in order to keep the project

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit fb4b603a5d31d80637de5d35bf5d709052fbf6ce
Author: Mergebot 
AuthorDate: Fri May 25 01:51:45 2018 -0700

Prepare repository for deployment.
---
 content/documentation/io/built-in/index.html | 4 
 1 file changed, 4 insertions(+)

diff --git a/content/documentation/io/built-in/index.html 
b/content/documentation/io/built-in/index.html
index ec14532..131f7cc 100644
--- a/content/documentation/io/built-in/index.html
+++ b/content/documentation/io/built-in/index.html
@@ -282,6 +282,10 @@
 https://issues.apache.org/jira/browse/BEAM-607;>BEAM-607
   
   
+Apache KuduJava
+https://issues.apache.org/jira/browse/BEAM-2661;>BEAM-2661
+
+  
 Apache ParquetJava
 https://issues.apache.org/jira/browse/BEAM-214;>BEAM-214
   

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 3f7f6ea86a3bdd0e29fcdb3058719fe7099e
Author: Mergebot 
AuthorDate: Fri May 25 01:20:18 2018 -0700

Prepare repository for deployment.
---
 .../documentation/io/built-in/hadoop/index.html| 68 ++
 1 file changed, 68 insertions(+)

diff --git a/content/documentation/io/built-in/hadoop/index.html 
b/content/documentation/io/built-in/hadoop/index.html
index c200f48..898792a 100644
--- a/content/documentation/io/built-in/hadoop/index.html
+++ b/content/documentation/io/built-in/hadoop/index.html
@@ -197,6 +197,7 @@
   Elasticsearch - 
EsInputFormat
   HCatalog - HCatInputFormat
   Amazon DynamoDB - 
DynamoDBInputFormat
+  Apache HBase - 
TableSnapshotInputFormat
 
 
 
@@ -470,6 +471,73 @@ The below example uses one such available wrapper API - https://github.
 
 
 
+Apache HBase - 
TableSnapshotInputFormat
+
+To read data from an HBase table snapshot, use org.apache.hadoop.hbase.mapreduce.TableSnapshotInputFormat.
+Reading from a table snapshot bypasses the HBase region servers, instead 
reading HBase data files directly from the filesystem.
+This is useful for cases such as reading historical data or offloading of work 
from the HBase cluster. 
+There are scenarios when this may prove faster than accessing content through 
the region servers using the HBaseIO.
+
+A table snapshot can be taken using the HBase shell or programmatically:
+try (
+Connection connection = ConnectionFactory.createConnection(hbaseConf);
+Admin admin = connection.getAdmin()
+  ) {
+  admin.snapshot(
+"my_snaphshot",
+TableName.valueOf("my_table"),
+HBaseProtos.SnapshotDescription.Type.FLUSH);
+}  
+
+
+
+  
# The Beam SDK for Python does not support Hadoop InputFormat 
IO.
+
+
+
+A TableSnapshotInputFormat is 
configured as follows:
+
+// Construct a typical HBase 
scan
+Scan scan = new Scan();
+scan.setCaching(1000);
+scan.setBatch(1000);
+scan.addColumn(Bytes.toBytes("CF"), Bytes.toBytes("col_1"));
+scan.addColumn(Bytes.toBytes("CF"), Bytes.toBytes("col_2"));
+
+Configuration hbaseConf = HBaseConfiguration.create();
+hbaseConf.set(HConstants.ZOOKEEPER_QUORUM, "zk1:2181");
+hbaseConf.set("hbase.rootdir", "/hbase");
+hbaseConf.setClass(
+"mapreduce.job.inputformat.class", TableSnapshotInputFormat.class, InputFormat.class);
+hbaseConf.setClass("key.class", ImmutableBytesWritable.class, Writable.class);
+hbaseConf.setClass("value.class", Result.class, Writable.class);
+ClientProtos.Scan proto = 
ProtobufUtil.toScan(scan);
+hbaseConf.set(TableInputFormat.SCAN, Base64.encodeBytes(proto.toByteArray()));
+
+// Make use of existing utility methods
+Job job = 
Job.getInstance(hbaseConf); // creates 
internal clone of hbaseConf
+TableSnapshotInputFormat.setInput(job, "my_snapshot", new Path("/tmp/snapshot_restore"));
+hbaseConf = job.getConfiguration(); // extract the modified clone
+
+
+
+  
# The Beam SDK for Python does not support Hadoop InputFormat 
IO.
+
+
+
+Call Read transform as follows:
+
+PCollectionImmutableBytesWritable, Result 
hbaseSnapshotData =
+  p.apply("read",
+  HadoopInputFormatIO.ImmutableBytesWritable, Resultread()
+  .withConfiguration(hbaseConf);
+
+
+
+  
# The Beam SDK for Python does not support Hadoop InputFormat 
IO.
+
+
+
   
 
 

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 419cff6561853206dd54a021e9c3d2b25c7ebfbc
Author: Mergebot 
AuthorDate: Thu May 24 17:00:08 2018 -0700

Prepare repository for deployment.
---
 content/contribute/become-a-committer/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/become-a-committer/index.html 
b/content/contribute/become-a-committer/index.html
index e0cfe9c..5f8c08d 100644
--- a/content/contribute/become-a-committer/index.html
+++ b/content/contribute/become-a-committer/index.html
@@ -219,7 +219,7 @@ when to ask someone else to make the judgment
 
   They have a proven commitment to the project
   They share their intentions with the community
-  They accept and integrate community feedback in their on plans, designs,
+  They accept and integrate community feedback in their plans, designs,
 code, etc.
   They earnestly try to make Beam better with their contributions
   In particular, if a code contributor:

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 0e176768f6b1cbe7515ec49bc6ad8874e07a2e04
Author: Mergebot 
AuthorDate: Thu May 24 16:56:40 2018 -0700

Prepare repository for deployment.
---
 content/contribute/testing/index.html | 17 +
 1 file changed, 1 insertion(+), 16 deletions(-)

diff --git a/content/contribute/testing/index.html 
b/content/contribute/testing/index.html
index ca0747b..2a1db6c 100644
--- a/content/contribute/testing/index.html
+++ b/content/contribute/testing/index.html
@@ -228,21 +228,6 @@ details on those testing types.
Runs In

   
-  
-   DoFn
-   
-   Correctness on one/few bundles
-   
-   DoFnTester
-   
-   https://github.com/apache/beam/blob/master/sdks/java/io/google-cloud-platform/src/test/java/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIOTest.java#L1325;>BigQueryIOTest
-   
-   Unit
-   
-   Precommit, Postcommit
-   
-  
-  
BoundedSource

Correctly Reads Input
@@ -255,7 +240,7 @@ details on those testing types.

Precommit, Postcommit

-  
+  /tr
   



-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 0ab37eef22092cbb536e8ed58a1821864809fdb9
Author: Mergebot 
AuthorDate: Wed May 16 08:48:43 2018 -0700

Prepare repository for deployment.
---
 content/contribute/index.html | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/content/contribute/index.html b/content/contribute/index.html
index 50797e9..e8d2491 100644
--- a/content/contribute/index.html
+++ b/content/contribute/index.html
@@ -355,7 +355,7 @@ across Java, Python, and Go, and every Beam runner.
 
 
 Contributions are welcome! If you are interested to help, you can select a 
subpackage to port and assign yourself the corresponding issue. Comment on the 
issue if you cannot assign it yourself.
-When submitting a new PR, please tag @RobbeSneyders, @aaltay, and 
@tvalentyn.
+When submitting a new PR, please tag https://github.com/robbesneyders;>@RobbeSneyders, https://github.com/aaltay;>@aaltay, and https://github.com/tvalentyn;>@tvalentyn.
 
 Stale pull requests
 

-- 
To stop receiving notification emails like this one, please contact
mergebot-r...@apache.org.

[beam-site] 01/01: Prepare repository for deployment.

[mergebot-role]

This is an automated email from the ASF dual-hosted git repository.

mergebot-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam-site.git

commit 97f27c9cf518f34a7e9e573612ff495b29eb06c6
Author: Mergebot 
AuthorDate: Tue May 15 21:10:42 2018 -0700

Prepare repository for deployment.
---
 content/documentation/dsls/sql/index.html  |  11 +
 content/documentation/index.html   |   3 +-
 .../sdks/feature-comparison/index.html |  11 +
 content/documentation/sdks/{java => go}/index.html |  51 ++--
 .../documentation/sdks/java-extensions/index.html  |  11 +
 .../documentation/sdks/java-thirdparty/index.html  |  11 +
 content/documentation/sdks/java/index.html |  11 +
 content/documentation/sdks/java/nexmark/index.html |  11 +
 .../documentation/sdks/python-custom-io/index.html |  11 +
 .../sdks/python-pipeline-dependencies/index.html   |  11 +
 .../documentation/sdks/python-streaming/index.html |  11 +
 .../sdks/python-type-safety/index.html |  11 +
 content/documentation/sdks/python/index.html   |  11 +
 content/get-started/beam-overview/index.html   |   4 +-
 content/get-started/downloads/index.html   |   1 +
 content/get-started/index.html |   3 +-
 .../get-started/mobile-gaming-example/index.html   |   6 +
 content/get-started/{ => quickstart-go}/index.html |  80 --
 content/get-started/quickstart-java/index.html |   1 +
 content/get-started/quickstart-py/index.html   |   1 +
 content/get-started/wordcount-example/index.html   | 317 -
 content/images/logos/sdks/go.png   | Bin 0 -> 15475 bytes
 content/index.html |   2 +
 23 files changed, 526 insertions(+), 64 deletions(-)

diff --git a/content/documentation/dsls/sql/index.html 
b/content/documentation/dsls/sql/index.html
index ab2348b..d85f387 100644
--- a/content/documentation/dsls/sql/index.html
+++ b/content/documentation/dsls/sql/index.html
@@ -120,6 +120,17 @@
 
 
 
+  Go SDK
+  
+Go SDK overview
+https://godoc.org/github.com/apache/beam/sdks/go/pkg/beam; 
target="_blank">Go SDK API reference 
+
+  
+
+
+
   DSLs
   
 SQL
diff --git a/content/documentation/index.html b/content/documentation/index.html
index 5c78629..71d463f 100644
--- a/content/documentation/index.html
+++ b/content/documentation/index.html
@@ -236,6 +236,7 @@
 
   Java SDK
   Python SDK
+  Go SDK
 
 
 Runners
@@ -257,7 +258,7 @@
 
 Beam is designed to enable pipelines to be portable across different 
runners. However, given every runner has different capabilities, they also have 
different abilities to implement the core concepts in the Beam model. The Capability Matrix provides 
a detailed comparison of runner functionality.
 
-Once you have chosen which runner to use, see that runner’s page for more 
information about any initial runner-specific setup as well as any required or 
optional PipelineOptions for configuring 
it’s execution. You may also want to refer back to the Quickstart for Java or Python for instructions on executing the 
sample WordCount pipeline.
+Once you have chosen which runner to use, see that runner’s page for more 
information about any initial runner-specific setup as well as any required or 
optional PipelineOptions for configuring 
it’s execution. You may also want to refer back to the Quickstart for Java, Python or Go for instructions on executing the 
sample W [...]
 
   
 
diff --git a/content/documentation/sdks/feature-comparison/index.html 
b/content/documentation/sdks/feature-comparison/index.html
index 57f3a81..c3ae7f7 100644
--- a/content/documentation/sdks/feature-comparison/index.html
+++ b/content/documentation/sdks/feature-comparison/index.html
@@ -120,6 +120,17 @@
 
 
 
+  Go SDK
+  
+Go SDK overview
+https://godoc.org/github.com/apache/beam/sdks/go/pkg/beam; 
target="_blank">Go SDK API reference 
+
+  
+
+
+
   DSLs
   
 SQL
diff --git a/content/documentation/sdks/java/index.html 
b/content/documentation/sdks/go/index.html
similarity index 84%
copy from content/documentation/sdks/java/index.html
copy to content/documentation/sdks/go/index.html
index f9d450e..4f87793 100644
--- a/content/documentation/sdks/java/index.html
+++ b/content/documentation/sdks/go/index.html
@@ -4,7 +4,7 @@
   
   
   
-  Beam Java SDK
+  Beam Go SDK
   
   https://fonts.googleapis.com/css?family=Roboto:100,300,400; 
rel="stylesheet">
@@ -15,7 +15,7 @@
   
   
   
-  https://beam.apache.org/documentation/sdks/java/; data-proofer-ignore>
+  https://beam.apache.org/documentation/sdks/go/; 
data-proofer-ignore>
   
   https://beam.apache.org/feed.xml;>
   
@@ -120,6 +120,17 @@
 
 
 

+  Go SDK
+  

+
Go SDK overview
+