[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 150f2687fc3cd37dcc5b7d5d1ded5508498d9546 Author: Mergebot AuthorDate: Tue Oct 16 15:14:35 2018 + Prepare repository for deployment. --- .../io/built-in/google-bigquery/index.html | 1367 content/documentation/io/built-in/index.html |4 +- 2 files changed, 1369 insertions(+), 2 deletions(-) diff --git a/content/documentation/io/built-in/google-bigquery/index.html b/content/documentation/io/built-in/google-bigquery/index.html new file mode 100644 index 000..32820de --- /dev/null +++ b/content/documentation/io/built-in/google-bigquery/index.html @@ -0,0 +1,1367 @@ + + + + + + + + + + + Google BigQuery IO + + https://fonts.googleapis.com/css?family=Roboto:100,300,400"; rel="stylesheet"> + + https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"</a>;> + + + + + + https://beam.apache.org/documentation/io/built-in/google-bigquery/"; data-proofer-ignore> + + https://beam.apache.org/feed.xml";> + + (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){ +(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o), + m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m) + })(window,document,'script','//www.google-analytics.com/analytics.js','ga'); +ga('create', 'UA-73650088-1', 'auto'); +ga('send', 'pageview'); + + + + + + + + + +Toggle navigation + + + + + + + + + + + + + + + + Get Started + + + Documentation + + + SDKS + + + RUNNERS + + + Contribute + + + Community + +Blog + + + + https://www.apache.org/foundation/press/kit/feather_small.png"; alt="Apache Logo" style="height:20px;"> + +http://www.apache.org/";>ASF Homepage +http://www.apache.org/licenses/";>License +http://www.apache.org/security/";>Security +http://www.apache.org/foundation/thanks.html";>Thanks +http://www.apache.org/foundation/sponsorship.html";>Sponsorship +https://www.apache.org/foundation/policies/conduct";>Code of Conduct + + + + + + + + + + + + + +Documentation +Using the Documentation +Beam Execution Model + + Pipeline development lifecycle + + +Design Your Pipeline +Create Your Pipeline +Test Your Pipeline + + + + Beam programming guide + + +Overview +Pipelines + + PCollections + + +Creating a PCollection +PCollection characteristics + + + + Transforms + + +Applying transforms + + Core Beam transforms + + +ParDo +GroupByKey +CoGroupByKey +Combine +Flatten +Partition + + + +Requirements for user code +Side inputs +Additional outputs +Composite transforms + + + + Pipeline I/O + + +Using I/O transforms +Built-in I/O transforms +Authoring new I/O transforms +Testing I/O transforms + + + + Data encoding and type safety + + +Data encoding basics +Specifying coders +Default coders and the CoderRegistry + + + + Windowing + + +Windowing basics +Provided windowing functions +Setting your PCollection’s windowing function +Watermarks and late data +Adding timestamps to a PCollection’s elements + + + + Triggers + + +Trigger basics +Event time triggers and the default trigger +Processing time triggers +Data-driven triggers +Setting a trigger +Composite triggers + + +Additional Resources + + + + + + + + + + + + + + Before you start + BigQuery basics + + Table names + Table rows + Schemas + + + Reading from BigQuery + + Reading from a table + Reading with a query string + + + Writing to BigQuery + + Create disposition + Write disposition + Creating a table schema + Setting the insertion method + Writing
[beam-site] branch asf-site updated (0c4dd7c -> 150f268)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 0c4dd7c Prepare repository for deployment. add ab5e53d Add new page for Google BigQueryIO add c43c5ef This closes #376 new 150f268 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../io/built-in/google-bigquery/index.html | 1367 content/documentation/io/built-in/index.html |4 +- src/documentation/io/built-in-google-bigquery.md | 760 +++ src/documentation/io/built-in.md |4 +- 4 files changed, 2131 insertions(+), 4 deletions(-) create mode 100644 content/documentation/io/built-in/google-bigquery/index.html create mode 100644 src/documentation/io/built-in-google-bigquery.md
[beam-site] branch mergebot updated (0d4cb6f -> c43c5ef)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 0d4cb6f This closes #376 new c43c5ef This closes #376 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (0d4cb6f) \ N -- N -- N refs/heads/mergebot (c43c5ef) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes:
[beam-site] 01/01: This closes #376
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit c43c5efcb3182de882763a2cba24cb9dac2226e1 Merge: 0c4dd7c ab5e53d Author: Mergebot AuthorDate: Tue Oct 16 15:11:35 2018 + This closes #376 src/documentation/io/built-in-google-bigquery.md | 760 +++ src/documentation/io/built-in.md | 4 +- 2 files changed, 762 insertions(+), 2 deletions(-)
[beam-site] 01/01: This closes #376
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 0d4cb6f761473e47c104295afb098429a8da5332 Merge: 0c4dd7c ab5e53d Author: Mergebot AuthorDate: Tue Oct 16 06:51:51 2018 + This closes #376 src/documentation/io/built-in-google-bigquery.md | 760 +++ src/documentation/io/built-in.md | 4 +- 2 files changed, 762 insertions(+), 2 deletions(-)
[beam-site] branch mergebot updated (1db9f8b -> 0d4cb6f)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 1db9f8b This closes #376 new 0d4cb6f This closes #376 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (1db9f8b) \ N -- N -- N refs/heads/mergebot (0d4cb6f) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes:
[beam-site] branch mergebot updated (207871f -> 1db9f8b)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 207871f This closes #573 add 0c4dd7c Prepare repository for deployment. new ab5e53d Add new page for Google BigQueryIO new 1db9f8b This closes #376 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/community/contact-us/index.html | 2 +- src/documentation/io/built-in-google-bigquery.md | 760 +++ src/documentation/io/built-in.md | 4 +- 3 files changed, 763 insertions(+), 3 deletions(-) create mode 100644 src/documentation/io/built-in-google-bigquery.md
[beam-site] 01/02: Add new page for Google BigQueryIO
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit ab5e53d49323e50a9259df3c216235b51659cbb1 Author: melissa AuthorDate: Tue Jan 16 17:16:19 2018 -0800 Add new page for Google BigQueryIO --- src/documentation/io/built-in-google-bigquery.md | 760 +++ src/documentation/io/built-in.md | 4 +- 2 files changed, 762 insertions(+), 2 deletions(-) diff --git a/src/documentation/io/built-in-google-bigquery.md b/src/documentation/io/built-in-google-bigquery.md new file mode 100644 index 000..d16289a --- /dev/null +++ b/src/documentation/io/built-in-google-bigquery.md @@ -0,0 +1,760 @@ +--- +layout: section +title: "Google BigQuery IO" +section_menu: section-menu/documentation.html +permalink: /documentation/io/built-in/google-bigquery/ +--- + +[Built-in I/O Transforms]({{site.baseurl}}/documentation/io/built-in/) + +# Google BigQuery IO + + + Adapt for: + +Java SDK +Python SDK + + + +The Beam SDKs include built-in transforms that can read data from and write data +to [Google BigQuery](https://cloud.google.com/bigquery) tables. + +## Before you start + + + +{:.language-java} +To use BigQueryIO, add the Maven artifact dependency to your `pom.xml` file. + +```java + +org.apache.beam +beam-sdks-java-io-google-cloud-platform +{{ site.release_latest }} + +``` + +{:.language-java} +Additional resources: + +{:.language-java} +* [BigQueryIO source code](https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery) +* [BigQueryIO Javadoc]({{ site.baseurl }}/documentation/sdks/javadoc/{{ site.release_latest }}/index.html?org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.html) +* [Google BigQuery documentation](https://cloud.google.com/bigquery/docs) + + + + +{:.language-py} +To use BigQueryIO, you must install the Google Cloud Platform dependencies by +running `pip install apache-beam[gcp]`. + +{:.language-py} +Additional resources: + +{:.language-py} +* [BigQueryIO source code](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery.py) +* [BigQueryIO Pydoc]({{ site.baseurl }}/documentation/sdks/pydoc/{{ site.release_latest }}/apache_beam.io.gcp.bigquery.html) +* [Google BigQuery documentation](https://cloud.google.com/bigquery/docs) + + +## BigQuery basics + +### Table names + +To read or write from a BigQuery table, you must provide a fully-qualified +BigQuery table name (for example, `bigquery-public-data:github_repos.sample_contents`). +A fully-qualified BigQuery table name consists of three parts: + + * **Project ID**: The ID for your Google Cloud Project. The default value comes + from your pipeline options object. + * **Dataset ID**: The BigQuery dataset ID, which is unique within a given Cloud + Project. + * **Table ID**: A BigQuery table ID, which is unique within a given dataset. + +A table name can also include a [table decorator](https://cloud.google.com/bigquery/table-decorators) +if you are using [time-partitioned tables](#using-time-partitioning). + +To specify a BigQuery table, you can use either the table's fully-qualified name as +a string, or use a + + [TableReference](https://developers.google.com/resources/api-libraries/documentation/bigquery/v2/java/latest/index.html?com/google/api/services/bigquery/model/TableReference.html) + + + [TableReference](https://googleapis.github.io/google-cloud-python/latest/bigquery/generated/google.cloud.bigquery.table.TableReference.html#google.cloud.bigquery.table.TableReference) + +object. + + Using a string + +To specify a table with a string, use the format +`[project_id]:[dataset_id].[table_id]` to specify the fully-qualified BigQuery +table name. + +```java +{% github_sample /apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/snippets/Snippets.java tag:BigQueryTableSpec +%}``` +```py +{% github_sample /apache/beam/blob/master/sdks/python/apache_beam/examples/snippets/snippets.py tag:model_bigqueryio_table_spec +%}``` + +You can also omit `project_id` and use the `[dataset_id].[table_id]` format. If +you omit the project ID, Beam uses the default project ID from your + + [pipeline options]({{ site.baseurl }}/documentation/sdks/javadoc/{{ site.release_latest }}/index.html?org/apache/beam/sdk/extensions/gcp/options/GcpOptions.html). + + + [pipeline options]({{ site.baseurl }}/documentation/sdks/pydoc/{{ site.release_latest }}/apache_beam.options.pipeline_options.html#apache_beam.options.pipeline_options.GoogleCloudOptions). + + +```java +{% github_sample /apache/beam/blob/master/examples/java/src/main/java/org/apache/beam/examples/snippets/Snippets.java tag:BigQueryTableSpecWithoutProject +%}``` +```py +{% github_sample /apache/beam/blob/master/sdks/python/apache_beam/examples/snipp
[beam-site] 02/02: This closes #376
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 1db9f8bce084b48724e50d18e0e717eaca639e6f Merge: 0c4dd7c ab5e53d Author: Mergebot AuthorDate: Tue Oct 16 06:22:51 2018 + This closes #376 src/documentation/io/built-in-google-bigquery.md | 760 +++ src/documentation/io/built-in.md | 4 +- 2 files changed, 762 insertions(+), 2 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 0c4dd7c3f9a08d0c4a92e5454de13347c1d8db00 Author: Mergebot AuthorDate: Wed Oct 10 18:11:16 2018 + Prepare repository for deployment. --- content/community/contact-us/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/community/contact-us/index.html b/content/community/contact-us/index.html index 21b26b0..af3b843 100644 --- a/content/community/contact-us/index.html +++ b/content/community/contact-us/index.html @@ -226,7 +226,7 @@ whichever one seems best! https://s.apache.org/beam-slack-channel";>Slack - Chat with users and developers (https://s.apache.org/slack-invite";>Join) + Chat with users and developers on channel #beam (https://s.apache.org/slack-invite";>Join)
[beam-site] branch asf-site updated (b1a61a4 -> 0c4dd7c)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from b1a61a4 Prepare repository for deployment. add 5b651b9 Add the #beam channel add 207871f This closes #573 new 0c4dd7c Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/community/contact-us/index.html | 2 +- src/community/contact-us.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
[beam-site] 01/02: Add the #beam channel
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 5b651b9ab2aba9efe40aa89fbb42ecea14a8 Author: Christian Schneider AuthorDate: Thu Oct 4 17:30:55 2018 +0200 Add the #beam channel On first login people are directed to the #general channel. We should advise them to use the channel #beam --- src/community/contact-us.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/community/contact-us.md b/src/community/contact-us.md index e0639ad..7b5651a 100644 --- a/src/community/contact-us.md +++ b/src/community/contact-us.md @@ -34,7 +34,7 @@ whichever one seems best! | [commits@](https://lists.apache.org/list.html?commits@beam.apache.org) mailing list | Firehose of commits, bugs, pull requests, etc. ([Subscribe](mailto:commits-subscr...@beam.apache.org), [Unsubscribe](mailto:commits-unsubscr...@beam.apache.org)) | | [JIRA bug tracker](https://issues.apache.org/jira/browse/BEAM) | Report bugs / discover known issues | | [StackOverflow](http://stackoverflow.com/questions/tagged/apache-beam) | Ask and answer user support questions | -| [Slack](https://s.apache.org/beam-slack-channel) | Chat with users and developers ([Join](https://s.apache.org/slack-invite)) | +| [Slack](https://s.apache.org/beam-slack-channel) | Chat with users and developers on channel #beam ([Join](https://s.apache.org/slack-invite)) | {:.table} If you wish to report a security vulnerability, please contact [secur...@apache.org](mailto:secur...@apache.org). Apache Beam follows the typical [Apache vulnerability handling process](https://apache.org/security/committers.html#vulnerability-handling).
[beam-site] branch mergebot updated (7fb7725 -> 207871f)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 7fb7725 This closes #568 add b1a61a4 Prepare repository for deployment. new 5b651b9 Add the #beam channel new 207871f This closes #573 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/blog/2018/06/26/beam-2.5.0.html| 2 +- content/blog/2018/10/03/beam-2.7.0.html| 4 ++-- content/blog/index.html| 2 +- content/contribute/dependencies/index.html | 2 +- content/contribute/index.html | 2 +- content/contribute/release-guide/index.html| 3 +++ content/contribute/runner-guide/index.html | 2 +- .../documentation/dsls/sql/create-external-table/index.html| 10 +- content/documentation/io/testing/index.html| 6 +++--- content/feed.xml | 6 +++--- content/get-started/quickstart-java/index.html | 4 ++-- content/get-started/quickstart-py/index.html | 2 +- content/get-started/wordcount-example/index.html | 2 +- src/community/contact-us.md| 2 +- 14 files changed, 26 insertions(+), 23 deletions(-)
[beam-site] 02/02: This closes #573
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 207871fe55fedbcad9d210e31e106867d020a3aa Merge: b1a61a4 5b651b9 Author: Mergebot AuthorDate: Wed Oct 10 18:08:22 2018 + This closes #573 src/community/contact-us.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit b1a61a48da7c38e4c4de86a9ab2ca5c6fadedc91 Author: Mergebot AuthorDate: Mon Oct 8 20:59:35 2018 + Prepare repository for deployment. --- content/blog/2018/06/26/beam-2.5.0.html| 2 +- content/blog/2018/10/03/beam-2.7.0.html| 4 ++-- content/blog/index.html| 2 +- content/contribute/dependencies/index.html | 2 +- content/contribute/index.html | 2 +- content/contribute/release-guide/index.html| 3 +++ content/contribute/runner-guide/index.html | 2 +- .../documentation/dsls/sql/create-external-table/index.html| 10 +- content/documentation/io/testing/index.html| 6 +++--- content/feed.xml | 6 +++--- content/get-started/quickstart-java/index.html | 4 ++-- content/get-started/quickstart-py/index.html | 2 +- content/get-started/wordcount-example/index.html | 2 +- 13 files changed, 25 insertions(+), 22 deletions(-) diff --git a/content/blog/2018/06/26/beam-2.5.0.html b/content/blog/2018/06/26/beam-2.5.0.html index e054124..32a2531 100644 --- a/content/blog/2018/06/26/beam-2.5.0.html +++ b/content/blog/2018/06/26/beam-2.5.0.html @@ -165,7 +165,7 @@ please check the detailed release notes. New Features / Improvements Go SDK support -The Go SDK has been officially accepted into the project, after an incubation period and community effort. Go pipelines run on Dataflow runner. More details are https://beam.apache.org/documentation/sdks/go/";>here. +The Go SDK has been officially accepted into the project, after an incubation period and community effort. Go pipelines run on Dataflow runner. More details are here. Parquet support Support for Apache Parquet format was added. It uses Parquet 1.10 release which, thanks to AvroParquerWriter’s API changes, allows FileIO.Sink implementation. diff --git a/content/blog/2018/10/03/beam-2.7.0.html b/content/blog/2018/10/03/beam-2.7.0.html index df816da..9476ed0 100644 --- a/content/blog/2018/10/03/beam-2.7.0.html +++ b/content/blog/2018/10/03/beam-2.7.0.html @@ -159,7 +159,7 @@ limitations under the License. --> We are happy to present the new 2.7.0 release of Beam. This release includes both improvements and new functionality. -See the https://beam.apache.org/get-started/downloads/#270-2018-10-02";>download page for this release. +See the download page for this release. For more information on changes in 2.7.0, check out the https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654";>detailed release notes. @@ -186,7 +186,7 @@ For more information on changes in 2.7.0, check out the Experimental support for Python on local Flink runner for simple examples, see latest information here: -https://beam.apache.org/contribute/portability/#status. +/contribute/portability/#status. Miscellaneous Fixes diff --git a/content/blog/index.html b/content/blog/index.html index ad88fa9..24639b1 100644 --- a/content/blog/index.html +++ b/content/blog/index.html @@ -159,7 +159,7 @@ limitations under the License. --> We are happy to present the new 2.7.0 release of Beam. This release includes both improvements and new functionality. -See the https://beam.apache.org/get-started/downloads/#270-2018-10-02";>download page for this release. +See the download page for this release. diff --git a/content/contribute/dependencies/index.html b/content/contribute/dependencies/index.html index 5a613d1..9d15b6b 100644 --- a/content/contribute/dependencies/index.html +++ b/content/contribute/dependencies/index.html @@ -304,7 +304,7 @@ limitations under the License. Dependency updates and backwards compatibility -Beam releases https://beam.apache.org/get-started/downloads/";>adhere to semantic versioning. Hence, community members should take care when updating dependencies. Minor version updates to dependencies should be backwards compatible in most cases. Some updates to dependencies though may result in backwards incompatible API or functionality changes to Beam. PR reviewers and committers should take care to detect any dependency updates that could potentially introduce backwar [...] +Beam releases adhere to semantic versioning. Hence, community members should take care when updating dependencies. Minor version updates to dependencies should be backwards compatible in most cases. Some updates to dependencies though may result in backwards incompatible API or functionality changes to Beam. PR reviewers and committers should take care to det
[beam-site] branch asf-site updated (14d974b -> b1a61a4)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 14d974b Merge Update internal links to use site.baseurl #576 add bf50ad5 Add instructions about how to sign and hash python wheels add 7fb7725 This closes #568 new b1a61a4 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/blog/2018/06/26/beam-2.5.0.html| 2 +- content/blog/2018/10/03/beam-2.7.0.html| 4 ++-- content/blog/index.html| 2 +- content/contribute/dependencies/index.html | 2 +- content/contribute/index.html | 2 +- content/contribute/release-guide/index.html| 3 +++ content/contribute/runner-guide/index.html | 2 +- .../documentation/dsls/sql/create-external-table/index.html| 10 +- content/documentation/io/testing/index.html| 6 +++--- content/feed.xml | 6 +++--- content/get-started/quickstart-java/index.html | 4 ++-- content/get-started/quickstart-py/index.html | 2 +- content/get-started/wordcount-example/index.html | 2 +- src/contribute/release-guide.md| 3 +++ 14 files changed, 28 insertions(+), 22 deletions(-)
[beam-site] 02/02: This closes #568
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 7fb77258dc98d09fdd77ff3e0d659bd91d752169 Merge: 14d974b bf50ad5 Author: Mergebot AuthorDate: Mon Oct 8 20:56:42 2018 + This closes #568 src/contribute/release-guide.md | 3 +++ 1 file changed, 3 insertions(+)
[beam-site] branch mergebot updated (3eb0e34 -> 7fb7725)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 3eb0e34 This closes #576 add 5f1f846 Add deprecation notices add 00f7adf Merge PR #567: [BEAM-4502] Add deprecation notices add 9643460 [BEAM-5667] remove gradle files from website add be422ea Merge PR#579: [BEAM-5667] remove gradle files from website add 6f31911 [BEAM-5665] Exclude down website atrato.io from website checks add 66ac84a Merge PR #578: [BEAM-5665] Exclude down website atrato.io from website checks add 14d974b Merge Update internal links to use site.baseurl #576 new bf50ad5 Add instructions about how to sign and hash python wheels new 7fb7725 This closes #568 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (3eb0e34) \ N -- N -- N refs/heads/mergebot (7fb7725) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/PULL_REQUEST_TEMPLATE.md | 7 +++ .gradle/4.8/fileChanges/last-build.bin | Bin 1 -> 0 bytes .gradle/4.8/fileHashes/fileHashes.bin | Bin 18547 -> 0 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 17 -> 0 bytes .gradle/vcsWorkingDirs/gc.properties | 0 README.md | 5 + Rakefile | 1 + src/contribute/release-guide.md| 3 +++ 8 files changed, 16 insertions(+) delete mode 100644 .gradle/4.8/fileChanges/last-build.bin delete mode 100644 .gradle/4.8/fileHashes/fileHashes.bin delete mode 100644 .gradle/4.8/fileHashes/fileHashes.lock delete mode 100644 .gradle/vcsWorkingDirs/gc.properties
[beam-site] 01/02: Add instructions about how to sign and hash python wheels
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit bf50ad55f2866c7e311f745dbdd1a8e403a410cf Author: Boyuan Zhang AuthorDate: Mon Oct 1 15:09:01 2018 -0700 Add instructions about how to sign and hash python wheels --- src/contribute/release-guide.md | 3 +++ 1 file changed, 3 insertions(+) diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md index 6a5e1c4..76edfca 100644 --- a/src/contribute/release-guide.md +++ b/src/contribute/release-guide.md @@ -592,6 +592,9 @@ If you are interested in how it works, please refer to the [structure section](h Please follow the [user guide](https://github.com/apache/beam-wheels#user-guide) to build python wheels. +Once all python wheels have been staged [dist.apache.org](https://dist.apache.org/repos/dist/dev/beam/), +please run ./sign_hash_python_wheels.sh to sign and hash python wheels. + Checklist to proceed to the next step 1. Maven artifacts deployed to the staging repository of [repository.apache.org](https://repository.apache.org/content/repositories/)
[beam-site] branch mergebot updated (0010c04 -> 3eb0e34)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 0010c04 This closes #579 omit 9643460 [BEAM-5667] remove gradle files from website add 65a2c94 Update internal links to use site.baseurl new 3eb0e34 This closes #576 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (0010c04) \ N -- N -- N refs/heads/mergebot (3eb0e34) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gradle/4.8/fileChanges/last-build.bin | Bin 0 -> 1 bytes .gradle/4.8/fileHashes/fileHashes.bin | Bin 0 -> 18547 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 0 -> 17 bytes .gradle/vcsWorkingDirs/gc.properties| 0 src/_posts/2018-06-26-beam-2.5.0.md | 2 +- src/_posts/2018-10-03-beam-2.7.0.md | 4 ++-- src/contribute/dependencies.md | 2 +- src/contribute/index.md | 2 +- src/contribute/runner-guide.md | 2 +- src/documentation/dsls/sql/create-external-table.md | 10 +- src/documentation/io/testing.md | 6 +++--- src/get-started/quickstart-java.md | 4 ++-- src/get-started/quickstart-py.md| 2 +- src/get-started/wordcount-example.md| 2 +- 14 files changed, 18 insertions(+), 18 deletions(-) create mode 100644 .gradle/4.8/fileChanges/last-build.bin create mode 100644 .gradle/4.8/fileHashes/fileHashes.bin create mode 100644 .gradle/4.8/fileHashes/fileHashes.lock create mode 100644 .gradle/vcsWorkingDirs/gc.properties
[beam-site] 01/01: This closes #576
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 3eb0e342dab3da580f126d93cf86d80848b933e5 Merge: c76fdb7 65a2c94 Author: Mergebot AuthorDate: Fri Oct 5 18:44:08 2018 + This closes #576 src/_posts/2018-06-26-beam-2.5.0.md | 2 +- src/_posts/2018-10-03-beam-2.7.0.md | 4 ++-- src/contribute/dependencies.md | 2 +- src/contribute/index.md | 2 +- src/contribute/runner-guide.md | 2 +- src/documentation/dsls/sql/create-external-table.md | 10 +- src/documentation/io/testing.md | 6 +++--- src/get-started/quickstart-java.md | 4 ++-- src/get-started/quickstart-py.md| 2 +- src/get-started/wordcount-example.md| 2 +- 10 files changed, 18 insertions(+), 18 deletions(-)
[beam-site] 01/01: This closes #579
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 0010c046401ad171547d720b21dea910a17d2a09 Merge: c76fdb7 9643460 Author: Mergebot AuthorDate: Fri Oct 5 18:32:57 2018 + This closes #579 .gradle/4.8/fileChanges/last-build.bin | Bin 1 -> 0 bytes .gradle/4.8/fileHashes/fileHashes.bin | Bin 18547 -> 0 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 17 -> 0 bytes .gradle/vcsWorkingDirs/gc.properties | 0 4 files changed, 0 insertions(+), 0 deletions(-)
[beam-site] branch mergebot updated (b19e933 -> 0010c04)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard b19e933 This closes #578 omit 6f31911 [BEAM-5665] Exclude down website atrato.io from website checks add 9643460 [BEAM-5667] remove gradle files from website new 0010c04 This closes #579 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (b19e933) \ N -- N -- N refs/heads/mergebot (0010c04) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gradle/4.8/fileChanges/last-build.bin | Bin 1 -> 0 bytes .gradle/4.8/fileHashes/fileHashes.bin | Bin 18547 -> 0 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 17 -> 0 bytes .gradle/vcsWorkingDirs/gc.properties | 0 Rakefile | 1 - 5 files changed, 1 deletion(-) delete mode 100644 .gradle/4.8/fileChanges/last-build.bin delete mode 100644 .gradle/4.8/fileHashes/fileHashes.bin delete mode 100644 .gradle/4.8/fileHashes/fileHashes.lock delete mode 100644 .gradle/vcsWorkingDirs/gc.properties
[beam-site] 01/01: This closes #578
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit b19e93389709899035de8c25c0c2468735689ad0 Merge: c76fdb7 6f31911 Author: Mergebot AuthorDate: Fri Oct 5 17:21:01 2018 + This closes #578 Rakefile | 1 + 1 file changed, 1 insertion(+)
[beam-site] branch mergebot updated (f61b020 -> b19e933)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard f61b020 This closes #567 discard 0be7a8f Add deprecation notices add 6f31911 [BEAM-5665] Exclude down website atrato.io from website checks new b19e933 This closes #578 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (f61b020) \ N -- N -- N refs/heads/mergebot (b19e933) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/PULL_REQUEST_TEMPLATE.md | 7 --- README.md| 5 - Rakefile | 1 + 3 files changed, 1 insertion(+), 12 deletions(-)
[beam-site] branch mergebot updated (1a86fd7 -> f61b020)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 1a86fd7 This closes #574 add c76fdb7 Prepare repository for deployment. new 0be7a8f Add deprecation notices new f61b020 This closes #567 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .github/PULL_REQUEST_TEMPLATE.md | 7 +++ README.md | 5 + content/contribute/postcommits-policies/index.html | 3 +-- 3 files changed, 13 insertions(+), 2 deletions(-)
[beam-site] 02/02: This closes #567
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit f61b0209ef963bf49f41a7576aaa0bc16542cc0e Merge: c76fdb7 0be7a8f Author: Mergebot AuthorDate: Fri Oct 5 16:47:38 2018 + This closes #567 .github/PULL_REQUEST_TEMPLATE.md | 7 +++ README.md| 5 + 2 files changed, 12 insertions(+)
[beam-site] 01/02: Add deprecation notices
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 0be7a8ff512c76cabecc2a12601e7af93180ca94 Author: Udi Meiri AuthorDate: Mon Oct 1 11:24:10 2018 -0700 Add deprecation notices --- .github/PULL_REQUEST_TEMPLATE.md | 7 +++ README.md| 5 + 2 files changed, 12 insertions(+) diff --git a/.github/PULL_REQUEST_TEMPLATE.md b/.github/PULL_REQUEST_TEMPLATE.md index 7862359..ffb5c42 100644 --- a/.github/PULL_REQUEST_TEMPLATE.md +++ b/.github/PULL_REQUEST_TEMPLATE.md @@ -1,3 +1,10 @@ +**Deprecation notice:** The website is being migrated to +https://github.com/apache/beam/tree/master/website + +Please create new pull requests against the above repo. + +--- + *Please* add a meaningful description for your change here. Once your pull request has been opened and assigned a number, please edit the diff --git a/README.md b/README.md index b0e00a9..e3d68be 100644 --- a/README.md +++ b/README.md @@ -1,3 +1,8 @@ +**Deprecation notice:** The website is being migrated to +https://github.com/apache/beam/tree/master/website + +--- + # Apache Beam website This is the website for [Apache Beam](https://beam.apache.org/), hosted at:
[beam-site] branch asf-site updated (214ffd0 -> c76fdb7)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 214ffd0 Prepare repository for deployment. add 71e2dee Add JIRA template for post-commit failures add 1a86fd7 This closes #574 new c76fdb7 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/postcommits-policies/index.html | 3 +-- src/contribute/postcommits-policies.md | 3 +-- 2 files changed, 2 insertions(+), 4 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit c76fdb7cc9dbbada93708bbf1017e703549b8214 Author: Mergebot AuthorDate: Thu Oct 4 18:56:29 2018 + Prepare repository for deployment. --- content/contribute/postcommits-policies/index.html | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-) diff --git a/content/contribute/postcommits-policies/index.html b/content/contribute/postcommits-policies/index.html index 275e837..44fa0db 100644 --- a/content/contribute/postcommits-policies/index.html +++ b/content/contribute/postcommits-policies/index.html @@ -261,8 +261,7 @@ community follows these post-commit test policies: I found a test failure - Create a https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20test-failures";>JIRA issue -and assign it to yourself. + Create a https://s.apache.org/beam-test-failure";>JIRA issue and assign it to yourself. Do high level triage of the failure. Assign the JIRA issue to a relevant person.
[beam-site] 01/01: This closes #574
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 1a86fd74677b0d1778e5852ac3646cffcf68b8c2 Merge: 214ffd0 71e2dee Author: Mergebot AuthorDate: Thu Oct 4 18:52:27 2018 + This closes #574 src/contribute/postcommits-policies.md | 3 +-- 1 file changed, 1 insertion(+), 2 deletions(-)
[beam-site] branch mergebot updated (4091c5d -> 1a86fd7)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 4091c5d This closes #572 add 214ffd0 Prepare repository for deployment. add 71e2dee Add JIRA template for post-commit failures new 1a86fd7 This closes #574 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/release-guide/index.html | 5 +++-- src/contribute/postcommits-policies.md | 3 +-- 2 files changed, 4 insertions(+), 4 deletions(-)
[beam-site] branch asf-site updated (5122163 -> 214ffd0)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 5122163 Prepare repository for deployment. add 02d574a Update release guide add ad9b65d Edit suggestions add 4091c5d This closes #572 new 214ffd0 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/release-guide/index.html | 5 +++-- src/contribute/release-guide.md | 5 +++-- 2 files changed, 6 insertions(+), 4 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 214ffd0a73207c0ac49f27910963316869d7dea6 Author: Mergebot AuthorDate: Thu Oct 4 04:15:01 2018 + Prepare repository for deployment. --- content/contribute/release-guide/index.html | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-) diff --git a/content/contribute/release-guide/index.html b/content/contribute/release-guide/index.html index 2af7e88..5a0eec3 100644 --- a/content/contribute/release-guide/index.html +++ b/content/contribute/release-guide/index.html @@ -570,8 +570,9 @@ instructions. Attention: Only PMC has permission to perform this. If you are not a PMC, please ask for help in dev@ mailing list. - In JIRA, navigate to the https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions";>Beam > Administration > Versions. - Add a new release: choose the next minor version number compared to the one currently underway, select today’s date as the Start Date, and choose Add. + In JIRA, navigate to https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions";>Beam > Administration > Versions. + Add a new release. Choose the next minor version number after the version currently underway, select the release cut date (today’s date) as the Start Date, and choose Add. + At the end of the release, go to the same page and mark the recently released version as released. Use the ... menu and choose Release. Triage release-blocking issues in JIRA
[beam-site] branch mergebot updated (021f266 -> 4091c5d)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 021f266 This closes #570 add 5122163 Prepare repository for deployment. new 02d574a Update release guide new ad9b65d Edit suggestions new 4091c5d This closes #572 The 3 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../2018/10/03/beam-2.7.0.html}| 81 +++--- content/blog/index.html| 32 content/feed.xml | 174 ++--- content/get-started/downloads/index.html | 2 + content/index.html | 10 +- src/contribute/release-guide.md| 5 +- 6 files changed, 188 insertions(+), 116 deletions(-) copy content/{beam/capability/2016/04/03/presentation-materials.html => blog/2018/10/03/beam-2.7.0.html} (78%)
[beam-site] 03/03: This closes #572
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 4091c5d00e0c48c0bdb9f6dc71d421ddd4085fd4 Merge: 5122163 ad9b65d Author: Mergebot AuthorDate: Thu Oct 4 04:11:38 2018 + This closes #572 src/contribute/release-guide.md | 5 +++-- 1 file changed, 3 insertions(+), 2 deletions(-)
[beam-site] 01/03: Update release guide
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 02d574ab0ec1a1191a53b6c1b7d87da0f6cbdf1d Author: Ahmet Altay AuthorDate: Wed Oct 3 16:50:45 2018 -0700 Update release guide --- src/contribute/release-guide.md | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md index cddad39..b8cd62c 100644 --- a/src/contribute/release-guide.md +++ b/src/contribute/release-guide.md @@ -181,7 +181,8 @@ When contributors resolve an issue in JIRA, they are tagging it with a release t __Attention__: Only PMC has permission to perform this. If you are not a PMC, please ask for help in dev@ mailing list. 1. In JIRA, navigate to the [`Beam > Administration > Versions`](https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions). -1. Add a new release: choose the next minor version number compared to the one currently underway, select today’s date as the `Start Date`, and choose `Add`. +1. Add a new release: choose the next minor version number compared to the one currently underway, select release cut date (today’s date) as the `Start Date`, and choose `Add`. +1. At the end of the release, in the same page mark the recently released version as released. (Use the `...` menu and choose `Release`). ### Triage release-blocking issues in JIRA
[beam-site] 02/03: Edit suggestions
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit ad9b65dbfdb0c98c4f381b05ede31416a5f7f95b Author: Melissa Pashniak AuthorDate: Wed Oct 3 18:37:20 2018 -0700 Edit suggestions --- src/contribute/release-guide.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md index b8cd62c..6a5e1c4 100644 --- a/src/contribute/release-guide.md +++ b/src/contribute/release-guide.md @@ -180,9 +180,9 @@ When contributors resolve an issue in JIRA, they are tagging it with a release t __Attention__: Only PMC has permission to perform this. If you are not a PMC, please ask for help in dev@ mailing list. -1. In JIRA, navigate to the [`Beam > Administration > Versions`](https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions). -1. Add a new release: choose the next minor version number compared to the one currently underway, select release cut date (today’s date) as the `Start Date`, and choose `Add`. -1. At the end of the release, in the same page mark the recently released version as released. (Use the `...` menu and choose `Release`). +1. In JIRA, navigate to [`Beam > Administration > Versions`](https://issues.apache.org/jira/plugins/servlet/project-config/BEAM/versions). +1. Add a new release. Choose the next minor version number after the version currently underway, select the release cut date (today’s date) as the `Start Date`, and choose `Add`. +1. At the end of the release, go to the same page and mark the recently released version as released. Use the `...` menu and choose `Release`. ### Triage release-blocking issues in JIRA
[beam-site] branch asf-site updated (3a5943e -> 5122163)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 3a5943e Prepare repository for deployment. add f94845c Add Beam 2.7.0 release blog post add 021f266 This closes #570 new 5122163 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .../2018/10/03/beam-2.7.0.html}| 81 +++--- content/blog/index.html| 32 content/feed.xml | 174 ++--- content/get-started/downloads/index.html | 2 + content/index.html | 10 +- src/_data/authors.yml | 3 + src/_posts/2018-10-03-beam-2.7.0.md| 76 + src/get-started/downloads.md | 2 + 8 files changed, 266 insertions(+), 114 deletions(-) copy content/{beam/capability/2016/04/03/presentation-materials.html => blog/2018/10/03/beam-2.7.0.html} (78%) create mode 100644 src/_posts/2018-10-03-beam-2.7.0.md
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 5122163694da52d36c6ce7f7a943c7a141020ba8 Author: Mergebot AuthorDate: Wed Oct 3 20:03:19 2018 + Prepare repository for deployment. --- .../2018/10/03/beam-2.7.0.html}| 287 +++-- content/blog/index.html| 32 +++ content/feed.xml | 174 ++--- content/get-started/downloads/index.html | 2 + content/index.html | 10 +- 5 files changed, 213 insertions(+), 292 deletions(-) diff --git a/content/index.html b/content/blog/2018/10/03/beam-2.7.0.html similarity index 56% copy from content/index.html copy to content/blog/2018/10/03/beam-2.7.0.html index bf13aa1..df816da 100644 --- a/content/index.html +++ b/content/blog/2018/10/03/beam-2.7.0.html @@ -28,9 +28,8 @@ - Apache Beam - + Apache Beam 2.7.0 + https://fonts.googleapis.com/css?family=Roboto:100,300,400"; rel="stylesheet"> https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"</a>;> @@ -39,7 +38,7 @@ - https://beam.apache.org/"; data-proofer-ignore> + https://beam.apache.org/blog/2018/10/03/beam-2.7.0.html"; data-proofer-ignore> https://beam.apache.org/feed.xml";> @@ -52,7 +51,7 @@ - + + + + +http://schema.org/BlogPosting";> + + +Apache Beam 2.7.0 +Oct 3, 2018 • + Charles Chen + + + + + + - - - - - - -Apache Beam: An advanced unified programming model - - -Implement batch and streaming data processing jobs that run on any execution engine. - - -Learn more -Download Beam SDK 2.7.0 - - -Java Quickstart -Python Quickstart - Go Quickstart - - - - - - -The latest from the blog - - - - - Beam Summit Europe 2018 - Aug 21, 2018 - - - - A review of input streaming connectors - Aug 20, 2018 - - - - Apache Beam 2.6.0 - Aug 10, 2018 - - - - - - - - - - -All about Apache Beam - - - - - -Unified - - -Use a single programming model for both batch and streaming use cases. - - - - - -Portable - - -Execute pipelines on multiple execution environments. - - - - - -Extensible - - -Write and share new SDKs, IO connectors, and transformation libraries. - - - - - +We are happy to present the new 2.7.0 release of Beam. This release includes both improvements and new functionality. +See the https://beam.apache.org/get-started/downloads/#270-2018-10-02";>download page for this release. +For more information on changes in 2.7.0, check out the +https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654";>detailed release notes. - - - - - +New Features / Improvements - - -Works with - - - - - http://apex.apache.org";> - - - - http://flink.apache.org";> - - - - http://spark.apache.org/";> - - - - https://cloud.google.com/dataflow/";> - - - - http://gearpump.apache.org/";> - - - - http://samza.apache.org/";> - - - - +New I/Os - - - - Testimonials - - - - - - A framework that delivers the flexibility and advanced functionality our customers need. - - - - -–Talend - - - - - - - Apache Beam has powerful semantics that solve real-world challenges of stream processing. - - - - -–PayPal - - - - - - - Apache Beam represents a principled approach for analyzing data streams. - - - - -–data Artisans - - - - - - - Beam is an open source community and contributions are greatly appreciated! - If you’d like to contribute, please see the Contribute section. - - - + + KuduIO + Amazon SNS sink + Amazon SqsIO + + +Dependency Upgrades + + + Apache Calcite
[beam-site] branch mergebot updated: Add Beam 2.7.0 release blog post
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git The following commit(s) were added to refs/heads/mergebot by this push: new f94845c Add Beam 2.7.0 release blog post new 021f266 This closes #570 f94845c is described below commit f94845c063464bb21243d27d9428c71aee74319e Author: Charles Chen AuthorDate: Wed Oct 3 11:35:56 2018 -0700 Add Beam 2.7.0 release blog post --- src/_data/authors.yml | 3 ++ src/_posts/2018-10-03-beam-2.7.0.md | 76 + src/get-started/downloads.md| 2 + 3 files changed, 81 insertions(+) diff --git a/src/_data/authors.yml b/src/_data/authors.yml index 6d34750..1950cae 100644 --- a/src/_data/authors.yml +++ b/src/_data/authors.yml @@ -18,6 +18,9 @@ aljoscha: altay: name: Ahmet Altay email: al...@apache.org +ccy: +name: Charles Chen +email: c...@apache.org davor: name: Davor Bonaci email: da...@apache.org diff --git a/src/_posts/2018-10-03-beam-2.7.0.md b/src/_posts/2018-10-03-beam-2.7.0.md new file mode 100644 index 000..289763d --- /dev/null +++ b/src/_posts/2018-10-03-beam-2.7.0.md @@ -0,0 +1,76 @@ +--- +layout: post +title: "Apache Beam 2.7.0" +date: 2018-10-03 00:00:01 -0800 +excerpt_separator: +categories: blog +authors: +- ccy + +--- + + +We are happy to present the new 2.7.0 release of Beam. This release includes both improvements and new functionality. +See the [download page](https://beam.apache.org/get-started/downloads/#270-2018-10-02) for this release. +For more information on changes in 2.7.0, check out the +[detailed release notes](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654). + +## New Features / Improvements + +### New I/Os + +* KuduIO +* Amazon SNS sink +* Amazon SqsIO + +### Dependency Upgrades + +* Apache Calcite dependency upgraded to 1.17.0 +* Apache Derby dependency upgraded to 10.14.2.0 +* Apache HTTP components upgraded (see release notes). + +### Portability + +* Experimental support for Python on local Flink runner for simple +examples, see latest information here: +https://beam.apache.org/contribute/portability/#status. + +## Miscellaneous Fixes + +### I/Os + +* KinesisIO, fixed dependency issue + +## List of Contributors + +According to git shortlog, the following 72 people contributed +to the 2.7.0 release. Thank you to all contributors! + +Ahmet Altay, Alan Myrvold, Alexey Romanenko, Aljoscha Krettek, +Andrew Pilloud, Ankit Jhalaria, Ankur Goenka, Anton Kedin, Boyuan +Zhang, Carl McGraw, Carlos Alonso, cclauss, Chamikara Jayalath, +Charles Chen, Cory Brzycki, Daniel Oliveira, Dariusz Aniszewski, +devinduan, Eric Beach, Etienne Chauchot, Eugene Kirpichov, Garrett +Jones, Gene Peters, Gleb Kanterov, Henning Rohde, Henry Suryawirawan, +Holden Karau, Huygaa Batsaikhan, Ismaël Mejía, Jason Kuster, Jean- +Baptiste Onofré, Joachim van der Herten, Jozef Vilcek, jxlewis, Kai +Jiang, Katarzyna Kucharczyk, Kenn Knowles, Krzysztof Trubalski, Kyle +Winkelman, Leen Toelen, Luis Enrique Ortíz Ramirez, Lukasz Cwik, +Łukasz Gajowy, Luke Cwik, Mark Liu, Matthias Feys, Maximilian Michels, +Melissa Pashniak, Mikhail Gryzykhin, Mikhail Sokolov, mingmxu, Norbert +Chen, Pablo Estrada, Prateek Chanda, Raghu Angadi, Ravi Pathak, Reuven +Lax, Robert Bradshaw, Robert Burke, Rui Wang, Ryan Williams, Sindy Li, +Thomas Weise, Tim Robertson, Tormod Haavi, Udi Meiri, Vaclav Plajt, +Valentyn Tymofieiev, xiliu, XuMingmin, Yifan Zou, Yueyang Qiu. diff --git a/src/get-started/downloads.md b/src/get-started/downloads.md index e421ea0..24c5aff 100644 --- a/src/get-started/downloads.md +++ b/src/get-started/downloads.md @@ -84,6 +84,8 @@ Official [source code download](https://dist.apache.org/repos/dist/release/beam/ [SHA-512](https://dist.apache.org/repos/dist/release/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512) [signature](https://dist.apache.org/repos/dist/release/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc). +[Release notes](https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654). + ### 2.6.0 (2018-08-08) Official [source code download](https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip) [SHA-512](https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512)
[beam-site] branch mergebot updated (8d99a08 -> 3a5943e)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 8d99a08 This closes #563 add 3a5943e Prepare repository for deployment. No new revisions were added by this update. Summary of changes: content/contribute/testing/index.html | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 3a5943e7bdbeefb881999ca1d91d7c08d2233b3e Author: Mergebot AuthorDate: Wed Oct 3 19:55:57 2018 + Prepare repository for deployment. --- content/contribute/testing/index.html | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/content/contribute/testing/index.html b/content/contribute/testing/index.html index 2c27a71..a616019 100644 --- a/content/contribute/testing/index.html +++ b/content/contribute/testing/index.html @@ -336,13 +336,13 @@ desired configurations. NeedsRunner is a category of tests that require a Beam runner. To run NeedsRunner tests: -$ ./gradlew :runners:direct-java:needsRunnerTests +$ ./gradlew beam-runners-direct-java:needsRunnerTests To run a single NeedsRunner test use the test property, e.g. -$ ./gradlew :runners:direct-java:needsRunnerTests --tests org.apache.beam.sdk.transforms.MapElementsTest.testMapBasic +$ ./gradlew beam-runners-direct-java:needsRunnerTests --tests org.apache.beam.sdk.transforms.MapElementsTest.testMapBasic @@ -352,7 +352,7 @@ NeedsRunner tests: sdks/java/io/google-cloud-platform) can be executed with the gradle test command: -$ ./gradlew sdks:java:io:google-cloud-platform:test --tests org.apache.beam.sdk.io.gcp.spanner.SpannerIOWriteTest +$ ./gradlew beam-sdks-java-io-google-cloud-platform:test --tests org.apache.beam.sdk.io.gcp.spanner.SpannerIOWriteTest
[beam-site] branch asf-site updated (ad9a085 -> 3a5943e)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from ad9a085 Prepare repository for deployment. add 17814c2 Fix wrong gradle project targets in testing web-page. add 8d99a08 This closes #563 new 3a5943e Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/testing/index.html | 6 +++--- src/contribute/testing.md | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-)
[beam-site] 01/02: Fix wrong gradle project targets in testing web-page.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 17814c2318633dedd39ea9030e9875510a447782 Author: Ruoyun AuthorDate: Tue Sep 25 15:55:40 2018 -0700 Fix wrong gradle project targets in testing web-page. --- src/contribute/testing.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/src/contribute/testing.md b/src/contribute/testing.md index 2d847a7..7e21c22 100644 --- a/src/contribute/testing.md +++ b/src/contribute/testing.md @@ -107,13 +107,13 @@ NeedsRunner is a category of tests that require a Beam runner. To run NeedsRunner tests: ``` -$ ./gradlew :runners:direct-java:needsRunnerTests +$ ./gradlew beam-runners-direct-java:needsRunnerTests ``` To run a single NeedsRunner test use the `test` property, e.g. ``` -$ ./gradlew :runners:direct-java:needsRunnerTests --tests org.apache.beam.sdk.transforms.MapElementsTest.testMapBasic +$ ./gradlew beam-runners-direct-java:needsRunnerTests --tests org.apache.beam.sdk.transforms.MapElementsTest.testMapBasic ``` will run the `MapElementsTest.testMapBasic()` test. @@ -123,7 +123,7 @@ NeedsRunner tests in modules that are not required to build runners (e.g. command: ``` -$ ./gradlew sdks:java:io:google-cloud-platform:test --tests org.apache.beam.sdk.io.gcp.spanner.SpannerIOWriteTest +$ ./gradlew beam-sdks-java-io-google-cloud-platform:test --tests org.apache.beam.sdk.io.gcp.spanner.SpannerIOWriteTest ``` ### ValidatesRunner
[beam-site] branch mergebot updated (a84dcf3 -> 8d99a08)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from a84dcf3 This closes #560 add ad9a085 Prepare repository for deployment. new 17814c2 Fix wrong gradle project targets in testing web-page. new 8d99a08 This closes #563 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/documentation/dsls/sql/select/index.html | 825 +-- src/contribute/testing.md| 6 +- 2 files changed, 787 insertions(+), 44 deletions(-)
[beam-site] 02/02: This closes #563
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 8d99a089aebcc3f00058d968a40dc8678464b5c3 Merge: ad9a085 17814c2 Author: Mergebot AuthorDate: Wed Oct 3 19:53:05 2018 + This closes #563 src/contribute/testing.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit ad9a0859c3b6dad3e860e89cb56e0769b731fda8 Author: Mergebot AuthorDate: Wed Oct 3 19:22:45 2018 + Prepare repository for deployment. --- content/documentation/dsls/sql/select/index.html | 825 +-- 1 file changed, 784 insertions(+), 41 deletions(-) diff --git a/content/documentation/dsls/sql/select/index.html b/content/documentation/dsls/sql/select/index.html index b35adca..a07cd08 100644 --- a/content/documentation/dsls/sql/select/index.html +++ b/content/documentation/dsls/sql/select/index.html @@ -222,6 +222,75 @@ + + SQL Syntax + SELECT list + + SELECT * + SELECT expression + SELECT expression.* + SELECT modifiers + Aliases + + + FROM clause + + Syntax + Subqueries + Aliases + + + JOIN types + + Syntax + [INNER] JOIN + CROSS JOIN + FULL [OUTER] JOIN + LEFT [OUTER] JOIN + RIGHT [OUTER] JOIN + ON clause + USING clause + Sequences of JOINs + + + WHERE clause + + Syntax + + + GROUP BY clause + + Syntax + + + HAVING clause + + Syntax + + + Set operators + + Syntax + UNION + INTERSECT + EXCEPT + + + LIMIT clause and OFFSET clause + + Syntax + + + WITH clause + Aliases + + Explicit alias syntax + Explicit alias visibility + Ambiguous aliases + Implicit aliases + + + @@ -256,62 +325,736 @@ batch/streaming model: Windowing & Triggering -Below is a curated grammar of the supported syntax in Beam SQL +Query statements scan one or more tables or expressions and return the computed +result rows. This topic describes the syntax for SQL queries in Beam. + +SQL Syntax -query: - { - select - | query UNION [ ALL ] query - | query MINUS [ ALL ] query - | query INTERSECT [ ALL ] query - } -[ ORDER BY orderItem [, orderItem ]* LIMIT count [OFFSET offset] ] +query_statement: +[ WITH with_query_name AS ( query_expr ) [, ...] ] +query_expr -orderItem: - expression [ ASC | DESC ] +query_expr: +{ select | ( query_expr ) | query_expr set_op query_expr } +[ LIMIT count [ OFFSET skip_rows ] ] select: - SELECT - { * | projectItem [, projectItem ]* } - FROM tableExpression - [ WHERE booleanExpression ] - [ GROUP BY { groupItem [, groupItem ]* } ] - [ HAVING booleanExpression ] +SELECT [{ ALL | DISTINCT }] +{ [ expression. ]* [ EXCEPT ( column_name [, ...] ) ] +[ REPLACE ( expression [ AS ] column_name [, ...] ) ] +| expression [ [ AS ] alias ] } [, ...] +[ FROM from_item [, ...] ] +[ WHERE bool_expression ] +[ GROUP BY { expression [, ...] | ROLLUP ( expression [, ...] ) } ] +[ HAVING bool_expression ] + +set_op: +UNION { ALL | DISTINCT } | INTERSECT DISTINCT | EXCEPT DISTINCT + +from_item: { +table_name [ [ AS ] alias ] | +join | +( query_expr ) [ [ AS ] alias ] +with_query_name [ [ AS ] alias ] +} + +join: +from_item [ join_type ] JOIN from_item +[ { ON bool_expression | USING ( join_column [, ...] ) } ] + +join_type: +{ INNER | CROSS | FULL [OUTER] | LEFT [OUTER] | RIGHT [OUTER] } + + + +Notation: + + + Square brackets “[ ]” indicate optional clauses. + Parentheses “( )” indicate literal parentheses. + + + + + The vertical bar “ + ” indicates a logical OR. + + + + + Curly braces “{ }” enclose a set of options. + A comma followed by an ellipsis within square brackets “[, … ]” +indicates that the preceding item can repeat in a comma-separated list. + + +SELECT list + +Syntax: + +SELECT [{ ALL | DISTINCT }] +{ [ expression. ]* +| expression [ [ AS ] alias ] } [, ...] + + + +The SELECT list defines the columns that the query will return. Expressions in +the SELECT list can refer to columns in any of the from_items in its +corresponding FROM clause. + +Each item in the SELECT list is one of: + + + * + expression + expression.* + + +SELECT * + +SELECT *, often referred to as select star, produces one output column for +each column that is visible after executing the full query. + +SELECT * FROM (SELECT 'apple' AS fruit, 'carrot' AS vegetable); + ++---+---+ +| fruit | vegetable | ++---+---+ +| apple | carrot| ++---+---+ + + + +SELECT expression + +Items in a SELECT list can be expressions. These expressions evaluate to a +single value and produce one output column, with an optional explicit alias. + +If the expression does not have an explicit alias, it receives an implicit alias +according to the rules for implic
[beam-site] branch asf-site updated (34da82a -> ad9a085)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 34da82a Prepare repository for deployment. add c55e355 Pull in SELECT documentation from bigquery add 495dc33 Update SELECT doc for Beam add a84dcf3 This closes #560 new ad9a085 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/documentation/dsls/sql/select/index.html | 825 +-- src/documentation/dsls/sql/select.md | 709 +-- 2 files changed, 1451 insertions(+), 83 deletions(-)
[beam-site] 03/03: This closes #560
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit a84dcf3d9b752c48ccc8737b3ae440bcb598d433 Merge: 34da82a 495dc33 Author: Mergebot AuthorDate: Wed Oct 3 19:19:53 2018 + This closes #560 src/documentation/dsls/sql/select.md | 709 --- 1 file changed, 667 insertions(+), 42 deletions(-)
[beam-site] 01/03: Pull in SELECT documentation from bigquery
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit c55e35553e49231d39371a3c7c98ce56d5a34aa4 Author: Andrew Pilloud AuthorDate: Mon Jul 23 11:24:39 2018 -0700 Pull in SELECT documentation from bigquery --- src/documentation/dsls/sql/select.md | 1855 +- 1 file changed, 1813 insertions(+), 42 deletions(-) diff --git a/src/documentation/dsls/sql/select.md b/src/documentation/dsls/sql/select.md index 24bd728..c15003e 100644 --- a/src/documentation/dsls/sql/select.md +++ b/src/documentation/dsls/sql/select.md @@ -32,59 +32,1830 @@ batch/streaming model: - [Joins]({{ site.baseurl}}/documentation/dsls/sql/joins) - [Windowing & Triggering]({{ site.baseurl}}/documentation/dsls/sql/windowing-and-triggering/) -Below is a curated grammar of the supported syntax in Beam SQL +Query statements scan one or more tables or expressions and return the computed +result rows. This topic describes the syntax for SQL queries in BigQuery. +## SQL Syntax + +query_statement: +[ WITH with_query_name AS ( query_expr ) [, ...] ] +query_expr + +query_expr: +{ select | ( query_expr ) | query_expr set_op query_expr } +[ ORDER BY expression [{ ASC | DESC }] [, ...] ] +[ LIMIT count [ OFFSET skip_rows ] ] + +select: +SELECT [{ ALL | DISTINCT }] +{ [ expression. ]* [ EXCEPT ( column_name [, ...] ) ] +[ REPLACE ( expression [ AS ] column_name [, ...] ) ] +| expression [ [ AS ] alias ] } [, ...] +[ FROM from_item [, ...] ] +[ WHERE bool_expression ] +[ GROUP BY { expression [, ...] | ROLLUP ( expression [, ...] ) } ] +[ HAVING bool_expression ] +[ WINDOW window_name AS ( window_definition ) [, ...] ] + +set_op: +UNION { ALL | DISTINCT } | INTERSECT DISTINCT | EXCEPT DISTINCT + +from_item: { +table_name [ [ AS ] alias ] [ FOR SYSTEM TIME AS OF timestamp_expression ] | +join | +( query_expr ) [ [ AS ] alias ] | +field_path | +{ UNNEST( array_expression ) | UNNEST( array_path ) | array_path } +[ [ AS ] alias ] [ WITH OFFSET [ [ AS ] alias ] ] | +with_query_name [ [ AS ] alias ] +} + +join: +from_item [ join_type ] JOIN from_item +[ { ON bool_expression | USING ( join_column [, ...] ) } ] + +join_type: +{ INNER | CROSS | FULL [OUTER] | LEFT [OUTER] | RIGHT [OUTER] } + +Notation: + +- Square brackets "\[ \]" indicate optional clauses. +- Parentheses "( )" indicate literal parentheses. +- The vertical bar "|" indicates a logical OR. +- Curly braces "{ }" enclose a set of options. +- A comma followed by an ellipsis within square brackets "\[, ... \]" +indicates that the preceding item can repeat in a comma-separated list. + +## SELECT list + +Syntax: + +SELECT [{ ALL | DISTINCT }] +{ [ expression. ]* [ EXCEPT ( column_name [, ...] ) ] +[ REPLACE ( expression [ AS ] column_name [, ...] ) ] +| expression [ [ AS ] alias ] } [, ...] + +The `SELECT` list defines the columns that the query will return. Expressions in +the `SELECT` list can refer to columns in any of the `from_item`s in its +corresponding `FROM` clause. + +Each item in the `SELECT` list is one of: + +- \* +- `expression` +- `expression.*` + +### SELECT \* + +`SELECT *`, often referred to as *select star*, produces one output column for +each column that is visible after executing the full query. + +``` {.codehilite} +SELECT * FROM (SELECT "apple" AS fruit, "carrot" AS vegetable); + ++---+---+ +| fruit | vegetable | ++---+---+ +| apple | carrot| ++---+---+ +``` + +### SELECT `expression` + +Items in a `SELECT` list can be expressions. These expressions evaluate to a +single value and produce one output column, with an optional explicit `alias`. + +If the expression does not have an explicit alias, it receives an implicit alias +according to the rules for [implicit aliases](#implicit_aliases), if possible. +Otherwise, the column is anonymous and you cannot refer to it by name elsewhere +in the query. + +### SELECT `expression.*` {#select-expression_1} + +An item in a `SELECT` list can also take the form of `expression.*`. This +produces one output column for each column or top-level field of `expression`. +The expression must either be a table alias or evaluate to a single value of a +data type with fields, such as a STRUCT. + +The following query produces one output column for each column in the table +`groceries`, aliased as `g`. + +``` {.codehilite} +WITH groceries AS + (SELECT "milk" AS dairy, + "eggs" AS protein, + "bread&quo
[beam-site] 02/03: Update SELECT doc for Beam
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 495dc33304989b45f8493c4e270ab82a5a11f7c9 Author: Andrew Pilloud AuthorDate: Mon Sep 24 15:11:40 2018 -0700 Update SELECT doc for Beam --- src/documentation/dsls/sql/select.md | 1286 ++ 1 file changed, 70 insertions(+), 1216 deletions(-) diff --git a/src/documentation/dsls/sql/select.md b/src/documentation/dsls/sql/select.md index c15003e..f3a135f 100644 --- a/src/documentation/dsls/sql/select.md +++ b/src/documentation/dsls/sql/select.md @@ -33,7 +33,7 @@ batch/streaming model: - [Windowing & Triggering]({{ site.baseurl}}/documentation/dsls/sql/windowing-and-triggering/) Query statements scan one or more tables or expressions and return the computed -result rows. This topic describes the syntax for SQL queries in BigQuery. +result rows. This topic describes the syntax for SQL queries in Beam. ## SQL Syntax @@ -43,7 +43,6 @@ result rows. This topic describes the syntax for SQL queries in BigQuery. query_expr: { select | ( query_expr ) | query_expr set_op query_expr } -[ ORDER BY expression [{ ASC | DESC }] [, ...] ] [ LIMIT count [ OFFSET skip_rows ] ] select: @@ -55,18 +54,14 @@ result rows. This topic describes the syntax for SQL queries in BigQuery. [ WHERE bool_expression ] [ GROUP BY { expression [, ...] | ROLLUP ( expression [, ...] ) } ] [ HAVING bool_expression ] -[ WINDOW window_name AS ( window_definition ) [, ...] ] set_op: UNION { ALL | DISTINCT } | INTERSECT DISTINCT | EXCEPT DISTINCT from_item: { -table_name [ [ AS ] alias ] [ FOR SYSTEM TIME AS OF timestamp_expression ] | +table_name [ [ AS ] alias ] | join | -( query_expr ) [ [ AS ] alias ] | -field_path | -{ UNNEST( array_expression ) | UNNEST( array_path ) | array_path } -[ [ AS ] alias ] [ WITH OFFSET [ [ AS ] alias ] ] | +( query_expr ) [ [ AS ] alias ] with_query_name [ [ AS ] alias ] } @@ -91,8 +86,7 @@ Notation: Syntax: SELECT [{ ALL | DISTINCT }] -{ [ expression. ]* [ EXCEPT ( column_name [, ...] ) ] -[ REPLACE ( expression [ AS ] column_name [, ...] ) ] +{ [ expression. ]* | expression [ [ AS ] alias ] } [, ...] The `SELECT` list defines the columns that the query will return. Expressions in @@ -110,8 +104,8 @@ Each item in the `SELECT` list is one of: `SELECT *`, often referred to as *select star*, produces one output column for each column that is visible after executing the full query. -``` {.codehilite} -SELECT * FROM (SELECT "apple" AS fruit, "carrot" AS vegetable); +``` +SELECT * FROM (SELECT 'apple' AS fruit, 'carrot' AS vegetable); +---+---+ | fruit | vegetable | @@ -126,7 +120,7 @@ Items in a `SELECT` list can be expressions. These expressions evaluate to a single value and produce one output column, with an optional explicit `alias`. If the expression does not have an explicit alias, it receives an implicit alias -according to the rules for [implicit aliases](#implicit_aliases), if possible. +according to the rules for [implicit aliases](#implicit-aliases), if possible. Otherwise, the column is anonymous and you cannot refer to it by name elsewhere in the query. @@ -134,17 +128,16 @@ in the query. An item in a `SELECT` list can also take the form of `expression.*`. This produces one output column for each column or top-level field of `expression`. -The expression must either be a table alias or evaluate to a single value of a -data type with fields, such as a STRUCT. +The expression must be a table alias. The following query produces one output column for each column in the table `groceries`, aliased as `g`. -``` {.codehilite} +``` WITH groceries AS - (SELECT "milk" AS dairy, - "eggs" AS protein, - "bread" AS grain) + (SELECT 'milk' AS dairy, + 'eggs' AS protein, + 'bread' AS grain) SELECT g.* FROM groceries AS g; @@ -155,38 +148,6 @@ FROM groceries AS g; +---+-+---+ ``` -More examples: - -``` {.codehilite} -WITH locations AS - (SELECT STRUCT("Seattle" AS city, "Washington" AS state) AS location - UNION ALL - SELECT STRUCT("Phoenix" AS city, "Arizona" AS state) AS location) -SELECT l.location.* -FROM locations l; - -+-++ -| city| state | -+-++ -| Seattle | Washington | -| Phoenix | Arizona| -+-++ -``` - -``` {.codehilite} -WITH locations AS - (SELECT ARRAY>[("Seattle", "Washington"), -("Phoenix", &q
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit fb27d25e53e157a5297258308f46529d2c8e036e Author: Mergebot AuthorDate: Wed Oct 3 17:29:22 2018 + Prepare repository for deployment. --- content/contribute/dependencies/index.html | 22 +- 1 file changed, 13 insertions(+), 9 deletions(-) diff --git a/content/contribute/dependencies/index.html b/content/contribute/dependencies/index.html index dd97540..5a613d1 100644 --- a/content/contribute/dependencies/index.html +++ b/content/contribute/dependencies/index.html @@ -200,7 +200,7 @@ Identifying outdated dependencies - JIRA Automation + JIRA Issue Automation Upgrading identified outdated dependencies Dependency updates and backwards compatibility @@ -259,17 +259,21 @@ limitations under the License. These kind of urgently required upgrades might not get automatically picked up by the Jenkins job for few months. So Beam community has to act to identify such issues and perform upgrades early. -JIRA Automation +JIRA Issue Automation In order to track the dependency upgrade process, JIRA tickets will be created per significant outdated dependency based on the report. A bot named Beam Jira Bot was created for managing JIRA issues. Beam community agrees on the following policies that creates and updates issues. - Issues will be named as “Beam Dependency Update Request: ". - Issues will be created under the component “dependencies” - Issues will be assigned to the primary owner of the dependencies, who are mentioned in the dependency ownership files. (https://github.com/apache/beam/blob/master/ownership/JAVA_DEPENDENCY_OWNERS.yaml";>Java Dependency Owners and https://github.com/apache/beam/blob/master/ownership/PYTHON_DEPENDENCY_OWNERS.yaml";>Python Dependency Owners) - If more than one owners found for a dependency, the first owner will be picked as the primary owner, the others will be pinged in the issue’s description. - If no owners found, leave the assignee empty. The component lead is responsible for triaging the issue. - Avoid creating duplicate issues. Updating the descriptions of the open issues created by the previous dependency check. - The dependency sometimes is not able to be upgraded, the issue should be closed as “won’t fix”. And, the bot should avoid recreating issues with “won’t fix”. + Title (summary) of the issues will be in the format “Beam Dependency Update Request: " where is the dependency artifact name. + Issues will be created under the component “dependencies”. + Owners of dependencies will be notified by tagging the corresponding JIRA IDs mentioned in the ownership files in the issue description. See https://github.com/apache/beam/blob/master/ownership/JAVA_DEPENDENCY_OWNERS.yaml";>Java Dependency Owners and https://github.com/apache/beam/blob/master/ownership/PYTHON_DEPENDENCY_OWNERS.yaml";>Python Dependency Owners for current owners for Java SDK and Python SDK dependencies respectively. + Automated tool will not create duplicate issues for the same dependency. Instead the tool will look for an existing JIRA when one has to be created for a given dependency and description of the JIRA will be updated with latest information, for example, current version of the dependency. + If a Beam community member determines that a given dependency should not be upgraded the corresponding JIRA issue can be closed with a fix version specified. + Automated tool will reopen a JIRA for a given dependency when one of following conditions is met: + + Next SDK release is for a fix version mentioned in the JIRA. + Six months and three or more minor releases have passed since the JIRA was closed. + + Upgrading identified outdated dependencies
[beam-site] branch asf-site updated (b62563d -> fb27d25)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from b62563d Prepare repository for deployment. add dc6de19 [BEAM-5339] update the beam dependency guide add bcd66cc This closes #554 new fb27d25 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gradle/4.8/fileChanges/last-build.bin | Bin 0 -> 1 bytes .gradle/4.8/fileHashes/fileHashes.bin | Bin 0 -> 18547 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 0 -> 17 bytes .gradle/vcsWorkingDirs/gc.properties | 0 content/contribute/dependencies/index.html | 22 +- src/contribute/dependencies.md | 17 + 6 files changed, 22 insertions(+), 17 deletions(-) create mode 100644 .gradle/4.8/fileChanges/last-build.bin create mode 100644 .gradle/4.8/fileHashes/fileHashes.bin create mode 100644 .gradle/4.8/fileHashes/fileHashes.lock create mode 100644 .gradle/vcsWorkingDirs/gc.properties
[beam-site] 01/02: [BEAM-5339] update the beam dependency guide
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit dc6de1966545f8404388f19be3267f09492dde0e Author: Yifan Zou AuthorDate: Tue Sep 18 14:58:37 2018 -0700 [BEAM-5339] update the beam dependency guide --- .gradle/4.8/fileChanges/last-build.bin | Bin 0 -> 1 bytes .gradle/4.8/fileHashes/fileHashes.bin | Bin 0 -> 18547 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 0 -> 17 bytes .gradle/vcsWorkingDirs/gc.properties | 0 src/contribute/dependencies.md | 17 + 5 files changed, 9 insertions(+), 8 deletions(-) diff --git a/.gradle/4.8/fileChanges/last-build.bin b/.gradle/4.8/fileChanges/last-build.bin new file mode 100644 index 000..f76dd23 Binary files /dev/null and b/.gradle/4.8/fileChanges/last-build.bin differ diff --git a/.gradle/4.8/fileHashes/fileHashes.bin b/.gradle/4.8/fileHashes/fileHashes.bin new file mode 100644 index 000..63c4dc2 Binary files /dev/null and b/.gradle/4.8/fileHashes/fileHashes.bin differ diff --git a/.gradle/4.8/fileHashes/fileHashes.lock b/.gradle/4.8/fileHashes/fileHashes.lock new file mode 100644 index 000..7db49b0 Binary files /dev/null and b/.gradle/4.8/fileHashes/fileHashes.lock differ diff --git a/.gradle/vcsWorkingDirs/gc.properties b/.gradle/vcsWorkingDirs/gc.properties new file mode 100644 index 000..e69de29 diff --git a/src/contribute/dependencies.md b/src/contribute/dependencies.md index 99ec6e6..3626f2e 100644 --- a/src/contribute/dependencies.md +++ b/src/contribute/dependencies.md @@ -52,16 +52,17 @@ In addition to this, Beam community members might identify other critical depend These kind of urgently required upgrades might not get automatically picked up by the Jenkins job for few months. So Beam community has to act to identify such issues and perform upgrades early. -## JIRA Automation +## JIRA Issue Automation In order to track the dependency upgrade process, JIRA tickets will be created per significant outdated dependency based on the report. A bot named *Beam Jira Bot* was created for managing JIRA issues. Beam community agrees on the following policies that creates and updates issues. -* Issues will be named as "Beam Dependency Update Request: ". -* Issues will be created under the component *"dependencies"* -* Issues will be assigned to the primary owner of the dependencies, who are mentioned in the dependency ownership files. ([Java Dependency Owners](https://github.com/apache/beam/blob/master/ownership/JAVA_DEPENDENCY_OWNERS.yaml) and [Python Dependency Owners](https://github.com/apache/beam/blob/master/ownership/PYTHON_DEPENDENCY_OWNERS.yaml)) -* If more than one owners found for a dependency, the first owner will be picked as the primary owner, the others will be pinged in the issue's description. -* If no owners found, leave the assignee empty. The component lead is responsible for triaging the issue. -* Avoid creating duplicate issues. Updating the descriptions of the open issues created by the previous dependency check. -* The dependency sometimes is not able to be upgraded, the issue should be closed as *"won't fix"*. And, the bot should avoid recreating issues with "won't fix". +* Title (summary) of the issues will be in the format "Beam Dependency Update Request: " where is the dependency artifact name. +* Issues will be created under the component *"dependencies"*. +* Owners of dependencies will be notified by tagging the corresponding JIRA IDs mentioned in the ownership files in the issue description. See [Java Dependency Owners](https://github.com/apache/beam/blob/master/ownership/JAVA_DEPENDENCY_OWNERS.yaml) and [Python Dependency Owners](https://github.com/apache/beam/blob/master/ownership/PYTHON_DEPENDENCY_OWNERS.yaml) for current owners for Java SDK and Python SDK dependencies respectively. +* Automated tool will not create duplicate issues for the same dependency. Instead the tool will look for an existing JIRA when one has to be created for a given dependency and description of the JIRA will be updated with latest information, for example, current version of the dependency. +* If a Beam community member determines that a given dependency should not be upgraded the corresponding JIRA issue can be closed with a fix version specified. +* Automated tool will reopen a JIRA for a given dependency when one of following conditions is met: + * Next SDK release is for a fix version mentioned in the JIRA. + * Six months __and__ three or more minor releases have passed since the JIRA was closed. ## Upgrading identified outdated dependencies
[beam-site] branch mergebot updated (d8e162c -> bcd66cc)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from d8e162c This closes #569 add b62563d Prepare repository for deployment. new dc6de19 [BEAM-5339] update the beam dependency guide new bcd66cc This closes #554 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: .gradle/4.8/fileChanges/last-build.bin | Bin 0 -> 1 bytes .gradle/4.8/fileHashes/fileHashes.bin| Bin 0 -> 18547 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 0 -> 17 bytes .gradle/vcsWorkingDirs/gc.properties | 0 content/get-started/downloads/index.html | 6 +++--- src/contribute/dependencies.md | 17 + 6 files changed, 12 insertions(+), 11 deletions(-) create mode 100644 .gradle/4.8/fileChanges/last-build.bin create mode 100644 .gradle/4.8/fileHashes/fileHashes.bin create mode 100644 .gradle/4.8/fileHashes/fileHashes.lock create mode 100644 .gradle/vcsWorkingDirs/gc.properties
[beam-site] 02/02: This closes #554
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit bcd66cc306bd4bb74729ede20bb5d34b54a83934 Merge: b62563d dc6de19 Author: Mergebot AuthorDate: Wed Oct 3 17:26:47 2018 + This closes #554 .gradle/4.8/fileChanges/last-build.bin | Bin 0 -> 1 bytes .gradle/4.8/fileHashes/fileHashes.bin | Bin 0 -> 18547 bytes .gradle/4.8/fileHashes/fileHashes.lock | Bin 0 -> 17 bytes .gradle/vcsWorkingDirs/gc.properties | 0 src/contribute/dependencies.md | 17 + 5 files changed, 9 insertions(+), 8 deletions(-)
[beam-site] branch asf-site updated (ac4f6be -> b62563d)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from ac4f6be This closes #566 add 4b1bd29 [BEAM-5603] fix broken 2.6.0 download links add d8e162c This closes #569 new b62563d Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/get-started/downloads/index.html | 6 +++--- src/get-started/downloads.md | 6 +++--- 2 files changed, 6 insertions(+), 6 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit b62563db8243e26a194868c07a47251fd5c0591a Author: Mergebot AuthorDate: Wed Oct 3 17:26:05 2018 + Prepare repository for deployment. --- content/get-started/downloads/index.html | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/content/get-started/downloads/index.html b/content/get-started/downloads/index.html index 7a1ca7d..ef1648f 100644 --- a/content/get-started/downloads/index.html +++ b/content/get-started/downloads/index.html @@ -276,9 +276,9 @@ versions denoted 0.x.y. Releases 2.6.0 (2018-08-08) -Official https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip";>source code download -https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512";>SHA-512 -https://dist.apache.org/repos/dist/release/beam/2.6.0/apache-beam-2.6.0-source-release.zip.asc";>signature. +Official https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip";>source code download +https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512";>SHA-512 +https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.asc";>signature. https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343392";>Release notes.
[beam-site] 01/01: This closes #569
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit d8e162c16e1c1328365fb9df6f88686e360408e9 Merge: ac4f6be 4b1bd29 Author: Mergebot AuthorDate: Wed Oct 3 17:22:17 2018 + This closes #569 src/get-started/downloads.md | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-)
[beam-site] branch mergebot updated (340090f -> d8e162c)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 340090f This closes #564 add 87fb41e Prepare repository for deployment. add 93a09e4 update create table to create external table add d9b8e36 Regenerate website add d52bf3e This closes #562 add 6d814e9 add whitespace to redirection in create_external_table add b7e59f5 Regenerate website add ac4f6be This closes #566 add 4b1bd29 [BEAM-5603] fix broken 2.6.0 download links new d8e162c This closes #569 The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/index.html | 2 +- .../dsls/sql/aggregate-functions/index.html| 2 +- .../index.html | 30 +- .../documentation/dsls/sql/create-table/index.html | 743 + .../documentation/dsls/sql/data-types/index.html | 2 +- content/documentation/dsls/sql/joins/index.html| 2 +- content/documentation/dsls/sql/lexical/index.html | 2 +- content/documentation/dsls/sql/overview/index.html | 2 +- .../dsls/sql/scalar-functions/index.html | 2 +- content/documentation/dsls/sql/select/index.html | 2 +- content/documentation/dsls/sql/set/index.html | 2 +- content/documentation/dsls/sql/shell/index.html| 10 +- .../dsls/sql/statements/create-table/index.html| 8 +- .../dsls/sql/user-defined-functions/index.html | 2 +- .../documentation/dsls/sql/walkthrough/index.html | 2 +- .../dsls/sql/windowing-and-triggering/index.html | 2 +- content/documentation/programming-guide/index.html | 2 +- .../sdks/feature-comparison/index.html | 2 +- content/documentation/sdks/go/index.html | 2 +- .../documentation/sdks/java-extensions/index.html | 2 +- .../documentation/sdks/java-thirdparty/index.html | 2 +- .../documentation/sdks/java/euphoria/index.html| 2 +- content/documentation/sdks/java/index.html | 2 +- content/documentation/sdks/java/nexmark/index.html | 2 +- .../documentation/sdks/python-custom-io/index.html | 2 +- .../sdks/python-pipeline-dependencies/index.html | 2 +- .../documentation/sdks/python-streaming/index.html | 2 +- .../sdks/python-type-safety/index.html | 2 +- content/documentation/sdks/python/index.html | 2 +- src/_includes/section-menu/sdks.html | 2 +- .../{create-table.md => create-external-table.md} | 32 +- src/documentation/dsls/sql/shell.md| 8 +- src/get-started/downloads.md | 6 +- 33 files changed, 82 insertions(+), 807 deletions(-) copy content/documentation/dsls/sql/{create-table => create-external-table}/index.html (96%) rename src/documentation/dsls/sql/{create-table.md => create-external-table.md} (89%)
[beam-site] branch asf-site updated (0d2d038 -> 87fb41e)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 0d2d038 Prepare repository for deployment. add 3a77aef Fix Java11 Jira link add 340090f This closes #564 new 87fb41e Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/index.html | 2 +- content/documentation/programming-guide/index.html | 2 +- src/contribute/index.md| 2 +- 3 files changed, 3 insertions(+), 3 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 87fb41e690d2196528de6230d54cf103f451c2b6 Author: Mergebot AuthorDate: Wed Sep 26 21:49:08 2018 + Prepare repository for deployment. --- content/contribute/index.html | 2 +- content/documentation/programming-guide/index.html | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-) diff --git a/content/contribute/index.html b/content/contribute/index.html index f4a3af3..099c100 100644 --- a/content/contribute/index.html +++ b/content/contribute/index.html @@ -618,7 +618,7 @@ When submitting a new PR, please tag https://github.com/robbesneyders";> Work to support the next LTS release of Java is in progress. For more details about the scope and info on the various tasks please see the JIRA ticket. - JIRA: https://issues.apache.org/jira/issues/BEAM-2530";>BEAM-2530 + JIRA: https://issues.apache.org/jira/browse/BEAM-2530";>BEAM-2530 Contact: mailto:ieme...@gmail.com";>Ismaël Mejía diff --git a/content/documentation/programming-guide/index.html b/content/documentation/programming-guide/index.html index eb7ccb6..ea57f77 100644 --- a/content/documentation/programming-guide/index.html +++ b/content/documentation/programming-guide/index.html @@ -2902,7 +2902,7 @@ least 10 minutes: from apache_beam import window session_windowed_items = ( -items | 'window' >> beam.WindowInto(window.Sessions(10))) +items | 'window' >> beam.WindowInto(window.Sessions(10 * 60)))
[beam-site] branch mergebot updated (0acf4b0 -> 340090f)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 0acf4b0 This closes #564 new 340090f This closes #564 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (0acf4b0) \ N -- N -- N refs/heads/mergebot (340090f) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes:
[beam-site] 01/01: This closes #564
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 340090f3b5ab28f908dcf4665c386149468abdee Merge: 0d2d038 3a77aef Author: Mergebot AuthorDate: Wed Sep 26 21:46:15 2018 + This closes #564 src/contribute/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam-site] 01/01: This closes #564
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 0acf4b0911c5a35b89578675ea8678462591102f Merge: 0d2d038 3a77aef Author: Mergebot AuthorDate: Wed Sep 26 18:32:15 2018 + This closes #564 src/contribute/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam-site] branch mergebot updated (9969d9d -> 0acf4b0)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. discard 9969d9d This closes #564 new 0acf4b0 This closes #564 This update added new revisions after undoing existing revisions. That is to say, some revisions that were in the old version of the branch are not in the new version. This situation occurs when a user --force pushes a change and generates a repository containing something like this: * -- * -- B -- O -- O -- O (9969d9d) \ N -- N -- N refs/heads/mergebot (0acf4b0) You should already have received notification emails for all of the O revisions, and so the following emails describe only the N revisions from the common base, B. Any revisions marked "omit" are not gone; other references still refer to them. Any revisions marked "discard" are gone forever. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes:
[beam-site] 02/02: This closes #564
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 9969d9dc87a2cce6fa6a30805a33d46e13a04ddc Merge: 0d2d038 3a77aef Author: Mergebot AuthorDate: Wed Sep 26 18:00:59 2018 + This closes #564 src/contribute/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam-site] branch mergebot updated (4c919d1 -> 9969d9d)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 4c919d1 This closes #557 add 0d2d038 Prepare repository for deployment. new 3a77aef Fix Java11 Jira link new 9969d9d This closes #564 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/get-started/quickstart-go/index.html | 3 +++ content/get-started/wordcount-example/index.html | 9 + src/contribute/index.md | 2 +- 3 files changed, 13 insertions(+), 1 deletion(-)
[beam-site] 01/02: Fix Java11 Jira link
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 3a77aef236f2235e33f7422934e9267260499f28 Author: akedin AuthorDate: Wed Sep 26 06:02:51 2018 -0700 Fix Java11 Jira link --- src/contribute/index.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/contribute/index.md b/src/contribute/index.md index 82d629f..9390e65 100644 --- a/src/contribute/index.md +++ b/src/contribute/index.md @@ -338,7 +338,7 @@ When submitting a new PR, please tag [@RobbeSneyders](https://github.com/robbesn Work to support the next LTS release of Java is in progress. For more details about the scope and info on the various tasks please see the JIRA ticket. -- JIRA: [BEAM-2530](https://issues.apache.org/jira/issues/BEAM-2530) +- JIRA: [BEAM-2530](https://issues.apache.org/jira/browse/BEAM-2530) - Contact: [Ismaël Mejía](mailto:ieme...@gmail.com) ### IO Performance Testing
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 0d2d038b60e2eba5378963bf429a058b39018726 Author: Mergebot AuthorDate: Tue Sep 25 18:04:29 2018 + Prepare repository for deployment. --- content/get-started/quickstart-go/index.html | 3 +++ content/get-started/wordcount-example/index.html | 9 + 2 files changed, 12 insertions(+) diff --git a/content/get-started/quickstart-go/index.html b/content/get-started/quickstart-go/index.html index 8a2435a..dbfae68 100644 --- a/content/get-started/quickstart-go/index.html +++ b/content/get-started/quickstart-go/index.html @@ -245,11 +245,14 @@ $ wordcount --input <PATH_TO_INPUT_FILE> --output counts $ go install github.com/apache/beam/sdks/go/examples/wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs://<your-gcs-bucket>/counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs://<your-gcs-bucket>/tmp/ \ +--staging_location gs://<your-gcs-bucket>/binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515 diff --git a/content/get-started/wordcount-example/index.html b/content/get-started/wordcount-example/index.html index 0b8d502..7878541 100644 --- a/content/get-started/wordcount-example/index.html +++ b/content/get-started/wordcount-example/index.html @@ -689,11 +689,14 @@ $ wordcount --input <PATH_TO_INPUT_FILE> --output counts $ go install github.com/apache/beam/sdks/go/examples/wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs://<your-gcs-bucket>/counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs://<your-gcs-bucket>/tmp/ \ +--staging_location gs://<your-gcs-bucket>/binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515 @@ -1009,11 +1012,14 @@ $ debugging_wordcount --input <PATH_TO_INPUT_FILE> --output counts $ go install github.com/apache/beam/sdks/go/examples/debugging_wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ debugging_wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs://<your-gcs-bucket>/counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs://<your-gcs-bucket>/tmp/ \ + --staging_location gs://<your-gcs-bucket>/binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515 @@ -1343,11 +1349,14 @@ $ windowed_wordcount --input <PATH_TO_INPUT_FILE> --output counts $ go install github.com/apache/beam/sdks/go/examples/windowed_wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ windowed_wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs://<your-gcs-bucket>/counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs://<your-gcs-bucket>/tmp/ \ +--staging_location gs://<your-gcs-bucket>/binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515
[beam-site] branch asf-site updated (e5d9fe3 -> 0d2d038)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from e5d9fe3 Prepare repository for deployment. add 42e52af [BEAM-5436] Improve docs for Go SDK add 4c919d1 This closes #557 new 0d2d038 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/get-started/quickstart-go/index.html | 3 +++ content/get-started/wordcount-example/index.html | 9 + src/get-started/quickstart-go.md | 3 +++ src/get-started/wordcount-example.md | 9 + 4 files changed, 24 insertions(+)
[beam-site] branch mergebot updated (e229489 -> 4c919d1)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from e229489 This closes #561 add e5d9fe3 Prepare repository for deployment. new 42e52af [BEAM-5436] Improve docs for Go SDK new 4c919d1 This closes #557 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/release-guide/index.html | 2 +- src/get-started/quickstart-go.md| 3 +++ src/get-started/wordcount-example.md| 9 + 3 files changed, 13 insertions(+), 1 deletion(-)
[beam-site] 02/02: This closes #557
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 4c919d100d6e344cb481838c3f0fc823a537044a Merge: e5d9fe3 42e52af Author: Mergebot AuthorDate: Tue Sep 25 18:01:24 2018 + This closes #557 src/get-started/quickstart-go.md | 3 +++ src/get-started/wordcount-example.md | 9 + 2 files changed, 12 insertions(+)
[beam-site] 01/02: [BEAM-5436] Improve docs for Go SDK
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 42e52afbb1ca675880ba9c3f26c638ee323ea759 Author: vitaliytv AuthorDate: Fri Sep 21 08:29:38 2018 +0300 [BEAM-5436] Improve docs for Go SDK --- src/get-started/quickstart-go.md | 3 +++ src/get-started/wordcount-example.md | 9 + 2 files changed, 12 insertions(+) diff --git a/src/get-started/quickstart-go.md b/src/get-started/quickstart-go.md index 3dcd156..a14965e 100644 --- a/src/get-started/quickstart-go.md +++ b/src/get-started/quickstart-go.md @@ -61,11 +61,14 @@ $ wordcount --input --output counts {:.runner-dataflow} ``` $ go install github.com/apache/beam/sdks/go/examples/wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs:///counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs:///tmp/ \ +--staging_location gs:///binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515 ``` diff --git a/src/get-started/wordcount-example.md b/src/get-started/wordcount-example.md index aad7857..684f5ac 100644 --- a/src/get-started/wordcount-example.md +++ b/src/get-started/wordcount-example.md @@ -464,11 +464,14 @@ This runner is not yet available for the Go SDK. {:.runner-dataflow} ``` $ go install github.com/apache/beam/sdks/go/examples/wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs:///counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs:///tmp/ \ +--staging_location gs:///binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515 ``` @@ -791,11 +794,14 @@ This runner is not yet available for the Go SDK. {:.runner-dataflow} ``` $ go install github.com/apache/beam/sdks/go/examples/debugging_wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ debugging_wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs:///counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs:///tmp/ \ + --staging_location gs:///binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515 ``` @@ -1115,11 +1121,14 @@ This runner is not yet available for the Go SDK. {:.runner-dataflow} ``` $ go install github.com/apache/beam/sdks/go/examples/windowed_wordcount +# As part of the initial setup, for non linux users - install package unix before run +$ go get -u golang.org/x/sys/unix $ windowed_wordcount --input gs://dataflow-samples/shakespeare/kinglear.txt \ --output gs:///counts \ --runner dataflow \ --project your-gcp-project \ --temp_location gs:///tmp/ \ +--staging_location gs:///binaries/ \ --worker_harness_container_image=apache-docker-beam-snapshots-docker.bintray.io/beam/go:20180515 ```
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit e5d9fe360dde8fbfb784f921bfb9c8bd9b7111e7 Author: Mergebot AuthorDate: Tue Sep 25 15:08:51 2018 + Prepare repository for deployment. --- content/contribute/release-guide/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/contribute/release-guide/index.html b/content/contribute/release-guide/index.html index a2cb0ec..2af7e88 100644 --- a/content/contribute/release-guide/index.html +++ b/content/contribute/release-guide/index.html @@ -723,7 +723,7 @@ sed -i -e "s/'beam-master-.*'/'beam-${RELEASE}'/g" runners/google-cloud-dataflow Start a snapshot build -Start a build of https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_NightlySnapshot/";>the nightly snapshot against master branch. +Start a build of https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_Gradle_NightlySnapshot/";>the nightly snapshot against master branch. Some processes, including our archetype tests, rely on having a live SNAPSHOT of the current version from the master branch. Once the release branch is cut, these SNAPSHOT versions are no longer found, so builds will be broken until a new snapshot is available.
[beam-site] branch asf-site updated (7e2601b -> e5d9fe3)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 7e2601b Prepare repository for deployment. add 854f7be [BEAM-5491] Update NightlySnapshot job name add e229489 This closes #561 new e5d9fe3 Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/release-guide/index.html | 2 +- src/contribute/release-guide.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
[beam-site] 02/02: This closes #561
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit e229489cc9358d0a546d7d4017e9eef83e37df29 Merge: 7e2601b 854f7be Author: Mergebot AuthorDate: Tue Sep 25 15:05:32 2018 + This closes #561 src/contribute/release-guide.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam-site] 01/02: [BEAM-5491] Update NightlySnapshot job name
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 854f7be86a3310f286b15156d694b5c74848bbef Author: Andrew Pilloud AuthorDate: Mon Sep 24 16:26:02 2018 -0700 [BEAM-5491] Update NightlySnapshot job name --- src/contribute/release-guide.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/contribute/release-guide.md b/src/contribute/release-guide.md index 2c66080..cddad39 100644 --- a/src/contribute/release-guide.md +++ b/src/contribute/release-guide.md @@ -296,7 +296,7 @@ There are 2 ways to cut a release branch: either running automation script(recom ### Start a snapshot build -Start a build of [the nightly snapshot](https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_NightlySnapshot/) against master branch. +Start a build of [the nightly snapshot](https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_Gradle_NightlySnapshot/) against master branch. Some processes, including our archetype tests, rely on having a live SNAPSHOT of the current version from the `master` branch. Once the release branch is cut, these SNAPSHOT versions are no longer found, so builds will be broken until a new snapshot is available.
[beam-site] branch mergebot updated (ce47430 -> e229489)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from ce47430 This closes #556 add 7e2601b Prepare repository for deployment. new 854f7be [BEAM-5491] Update NightlySnapshot job name new e229489 This closes #561 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/index.html | 2 +- content/documentation/programming-guide/index.html | 1 + src/contribute/release-guide.md| 2 +- 3 files changed, 3 insertions(+), 2 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 7e2601bc6c819f922f34b1f29e573015c03eb3ea Author: Mergebot AuthorDate: Mon Sep 24 22:23:22 2018 + Prepare repository for deployment. --- content/contribute/index.html | 2 +- content/documentation/programming-guide/index.html | 1 + 2 files changed, 2 insertions(+), 1 deletion(-) diff --git a/content/contribute/index.html b/content/contribute/index.html index 1d30ae8..f4a3af3 100644 --- a/content/contribute/index.html +++ b/content/contribute/index.html @@ -300,7 +300,7 @@ to ask to be added as a contributor in the Beam issue tracker. https://github.com/apache/beam";>https://github.com/apache/beam. To contribute, follow the usual GitHub process: fork the repo, make your changes, and open a pull request and @mention a reviewer. If you have more than one commit -in your change, you many be asked to rebase and squash the commits. +in your change, you may be asked to rebase and squash the commits. If you are unfamiliar with this workflow, GitHub maintains these helpful guides: diff --git a/content/documentation/programming-guide/index.html b/content/documentation/programming-guide/index.html index eb8719b..eb7ccb6 100644 --- a/content/documentation/programming-guide/index.html +++ b/content/documentation/programming-guide/index.html @@ -1845,6 +1845,7 @@ determined by the input data, or depend on a different branch of your pipeline.< PCollection<String> wordsBelowCutOff = words.apply(ParDo .of(new DoFn<String, String>() { + @ProcessElement public void processElement(@Element String word, OutputReceiver<String> out, ProcessContext c// In our DoFn, access the side input. int lengthCutOff = c.sideInput(maxWordLengthCutOffView);
[beam-site] branch asf-site updated (6f2163a -> 7e2601b)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 6f2163a Prepare repository for deployment. add 7c397ef Fix a few typos in beam site docs add ce47430 This closes #556 new 7e2601b Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/contribute/index.html | 2 +- content/documentation/programming-guide/index.html | 1 + src/contribute/index.md| 2 +- src/documentation/programming-guide.md | 1 + 4 files changed, 4 insertions(+), 2 deletions(-)
[beam-site] 02/02: This closes #556
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit ce474304fd86061a618314ce8edecbcc5dcc2fb2 Merge: 6f2163a 7c397ef Author: Mergebot AuthorDate: Mon Sep 24 22:20:22 2018 + This closes #556 src/contribute/index.md| 2 +- src/documentation/programming-guide.md | 1 + 2 files changed, 2 insertions(+), 1 deletion(-)
[beam-site] 01/02: Fix a few typos in beam site docs
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 7c397efeca009ae8f93e534cd32e6d5a9a7002bf Author: Ruoyun AuthorDate: Thu Sep 20 15:29:14 2018 -0700 Fix a few typos in beam site docs --- src/contribute/index.md| 2 +- src/documentation/programming-guide.md | 1 + 2 files changed, 2 insertions(+), 1 deletion(-) diff --git a/src/contribute/index.md b/src/contribute/index.md index b607b1c..82d629f 100644 --- a/src/contribute/index.md +++ b/src/contribute/index.md @@ -75,7 +75,7 @@ Coding happens at [https://github.com/apache/beam](https://github.com/apache/beam). To contribute, follow the usual GitHub process: fork the repo, make your changes, and open a pull request and @mention a reviewer. If you have more than one commit -in your change, you many be asked to rebase and squash the commits. +in your change, you may be asked to rebase and squash the commits. If you are unfamiliar with this workflow, GitHub maintains these helpful guides: - [Git Handbook](https://guides.github.com/introduction/git-handbook/) diff --git a/src/documentation/programming-guide.md b/src/documentation/programming-guide.md index 73ae16b..c3ff871 100644 --- a/src/documentation/programming-guide.md +++ b/src/documentation/programming-guide.md @@ -1350,6 +1350,7 @@ determined by the input data, or depend on a different branch of your pipeline. PCollection wordsBelowCutOff = words.apply(ParDo .of(new DoFn() { + @ProcessElement public void processElement(@Element String word, OutputReceiver out, ProcessContext c) { // In our DoFn, access the side input. int lengthCutOff = c.sideInput(maxWordLengthCutOffView);
[beam-site] branch mergebot updated (223e504 -> ce47430)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 223e504 This closes #559 add 6f2163a Prepare repository for deployment. new 7c397ef Fix a few typos in beam site docs new ce47430 This closes #556 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/documentation/programming-guide/index.html | 4 ++-- src/contribute/index.md| 2 +- src/documentation/programming-guide.md | 1 + 3 files changed, 4 insertions(+), 3 deletions(-)
[beam-site] branch asf-site updated (ef7b80d -> 6f2163a)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from ef7b80d Prepare repository for deployment. add cc10ea6 Fix sliding time windows example documentation add 223e504 This closes #559 new 6f2163a Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/documentation/programming-guide/index.html | 4 ++-- src/documentation/programming-guide.md | 4 ++-- 2 files changed, 4 insertions(+), 4 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 6f2163a50e0e08d2bce5fa780d25e785dff02e4a Author: Mergebot AuthorDate: Mon Sep 24 20:56:25 2018 + Prepare repository for deployment. --- content/documentation/programming-guide/index.html | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/content/documentation/programming-guide/index.html b/content/documentation/programming-guide/index.html index 6093382..eb8719b 100644 --- a/content/documentation/programming-guide/index.html +++ b/content/documentation/programming-guide/index.html @@ -2873,12 +2873,12 @@ into fixed windows, each one minute in length: 7.3.2. Sliding time windows The following example code shows how to apply Window to divide a PCollection -into sliding time windows. Each window is 30 minutes in length, and a new window +into sliding time windows. Each window is 30 seconds in length, and a new window begins every five seconds: PCollection<String> items = ...; PCollection<String> slidingWindowedItems = items.apply( -Window.<String>into(SlidingWindows.of(Duration.standardMinutes(30)).everyWindow.<String>into(SlidingWindows.of(Duration.standardSeconds(30)).every from apache_beam import window
[beam-site] 02/02: This closes #559
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 223e50455c804d8528dc85038e30f0d8f396702a Merge: ef7b80d cc10ea6 Author: Mergebot AuthorDate: Mon Sep 24 20:53:36 2018 + This closes #559 src/documentation/programming-guide.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-)
[beam-site] 01/02: Fix sliding time windows example documentation
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit cc10ea67b03501c4a07176744eab7fac03abbd1c Author: deepyaman AuthorDate: Mon Sep 24 16:34:59 2018 -0400 Fix sliding time windows example documentation - Update description text and Java code because Python test snippet with 30-minute windows would be unwieldy --- src/documentation/programming-guide.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/src/documentation/programming-guide.md b/src/documentation/programming-guide.md index bd7c304..73ae16b 100644 --- a/src/documentation/programming-guide.md +++ b/src/documentation/programming-guide.md @@ -2312,13 +2312,13 @@ into fixed windows, each one minute in length: 7.3.2. Sliding time windows {#using-sliding-time-windows} The following example code shows how to apply `Window` to divide a `PCollection` -into sliding time windows. Each window is 30 minutes in length, and a new window +into sliding time windows. Each window is 30 seconds in length, and a new window begins every five seconds: ```java PCollection items = ...; PCollection slidingWindowedItems = items.apply( - Window.into(SlidingWindows.of(Duration.standardMinutes(30)).every(Duration.standardSeconds(5; + Window.into(SlidingWindows.of(Duration.standardSeconds(30)).every(Duration.standardSeconds(5; ``` ```py {% github_sample /apache/beam/blob/master/sdks/python/apache_beam/examples/snippets/snippets_test.py tag:setting_sliding_windows
[beam-site] branch mergebot updated (4cbda00 -> 223e504)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 4cbda00 This closes #558 add ef7b80d Prepare repository for deployment. new cc10ea6 Fix sliding time windows example documentation new 223e504 This closes #559 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/get-started/wordcount-example/index.html | 2 +- src/documentation/programming-guide.md | 4 ++-- 2 files changed, 3 insertions(+), 3 deletions(-)
[beam-site] branch asf-site updated (70bdfaf -> ef7b80d)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 70bdfaf Prepare repository for deployment. add 7f0c8bf typo Python -> Go add 4cbda00 This closes #558 new ef7b80d Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/get-started/wordcount-example/index.html | 2 +- src/get-started/wordcount-example.md | 2 +- 2 files changed, 2 insertions(+), 2 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit ef7b80dff9533acf57dcf5cb0aea889f1b455df7 Author: Mergebot AuthorDate: Mon Sep 24 17:27:41 2018 + Prepare repository for deployment. --- content/get-started/wordcount-example/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/content/get-started/wordcount-example/index.html b/content/get-started/wordcount-example/index.html index 82f3bd0..0b8d502 100644 --- a/content/get-started/wordcount-example/index.html +++ b/content/get-started/wordcount-example/index.html @@ -1319,7 +1319,7 @@ python -m apache_beam.examples.windowed_wordcount --input YOUR_INPUT_FILE \ To view the full code in Python, see https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/windowed_wordcount.py";>windowed_wordcount.py. -To run this example in Python: +To run this example in Go: $ go install github.com/apache/beam/sdks/go/examples/windowed_wordcount $ windowed_wordcount --input <PATH_TO_INPUT_FILE> --output counts
[beam-site] branch mergebot updated (6097f3c -> 4cbda00)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 6097f3c This closes #555 add 70bdfaf Prepare repository for deployment. new 7f0c8bf typo Python -> Go new 4cbda00 This closes #558 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/blog/2018/06/26/beam-2.5.0.html| 16 +- content/blog/2018/08/10/beam-2.6.0.html| 16 +- .../08/20/review-input-streaming-connectors.html | 16 +- content/blog/2018/08/21/beam-summit-europe.html| 16 +- content/blog/index.html| 56 +++ content/community/youtube-channel/index.html | 16 +- content/documentation/dsls/sql/lexical/index.html | 16 +- .../documentation/io/built-in/hcatalog/index.html | 16 +- content/documentation/runners/samza/index.html | 16 +- content/feed.xml | 64 -- src/get-started/wordcount-example.md | 2 +- 11 files changed, 237 insertions(+), 13 deletions(-)
[beam-site] 02/02: This closes #558
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 4cbda003939f3e690aa959b83747556e62a9231a Merge: 70bdfaf 7f0c8bf Author: Mergebot AuthorDate: Mon Sep 24 17:24:26 2018 + This closes #558 src/get-started/wordcount-example.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-)
[beam-site] 01/02: typo Python -> Go
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 7f0c8bf545221b18e63489737c7e15e3279db3d0 Author: Vitalii Tverdokhlib AuthorDate: Fri Sep 21 11:13:24 2018 +0300 typo Python -> Go --- src/get-started/wordcount-example.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/src/get-started/wordcount-example.md b/src/get-started/wordcount-example.md index 82d6af9..aad7857 100644 --- a/src/get-started/wordcount-example.md +++ b/src/get-started/wordcount-example.md @@ -1084,7 +1084,7 @@ This runner is not yet available for the Python SDK. To view the full code in Python, see **[windowed_wordcount.py](https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/windowed_wordcount.py).** -**To run this example in Python:** +**To run this example in Go:** {:.runner-direct} ```
[beam-site] branch asf-site updated (c427295 -> 70bdfaf)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git. from c427295 Prepare repository for deployment. add 7b4d91f [BEAM-4568] Add Apache headers to new source pages. add 6097f3c This closes #555 new 70bdfaf Prepare repository for deployment. The 1 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/blog/2018/06/26/beam-2.5.0.html| 16 +- content/blog/2018/08/10/beam-2.6.0.html| 16 +- .../08/20/review-input-streaming-connectors.html | 16 +- content/blog/2018/08/21/beam-summit-europe.html| 16 +- content/blog/index.html| 56 +++ content/community/youtube-channel/index.html | 16 +- content/documentation/dsls/sql/lexical/index.html | 16 +- .../documentation/io/built-in/hcatalog/index.html | 16 +- content/documentation/runners/samza/index.html | 16 +- content/feed.xml | 64 -- src/_posts/2018-06-26-beam-2.5.0.md| 15 - src/_posts/2018-08-10-beam-2.6.0.md| 13 + ...2018-08-20-review-input-streaming-connectors.md | 13 + src/_posts/2018-08-21-beam-summit-europe.md| 13 + src/community/youtube-channel.md | 13 + src/documentation/dsls/sql/lexical-structure.md| 13 + src/documentation/io/built-in-hcatalog.md | 15 - src/documentation/runners/samza.md | 14 + 18 files changed, 343 insertions(+), 14 deletions(-)
[beam-site] 01/01: Prepare repository for deployment.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 70bdfaf46c74a0feab03946ac512b9c5e4712c8b Author: Mergebot AuthorDate: Thu Sep 20 23:18:36 2018 + Prepare repository for deployment. --- content/blog/2018/06/26/beam-2.5.0.html| 16 +- content/blog/2018/08/10/beam-2.6.0.html| 16 +- .../08/20/review-input-streaming-connectors.html | 16 +- content/blog/2018/08/21/beam-summit-europe.html| 16 +- content/blog/index.html| 56 +++ content/community/youtube-channel/index.html | 16 +- content/documentation/dsls/sql/lexical/index.html | 16 +- .../documentation/io/built-in/hcatalog/index.html | 16 +- content/documentation/runners/samza/index.html | 16 +- content/feed.xml | 64 -- 10 files changed, 236 insertions(+), 12 deletions(-) diff --git a/content/blog/2018/06/26/beam-2.5.0.html b/content/blog/2018/06/26/beam-2.5.0.html index 562cf68..e054124 100644 --- a/content/blog/2018/06/26/beam-2.5.0.html +++ b/content/blog/2018/06/26/beam-2.5.0.html @@ -144,7 +144,21 @@ -We are glad to present the new 2.5.0 release of Beam. This release includes + + +We are glad to present the new 2.5.0 release of Beam. This release includes multiple fixes and new functionalities. For more information please check the detailed release notes. diff --git a/content/blog/2018/08/10/beam-2.6.0.html b/content/blog/2018/08/10/beam-2.6.0.html index dc4b766..9c80b96 100644 --- a/content/blog/2018/08/10/beam-2.6.0.html +++ b/content/blog/2018/08/10/beam-2.6.0.html @@ -144,7 +144,21 @@ -We are glad to present the new 2.6.0 release of Beam. + + +We are glad to present the new 2.6.0 release of Beam. This release includes multiple fixes and new functionality, such as new features in SQL and portability. We also spent a significant amount of time automating the release and fixing continuous integration. For more information, check the https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343392";>release notes. diff --git a/content/blog/2018/08/20/review-input-streaming-connectors.html b/content/blog/2018/08/20/review-input-streaming-connectors.html index 1bdde6d..2e9c8bb 100644 --- a/content/blog/2018/08/20/review-input-streaming-connectors.html +++ b/content/blog/2018/08/20/review-input-streaming-connectors.html @@ -144,7 +144,21 @@ -In this post, you’ll learn about the current state of support for input streaming connectors in Apache Beam. For more context, you’ll also learn about the corresponding state of support in https://spark.apache.org/";>Apache Spark. + + +In this post, you’ll learn about the current state of support for input streaming connectors in Apache Beam. For more context, you’ll also learn about the corresponding state of support in https://spark.apache.org/";>Apache Spark. With batch processing, you might load data from any source, including a database system. Even if there are no specific SDKs available for those database systems, you can often resort to using a https://en.wikipedia.org/wiki/Java_Database_Connectivity";>JDBC driver. With streaming, implementing a proper data pipeline is arguably more challenging as generally fewer source types are available. For that reason, this article particularly focuses on the streaming use case. diff --git a/content/blog/2018/08/21/beam-summit-europe.html b/content/blog/2018/08/21/beam-summit-europe.html index db5f28c..2b59791 100644 --- a/content/blog/2018/08/21/beam-summit-europe.html +++ b/content/blog/2018/08/21/beam-summit-europe.html @@ -144,7 +144,21 @@ -With a growing community of contributors and users, the Apache Beam project is organising the first European Beam Summit. + + +With a growing community of contributors and users, the Apache Beam project is organising the first European Beam Summit. We are happy to invite you to this event, which will take place in London on October 1st and 2nd of 2018. diff --git a/content/blog/index.html b/content/blog/index.html index 23508c8..f3c8774 100644 --- a/content/blog/index.html +++ b/content/blog/index.html @@ -144,6 +144,20 @@ for the project. Matthias Baetens [https://twitter.com/matthiasbaetens";>@matthiasbaetens] + + With a growing community of contributors and users, the Apache Beam project is organising the first European Beam Summit. We are happy to invite you to this event, which will take place in London on October 1st and 2nd of 2018. @@ -163,6 +177,20 @@ Read more < Leonid Kuligin [https://twitter.com/lkulighin";>@lkulighin] & Julien Phalip [https://twitter.com/julienphalip";>@julienpha
[beam-site] 02/02: This closes #555
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 6097f3cf6493725aa6d59621b453aa29098111c3 Merge: c427295 7b4d91f Author: Mergebot AuthorDate: Thu Sep 20 23:15:22 2018 + This closes #555 src/_posts/2018-06-26-beam-2.5.0.md | 15 ++- src/_posts/2018-08-10-beam-2.6.0.md | 13 + .../2018-08-20-review-input-streaming-connectors.md | 13 + src/_posts/2018-08-21-beam-summit-europe.md | 13 + src/community/youtube-channel.md | 13 + src/documentation/dsls/sql/lexical-structure.md | 13 + src/documentation/io/built-in-hcatalog.md | 15 ++- src/documentation/runners/samza.md| 14 ++ 8 files changed, 107 insertions(+), 2 deletions(-)
[beam-site] 01/02: [BEAM-4568] Add Apache headers to new source pages.
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a commit to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git commit 7b4d91f5763654e86353d4c254fafb775e99da13 Author: Scott Wegner AuthorDate: Wed Sep 19 13:32:29 2018 -0700 [BEAM-4568] Add Apache headers to new source pages. This is required for Rat check when importing website content to the apache/beam repository. --- src/_posts/2018-06-26-beam-2.5.0.md | 15 ++- src/_posts/2018-08-10-beam-2.6.0.md | 13 + .../2018-08-20-review-input-streaming-connectors.md | 13 + src/_posts/2018-08-21-beam-summit-europe.md | 13 + src/community/youtube-channel.md | 13 + src/documentation/dsls/sql/lexical-structure.md | 13 + src/documentation/io/built-in-hcatalog.md | 15 ++- src/documentation/runners/samza.md| 14 ++ 8 files changed, 107 insertions(+), 2 deletions(-) diff --git a/src/_posts/2018-06-26-beam-2.5.0.md b/src/_posts/2018-06-26-beam-2.5.0.md index b445d6b..9ee57a5 100644 --- a/src/_posts/2018-06-26-beam-2.5.0.md +++ b/src/_posts/2018-06-26-beam-2.5.0.md @@ -7,6 +7,19 @@ categories: blog authors: - aromanenko --- + We are glad to present the new 2.5.0 release of Beam. This release includes multiple fixes and new functionalities. For more information @@ -82,4 +95,4 @@ Metrics are pushed by the runners to configurable sinks (Http REST sink availabl According to git shortlog, the following 84 people contributed to the 2.5.0 release. Thank you to all contributors! -Ahmet Altay, Alan Myrvold, Alex Amato, Alex Van Boxel, Alexander Dejanovski, Alexey Romanenko, Aljoscha Krettek, ananvay, Andreas Ehrencrona, Andrew Pilloud, Ankur Goenka, Anton Kedin, arkash, Austin Bennett, Axel Magnuson, Ben Chambers, Ben Sidhom, Bill Neubauer, Boyuan Zhang, Braden Bassingthwaite, Cade Markegard, cclauss, Chamikara Jayalath, Charles Chen, Chuan Yu Foo, Cody Schroeder, Colm O hEigeartaigh, Daniel Oliveira, Dariusz Aniszewski, David Cavazos, Dawid Wysakowicz, Eric Rosha [...] \ No newline at end of file +Ahmet Altay, Alan Myrvold, Alex Amato, Alex Van Boxel, Alexander Dejanovski, Alexey Romanenko, Aljoscha Krettek, ananvay, Andreas Ehrencrona, Andrew Pilloud, Ankur Goenka, Anton Kedin, arkash, Austin Bennett, Axel Magnuson, Ben Chambers, Ben Sidhom, Bill Neubauer, Boyuan Zhang, Braden Bassingthwaite, Cade Markegard, cclauss, Chamikara Jayalath, Charles Chen, Chuan Yu Foo, Cody Schroeder, Colm O hEigeartaigh, Daniel Oliveira, Dariusz Aniszewski, David Cavazos, Dawid Wysakowicz, Eric Rosha [...] diff --git a/src/_posts/2018-08-10-beam-2.6.0.md b/src/_posts/2018-08-10-beam-2.6.0.md index 247ff3e..dbc2bcf 100644 --- a/src/_posts/2018-08-10-beam-2.6.0.md +++ b/src/_posts/2018-08-10-beam-2.6.0.md @@ -9,6 +9,19 @@ authors: - rfernand --- + We are glad to present the new 2.6.0 release of Beam. This release includes multiple fixes and new functionality, such as new features in SQL and portability. diff --git a/src/_posts/2018-08-20-review-input-streaming-connectors.md b/src/_posts/2018-08-20-review-input-streaming-connectors.md index 4d6f104..d3a9c9a 100644 --- a/src/_posts/2018-08-20-review-input-streaming-connectors.md +++ b/src/_posts/2018-08-20-review-input-streaming-connectors.md @@ -8,6 +8,19 @@ authors: - lkuligin - jphalip --- + In this post, you'll learn about the current state of support for input streaming connectors in [Apache Beam]({{ site.baseurl }}/). For more context, you'll also learn about the corresponding state of support in [Apache Spark](https://spark.apache.org/). diff --git a/src/_posts/2018-08-21-beam-summit-europe.md b/src/_posts/2018-08-21-beam-summit-europe.md index 8287b08..c867c8c 100644 --- a/src/_posts/2018-08-21-beam-summit-europe.md +++ b/src/_posts/2018-08-21-beam-summit-europe.md @@ -7,6 +7,19 @@ categories: blog authors: - mbaetens --- + With a growing community of contributors and users, the Apache Beam project is organising the first European Beam Summit. diff --git a/src/community/youtube-channel.md b/src/community/youtube-channel.md index 4d09a1d..23100b5 100644 --- a/src/community/youtube-channel.md +++ b/src/community/youtube-channel.md @@ -4,6 +4,19 @@ title: 'Beam YouTube channel' section_menu: section-menu/community.html permalink: /community/youtube-channel/ --- + # Beam YouTube channel ## What is it and what are the goals? diff --git a/src/documentation/dsls/sql/lexical-structure.md b/src/documentation/dsls/sql/lexical-structure.md index 8f3cd01..423871c 100644 --- a/src/documentation/dsls/sql/lexical-structure.md +++ b/src/documentation/dsls/sql/lexical-structure.md @@ -4,6 +4,19 @@ title: "Beam SQL: Lexical
[beam-site] branch mergebot updated (9ed4300 -> 6097f3c)
This is an automated email from the ASF dual-hosted git repository. mergebot-role pushed a change to branch mergebot in repository https://gitbox.apache.org/repos/asf/beam-site.git. from 9ed4300 This closes #553 add c427295 Prepare repository for deployment. new 7b4d91f [BEAM-4568] Add Apache headers to new source pages. new 6097f3c This closes #555 The 2 revisions listed above as "new" are entirely new to this repository and will be described in separate emails. The revisions listed as "add" were already present in the repository and have only been added to this reference. Summary of changes: content/documentation/runners/flink/index.html | 50 -- src/_posts/2018-06-26-beam-2.5.0.md| 15 ++- src/_posts/2018-08-10-beam-2.6.0.md| 13 ++ ...2018-08-20-review-input-streaming-connectors.md | 13 ++ src/_posts/2018-08-21-beam-summit-europe.md| 13 ++ src/community/youtube-channel.md | 13 ++ src/documentation/dsls/sql/lexical-structure.md| 13 ++ src/documentation/io/built-in-hcatalog.md | 15 ++- src/documentation/runners/samza.md | 14 ++ 9 files changed, 145 insertions(+), 14 deletions(-)