[beam] branch asf-site updated: Publishing website 2018/10/09 18:28:48 at commit ac21fff
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 9f8bb5e Publishing website 2018/10/09 18:28:48 at commit ac21fff 9f8bb5e is described below commit 9f8bb5eabdc6b5b369c6e580970fc6f8e629e3bd Author: jenkins AuthorDate: Tue Oct 9 18:28:48 2018 + Publishing website 2018/10/09 18:28:48 at commit ac21fff
[beam] branch asf-site updated: Publishing website 2018/10/09 18:37:33 at commit f58f6e6
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 1df1402 Publishing website 2018/10/09 18:37:33 at commit f58f6e6 1df1402 is described below commit 1df1402b6b84b095fe0d44d7bfa405f1fcafd276 Author: jenkins AuthorDate: Tue Oct 9 18:37:34 2018 + Publishing website 2018/10/09 18:37:33 at commit f58f6e6
[beam] branch asf-site updated: Publishing website 2018/10/09 18:38:19 at commit 6578254
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 3ba8c4a Publishing website 2018/10/09 18:38:19 at commit 6578254 3ba8c4a is described below commit 3ba8c4afaafdc714f094424078947ef5e653a063 Author: jenkins AuthorDate: Tue Oct 9 18:38:19 2018 + Publishing website 2018/10/09 18:38:19 at commit 6578254
[beam] branch asf-site updated: Publishing website 2018/10/09 18:41:21 at commit ddbca9d
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new c3ecd83 Publishing website 2018/10/09 18:41:21 at commit ddbca9d c3ecd83 is described below commit c3ecd8353e88f8ab25687991b8e6906989d44150 Author: jenkins AuthorDate: Tue Oct 9 18:41:22 2018 + Publishing website 2018/10/09 18:41:21 at commit ddbca9d --- website/generated-content/contribute/index.html | 3 +++ 1 file changed, 3 insertions(+) diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html index 6259dea..54e6b99 100644 --- a/website/generated-content/contribute/index.html +++ b/website/generated-content/contribute/index.html @@ -290,6 +290,9 @@ you want to be assigned issues, a PMC member can add you to the project contribu group. Email the dev@ mailing list to ask to be added as a contributor in the Beam issue tracker. +Anyone can browse the https://cwiki.apache.org/confluence/display/BEAM/Apache+Beam";>Beam Wiki Space. +If you wish to contribute changes, please request edit access on the dev@ mailing list. + Contributing code Discussons about contributing code to beam happens on the dev@ mailing list. Introduce yourself!
[beam] branch asf-site updated: Publishing website 2018/10/09 19:54:38 at commit 36da831
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 66cf000 Publishing website 2018/10/09 19:54:38 at commit 36da831 66cf000 is described below commit 66cf000305deb50fefa94624469b853c47344e6c Author: jenkins AuthorDate: Tue Oct 9 19:54:39 2018 + Publishing website 2018/10/09 19:54:38 at commit 36da831
[beam] branch asf-site updated: Publishing website 2018/10/09 19:55:23 at commit 092d496
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new b2579c5 Publishing website 2018/10/09 19:55:23 at commit 092d496 b2579c5 is described below commit b2579c5c9ab5423511f6712f74bcd2062b3ee7d7 Author: jenkins AuthorDate: Tue Oct 9 19:55:23 2018 + Publishing website 2018/10/09 19:55:23 at commit 092d496
[beam] branch asf-site updated: Publishing website 2018/10/09 19:58:54 at commit 0e8f28a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new fe92be1 Publishing website 2018/10/09 19:58:54 at commit 0e8f28a fe92be1 is described below commit fe92be163ca006ebd8929676a0cd7b1e05c130b9 Author: jenkins AuthorDate: Tue Oct 9 19:58:55 2018 + Publishing website 2018/10/09 19:58:54 at commit 0e8f28a
[beam] branch asf-site updated: Publishing website 2018/10/09 20:09:55 at commit 4afd5ec
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new e6f6495 Publishing website 2018/10/09 20:09:55 at commit 4afd5ec e6f6495 is described below commit e6f649553431f757fbbda9d2316e82f0187a8ac0 Author: jenkins AuthorDate: Tue Oct 9 20:09:56 2018 + Publishing website 2018/10/09 20:09:55 at commit 4afd5ec
[beam] branch asf-site updated: Publishing website 2018/10/09 21:28:46 at commit 4e132f3
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new ca713d0 Publishing website 2018/10/09 21:28:46 at commit 4e132f3 ca713d0 is described below commit ca713d03a62c142968bb74cb189e19acfb945522 Author: jenkins AuthorDate: Tue Oct 9 21:28:47 2018 + Publishing website 2018/10/09 21:28:46 at commit 4e132f3
[beam] branch asf-site updated: Publishing website 2018/10/09 22:47:33 at commit c356c57
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 910e066 Publishing website 2018/10/09 22:47:33 at commit c356c57 910e066 is described below commit 910e066920dc4f51a3984e6e7b9f7e500fb59d98 Author: jenkins AuthorDate: Tue Oct 9 22:47:33 2018 + Publishing website 2018/10/09 22:47:33 at commit c356c57
[beam] branch asf-site updated: Publishing website 2018/10/09 22:59:23 at commit 1fce865
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 5fb2c22 Publishing website 2018/10/09 22:59:23 at commit 1fce865 5fb2c22 is described below commit 5fb2c221f089c0956b8614cfa1c4152db5908c0b Author: jenkins AuthorDate: Tue Oct 9 22:59:24 2018 + Publishing website 2018/10/09 22:59:23 at commit 1fce865
[beam] branch asf-site updated: Publishing website 2018/10/09 23:34:17 at commit 399c09f
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new c7a5019 Publishing website 2018/10/09 23:34:17 at commit 399c09f c7a5019 is described below commit c7a50194ed615923f78eb80c1bca4df83c1ac4ab Author: jenkins AuthorDate: Tue Oct 9 23:34:17 2018 + Publishing website 2018/10/09 23:34:17 at commit 399c09f
[beam] branch asf-site updated: Publishing website 2018/10/10 00:21:04 at commit b9af715
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 7919a9c Publishing website 2018/10/10 00:21:04 at commit b9af715 7919a9c is described below commit 7919a9cf52e790f9d6f7765c3422575954d0f310 Author: jenkins AuthorDate: Wed Oct 10 00:21:05 2018 + Publishing website 2018/10/10 00:21:04 at commit b9af715
[beam] branch asf-site updated: Publishing website 2018/10/10 00:47:15 at commit 82c1e6e
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 863bdbe Publishing website 2018/10/10 00:47:15 at commit 82c1e6e 863bdbe is described below commit 863bdbe4bd1f7f40a331519aff8fa48a4b2c3e40 Author: jenkins AuthorDate: Wed Oct 10 00:47:16 2018 + Publishing website 2018/10/10 00:47:15 at commit 82c1e6e
[beam] branch asf-site updated: Publishing website 2018/10/10 00:57:24 at commit ae3d9ca
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 906a922 Publishing website 2018/10/10 00:57:24 at commit ae3d9ca 906a922 is described below commit 906a9225c03238fbaee1b344617ee88b01c61ac9 Author: jenkins AuthorDate: Wed Oct 10 00:57:24 2018 + Publishing website 2018/10/10 00:57:24 at commit ae3d9ca
[beam] branch asf-site updated: Publishing website 2018/10/10 02:57:47 at commit d32364c
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 63c9eec Publishing website 2018/10/10 02:57:47 at commit d32364c 63c9eec is described below commit 63c9eec5bdc70b5b4fe5fa568969a19d89a0fc7b Author: jenkins AuthorDate: Wed Oct 10 02:57:47 2018 + Publishing website 2018/10/10 02:57:47 at commit d32364c
[beam] branch asf-site updated: Publishing website 2018/10/10 05:35:38 at commit 88c6845
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 7cd37ac Publishing website 2018/10/10 05:35:38 at commit 88c6845 7cd37ac is described below commit 7cd37ace8253e192a537db158a777e6fcbec5772 Author: jenkins AuthorDate: Wed Oct 10 05:35:39 2018 + Publishing website 2018/10/10 05:35:38 at commit 88c6845
[beam] branch asf-site updated: Publishing website 2018/10/10 06:00:35 at commit 88c6845
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 028ef3f Publishing website 2018/10/10 06:00:35 at commit 88c6845 028ef3f is described below commit 028ef3f057b1d7d5e09fd53a6f2f3fe114b56c01 Author: jenkins AuthorDate: Wed Oct 10 06:00:35 2018 + Publishing website 2018/10/10 06:00:35 at commit 88c6845
[beam] branch asf-site updated: Publishing website 2018/10/10 09:06:16 at commit a432a4f
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 234dce3 Publishing website 2018/10/10 09:06:16 at commit a432a4f 234dce3 is described below commit 234dce34a4242003b06bd52a1f9cd1d04d65edac Author: jenkins AuthorDate: Wed Oct 10 09:06:16 2018 + Publishing website 2018/10/10 09:06:16 at commit a432a4f
[beam] branch asf-site updated: Publishing website 2018/10/10 11:48:41 at commit b436c31
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new c831636 Publishing website 2018/10/10 11:48:41 at commit b436c31 c831636 is described below commit c83163604c446fb3217b48711b682d1c9b68b97e Author: jenkins AuthorDate: Wed Oct 10 11:48:41 2018 + Publishing website 2018/10/10 11:48:41 at commit b436c31
[beam] branch asf-site updated: Publishing website 2018/10/10 11:52:16 at commit 1dca49f
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new e69de04 Publishing website 2018/10/10 11:52:16 at commit 1dca49f e69de04 is described below commit e69de04f20df5b501753ad75c94a8ab0f2ee4652 Author: jenkins AuthorDate: Wed Oct 10 11:52:16 2018 + Publishing website 2018/10/10 11:52:16 at commit 1dca49f
[beam] branch asf-site updated: Publishing website 2018/10/10 12:00:35 at commit 1dca49f
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new f3a9383 Publishing website 2018/10/10 12:00:35 at commit 1dca49f f3a9383 is described below commit f3a9383412c323b8db5eb1cf7ca8733449492480 Author: jenkins AuthorDate: Wed Oct 10 12:00:36 2018 + Publishing website 2018/10/10 12:00:35 at commit 1dca49f
[beam] branch asf-site updated: Publishing website 2018/10/10 13:55:38 at commit 3f803f1
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 082eb2c Publishing website 2018/10/10 13:55:38 at commit 3f803f1 082eb2c is described below commit 082eb2c8781b5d27a37b9d95fc95fe65145cd33b Author: jenkins AuthorDate: Wed Oct 10 13:55:38 2018 + Publishing website 2018/10/10 13:55:38 at commit 3f803f1
[beam] branch asf-site updated: Publishing website 2018/10/10 14:55:43 at commit 18d2168
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 56405d9 Publishing website 2018/10/10 14:55:43 at commit 18d2168 56405d9 is described below commit 56405d99e7d7a1bb0f940252a11d78c994e6cddc Author: jenkins AuthorDate: Wed Oct 10 14:55:43 2018 + Publishing website 2018/10/10 14:55:43 at commit 18d2168
[beam] branch asf-site updated: Publishing website 2018/10/10 15:56:48 at commit d96d596
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new c0a5528 Publishing website 2018/10/10 15:56:48 at commit d96d596 c0a5528 is described below commit c0a5528122363761d49583f0e2b237efdf2521d1 Author: jenkins AuthorDate: Wed Oct 10 15:56:49 2018 + Publishing website 2018/10/10 15:56:48 at commit d96d596
[beam] branch asf-site updated: Publishing website 2018/10/10 16:09:01 at commit afa062a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new deaab34 Publishing website 2018/10/10 16:09:01 at commit afa062a deaab34 is described below commit deaab34c44114cf0709105d62508eb6da25117bf Author: jenkins AuthorDate: Wed Oct 10 16:09:02 2018 + Publishing website 2018/10/10 16:09:01 at commit afa062a
[beam] branch asf-site updated: Publishing website 2018/10/10 16:41:21 at commit 61223f4
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 30df68b Publishing website 2018/10/10 16:41:21 at commit 61223f4 30df68b is described below commit 30df68ba8507bbeb9d978404a19943359992e104 Author: jenkins AuthorDate: Wed Oct 10 16:41:21 2018 + Publishing website 2018/10/10 16:41:21 at commit 61223f4
[beam] branch asf-site updated: Publishing website 2018/10/10 18:00:37 at commit 61223f4
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new d06f3c3 Publishing website 2018/10/10 18:00:37 at commit 61223f4 d06f3c3 is described below commit d06f3c330115233ee446af1fbe2144853272697a Author: jenkins AuthorDate: Wed Oct 10 18:00:38 2018 + Publishing website 2018/10/10 18:00:37 at commit 61223f4
[beam] branch asf-site updated: Publishing website 2018/10/10 18:22:25 at commit dc96860
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 433cbee Publishing website 2018/10/10 18:22:25 at commit dc96860 433cbee is described below commit 433cbeec056bf10afa6fde4fcf12b8c574bd8299 Author: jenkins AuthorDate: Wed Oct 10 18:22:25 2018 + Publishing website 2018/10/10 18:22:25 at commit dc96860
[beam] branch asf-site updated: Publishing website 2018/10/10 19:32:08 at commit 31a3e3e
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new e6863c3 Publishing website 2018/10/10 19:32:08 at commit 31a3e3e e6863c3 is described below commit e6863c39656007ac96446dc8216a2fa328672828 Author: jenkins AuthorDate: Wed Oct 10 19:32:09 2018 + Publishing website 2018/10/10 19:32:08 at commit 31a3e3e
[beam] branch asf-site updated: Publishing website 2018/10/10 19:58:02 at commit 9be4fb9
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new e7bf9d0 Publishing website 2018/10/10 19:58:02 at commit 9be4fb9 e7bf9d0 is described below commit e7bf9d0b5f6545e9660f258121cbd6cf1d6e3d76 Author: jenkins AuthorDate: Wed Oct 10 19:58:03 2018 + Publishing website 2018/10/10 19:58:02 at commit 9be4fb9 --- website/generated-content/get-started/wordcount-example/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/get-started/wordcount-example/index.html b/website/generated-content/get-started/wordcount-example/index.html index 1e4dbac..bde4edc 100644 --- a/website/generated-content/get-started/wordcount-example/index.html +++ b/website/generated-content/get-started/wordcount-example/index.html @@ -335,7 +335,7 @@ show other best practices. https://github.com/apache/beam/blob/master/sdks/python/apache_beam/examples/wordcount_minimal.py";>wordcount_minimal.py. To view the full code in Go, see -https://github.com/apache/beam/blob/master/sdks/go/examples/minimal_wordcount/minimal_wordcount.go";>wordcount_minimal.go. +https://github.com/apache/beam/blob/master/sdks/go/examples/minimal_wordcount/minimal_wordcount.go";>minimal_wordcount.go. Key Concepts:
[beam] branch asf-site updated: Publishing website 2018/10/10 20:11:44 at commit 685e79d
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 81b34c2 Publishing website 2018/10/10 20:11:44 at commit 685e79d 81b34c2 is described below commit 81b34c2652cc6da73de3b18f685aa72baeaac6a4 Author: jenkins AuthorDate: Wed Oct 10 20:11:45 2018 + Publishing website 2018/10/10 20:11:44 at commit 685e79d
[beam] branch asf-site updated: Publishing website 2018/10/10 22:56:15 at commit 738f796
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 5eb0960 Publishing website 2018/10/10 22:56:15 at commit 738f796 5eb0960 is described below commit 5eb09607e52b621a3bed6a868a324465781d3e56 Author: jenkins AuthorDate: Wed Oct 10 22:56:16 2018 + Publishing website 2018/10/10 22:56:15 at commit 738f796
[beam] branch asf-site updated: Publishing website 2018/10/10 23:28:05 at commit 223372c
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 22801b7 Publishing website 2018/10/10 23:28:05 at commit 223372c 22801b7 is described below commit 22801b7549f9f13c1b7bb571724c6dae27f89b55 Author: jenkins AuthorDate: Wed Oct 10 23:28:06 2018 + Publishing website 2018/10/10 23:28:05 at commit 223372c
[beam] branch asf-site updated: Publishing website 2018/10/11 00:00:38 at commit 223372c
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new b57ef3e Publishing website 2018/10/11 00:00:38 at commit 223372c b57ef3e is described below commit b57ef3e0cb46d8029efe7f04a7f2fa5d9fcdaa06 Author: jenkins AuthorDate: Thu Oct 11 00:00:39 2018 + Publishing website 2018/10/11 00:00:38 at commit 223372c
[beam] branch asf-site updated: Publishing website 2018/10/11 01:03:11 at commit 4e0c9a1
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 8feb4da Publishing website 2018/10/11 01:03:11 at commit 4e0c9a1 8feb4da is described below commit 8feb4da08e13eea040ffc5cd3721f5a78c1ccfb2 Author: jenkins AuthorDate: Thu Oct 11 01:03:12 2018 + Publishing website 2018/10/11 01:03:11 at commit 4e0c9a1
[beam] branch asf-site updated: Publishing website 2018/10/11 17:43:36 at commit 6c53f30
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 6eda004 Publishing website 2018/10/11 17:43:36 at commit 6c53f30 6eda004 is described below commit 6eda004cd993dd16de76ba1148de3da885e54476 Author: jenkins AuthorDate: Thu Oct 11 17:43:37 2018 + Publishing website 2018/10/11 17:43:36 at commit 6c53f30 --- .../get-started/downloads/index.html | 55 +- 1 file changed, 42 insertions(+), 13 deletions(-) diff --git a/website/generated-content/get-started/downloads/index.html b/website/generated-content/get-started/downloads/index.html index e1a5be7..e99b3d9 100644 --- a/website/generated-content/get-started/downloads/index.html +++ b/website/generated-content/get-started/downloads/index.html @@ -178,7 +178,11 @@ Using a central repository - Downloading source code + Downloading source code + + Release integrity + + API stability Releases @@ -257,6 +261,17 @@ at scale. You can download the source code package for a release from the links in the Releases section. +Release integrity + +You must (verify)[https://www.apache.org/info/verification.html] the integrity +of downloaded files. We provide OpenPGP signatures for every release file. This +signature should be matched against the +(KEYS)[https://www.apache.org/dist/beam/KEYS] file which contains the OpenPGP +keys of Apache Beam’s Release Managers. We also provide SHA-512 checksums for +every release file (or SHA-1 and MD5 checksums for older releases). After you +download the file, you should calculate a checksum for your download, and make +sure it is the same as ours. + API stability Apache Beam uses http://semver.org/";>semantic versioning. Version numbers use @@ -277,48 +292,62 @@ versions denoted 0.x.y. Releases 2.7.0 (2018-10-02) -Official https://dist.apache.org/repos/dist/release/beam/2.7.0/apache-beam-2.7.0-source-release.zip";>source code download -https://dist.apache.org/repos/dist/release/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512";>SHA-512 -https://dist.apache.org/repos/dist/release/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc";>signature. +Official https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip";>source code download. +https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512";>SHA-512. +https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc";>signature. https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654";>Release notes. 2.6.0 (2018-08-08) -Official https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip";>source code download -https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512";>SHA-512 +Official https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip";>source code download. +https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512";>SHA-512. https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.asc";>signature. https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343392";>Release notes. 2.5.0 (2018-06-06) -Official https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip";>source code download -https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip.sha512";>SHA-512 +Official https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip";>source code download. +https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip.sha512";>SHA-512. https://archive.apache.org/dist/beam/2.5.0/apache-beam-2.5.0-source-release.zip.asc";>signature. https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12342847";>Release notes. 2.4.0 (2018-03-20) -Official https://archive.apache.org/dist/beam/2.4.0/apache-beam-2.4.0-source-release.zip";>source code download +Official https://archive.apache.org/dist/beam/2.4.0/apache-beam-2.4.0-source-release.zip";>source code download. +https://archive.apache.org/dist/beam/2.4.0/apache-beam-2.4.0-source-release.zip.sha512";>SHA-512. +https://archive.apache.org/dist/beam/2.4.0/apache-beam-2.4.0-source-release.zip.asc";>signature. https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12342682";>Release notes. 2.3.0 (2018-01-30) -Official https://archive.apache.org/dist/beam/2.3.0/apache-beam-2.3.0-source-release.zip";>source
[beam] branch asf-site updated: Publishing website 2018/10/11 21:48:26 at commit 97adb68
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 37f1005 Publishing website 2018/10/11 21:48:26 at commit 97adb68 37f1005 is described below commit 37f100519d090c4281e43b6548ebc70d1c5d3aae Author: jenkins AuthorDate: Thu Oct 11 21:48:26 2018 + Publishing website 2018/10/11 21:48:26 at commit 97adb68 --- website/generated-content/.htaccess | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/.htaccess b/website/generated-content/.htaccess index 82e9c99..2462791 100644 --- a/website/generated-content/.htaccess +++ b/website/generated-content/.htaccess @@ -21,4 +21,4 @@ RewriteRule ^(.*)$ https://beam.apache.org/$1 [L,R=301] # The following redirect maintains the previously supported URLs. RedirectMatch permanent "/documentation/sdks/(javadoc|pydoc)(.*)" "https://beam.apache.org/releases/$1$2"; # Keep this updated to point to the current release. -RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.6.0$2"; +RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.7.0$2";
[beam] branch asf-site updated: Publishing website 2018/10/15 17:05:13 at commit cc1c3f2
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new c4992cd Publishing website 2018/10/15 17:05:13 at commit cc1c3f2 c4992cd is described below commit c4992cd1eade2450bc2308568da295ee5ffd4635 Author: jenkins AuthorDate: Mon Oct 15 17:05:14 2018 + Publishing website 2018/10/15 17:05:13 at commit cc1c3f2 --- website/generated-content/contribute/become-a-committer/index.html | 6 ++ website/generated-content/contribute/index.html| 3 ++- 2 files changed, 4 insertions(+), 5 deletions(-) diff --git a/website/generated-content/contribute/become-a-committer/index.html b/website/generated-content/contribute/become-a-committer/index.html index 20ebfac..e900de5 100644 --- a/website/generated-content/contribute/become-a-committer/index.html +++ b/website/generated-content/contribute/become-a-committer/index.html @@ -246,11 +246,9 @@ some examples: https://lists.apache.org/list.html?d...@beam.apache.org";>dev@ archives and https://lists.apache.org/trends.html?d...@beam.apache.org";>statistics https://lists.apache.org/list.html?u...@beam.apache.org";>user@ archives and https://lists.apache.org/trends.html?u...@beam.apache.org";>statistics https://stackoverflow.com/questions/tagged/apache-beam";>apache-beam StackOverflow tag - Git metrics for https://github.com/apache/beam/graphs/contributors";>Beam -and the https://github.com/apache/beam-site/graphs/contributors";>Beam site + Git metrics for https://github.com/apache/beam/graphs/contributors";>Beam Code reviews given and received on -https://github.com/apache/beam/pulls";>Beam and the https://github.com/apache/beam-site/pulls";>Beam -site +https://github.com/apache/beam/pulls";>Beam Clear areas of ownership (a runner, a DSL, IO connector, documentation, etc.) Public events diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html index 54e6b99..06c353e 100644 --- a/website/generated-content/contribute/index.html +++ b/website/generated-content/contribute/index.html @@ -318,7 +318,8 @@ If you are unfamiliar with this workflow, GitHub maintains these helpful guides: (https://s.apache.org/beam-design-doc-template";>template, https://s.apache.org/beam-design-docs";>examples)). -Documentation happens at https://github.com/apache/beam-site";>https://github.com/apache/beam-site +Documentation happens at +https://github.com/apache/beam/tree/master/website";>https://github.com/apache/beam/tree/master/website and contributions are welcome. Large contributions require a signed https://www.apache.org/licenses/icla.pdf";>Individual Contributor License
[beam] branch asf-site updated: Publishing website 2018/10/15 17:38:25 at commit 053bc86
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new a489b42 Publishing website 2018/10/15 17:38:25 at commit 053bc86 a489b42 is described below commit a489b4245d2e83c9ff915e42152fe35fca462c8f Author: jenkins AuthorDate: Mon Oct 15 17:38:26 2018 + Publishing website 2018/10/15 17:38:25 at commit 053bc86 --- website/generated-content/community/contact-us/index.html | 2 +- website/generated-content/contribute/release-guide/index.html | 3 +++ 2 files changed, 4 insertions(+), 1 deletion(-) diff --git a/website/generated-content/community/contact-us/index.html b/website/generated-content/community/contact-us/index.html index 21b26b0..af3b843 100644 --- a/website/generated-content/community/contact-us/index.html +++ b/website/generated-content/community/contact-us/index.html @@ -226,7 +226,7 @@ whichever one seems best! https://s.apache.org/beam-slack-channel";>Slack - Chat with users and developers (https://s.apache.org/slack-invite";>Join) + Chat with users and developers on channel #beam (https://s.apache.org/slack-invite";>Join) diff --git a/website/generated-content/contribute/release-guide/index.html b/website/generated-content/contribute/release-guide/index.html index d291075..f64b3de 100644 --- a/website/generated-content/contribute/release-guide/index.html +++ b/website/generated-content/contribute/release-guide/index.html @@ -1146,6 +1146,9 @@ to point to the new release. See file history for examples. Please follow the https://github.com/apache/beam-wheels#user-guide";>user guide to build python wheels. +Once all python wheels have been staged https://dist.apache.org/repos/dist/dev/beam/";>dist.apache.org, +please run ./sign_hash_python_wheels.sh to sign and hash python wheels. + Checklist to proceed to the next step
[beam] branch asf-site updated: Publishing website 2018/10/16 15:59:06 at commit 3553620
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 39088c8 Publishing website 2018/10/16 15:59:06 at commit 3553620
39088c8 is described below
commit 39088c8854fbfcc1c3bb16e87addf8f5aded3d28
Author: jenkins
AuthorDate: Tue Oct 16 15:59:07 2018 +
Publishing website 2018/10/16 15:59:06 at commit 3553620
---
.../documentation/sdks/java/euphoria/index.html| 620 +++--
1 file changed, 578 insertions(+), 42 deletions(-)
diff --git
a/website/generated-content/documentation/sdks/java/euphoria/index.html
b/website/generated-content/documentation/sdks/java/euphoria/index.html
index 493f44a..679536e6 100644
--- a/website/generated-content/documentation/sdks/java/euphoria/index.html
+++ b/website/generated-content/documentation/sdks/java/euphoria/index.html
@@ -224,8 +224,43 @@
What is Euphoria
- How to build
- WordCount example
+ WordCount Example
+ Euphoria Guide
+
+ Datasets
+ Inputs and Outputs
+ Adding Operators
+ Coders and Types
+ Metrics and Accumulators
+ Windowing
+ Integration of Euphoria
into existing pipelines
+
+
+ How to get Euphoria
+ Operator Reference
+
+ CountByKey
+ Distinct
+ Join
+ LeftJoin
+ RightJoin
+ FullJoin
+ MapElements
+ FlatMap
+ Filter
+ ReduceByKey
+ ReduceWindow
+ SumByKey
+ Union
+ TopPerKey
+ AssignEventTime
+
+
+ Euphoria
To Beam Translation (advanced user section)
+
+ Unsupported Features
+
+
@@ -246,73 +281,574 @@ See the License for the specific language governing
permissions and
limitations under the License.
-->
Euphoria Java 8 DSL
+
-Euphoria is located in dsl-euphoria
branch. To build euphoria subprojects
use command:
+What is Euphoria
+Easy to use Java 8 API build on top of the Beam’s Java SDK. API provides a
high-level abstraction of data
transformations, with focus on the Java 8 language features (e.g. lambdas and
streams). It is fully inter-operable with existing Beam SDK and convertible
back and forth. It allows fast prototyping through use of (optional) https://github.com/EsotericSoftware/kryo";>Kryo based coders, lambdas
and high level operators and can be ./gradlew
:beam-sdks-java-extensions-euphoria-beam:build
-
-
+https://github.com/seznam/euphoria";>Euphoria API project has
been started in 2014, with a clear goal of providing the main building block
for https://www.seznam.cz/";>Seznam.cz’s data infrastructure.
+In 2015, http://www.vldb.org/pvldb/vol8/p1792-Akidau.pdf";>DataFlow
whitepaper inspired original authors to go one step further and also
provide the unified API for both stream and batch processing.
+The API has been open-sourced in 2016 and is still in active development. As
the Beam’s community goal was very similar, we decided to contribute
+the API as a high level DSL over Beam Java SDK and share our effort with the
community.
-WordCount example
+Euphoria DSL integration is still work in progress and is tracked as part
of https://issues.apache.org/jira/browse/BEAM-3900";>BEAM-3900.
-Pipeline pipeline = Pipeline.create(options);
+WordCount Example
+Lets start with the small example.
+PipelineOptions options = PipelineOptionsFactory.create();
+Pipeline pipeline = Pipeline.create(options);
-// Transform to euphoria's flow.
-BeamFlow flow = BeamFlow.create(pipeline);
+// Use Kryo as coder fallback
+KryoCoderProvider.of().registerTo(pipeline);
// Source of data loaded from Beam IO.
PCollection<String> input
=
-pipeline.apply(Create.of(inputs)).setTypeDescriptor(TypeDescriptor.of(String. [...]
+pipeline
+.apply(Create.of(textLineByLine))
+.setTypeDescriptor(TypeDescriptor.of(String.class));
+
// Transform PCollection to euphoria's Dataset.
-Dataset<String> lines
= flow.wrapped(input);
+Dataset<String> lines
= Dataset.of(input);
// FlatMap processes one input element at a time and allows
user code to emit
// zero, one, or more output elements. From input lines we
will get data set of words.
-Dataset<String> words
= FlatMap.named("TOKENIZER")
-.of(lines)
-.using((String line, Collector<String> context) ->
{
- for (String word :
line.split("\\s+")) {
-context.collect(word);
- }
+Dataset<String> words
=
+FlatMap.named("TOKENIZER")
+.of(lines)
+.using(
+(String line, Collector<String> context) ->
{
+ for (String word :
Splitter.onPattern("\\s+").split(line)) {
+context.collect(word);
+ }
+})
+.output();
+
+// Now we can count
[beam] branch asf-site updated: Publishing website 2018/10/16 16:10:56 at commit e6d7dfe
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new aeb9229 Publishing website 2018/10/16 16:10:56 at commit e6d7dfe aeb9229 is described below commit aeb92290d499e121185cf8f4ed47ae96d25f641a Author: jenkins AuthorDate: Tue Oct 16 16:10:56 2018 + Publishing website 2018/10/16 16:10:56 at commit e6d7dfe --- website/generated-content/contribute/index.html | 7 ++- 1 file changed, 6 insertions(+), 1 deletion(-) diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html index 06c353e..2db015d 100644 --- a/website/generated-content/contribute/index.html +++ b/website/generated-content/contribute/index.html @@ -516,7 +516,12 @@ Prow-style OWNERS files. A description of these files can be found For each file to be reviewed, look for an OWNERS file in its directory. Pick a single reviewer from that file. If the directory doesn’t contain an OWNERS file, go up a directory. Keep going until you find one. Try to limit the number of -reviewers to 2 per PR if possible, to minimize reviewer load. +reviewers to 2 per PR if possible, to minimize reviewer load. Comment on your PR +tagging the reviewer as follows: + +R: @reviewer + + Adding yourself as a reviewer
[beam] branch asf-site updated: Publishing website 2018/10/16 17:01:35 at commit d177ed9
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 4f283a8 Publishing website 2018/10/16 17:01:35 at commit d177ed9
4f283a8 is described below
commit 4f283a8df258ba7307e9a8c8d414cb826b30a74b
Author: jenkins
AuthorDate: Tue Oct 16 17:01:36 2018 +
Publishing website 2018/10/16 17:01:35 at commit d177ed9
---
.../io/built-in/google-bigquery/index.html | 1381
.../documentation/io/built-in/index.html |4 +-
2 files changed, 1383 insertions(+), 2 deletions(-)
diff --git
a/website/generated-content/documentation/io/built-in/google-bigquery/index.html
b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
new file mode 100644
index 000..467d15c
--- /dev/null
+++
b/website/generated-content/documentation/io/built-in/google-bigquery/index.html
@@ -0,0 +1,1381 @@
+
+
+
+
+
+
+
+
+
+
+ Google BigQuery IO
+
+ https://fonts.googleapis.com/css?family=Roboto:100,300,400";
rel="stylesheet">
+
+ https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"</a>;>
+
+
+
+
+
+ https://beam.apache.org/documentation/io/built-in/google-bigquery/";
data-proofer-ignore>
+
+ https://beam.apache.org/feed.xml";>
+
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+
+
+
+
+
+
+
+
+
+Toggle navigation
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ Get Started
+
+
+ Documentation
+
+
+ SDKS
+
+
+ RUNNERS
+
+
+ Contribute
+
+
+ Community
+
+Blog
+
+
+
+ https://www.apache.org/foundation/press/kit/feather_small.png"; alt="Apache
Logo" style="height:20px;">
+
+http://www.apache.org/";>ASF Homepage
+http://www.apache.org/licenses/";>License
+http://www.apache.org/security/";>Security
+http://www.apache.org/foundation/thanks.html";>Thanks
+http://www.apache.org/foundation/sponsorship.html";>Sponsorship
+https://www.apache.org/foundation/policies/conduct";>Code of
Conduct
+
+
+
+
+
+
+
+
+
+
+
+
+
+Documentation
+Using the Documentation
+Beam Execution Model
+
+ Pipeline development lifecycle
+
+
+Design Your
Pipeline
+Create Your
Pipeline
+Test Your
Pipeline
+
+
+
+ Beam programming guide
+
+
+Overview
+Pipelines
+
+ PCollections
+
+
+Creating
a PCollection
+PCollection
characteristics
+
+
+
+ Transforms
+
+
+Applying
transforms
+
+ Core Beam transforms
+
+
+ParDo
+GroupByKey
+CoGroupByKey
+Combine
+Flatten
+Partition
+
+
+
+Requirements
for user code
+Side
inputs
+Additional
outputs
+Composite
transforms
+
+
+
+ Pipeline I/O
+
+
+Using I/O
transforms
+Built-in I/O
transforms
+Authoring new I/O
transforms
+Testing I/O
transforms
+
+
+
+ Data encoding and type safety
+
+
+Data
encoding basics
+Specifying
coders
+Default
coders and the CoderRegistry
+
+
+
+ Windowing
+
+
+Windowing
basics
+Provided
windowing functions
+Setting
your PCollection’s windowing function
+Watermarks
and late data
+Adding
timestamps to a PCollection’s elements
+
+
+
+ Triggers
+
+
+Trigger
basics
+Event time
triggers and the default trigger
+Processing
time triggers
+Data-driven
triggers
+Setting a
trigger
+Composite
triggers
+
+
+Additional Resources
+
+
+
+
+
+
+
+
+
+
+
+
+
+ Before you start
+ BigQuery basics
+
+ Table names
+ Table rows
+ Schemas
+
+
+ Reading from
[beam] branch asf-site updated: Publishing website 2018/10/16 17:33:32 at commit ba3ef6e
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 0ec56b5 Publishing website 2018/10/16 17:33:32 at commit ba3ef6e 0ec56b5 is described below commit 0ec56b54ba361526a50daf68e8041f2b8fd95b71 Author: jenkins AuthorDate: Tue Oct 16 17:33:32 2018 + Publishing website 2018/10/16 17:33:32 at commit ba3ef6e --- website/generated-content/contribute/index.html | 3 ++- 1 file changed, 2 insertions(+), 1 deletion(-) diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html index 2db015d..af2a953 100644 --- a/website/generated-content/contribute/index.html +++ b/website/generated-content/contribute/index.html @@ -615,9 +615,10 @@ across Java, Python, and Go, and every Beam runner. https://docs.google.com/document/d/1xDG0MWVlDKDPu_IW9gtMvxi2S9I0GB0VDTkPhjXT0nE";>Proposal https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=245&view=detail";>Kanban Board + https://docs.google.com/document/d/1s1BJVCY65LB_SYK1SU1u7NbZiFANoq-nEYaEvzRbYlA";>Python 3 Conversion Quick Start Guide -Contributions are welcome! If you are interested to help, you can select a subpackage to port and assign yourself the corresponding issue. Comment on the issue if you cannot assign it yourself. +Contributions are welcome! If you are interested to help, you can select an unassigned issue in the Kanban board and assign it to yourself. Comment on the issue if you cannot assign it yourself. When submitting a new PR, please tag https://github.com/robbesneyders";>@RobbeSneyders, https://github.com/aaltay";>@aaltay, and https://github.com/tvalentyn";>@tvalentyn. Next Java LTS version support (Java 11 / 18.9)
[beam] branch asf-site updated: Publishing website 2018/10/16 19:31:34 at commit 8e83fb1
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 985fd90 Publishing website 2018/10/16 19:31:34 at commit 8e83fb1 985fd90 is described below commit 985fd907d9efb3dc433d25cbdb4d4ba21e98a037 Author: jenkins AuthorDate: Tue Oct 16 19:31:35 2018 + Publishing website 2018/10/16 19:31:34 at commit 8e83fb1 --- website/generated-content/get-started/downloads/index.html | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/website/generated-content/get-started/downloads/index.html b/website/generated-content/get-started/downloads/index.html index e99b3d9..fdcca84 100644 --- a/website/generated-content/get-started/downloads/index.html +++ b/website/generated-content/get-started/downloads/index.html @@ -263,10 +263,10 @@ at scale. Release integrity -You must (verify)[https://www.apache.org/info/verification.html] the integrity +You must https://www.apache.org/info/verification.html";>verify the integrity of downloaded files. We provide OpenPGP signatures for every release file. This signature should be matched against the -(KEYS)[https://www.apache.org/dist/beam/KEYS] file which contains the OpenPGP +https://www.apache.org/dist/beam/KEYS";>KEYS file which contains the OpenPGP keys of Apache Beam’s Release Managers. We also provide SHA-512 checksums for every release file (or SHA-1 and MD5 checksums for older releases). After you download the file, you should calculate a checksum for your download, and make
[beam] branch asf-site updated: Publishing website 2018/10/17 17:53:21 at commit 97d6ea3
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new d1c3933 Publishing website 2018/10/17 17:53:21 at commit 97d6ea3 d1c3933 is described below commit d1c39331d8450af33c8691208a337247bcb53462 Author: jenkins AuthorDate: Wed Oct 17 17:53:22 2018 + Publishing website 2018/10/17 17:53:21 at commit 97d6ea3 --- website/generated-content/documentation/sdks/java/euphoria/index.html | 1 - 1 file changed, 1 deletion(-) diff --git a/website/generated-content/documentation/sdks/java/euphoria/index.html b/website/generated-content/documentation/sdks/java/euphoria/index.html index 679536e6..dd5359f 100644 --- a/website/generated-content/documentation/sdks/java/euphoria/index.html +++ b/website/generated-content/documentation/sdks/java/euphoria/index.html @@ -846,7 +846,6 @@ the API as a high level DSL over Beam Java SDK and share our effort with the com Unsupported Features https://github.com/seznam/euphoria";>Original Euphoria contained some features and operators not jet supported in Beam port. List of not yet supported features follows: - Translation of ReduceStateByKey operator to Beam is not supported. Therefore TopPerKey decomposable to RSBK is also not supported. ReduceByKey in original Euphoria was allowed to sort output values (per key). This is also not yet translatable into Beam, therefore not supported.
[beam] branch asf-site updated: Publishing website 2018/10/17 21:15:33 at commit 9ae7dfd
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 7cef23c Publishing website 2018/10/17 21:15:33 at commit 9ae7dfd 7cef23c is described below commit 7cef23c06c26d94b219e2792a99852d09ad15e23 Author: jenkins AuthorDate: Wed Oct 17 21:15:33 2018 + Publishing website 2018/10/17 21:15:33 at commit 9ae7dfd --- website/generated-content/get-started/downloads/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/get-started/downloads/index.html b/website/generated-content/get-started/downloads/index.html index fdcca84..919df08 100644 --- a/website/generated-content/get-started/downloads/index.html +++ b/website/generated-content/get-started/downloads/index.html @@ -292,7 +292,7 @@ versions denoted 0.x.y. Releases 2.7.0 (2018-10-02) -Official https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip";>source code download. +Official http://www.apache.org/dyn/closer.cgi/beam/2.7.0/apache-beam-2.7.0-source-release.zip";>source code download. https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512";>SHA-512. https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc";>signature.
[beam] branch asf-site updated: Publishing website 2018/10/19 17:26:52 at commit 2c116ed
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 72a3d58 Publishing website 2018/10/19 17:26:52 at commit 2c116ed 72a3d58 is described below commit 72a3d5848c0ea64902033824228dd8c58bb6c20c Author: jenkins AuthorDate: Fri Oct 19 17:26:52 2018 + Publishing website 2018/10/19 17:26:52 at commit 2c116ed --- website/generated-content/contribute/become-a-committer/index.html | 2 +- website/generated-content/contribute/committer-guide/index.html | 2 +- website/generated-content/contribute/dependencies/index.html| 2 +- website/generated-content/contribute/design-documents/index.html| 2 +- website/generated-content/contribute/docker-images/index.html | 2 +- website/generated-content/contribute/index.html | 2 +- website/generated-content/contribute/portability/index.html | 2 +- website/generated-content/contribute/postcommits-guides/index.html | 2 +- .../contribute/postcommits-policies-details/index.html | 2 +- website/generated-content/contribute/postcommits-policies/index.html| 2 +- website/generated-content/contribute/precommit-policies/index.html | 2 +- website/generated-content/contribute/precommit-triage-guide/index.html | 2 +- website/generated-content/contribute/ptransform-style-guide/index.html | 2 +- website/generated-content/contribute/release-guide/index.html | 2 +- website/generated-content/contribute/runner-guide/index.html| 2 +- website/generated-content/contribute/testing/index.html | 2 +- 16 files changed, 16 insertions(+), 16 deletions(-) diff --git a/website/generated-content/contribute/become-a-committer/index.html b/website/generated-content/contribute/become-a-committer/index.html index e900de5..10685f8 100644 --- a/website/generated-content/contribute/become-a-committer/index.html +++ b/website/generated-content/contribute/become-a-committer/index.html @@ -142,7 +142,7 @@ IDE tips -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>IntelliJ Tips +https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips diff --git a/website/generated-content/contribute/committer-guide/index.html b/website/generated-content/contribute/committer-guide/index.html index fa29d8d..c392246 100644 --- a/website/generated-content/contribute/committer-guide/index.html +++ b/website/generated-content/contribute/committer-guide/index.html @@ -142,7 +142,7 @@ IDE tips -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>IntelliJ Tips +https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips diff --git a/website/generated-content/contribute/dependencies/index.html b/website/generated-content/contribute/dependencies/index.html index 9239370..40c7ae8 100644 --- a/website/generated-content/contribute/dependencies/index.html +++ b/website/generated-content/contribute/dependencies/index.html @@ -142,7 +142,7 @@ IDE tips -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>IntelliJ Tips +https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips diff --git a/website/generated-content/contribute/design-documents/index.html b/website/generated-content/contribute/design-documents/index.html index 4448a5e..7ccc741 100644 --- a/website/generated-content/contribute/design-documents/index.html +++ b/website/generated-content/contribute/design-documents/index.html @@ -142,7 +142,7 @@ IDE tips -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>IntelliJ Tips +https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips diff --git a/website/generated-content/contribute/docker-images/index.html b/website/generated-content/contribute/docker-images/index.html index 6311a18..1114bc3 100644 --- a/website/generated-content/contribute/docker-images/index.html +++ b/website/generated-content/contribute/docker-images/index.html @@ -142,7 +142,7 @@ IDE tips -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>IntelliJ Tips +https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE https://cwiki.apache.org/conflue
[beam] branch asf-site updated: Publishing website 2018/10/20 20:34:14 at commit e475c4c
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new f015516 Publishing website 2018/10/20 20:34:14 at commit e475c4c f015516 is described below commit f015516f786a3b067d2d9b9de86d9ae8afcb3252 Author: jenkins AuthorDate: Sat Oct 20 20:34:15 2018 + Publishing website 2018/10/20 20:34:14 at commit e475c4c --- website/generated-content/documentation/dsls/sql/walkthrough/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/documentation/dsls/sql/walkthrough/index.html b/website/generated-content/documentation/dsls/sql/walkthrough/index.html index 06251a7..34738cc 100644 --- a/website/generated-content/documentation/dsls/sql/walkthrough/index.html +++ b/website/generated-content/documentation/dsls/sql/walkthrough/index.html @@ -289,7 +289,7 @@ Types for more details on supported primitive data types. .in(p) .apply(Create .of(row) -.withCoder(appSchema.getRowCoder())); +.withCoder(RowCoder.of(appSchema)));
[beam] branch asf-site updated: Publishing website 2018/10/23 15:56:41 at commit f7b22d7
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new d109061 Publishing website 2018/10/23 15:56:41 at commit f7b22d7 d109061 is described below commit d1090615df5dd9bf432e0040badf6873130f8a43 Author: jenkins AuthorDate: Tue Oct 23 15:56:42 2018 + Publishing website 2018/10/23 15:56:41 at commit f7b22d7 --- website/generated-content/contribute/release-guide/index.html | 2 ++ 1 file changed, 2 insertions(+) diff --git a/website/generated-content/contribute/release-guide/index.html b/website/generated-content/contribute/release-guide/index.html index 8039ae0..e3a60ce 100644 --- a/website/generated-content/contribute/release-guide/index.html +++ b/website/generated-content/contribute/release-guide/index.html @@ -602,6 +602,8 @@ Automation Reliability. If the issue has not been resolved and it is not acceptable to release until it is fixed, the release cannot proceed. Instead, work with the Beam community to resolve the issue. +If there is a bug found in the RC creation process/tools, those issues should be considered high priority and fixed in 7 days. + Review Release Notes in JIRA JIRA automatically generates Release Notes based on the Fix Version field applied to issues. Release Notes are intended for Beam users (not Beam committers/contributors). You should ensure that Release Notes are informative and useful.
[beam] branch asf-site updated: Publishing website 2018/10/23 16:46:07 at commit f4aee0a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 3a030ad Publishing website 2018/10/23 16:46:07 at commit f4aee0a 3a030ad is described below commit 3a030ad66f923db3bd1f500b58485f6c095f5c83 Author: jenkins AuthorDate: Tue Oct 23 16:46:08 2018 + Publishing website 2018/10/23 16:46:07 at commit f4aee0a --- .../beam/capability/2016/03/17/capability-matrix.html | 2 +- .../beam/capability/2016/04/03/presentation-materials.html | 2 +- .../beam/python/sdk/2016/02/25/python-sdk-now-public.html | 2 +- .../generated-content/beam/release/2016/06/15/first-release.html| 2 +- .../beam/update/2016/10/11/strata-hadoop-world-and-beam.html| 2 +- .../beam/update/website/2016/02/22/beam-has-a-logo.html | 2 +- .../generated-content/blog/2016/05/18/splitAtFraction-method.html | 2 +- .../blog/2016/05/27/where-is-my-pcollection-dot-map.html| 2 +- .../blog/2016/06/13/flink-batch-runner-milestone.html | 2 +- website/generated-content/blog/2016/08/03/six-months.html | 2 +- website/generated-content/blog/2016/10/20/test-stream.html | 2 +- website/generated-content/blog/2017/01/09/added-apex-runner.html| 2 +- website/generated-content/blog/2017/01/10/beam-graduates.html | 2 +- .../generated-content/blog/2017/02/01/graduation-media-recap.html | 2 +- website/generated-content/blog/2017/02/13/stateful-processing.html | 2 +- website/generated-content/blog/2017/03/16/python-sdk-release.html | 2 +- .../blog/2017/05/17/beam-first-stable-release.html | 2 +- website/generated-content/blog/2017/08/16/splittable-do-fn.html | 2 +- website/generated-content/blog/2017/08/28/timely-processing.html| 2 +- website/generated-content/blog/2018/01/09/beam-a-look-back.html | 2 +- website/generated-content/blog/2018/02/19/beam-2.3.0.html | 2 +- website/generated-content/blog/2018/06/26/beam-2.5.0.html | 2 +- website/generated-content/blog/2018/08/10/beam-2.6.0.html | 2 +- .../blog/2018/08/20/review-input-streaming-connectors.html | 2 +- website/generated-content/blog/2018/08/21/beam-summit-europe.html | 2 +- website/generated-content/blog/2018/10/03/beam-2.7.0.html | 2 +- website/generated-content/blog/index.html | 2 +- website/generated-content/coming-soon.html | 2 +- website/generated-content/community/contact-us/index.html | 2 +- website/generated-content/community/logos/index.html| 2 +- website/generated-content/community/policies/index.html | 2 +- .../generated-content/community/presentation-materials/index.html | 2 +- website/generated-content/community/youtube-channel/index.html | 2 +- website/generated-content/contribute/become-a-committer/index.html | 2 +- website/generated-content/contribute/committer-guide/index.html | 2 +- website/generated-content/contribute/dependencies/index.html| 2 +- website/generated-content/contribute/design-documents/index.html| 2 +- website/generated-content/contribute/docker-images/index.html | 2 +- website/generated-content/contribute/index.html | 2 +- website/generated-content/contribute/portability/index.html | 2 +- website/generated-content/contribute/postcommits-guides/index.html | 2 +- .../contribute/postcommits-policies-details/index.html | 2 +- .../generated-content/contribute/postcommits-policies/index.html| 2 +- website/generated-content/contribute/precommit-policies/index.html | 2 +- .../generated-content/contribute/precommit-triage-guide/index.html | 2 +- .../generated-content/contribute/ptransform-style-guide/index.html | 2 +- website/generated-content/contribute/release-guide/index.html | 2 +- website/generated-content/contribute/runner-guide/index.html| 2 +- website/generated-content/contribute/testing/index.html | 2 +- .../documentation/dsls/sql/aggregate-functions/index.html | 6 +++--- .../documentation/dsls/sql/create-external-table/index.html | 6 +++--- .../generated-content/documentation/dsls/sql/data-types/index.html | 6 +++--- website/generated-content/documentation/dsls/sql/joins/index.html | 6 +++--- website/generated-content/documentation/dsls/sql/lexical/index.html | 6 +++--- .../generated-content/documentation/dsls/sql/overview/index.html| 6 +++--- .../documentation/dsls/sql/scalar-functions/index.html | 6 +++--- website/generated-content/documentation/dsls/sql/select/index.html | 6 +++--- website/generated-content/documentation/dsls/sql/set/index.html | 6 +++--- website/generated-content
[beam] branch asf-site updated: Publishing website 2018/10/24 16:58:27 at commit 3eeb688
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 4eedece Publishing website 2018/10/24 16:58:27 at commit 3eeb688 4eedece is described below commit 4eedeceef74e996819bf881742773b04db9c1a37 Author: jenkins AuthorDate: Wed Oct 24 16:58:28 2018 + Publishing website 2018/10/24 16:58:27 at commit 3eeb688 --- .../contribute/become-a-committer/index.html| 2 +- .../generated-content/contribute/committer-guide/index.html | 2 +- .../generated-content/contribute/dependencies/index.html| 2 +- .../contribute/design-documents/index.html | 2 +- .../generated-content/contribute/docker-images/index.html | 2 +- website/generated-content/contribute/index.html | 13 - website/generated-content/contribute/portability/index.html | 2 +- .../contribute/postcommits-guides/index.html| 2 +- .../contribute/postcommits-policies-details/index.html | 2 +- .../contribute/postcommits-policies/index.html | 2 +- .../contribute/precommit-policies/index.html| 2 +- .../contribute/precommit-triage-guide/index.html| 2 +- .../contribute/ptransform-style-guide/index.html| 2 +- .../generated-content/contribute/release-guide/index.html | 2 +- .../generated-content/contribute/runner-guide/index.html| 2 +- website/generated-content/contribute/testing/index.html | 2 +- 16 files changed, 27 insertions(+), 16 deletions(-) diff --git a/website/generated-content/contribute/become-a-committer/index.html b/website/generated-content/contribute/become-a-committer/index.html index 906eab3..0666769 100644 --- a/website/generated-content/contribute/become-a-committer/index.html +++ b/website/generated-content/contribute/become-a-committer/index.html @@ -178,7 +178,7 @@ Release guide - +Contact Us diff --git a/website/generated-content/contribute/committer-guide/index.html b/website/generated-content/contribute/committer-guide/index.html index 76006b6..54686c4 100644 --- a/website/generated-content/contribute/committer-guide/index.html +++ b/website/generated-content/contribute/committer-guide/index.html @@ -178,7 +178,7 @@ Release guide - +Contact Us diff --git a/website/generated-content/contribute/dependencies/index.html b/website/generated-content/contribute/dependencies/index.html index d03acc2..7027a19 100644 --- a/website/generated-content/contribute/dependencies/index.html +++ b/website/generated-content/contribute/dependencies/index.html @@ -178,7 +178,7 @@ Release guide - +Contact Us diff --git a/website/generated-content/contribute/design-documents/index.html b/website/generated-content/contribute/design-documents/index.html index a6061c9..3b1b59e 100644 --- a/website/generated-content/contribute/design-documents/index.html +++ b/website/generated-content/contribute/design-documents/index.html @@ -178,7 +178,7 @@ Release guide - +Contact Us diff --git a/website/generated-content/contribute/docker-images/index.html b/website/generated-content/contribute/docker-images/index.html index a709592..deacd5b 100644 --- a/website/generated-content/contribute/docker-images/index.html +++ b/website/generated-content/contribute/docker-images/index.html @@ -178,7 +178,7 @@ Release guide - +Contact Us diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html index 5523a4f..acb8afc 100644 --- a/website/generated-content/contribute/index.html +++ b/website/generated-content/contribute/index.html @@ -178,7 +178,7 @@ Release guide - +Contact Us @@ -199,6 +199,7 @@ + Finding Help Permissions Contributing code @@ -281,6 +282,11 @@ run?) For a list of open starter tasks, check https://s.apache.org/beam-starter-tasks";>https://s.apache.org/beam-starter-tasks. +Finding Help + +If you find any issues with this guide or have questions that aren’t answered, please +reach out to the Beam community. + Permissions For the https://issues.apache.org/jira/projects/BEAM/issues";>Beam issue tracker (JIRA), @@ -699,6 +705,11 @@ actionable comments for 60 days. Author of a closed pull request is welcome to reopen the same pull request again in the future. The associated JIRAs will be unassigned from the author but will stay open. + + +If you didn’t find the information you were looking for in this guide, please +reach out to the Beam community. +
[beam] branch asf-site updated: Publishing website 2018/10/26 12:54:22 at commit eb3b575
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new f8b5e25 Publishing website 2018/10/26 12:54:22 at commit eb3b575
f8b5e25 is described below
commit f8b5e2503df99191457477976728f9c56a0a178e
Author: jenkins
AuthorDate: Fri Oct 26 12:54:23 2018 +
Publishing website 2018/10/26 12:54:22 at commit eb3b575
---
.../documentation/dsls/sql/aggregate-functions/index.html | 2 +-
.../documentation/dsls/sql/create-external-table/index.html | 2 +-
.../documentation/dsls/sql/data-types/index.html | 2 +-
website/generated-content/documentation/dsls/sql/joins/index.html | 2 +-
.../generated-content/documentation/dsls/sql/lexical/index.html | 2 +-
.../generated-content/documentation/dsls/sql/overview/index.html | 2 +-
.../documentation/dsls/sql/scalar-functions/index.html| 2 +-
.../generated-content/documentation/dsls/sql/select/index.html| 2 +-
website/generated-content/documentation/dsls/sql/set/index.html | 2 +-
website/generated-content/documentation/dsls/sql/shell/index.html | 2 +-
.../documentation/dsls/sql/user-defined-functions/index.html | 2 +-
.../documentation/dsls/sql/walkthrough/index.html | 2 +-
.../documentation/dsls/sql/windowing-and-triggering/index.html| 2 +-
.../documentation/sdks/feature-comparison/index.html | 2 +-
website/generated-content/documentation/sdks/go/index.html| 2 +-
.../documentation/sdks/java-extensions/index.html | 2 +-
.../documentation/sdks/java-thirdparty/index.html | 2 +-
.../generated-content/documentation/sdks/java/euphoria/index.html | 2 +-
website/generated-content/documentation/sdks/java/index.html | 4 ++--
.../documentation/sdks/java/{ => testing}/nexmark/index.html | 8
.../documentation/sdks/python-custom-io/index.html| 2 +-
.../documentation/sdks/python-pipeline-dependencies/index.html| 2 +-
.../documentation/sdks/python-streaming/index.html| 2 +-
.../documentation/sdks/python-type-safety/index.html | 2 +-
website/generated-content/documentation/sdks/python/index.html| 2 +-
25 files changed, 29 insertions(+), 29 deletions(-)
diff --git
a/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html
b/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html
index 2400201..2fd1aea 100644
---
a/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html
+++
b/website/generated-content/documentation/dsls/sql/aggregate-functions/index.html
@@ -157,7 +157,7 @@
Java SDK
extensions
Java 3rd party
extensions
-Nexmark benchmark
suite
+Nexmark benchmark
suite
diff --git
a/website/generated-content/documentation/dsls/sql/create-external-table/index.html
b/website/generated-content/documentation/dsls/sql/create-external-table/index.html
index 6113ff4..b8e27c2 100644
---
a/website/generated-content/documentation/dsls/sql/create-external-table/index.html
+++
b/website/generated-content/documentation/dsls/sql/create-external-table/index.html
@@ -157,7 +157,7 @@
Java SDK
extensions
Java 3rd party
extensions
-Nexmark benchmark
suite
+Nexmark benchmark
suite
diff --git
a/website/generated-content/documentation/dsls/sql/data-types/index.html
b/website/generated-content/documentation/dsls/sql/data-types/index.html
index bb387bc..5ad432a 100644
--- a/website/generated-content/documentation/dsls/sql/data-types/index.html
+++ b/website/generated-content/documentation/dsls/sql/data-types/index.html
@@ -157,7 +157,7 @@
Java SDK
extensions
Java 3rd party
extensions
-Nexmark benchmark
suite
+Nexmark benchmark
suite
diff --git a/website/generated-content/documentation/dsls/sql/joins/index.html
b/website/generated-content/documentation/dsls/sql/joins/index.html
index 43a19bc..acaf88c 100644
--- a/website/generated-content/documentation/dsls/sql/joins/index.html
+++ b/website/generated-content/documentation/dsls/sql/joins/index.html
@@ -157,7 +157,7 @@
Java SDK
extensions
Java 3rd party
extensions
-Nexmark benchmark
suite
+Nexmark benchmark
suite
diff --git
a/website/generated-content/documentation/dsls/sql/lexical/index.html
b/website/generated-content/documentation/dsls/sql/lexical/index.html
index b2dda41..962cb52 100644
--- a/website/generated-content/documentation/dsls/sql/lexical/index.html
+++ b/website/generated-content/documentation/dsls/sql/lexical/index.html
@@ -157,7 +157,7 @@
Java SDK
extensions
Java 3rd party
extensions
-Nexmark benchmark
suite
+Nexmark benchmark
suite
diff --git
a/webs
[beam] branch asf-site updated: Publishing website 2018/10/26 18:26:17 at commit c7adb01
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e1ef435 Publishing website 2018/10/26 18:26:17 at commit c7adb01
e1ef435 is described below
commit e1ef435c15dee9f207255287cdcefdee588aea09
Author: jenkins
AuthorDate: Fri Oct 26 18:26:18 2018 +
Publishing website 2018/10/26 18:26:17 at commit c7adb01
---
.../contribute/precommit-triage-guide/index.html | 30 ++--
.../images/precommit_dashboard.png | 31 +
.../images/precommit_durations.png | Bin 45673 -> 0 bytes
3 files changed, 39 insertions(+), 22 deletions(-)
diff --git
a/website/generated-content/contribute/precommit-triage-guide/index.html
b/website/generated-content/contribute/precommit-triage-guide/index.html
index ddbba37..4404e67 100644
--- a/website/generated-content/contribute/precommit-triage-guide/index.html
+++ b/website/generated-content/contribute/precommit-triage-guide/index.html
@@ -210,7 +210,7 @@
What are fast pre-commits?
Determining Slowness
- Notebook
+ Pre-commit Dashboard
Triage Process
@@ -270,31 +270,17 @@ the Jenkins queue + the actual time it spends running.
Pre-commit jobs are timing out after 30 minutes. This can be determined
from
the console log of a job.
Pre-commits aren’t timing out, but the total wait time for pre-commit
results
-is >30m. This can be determined using a Jupyter notebook.
+is >30m.
-Notebook
+Pre-commit Dashboard
-The Beam repo contains a https://github.com/apache/beam/tree/master/.test-infra/jupyter";>Jupyter
-notebook named
-precommit_job_times.ipynb that can be
used to gather and visualize statistics
-about pre-commit running times.
+The Beam Community Metrics site contains a http://104.154.241.245/d/_TNndF2iz/pre-commit-tests";>Pre-Commit
+Tests dashboard showing
+job timing trends. You can modify the time window (defaults to 7 days) or
filter
+down to a specific test suite by clicking on it.
-Run the notebook. It should output a table with running times. The numbers
in
-the column totalDurationMinutes_all and
the rows with a job_name like 4
-weeks 95th contain the target numbers for determining slowness.
-If any of these numbers are above 30, triaging is required.
-
-Example
-Here’s an example table of running times:
-
-
-
-(Note that this example was created when pre-commits did not have 30m
timeouts.)
-
-In this example, Go pre-commits are taking approximately 14 minutes, which
is
-fast. Java and Python pre-commits are taking 78 and 32 minutes respectively,
-which is slow. Both Java and Python pre-commits require triage.
+
Triage Process
diff --git a/website/generated-content/images/precommit_dashboard.png
b/website/generated-content/images/precommit_dashboard.png
new file mode 100644
index 000..49e4065
--- /dev/null
+++ b/website/generated-content/images/precommit_dashboard.png
@@ -0,0 +1,31 @@
+
+
+
+
+
+ Sign in - Google Accounts
+ https://www.google.com/accounts/AccountChooser?hd=google.com&continue=https%3A%2F%2Fappengine.google.com%2F_ah%2Fconflogin%3Fcontinue%3Dhttps%3A%2F%2Fscreenshot.googleplex.com%2Fu5CALdM0vvL.png&service=ah";>
+
+
+ https://www.google.com/accounts/AccountChooser?hd=google.com&continue=https%3A%2F%2Fappengine.google.com%2F_ah%2Fconflogin%3Fcontinue%3Dhttps%3A%2F%2Fscreenshot.googleplex.com%2Fu5CALdM0vvL.png&service=ah";
method="get">
+
+ You should turn on Javascript support.
+
+
+
+
+window.onload = function() {
+ var redirectUrl =
'https:\x2F\x2Fwww.google.com\x2Faccounts\x2FAccountChooser?hd=google.com\x26continue=https%3A%2F%2Fappengine.google.com%2F_ah%2Fconflogin%3Fcontinue%3Dhttps%3A%2F%2Fscreenshot.googleplex.com%2Fu5CALdM0vvL.png\x26service=ah';
+ var domain = 'google.com';
+ var hash = window.location.hash;
+ if (hash) {
+ var match = hash.match(/[#&]Email=([^&]+)/);
+ if (match) {
+ redirectUrl += "&Email=" + match[1] + "@" + domain;
+ }
+ }
+ window.location.replace(redirectUrl);
+};
+
+
+
diff --git a/website/generated-content/images/precommit_durations.png
b/website/generated-content/images/precommit_durations.png
deleted file mode 100644
index c659677..000
Binary files a/website/generated-content/images/precommit_durations.png and
/dev/null differ
[beam] branch asf-site updated: Publishing website 2018/10/26 18:41:38 at commit 9f161d9
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 083bc96 Publishing website 2018/10/26 18:41:38 at commit 9f161d9 083bc96 is described below commit 083bc96f84efdd1dd1dda81205ab08406ebfd497 Author: jenkins AuthorDate: Fri Oct 26 18:41:38 2018 + Publishing website 2018/10/26 18:41:38 at commit 9f161d9 --- website/generated-content/.htaccess| 2 +- .../blog/2016/10/20/test-stream.html | 2 +- .../blog/2017/08/16/splittable-do-fn.html | 10 +++ .../08/20/review-input-streaming-connectors.html | 22 +++ .../contribute/ptransform-style-guide/index.html | 4 +-- .../contribute/release-guide/index.html| 2 +- .../dsls/sql/aggregate-functions/index.html| 4 +-- .../dsls/sql/create-external-table/index.html | 4 +-- .../documentation/dsls/sql/data-types/index.html | 4 +-- .../documentation/dsls/sql/joins/index.html| 4 +-- .../documentation/dsls/sql/lexical/index.html | 4 +-- .../documentation/dsls/sql/overview/index.html | 8 +++--- .../dsls/sql/scalar-functions/index.html | 4 +-- .../documentation/dsls/sql/select/index.html | 4 +-- .../documentation/dsls/sql/set/index.html | 4 +-- .../documentation/dsls/sql/shell/index.html| 4 +-- .../dsls/sql/user-defined-functions/index.html | 4 +-- .../documentation/dsls/sql/walkthrough/index.html | 10 +++ .../dsls/sql/windowing-and-triggering/index.html | 4 +-- .../io/built-in/google-bigquery/index.html | 14 +- .../pipelines/test-your-pipeline/index.html| 4 +-- .../documentation/programming-guide/index.html | 16 +-- .../documentation/runners/dataflow/index.html | 6 ++-- .../documentation/runners/direct/index.html| 14 +- .../documentation/runners/flink/index.html | 4 +-- .../documentation/runners/gearpump/index.html | 4 +-- .../documentation/runners/jstorm/index.html| 2 +- .../documentation/runners/mapreduce/index.html | 2 +- .../documentation/runners/samza/index.html | 2 +- .../documentation/runners/spark/index.html | 2 +- .../sdks/feature-comparison/index.html | 4 +-- .../documentation/sdks/go/index.html | 4 +-- .../documentation/sdks/java-extensions/index.html | 4 +-- .../documentation/sdks/java-thirdparty/index.html | 4 +-- .../documentation/sdks/java/euphoria/index.html| 6 ++-- .../documentation/sdks/java/index.html | 4 +-- .../sdks/java/testing/nexmark/index.html | 8 +++--- .../documentation/sdks/python-custom-io/index.html | 4 +-- .../sdks/python-pipeline-dependencies/index.html | 4 +-- .../documentation/sdks/python-streaming/index.html | 4 +-- .../sdks/python-type-safety/index.html | 4 +-- .../documentation/sdks/python/index.html | 4 +-- website/generated-content/feed.xml | 32 +++--- .../get-started/downloads/index.html | 18 .../get-started/quickstart-java/index.html | 4 +-- .../get-started/wordcount-example/index.html | 4 +-- website/generated-content/index.html | 4 +-- 47 files changed, 149 insertions(+), 141 deletions(-) diff --git a/website/generated-content/.htaccess b/website/generated-content/.htaccess index 2462791..5f00051 100644 --- a/website/generated-content/.htaccess +++ b/website/generated-content/.htaccess @@ -21,4 +21,4 @@ RewriteRule ^(.*)$ https://beam.apache.org/$1 [L,R=301] # The following redirect maintains the previously supported URLs. RedirectMatch permanent "/documentation/sdks/(javadoc|pydoc)(.*)" "https://beam.apache.org/releases/$1$2"; # Keep this updated to point to the current release. -RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.7.0$2"; +RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.8.0$2"; diff --git a/website/generated-content/blog/2016/10/20/test-stream.html b/website/generated-content/blog/2016/10/20/test-stream.html index 34da27a..468ca75 100644 --- a/website/generated-content/blog/2016/10/20/test-stream.html +++ b/website/generated-content/blog/2016/10/20/test-stream.html @@ -219,7 +219,7 @@ be controlled within a test. Writing Deterministic Tests to Emulate Nondeterminism The Beam testing infrastructure provides the -https://beam.apache.org/releases/javadoc/2.7.0/org/apache/beam/sdk/testing/PAssert.html";>PAssert +https://beam.apache.org/releases/javadoc/2.8.0/org/apache/beam/sdk/testing/PAssert.html";>PAssert methods, which assert properties about the contents of a P
[beam] branch asf-site updated: Publishing website 2018/10/26 20:15:52 at commit 6a4fc93
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 9085700 Publishing website 2018/10/26 20:15:52 at commit 6a4fc93 9085700 is described below commit 908570054018845d4df04e75d3af6c996f6f4cac Author: jenkins AuthorDate: Fri Oct 26 20:15:52 2018 + Publishing website 2018/10/26 20:15:52 at commit 6a4fc93 --- .../images/precommit_dashboard.png | Bin 1425 -> 215945 bytes 1 file changed, 0 insertions(+), 0 deletions(-) diff --git a/website/generated-content/images/precommit_dashboard.png b/website/generated-content/images/precommit_dashboard.png index 49e4065..f79e44c 100644 Binary files a/website/generated-content/images/precommit_dashboard.png and b/website/generated-content/images/precommit_dashboard.png differ
[beam] branch asf-site updated: Publishing website 2018/10/29 17:30:56 at commit 610aeb3
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new b258215 Publishing website 2018/10/29 17:30:56 at commit 610aeb3 b258215 is described below commit b25821593e89ba1d1a261860d2742b4ed7204802 Author: jenkins AuthorDate: Mon Oct 29 17:30:57 2018 + Publishing website 2018/10/29 17:30:56 at commit 610aeb3 --- website/generated-content/documentation/programming-guide/index.html | 4 +++- 1 file changed, 3 insertions(+), 1 deletion(-) diff --git a/website/generated-content/documentation/programming-guide/index.html b/website/generated-content/documentation/programming-guide/index.html index 38de3be..f9e8170 100644 --- a/website/generated-content/documentation/programming-guide/index.html +++ b/website/generated-content/documentation/programming-guide/index.html @@ -2130,7 +2130,9 @@ The PipelineOptions for the current pipel @OnTimer methods can also access many of these parameters. Timestamp, window, PipelineOptions, OutputReceiver, and MultiOutputReceiver parameters can all be accessed in an @OnTimer method. In addition, an @OnTimer method can take -a parameter of type TimeDomain which tells whether the timer is based on event time or processing time. +a parameter of type TimeDomain which tells whether the timer is based on event time or processing time. +Timers are explained in more detail in the +Timely (and Stateful) Processing with Apache Beam blog post. 4.6. Composite transforms
[beam] branch asf-site updated: Publishing website 2018/10/29 19:08:13 at commit 973643b
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 1f25359 Publishing website 2018/10/29 19:08:13 at commit 973643b 1f25359 is described below commit 1f253590ef0185350860d156f71b94b6eaeb6c47 Author: jenkins AuthorDate: Mon Oct 29 19:08:14 2018 + Publishing website 2018/10/29 19:08:13 at commit 973643b --- .../generated-content/contribute/become-a-committer/index.html | 10 ++ .../generated-content/contribute/committer-guide/index.html| 10 ++ website/generated-content/contribute/dependencies/index.html | 10 ++ .../generated-content/contribute/design-documents/index.html | 10 ++ website/generated-content/contribute/docker-images/index.html | 10 ++ website/generated-content/contribute/index.html| 10 ++ .../generated-content/contribute/postcommits-guides/index.html | 10 ++ .../contribute/postcommits-policies-details/index.html | 10 ++ .../contribute/postcommits-policies/index.html | 10 ++ .../generated-content/contribute/precommit-policies/index.html | 10 ++ .../contribute/precommit-triage-guide/index.html | 10 ++ .../contribute/ptransform-style-guide/index.html | 10 ++ website/generated-content/contribute/release-guide/index.html | 10 ++ website/generated-content/contribute/runner-guide/index.html | 10 ++ website/generated-content/contribute/testing/index.html| 10 ++ 15 files changed, 30 insertions(+), 120 deletions(-) diff --git a/website/generated-content/contribute/become-a-committer/index.html b/website/generated-content/contribute/become-a-committer/index.html index 28aaa49..01ce77b 100644 --- a/website/generated-content/contribute/become-a-committer/index.html +++ b/website/generated-content/contribute/become-a-committer/index.html @@ -147,14 +147,7 @@ Contribute Get started contributing - - IDE tips - - -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE -https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips - - +https://cwiki.apache.org/confluence/display/BEAM/Using+IntelliJ+IDE";>Using IntelliJ IDE Technical Docs @@ -187,6 +180,7 @@ Contact Us + diff --git a/website/generated-content/contribute/committer-guide/index.html b/website/generated-content/contribute/committer-guide/index.html index d936ecb..4e2050b 100644 --- a/website/generated-content/contribute/committer-guide/index.html +++ b/website/generated-content/contribute/committer-guide/index.html @@ -147,14 +147,7 @@ Contribute Get started contributing - - IDE tips - - -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE -https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips - - +https://cwiki.apache.org/confluence/display/BEAM/Using+IntelliJ+IDE";>Using IntelliJ IDE Technical Docs @@ -187,6 +180,7 @@ Contact Us + diff --git a/website/generated-content/contribute/dependencies/index.html b/website/generated-content/contribute/dependencies/index.html index 1460219..9439642 100644 --- a/website/generated-content/contribute/dependencies/index.html +++ b/website/generated-content/contribute/dependencies/index.html @@ -147,14 +147,7 @@ Contribute Get started contributing - - IDE tips - - -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE -https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips - - +https://cwiki.apache.org/confluence/display/BEAM/Using+IntelliJ+IDE";>Using IntelliJ IDE Technical Docs @@ -187,6 +180,7 @@ Contact Us + diff --git a/website/generated-content/contribute/design-documents/index.html b/website/generated-content/contribute/design-documents/index.html index f13c3f3..3132467 100644 --- a/website/generated-content/contribute/design-documents/index.html +++ b/website/generated-content/contribute/design-documents/index.html @@ -147,14 +147,7 @@ Contribute Get started contributing - - IDE tips - - -https://cwiki.apache.org/confluence/display/BEAM/IntelliJ+Tips";>Using IntelliJ IDE -https://cwiki.apache.org/confluence/display/BEAM/Eclipse+Tips";>Eclipse Tips - - +https://cwiki.apache.org/confluence/display/BEAM/Using+IntelliJ+IDE";>Using IntelliJ IDE Technical Docs @@ -187,6 +180,7 @@ Contact Us + diff --git a/website/generated-content/contribute/docker-images/index.html b/website/g
[beam] branch asf-site updated: Publishing website 2018/10/29 21:40:21 at commit 0944d24
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 947bb98 Publishing website 2018/10/29 21:40:21 at commit 0944d24 947bb98 is described below commit 947bb98865c33488025090f768a440a12618f1f8 Author: jenkins AuthorDate: Mon Oct 29 21:40:21 2018 + Publishing website 2018/10/29 21:40:21 at commit 0944d24 --- .../contribute/postcommits-policies/index.html | 37 ++ 1 file changed, 31 insertions(+), 6 deletions(-) diff --git a/website/generated-content/contribute/postcommits-policies/index.html b/website/generated-content/contribute/postcommits-policies/index.html index 4fc7eca..62d4460 100644 --- a/website/generated-content/contribute/postcommits-policies/index.html +++ b/website/generated-content/contribute/postcommits-policies/index.html @@ -235,11 +235,11 @@ limitations under the License. Post-commit tests validate that Beam works correctly in a live environment. The tests also catch errors that are hard to predict in the design and -implementation stages +implementation stages. Even though post-commit tests run after the code is merged into the repository, it is important that the tests pass reliably. Jenkins executes post-commit tests -against the HEAD of the master branch. If post-commit tests fail, there is a +against the HEAD of the master branch. If post-commit tests fail, there is a problem with the HEAD build. In addition, post-commit tests are time consuming to run, and it is often hard to triage test failures. @@ -284,14 +284,39 @@ open a pull request with the proposed fix while doing rollback. My change was rolled back due to a test failure +After rollback there is time for deeper investigation. Start by looking at the +JIRA issue to see the background information for the rollback. These scenarios +are all common: + + + Your change contained a bug. + Your change exposed an existing bug. + Your change exposed a bad test (flaky, overspecified, etc). + + +These are all valid reasons for rollback. Maintaining clear signal is the +highest priority. + +The high level steps are the same: + - Look at the JIRA issue to find the reason for the rollback. - Fix your code and re-run the post-commit tests. - Implement new pre-commit tests that will catch similar bugs before future -code is merged into the repository. + Create a fix and re-run the post-commit tests. + Implement new pre-commit tests that will catch similar failures +before future code is merged into the repository. Open a new PR that contains your fix and the new pre-commit tests. +If the bug is not in your code, here is how to “create a fix”: + + + File a ticket for the existing bug, if it does not already exist. +Remember that +a flaky test is a critical bug. Other +bad tests are similar: they may fail for arbitrary reasons having nothing +to do with what is being tested, making our signal unreliable. + Mark the problematic test to be skipped, with a link to the JIRA ticket. + + Useful links
[beam] branch asf-site updated: Publishing website 2018/10/30 00:44:15 at commit 8c84dc8
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 384d1a5 Publishing website 2018/10/30 00:44:15 at commit 8c84dc8 384d1a5 is described below commit 384d1a5ff3b9e1aa37a970a437430347a7db5ff0 Author: jenkins AuthorDate: Tue Oct 30 00:44:16 2018 + Publishing website 2018/10/30 00:44:15 at commit 8c84dc8 --- .../2018/10/29/beam-2.8.0.html}| 306 +++-- website/generated-content/blog/index.html | 32 +++ website/generated-content/feed.xml | 230 +++- website/generated-content/index.html | 10 +- 4 files changed, 246 insertions(+), 332 deletions(-) diff --git a/website/generated-content/index.html b/website/generated-content/blog/2018/10/29/beam-2.8.0.html similarity index 57% copy from website/generated-content/index.html copy to website/generated-content/blog/2018/10/29/beam-2.8.0.html index 34da659..37fe23e 100644 --- a/website/generated-content/index.html +++ b/website/generated-content/blog/2018/10/29/beam-2.8.0.html @@ -28,9 +28,8 @@ - Apache Beam - + Apache Beam 2.8.0 + https://fonts.googleapis.com/css?family=Roboto:100,300,400"; rel="stylesheet"> https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"</a>;> @@ -39,7 +38,7 @@ - https://beam.apache.org/"; data-proofer-ignore> + https://beam.apache.org/blog/2018/10/29/beam-2.8.0.html"; data-proofer-ignore> https://beam.apache.org/feed.xml";> https://use.fontawesome.com/releases/v5.4.1/css/all.css"; integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous"> @@ -53,7 +52,7 @@ - + + + + +http://schema.org/BlogPosting";> + + +Apache Beam 2.8.0 +Oct 29, 2018 • + Ahmet Altay + + + + + + - - - - - - -Apache Beam: An advanced unified programming model - - -Implement batch and streaming data processing jobs that run on any execution engine. - - -Learn more -Download Beam SDK 2.8.0 - - -Java Quickstart -Python Quickstart - Go Quickstart - - - - - - -The latest from the blog - - - - - Apache Beam 2.7.0 - Oct 3, 2018 - - - - Beam Summit Europe 2018 - Aug 21, 2018 - - - - A review of input streaming connectors - Aug 20, 2018 - - - - - - - - - - -All about Apache Beam - - - - - -Unified - - -Use a single programming model for both batch and streaming use cases. - - - - - -Portable - - -Execute pipelines on multiple execution environments. - - - - - -Extensible - - -Write and share new SDKs, IO connectors, and transformation libraries. - - - - - +We are happy to present the new 2.8.0 release of Beam. This release includes both improvements and new functionality. +See the download page for this release. +For more information on changes in 2.8.0, check out the +https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343985";>detailed release notes. - - - - - +New Features / Improvements - - -Works with - - - - - http://apex.apache.org";> - - - - http://flink.apache.org";> - - - - http://spark.apache.org/";> - - - - https://cloud.google.com/dataflow/";> - - - - http://gearpump.apache.org/";> - - - - http://samza.apache.org/";> - - - - +Known Issues - - - - Testimonials - - - - - - A framework that delivers the flexibility and advanced functionality our customers need. - - - - -–Talend - - - - - - - Apache Beam has powerful semantics that solve real-world challenges of stream processing. - - - - -–PayPal - - - - - - - Apache Beam represents a principled approach for analyzing data streams. - -
[beam] branch asf-site updated: Publishing website 2018/10/31 00:10:21 at commit 3030f79
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 4814448 Publishing website 2018/10/31 00:10:21 at commit 3030f79 4814448 is described below commit 4814448e788577f93df288e413d594779a9202ed Author: jenkins AuthorDate: Wed Oct 31 00:10:21 2018 + Publishing website 2018/10/31 00:10:21 at commit 3030f79 --- .../community/contact-us/index.html| 13 +- .../contribute/become-a-committer/index.html | 10 +- .../contribute/committer-guide/index.html | 10 +- .../contribute/dependencies/index.html | 10 +- .../contribute/design-documents/index.html | 10 +- .../contribute/docker-images/index.html| 10 +- .../contribute/feature-branches/index.html | 392 ++- website/generated-content/contribute/index.html| 429 - .../contribute/postcommits-guides/index.html | 10 +- .../postcommits-policies-details/index.html| 10 +- .../contribute/postcommits-policies/index.html | 10 +- .../contribute/precommit-policies/index.html | 10 +- .../contribute/precommit-triage-guide/index.html | 10 +- .../contribute/ptransform-style-guide/index.html | 10 +- .../contribute/release-guide/index.html| 10 +- .../contribute/runner-guide/index.html | 10 +- .../contribute/testing/index.html | 10 +- .../contribute/work-in-progress/index.html | 10 - .../get-started/quickstart-go/index.html | 2 + .../get-started/quickstart-java/index.html | 2 + .../get-started/quickstart-py/index.html | 2 + 21 files changed, 639 insertions(+), 351 deletions(-) diff --git a/website/generated-content/community/contact-us/index.html b/website/generated-content/community/contact-us/index.html index c0e0e5f..006a833 100644 --- a/website/generated-content/community/contact-us/index.html +++ b/website/generated-content/community/contact-us/index.html @@ -215,15 +215,15 @@ whichever one seems best! https://lists.apache.org/list.html?u...@beam.apache.org";>user@ mailing list - User support and questions (mailto:user-subscr...@beam.apache.org";>Subscribe, mailto:user-unsubscr...@beam.apache.org";>Unsubscribe) + User support and questions (mailto:user-subscr...@beam.apache.org";>Subscribe1, mailto:user-unsubscr...@beam.apache.org";>Unsubscribe1, https://lists.apache.org/list.html?u...@beam.apache.org";>Archives) https://lists.apache.org/list.html?d...@beam.apache.org";>dev@ mailing list - Development discussions (mailto:dev-subscr...@beam.apache.org";>Subscribe, mailto:dev-unsubscr...@beam.apache.org";>Unsubscribe) + Development discussions (mailto:dev-subscr...@beam.apache.org";>Subscribe1, mailto:dev-unsubscr...@beam.apache.org";>Unsubscribe1, https://lists.apache.org/list.html?d...@beam.apache.org";>Archives) https://lists.apache.org/list.html?commits@beam.apache.org";>commits@ mailing list - Firehose of commits, bugs, pull requests, etc. (mailto:commits-subscr...@beam.apache.org";>Subscribe, mailto:commits-unsubscr...@beam.apache.org";>Unsubscribe) + Firehose of commits, bugs, pull requests, etc. (mailto:commits-subscr...@beam.apache.org";>Subscribe1, mailto:commits-unsubscr...@beam.apache.org";>Unsubscribe1, https://lists.apache.org/list.html?commits@beam.apache.org";>Archives) https://issues.apache.org/jira/browse/BEAM";>JIRA bug tracker @@ -241,6 +241,13 @@ whichever one seems best! If you wish to report a security vulnerability, please contact mailto:secur...@apache.org";>secur...@apache.org. Apache Beam follows the typical https://apache.org/security/committers.html#vulnerability-handling";>Apache vulnerability handling process. + + + + To subscribe or unsubscribe, a blank email is fine. ↩ ↩2 ↩3 ↩4 ↩5 ↩6 + + + diff --git a/website/generated-content/contribute/become-a-committer/index.html b/website/generated-content/contribute/become-a-committer/index.html index 01ce77b..f0f76ca 100644 --- a/website/generated-content/contribute/become-a-committer/index.html +++ b/website/generated-content/contribute/become-a-committer/index.html @@ -147,20 +147,20 @@ Contribute Get started contributing -https://cwiki.apache.org/confluence/display/BEAM/Using+IntelliJ+IDE";>Using IntelliJ IDE +https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>FAQ Technical Docs +Roadmap Testing guide - - Pre-commit Slowness Triage Guid
[beam] branch asf-site updated: Publishing website 2018/11/01 18:19:27 at commit dc2a600
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new a61d7b5 Publishing website 2018/11/01 18:19:27 at commit dc2a600
a61d7b5 is described below
commit a61d7b53e14211a661e4e6304f8d02cfb27b20b1
Author: jenkins
AuthorDate: Thu Nov 1 18:19:27 2018 +
Publishing website 2018/11/01 18:19:27 at commit dc2a600
---
.../generated-content/get-started/mobile-gaming-example/index.html| 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
diff --git
a/website/generated-content/get-started/mobile-gaming-example/index.html
b/website/generated-content/get-started/mobile-gaming-example/index.html
index ea5b3b5..cff4fef 100644
--- a/website/generated-content/get-started/mobile-gaming-example/index.html
+++ b/website/generated-content/get-started/mobile-gaming-example/index.html
@@ -736,7 +736,7 @@ logical windows based on when those scores occurred in
event time.
'team': 'STRING',
'total_score':
'INTEGER',
'window_start':
'STRING',
- }))
+ }, options.view_as(GoogleCloudOptions).project))
@@ -1196,7 +1196,7 @@ between instances are.
| 'WriteAvgSessionLength' >> WriteToBigQuery(
args.table_name + '_sessions', args.dataset, {
'mean_duration': 'FLOAT',
-}))
+}, options.view_as(GoogleCloudOptions).project))
[beam] branch asf-site updated: Publishing website 2018/11/01 23:42:17 at commit ccb0fcb
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 67f4781 Publishing website 2018/11/01 23:42:17 at commit ccb0fcb 67f4781 is described below commit 67f478124753faff3cf8959706bc28e972ae23e8 Author: jenkins AuthorDate: Thu Nov 1 23:42:18 2018 + Publishing website 2018/11/01 23:42:17 at commit ccb0fcb --- .../generated-content/roadmap/go-sdk/index.html| 78 +++--- 1 file changed, 68 insertions(+), 10 deletions(-) diff --git a/website/generated-content/roadmap/go-sdk/index.html b/website/generated-content/roadmap/go-sdk/index.html index 88ccbda..d3780d0 100644 --- a/website/generated-content/roadmap/go-sdk/index.html +++ b/website/generated-content/roadmap/go-sdk/index.html @@ -191,6 +191,12 @@ + + Usability + Performance + Integrating with the Go ecosystem + Implement Portability features + @@ -212,19 +218,71 @@ limitations under the License. Go SDK Roadmap -This roadmap is in progress. In the meantime, here are available resources: +The Go SDK is currently experimental. As the first purely portable Beam SDK, the Go SDK is constrained +by the status of the https://beam.apache.org/roadmap/portability/";>Beam Portabillity Framework and the existence of +portable runners. + +With that in mind present work on the Go SDK has the following goals: + +Usability + +The Go SDK should not block users from writing the pipelines they need to run. - - - - - JIRA: https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go";>sdk-go / https://issues.apache.org/jira/browse/BEAM-2083";>BEAM-2083 - - - + Support large elements https://issues.apache.org/jira/browse/BEAM-4124";>BEAM-4124 + Coder Registry to support complex user elements https://issues.apache.org/jira/browse/BEAM-3306";>BEAM-3306 + + +Performance + +Since the Go SDK has no official runner support at this time, this gives us the chance to work on the performance +of the SDK harness. When portable runners are ready, the Go SDK should be ready as well. + + + Reducing framework overhead on the SDK Harness side https://issues.apache.org/jira/browse/BEAM-4726";>BEAM-4726 + Tooling to enable and verify pipeline performance https://issues.apache.org/jira/browse/BEAM-3612";>BEAM-3612 + Measure the performance of the SDK at scale. + + +Integrating with the Go ecosystem + +The authors of the Go SDK intended to keep the parts of the language we love, and intend for +user pipelines to be as close to ordinary Go as possible, minimizing framework boiler plate code. + + + Migrate to a vanity URL path https://issues.apache.org/jira/browse/BEAM-4115";>BEAM-4115 + Package versioning support https://issues.apache.org/jira/browse/BEAM-5379";>BEAM-5379 + + +Implement Portability features + +The following are dependant on the features being implemented in the Portability Framework. + + + Splitable DoFns (SDFs) for Scalable IO https://issues.apache.org/jira/browse/BEAM-3301";>BEAM-3301 + + This is the primary blocker for the Go SDK to scale to ingest large numbers of elements in both batch and streaming. + - Contact: mailto:hero...@google.com";>Henning Rohde + Triggers and Timers https://issues.apache.org/jira/browse/BEAM-3304";>BEAM-3304 + Advanced WindowFns + + Session windows https://issues.apache.org/jira/browse/BEAM-4152";>BEAM-4152 + Custom WindowFns (dependant on streaming Splitable DoFn support) https://issues.apache.org/jira/browse/BEAM-2939";>BEAM-2939 + + + + +Without SDFs, IOs are always constrained to work on a single machine prior to a sharding operation (like CoGroupByKey), +which makes scalable IOs difficult to impossible to write. + +Otherwise, improving examples and documentation for devs and users alike is ongoing. +Contributions are welcome. Please contact the mailto:d...@beam.apache.org?subject=%5BGo%20SDK%5D%20How%20can%20I%20help%3F";>dev list +for assistance in finding a place to help out. + + + JIRA: https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20sdk-go";>sdk-go / https://issues.apache.org/jira/browse/BEAM-2083";>BEAM-2083 + Contact: Robert Burke (@lostluck) mailto:r...@google.com,d...@beam.apache.org?subject=%5BGo%20SDK%5D";>Email
[beam] branch asf-site updated: Publishing website 2018/11/02 14:19:55 at commit e2f2c8b
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 4f65e67 Publishing website 2018/11/02 14:19:55 at commit e2f2c8b
4f65e67 is described below
commit 4f65e67b2091e4b50adef5c02ddeaedcc9587948
Author: jenkins
AuthorDate: Fri Nov 2 14:19:55 2018 +
Publishing website 2018/11/02 14:19:55 at commit e2f2c8b
---
.../blog/2018/10/31/beam-summit-aftermath.html | 337 ++
website/generated-content/blog/index.html | 31 +
website/generated-content/feed.xml | 691 -
website/generated-content/index.html | 10 +-
4 files changed, 493 insertions(+), 576 deletions(-)
diff --git
a/website/generated-content/blog/2018/10/31/beam-summit-aftermath.html
b/website/generated-content/blog/2018/10/31/beam-summit-aftermath.html
new file mode 100644
index 000..e8d0182
--- /dev/null
+++ b/website/generated-content/blog/2018/10/31/beam-summit-aftermath.html
@@ -0,0 +1,337 @@
+
+
+
+
+
+
+
+
+
+
+ Inaugural edition of the Beam Summit Europe 2018 - aftermath
+
+ https://fonts.googleapis.com/css?family=Roboto:100,300,400";
rel="stylesheet">
+
+ https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"</a>;>
+
+
+
+
+
+ https://beam.apache.org/blog/2018/10/31/beam-summit-aftermath.html";
data-proofer-ignore>
+
+ https://beam.apache.org/feed.xml";>
+ https://use.fontawesome.com/releases/v5.4.1/css/all.css";
integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz"
crossorigin="anonymous">
+
+
(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new
Date();a=s.createElement(o),
+
m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+
})(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+ga('create', 'UA-73650088-1', 'auto');
+ga('send', 'pageview');
+
+
+
+
+
+
+
+
+
+Toggle navigation
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ Get Started
+
+
+ Documentation
+
+
+ Languages
+
+
+ RUNNERS
+
+
+ Roadmap
+
+
+ Contribute
+
+
+ Community
+
+Blog
+
+
+
+ https://www.apache.org/foundation/press/kit/feather_small.png"; alt="Apache
Logo" style="height:20px;">
+
+http://www.apache.org/";>ASF Homepage
+http://www.apache.org/licenses/";>License
+http://www.apache.org/security/";>Security
+http://www.apache.org/foundation/thanks.html";>Thanks
+http://www.apache.org/foundation/sponsorship.html";>Sponsorship
+https://www.apache.org/foundation/policies/conduct";>Code of
Conduct
+
+
+
+ https://github.com/apache/beam/edit/master/website/src/_posts/2018-10-30-beam-summit-aftermath.md";>
+
+
+
+
+
+
+
+
+
+
+
+
+http://schema.org/BlogPosting";>
+
+
+Inaugural edition of the
Beam Summit Europe 2018 - aftermath
+Oct 31, 2018 •
+ Matthias Baetens [https://twitter.com/matthiasbaetens";>@matthiasbaetens]
+
+
+
+
+
+
+
+Almost 1 month ago, we had the pleasure to welcome the Beam community at
Level39 in London for the inaugural edition of the Beam Summit London Summit.
+
+Day 1
of the first Beam Summit London going full speed ahead! Sessions by https://twitter.com/SkyUK?ref_src=twsrc%5Etfw";>@SkyUK https://twitter.com/GCPcloud?ref_src=twsrc%5Etfw";>@GCPcloud https://twitter.com/Talend?ref_src=twsrc%5Etfw";>@Talend https://twitter.com/PlantixApp?ref_src=twsrc%5Etfw";>@PlantixApp and
more! https://twitter.com/hashtag/ApacheBeam?sr [...]
+https://platform.twitter.com/widgets.js"</a>;
charset="utf-8">
+
+First edition!
+
+This first edition of the summit was a free event, with over 125 RSVPs. We
had two days of content; day one was focused on the roadmap of the project, the
ASF and use cases from companies that use Beam. The second day was divided into
tracks (a beginner and an advanced track). Those presentations & workshops
were organised for the more than 80 attendees - and next to
that there were several other activities like discussio
[beam] branch asf-site updated: Publishing website 2018/11/02 20:48:33 at commit f0baa40
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 9a268a4 Publishing website 2018/11/02 20:48:33 at commit f0baa40
9a268a4 is described below
commit 9a268a4bfd35495789eebb337b068e37251eee10
Author: jenkins
AuthorDate: Fri Nov 2 20:48:33 2018 +
Publishing website 2018/11/02 20:48:33 at commit f0baa40
---
.../contribute/become-a-committer/index.html | 5 +-
.../contribute/committer-guide/index.html | 5 +-
.../contribute/dependencies/index.html | 5 +-
.../contribute/design-documents/index.html | 5 +-
.../contribute/docker-images/index.html| 5 +-
.../contribute/feature-branches/index.html | 5 +-
.../{precommit-policies => get-help}/index.html| 81 +++---
website/generated-content/contribute/index.html| 73 ---
.../contribute/postcommits-guides/index.html | 5 +-
.../postcommits-policies-details/index.html| 5 +-
.../contribute/postcommits-policies/index.html | 5 +-
.../contribute/precommit-policies/index.html | 5 +-
.../contribute/precommit-triage-guide/index.html | 5 +-
.../contribute/ptransform-style-guide/index.html | 5 +-
.../contribute/release-guide/index.html| 5 +-
.../contribute/runner-guide/index.html | 5 +-
.../contribute/testing/index.html | 5 +-
.../get-started/beam-overview/index.html | 2 +-
18 files changed, 72 insertions(+), 159 deletions(-)
diff --git a/website/generated-content/contribute/become-a-committer/index.html
b/website/generated-content/contribute/become-a-committer/index.html
index f0f76ca..a9e47b8 100644
--- a/website/generated-content/contribute/become-a-committer/index.html
+++ b/website/generated-content/contribute/become-a-committer/index.html
@@ -147,12 +147,11 @@
Contribute
Get started contributing
-https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>FAQ
+Get Help
Technical Docs
-Roadmap
Testing guide
Pre-commit Slowness
Triage
PTransform style
guide
@@ -173,13 +172,11 @@
Committers
-PMC and committers
Become a committer
Committer guide
Release guide
-Contact Us
diff --git a/website/generated-content/contribute/committer-guide/index.html
b/website/generated-content/contribute/committer-guide/index.html
index 25a601f..5974a9c 100644
--- a/website/generated-content/contribute/committer-guide/index.html
+++ b/website/generated-content/contribute/committer-guide/index.html
@@ -147,12 +147,11 @@
Contribute
Get started contributing
-https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>FAQ
+Get Help
Technical Docs
-Roadmap
Testing guide
Pre-commit Slowness
Triage
PTransform style
guide
@@ -173,13 +172,11 @@
Committers
-PMC and committers
Become a committer
Committer guide
Release guide
-Contact Us
diff --git a/website/generated-content/contribute/dependencies/index.html
b/website/generated-content/contribute/dependencies/index.html
index b12785e..6ad5574 100644
--- a/website/generated-content/contribute/dependencies/index.html
+++ b/website/generated-content/contribute/dependencies/index.html
@@ -147,12 +147,11 @@
Contribute
Get started contributing
-https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>FAQ
+Get Help
Technical Docs
-Roadmap
Testing guide
Pre-commit Slowness
Triage
PTransform style
guide
@@ -173,13 +172,11 @@
Committers
-PMC and committers
Become a committer
Committer guide
Release guide
-Contact Us
diff --git a/website/generated-content/contribute/design-documents/index.html
b/website/generated-content/contribute/design-documents/index.html
index 1345584..511d782 100644
--- a/website/generated-content/contribute/design-documents/index.html
+++ b/website/generated-content/contribute/design-documents/index.html
@@ -147,12 +147,11 @@
Contribute
Get started contributing
-https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>FAQ
+Get Help
Technical Docs
-Roadmap
Testing guide
Pre-commit Slowness
Triage
PTransform style
guide
@@ -173,13 +172,11 @@
Committers
-PMC and committers
Become a committer
Committer guide
Release guide
-Contact Us
diff --git a/website/generated-content/contribute/docker-images/index.html
b/website/generated-content/contribute/docker-images/index.html
index bef0076..6667146 100644
--- a/website/generated-content/contri
[beam] branch asf-site updated: Publishing website 2018/11/02 23:11:46 at commit c26d58a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new f7fee66 Publishing website 2018/11/02 23:11:46 at commit c26d58a f7fee66 is described below commit f7fee66fc58dc9b3a2c93f91877ce2bf2741743e Author: jenkins AuthorDate: Fri Nov 2 23:11:46 2018 + Publishing website 2018/11/02 23:11:46 at commit c26d58a --- .../generated-content/contribute/get-help/index.html | 2 +- website/generated-content/contribute/index.html | 20 ++-- 2 files changed, 11 insertions(+), 11 deletions(-) diff --git a/website/generated-content/contribute/get-help/index.html b/website/generated-content/contribute/get-help/index.html index a65b230..58d183d 100644 --- a/website/generated-content/contribute/get-help/index.html +++ b/website/generated-content/contribute/get-help/index.html @@ -221,7 +221,7 @@ limitations under the License. If you have any trouble contributing, don’t give up! - Check the https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ"; target="_blank">FAQ on our developers’ wiki . + Check the https://cwiki.apache.org/confluence/display/BEAM/Contributor+FAQ"; target="_blank">FAQ on our developers’ wiki . Send email to the Beam developer community on d...@beam.apache.org Find someone to chat with in realtime at #beam on Slack. diff --git a/website/generated-content/contribute/index.html b/website/generated-content/contribute/index.html index edb1b65..471eb5d 100644 --- a/website/generated-content/contribute/index.html +++ b/website/generated-content/contribute/index.html @@ -198,9 +198,9 @@ - Prerequisites for contributing code Contributing code + Prerequisites Connect With the Beam community Share your intent Development Setup @@ -256,13 +256,18 @@ Cloud Dataflow, etc) work on the core programming model (what is a Beam pipeline and how does it run?) improve the developer experience (for example, Windows guides) - add answers to the https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>contribution FAQ + add answers to the https://cwiki.apache.org/confluence/display/BEAM/Contributor+FAQ";>contribution FAQ organize local meetups of users or contributors to Apache Beam Most importantly, if you have an idea of how to contribute, then do it! -Prerequisites for contributing code +Contributing code + +Below is a tutorial for contributing code to Beam, covering our tools and typical process in +detail. + +Prerequisites To contribute code, you need @@ -278,11 +283,6 @@ Agreement (ICLA) to the Apache Software Foundation (ASF). -Contributing code - -Below is a tutorial for contributing code to Beam, covering our tools and typical process in -detail. - Connect With the Beam community @@ -370,7 +370,7 @@ environment. See the Developers’ wiki for tips, guides, and FAQs on: https://cwiki.apache.org/confluence/display/BEAM/Website+Tips";>Website https://cwiki.apache.org/confluence/display/BEAM/Gradle+Tips";>Gradle https://cwiki.apache.org/confluence/display/BEAM/Jenkins+Tips";>Jenkins - https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>FAQ + https://cwiki.apache.org/confluence/display/BEAM/Contributor+FAQ";>FAQ @@ -480,7 +480,7 @@ intensive efforts, check out the roadmap. Troubleshooting -If you run into any issues, check out the https://cwiki.apache.org/confluence/display/BEAM/Development+Environment+FAQ";>contribution FAQ or ask on +If you run into any issues, check out the https://cwiki.apache.org/confluence/display/BEAM/Contributor+FAQ";>contribution FAQ or ask on on the dev@ mailing list or #beam channel of the ASF slack. —-
[beam] branch asf-site updated: Publishing website 2018/11/03 13:17:25 at commit ced2dbc
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new b5073dc Publishing website 2018/11/03 13:17:25 at commit ced2dbc b5073dc is described below commit b5073dc0bf9ec24ce82f2967231e908660ad1555 Author: jenkins AuthorDate: Sat Nov 3 13:17:26 2018 + Publishing website 2018/11/03 13:17:25 at commit ced2dbc --- .../blog/2018/10/31/beam-summit-aftermath.html | 10 +- website/generated-content/feed.xml | 10 +- 2 files changed, 10 insertions(+), 10 deletions(-) diff --git a/website/generated-content/blog/2018/10/31/beam-summit-aftermath.html b/website/generated-content/blog/2018/10/31/beam-summit-aftermath.html index e8d0182..93f0754 100644 --- a/website/generated-content/blog/2018/10/31/beam-summit-aftermath.html +++ b/website/generated-content/blog/2018/10/31/beam-summit-aftermath.html @@ -210,11 +210,11 @@ Google, Spotify, Talend, Sky, Amazon, Data Artisans, Datatonic, Vente Exclusive, Day 2: Beginners track - https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI";>Day 2 - Beginner - Session 1 - Development Environment with Apache Beam - https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI";>Day 2 - Beginner - Session 2 - Towards Portability and Beyond - https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI";>Day 2 - Beginner - Session 3 - Python Streaming Pipelines with Beam on Flink - https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI";>Day 2 - Beginner - Session 4 - How runners execute a Beam pipeline - https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI";>Day 2 - Beginner - Session 5 - IO Integration Testing framework in Apache Beam + https://drive.google.com/open?id=1ntQEDhb8gkxof4uFftxWTOfN39laUDZU7IDHTPKWrcQ";>Day 2 - Beginner - Session 1 - Development Environment with Apache Beam + https://drive.google.com/open?id=0B4bFLXEWuluSWWJBWXV3ZTdseWpJN1o5UFdpSzV4Qi1sSGU0";>Day 2 - Beginner - Session 2 - Towards Portability and Beyond + https://drive.google.com/open?id=0B4bFLXEWuluSLTd6TFlYdFZZYjBTOFZQV3MxZzlPLWROWjZv";>Day 2 - Beginner - Session 3 - Python Streaming Pipelines with Beam on Flink + https://drive.google.com/open?id=0B4bFLXEWuluSMEV1a1cwM3ozeWQ4TkxlS0tFcnNtRGNGcjJ3";>Day 2 - Beginner - Session 4 - How runners execute a Beam pipeline + https://drive.google.com/open?id=1QyqO8zJ3fIWD5DTnr1JNCEbm2dS15c1c02fI8zD-zqY";>Day 2 - Beginner - Session 5 - IO Integration Testing framework in Apache Beam Day 2: Advanced track diff --git a/website/generated-content/feed.xml b/website/generated-content/feed.xml index bac7abd..dea4452 100644 --- a/website/generated-content/feed.xml +++ b/website/generated-content/feed.xml @@ -78,11 +78,11 @@ Google, Spotify, Talend, Sky, Amazon, Data Artisans, Datatonic, Vente Exclusive, <h3 id="day-2-beginners-track">Day 2: Beginners track</h3> <ul> - <li><a href="https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI">Day 2 - Beginner - Session 1 - Development Environment with Apache Beam</a></li> - <li><a href="https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI">Day 2 - Beginner - Session 2 - Towards Portability and Beyond</a></li> - <li><a href="https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI">Day 2 - Beginner - Session 3 - Python Streaming Pipelines with Beam on Flink</a></li> - <li><a href="https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI">Day 2 - Beginner - Session 4 - How runners execute a Beam pipeline</a></li> - <li><a href="https://drive.google.com/open?id=1aFH6lhnVIq4Alu-_HItQ0QOddEPJQRqI5jV_t0o3CYI">Day 2 - Beginner - Session 5 - IO Integration Testing framework in Apache Beam</a></li> + <li><a href="https://drive.google.com/open?id=1ntQEDhb8gkxof4uFftxWTOfN39laUDZU7IDHTPKWrcQ">Day 2 - Beginner - Session 1 - Development Environment with Apache Beam</a></li> + <li><a href="https://drive.google.com/open?id=0B4bFLXEWuluSWWJBWXV3ZTdseWpJN1o5UFdpSzV4Qi1sSGU0">Day 2 - Beginner - Session 2 - Towards Portability and Beyond</a></li> + <li><a href="https://drive.google.com/open?id=0B4bFLXEWuluSLTd6TFlYdFZZYjBTOFZQV3MxZzlPLWROWjZv">Day 2 - Beginner - Session 3 - Python Streaming Pipelines with Beam on Flink</a></li> + <l
[beam] branch asf-site updated: Publishing website 2018/11/03 14:34:38 at commit c6acd12
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 7a24eec Publishing website 2018/11/03 14:34:38 at commit c6acd12 7a24eec is described below commit 7a24eec17f8d61ec05a8ecc492e41b5203dcf367 Author: jenkins AuthorDate: Sat Nov 3 14:34:39 2018 + Publishing website 2018/11/03 14:34:38 at commit c6acd12 --- website/generated-content/documentation/runners/samza/index.html | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/website/generated-content/documentation/runners/samza/index.html b/website/generated-content/documentation/runners/samza/index.html index a123eb08..449d06d 100644 --- a/website/generated-content/documentation/runners/samza/index.html +++ b/website/generated-content/documentation/runners/samza/index.html @@ -221,14 +221,14 @@ limitations under the License. Samza Runner prerequisites and setup -The Samza Runner is built on Samza version greater than 0.14.1, and uses Scala version 2.11. +The Samza Runner is built on Samza version greater than 0.14.1. Specify your dependency You can specify your dependency on the Samza Runner by adding the following to your pom.xml: <dependency> <groupId>org.apache.beam</groupId> - <artifactId>beam-runners-samza_2.11</artifactId> + <artifactId>beam-runners-samza</artifactId> <version>2.8.0</version> <scope>runtime</scope> </dependency>
[beam] branch asf-site updated: Publishing website 2018/11/05 18:19:41 at commit 87cd769
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 57d2996 Publishing website 2018/11/05 18:19:41 at commit 87cd769 57d2996 is described below commit 57d2996f826f1d9d0a3c96370efa9b031d433699 Author: jenkins AuthorDate: Mon Nov 5 18:19:42 2018 + Publishing website 2018/11/05 18:19:41 at commit 87cd769 --- .../generated-content/contribute/feature-branches/index.html | 2 +- .../documentation/io/built-in/google-bigquery/index.html | 12 ++-- website/generated-content/roadmap/index.html | 2 +- 3 files changed, 8 insertions(+), 8 deletions(-) diff --git a/website/generated-content/contribute/feature-branches/index.html b/website/generated-content/contribute/feature-branches/index.html index 1fd1268..9d46d17 100644 --- a/website/generated-content/contribute/feature-branches/index.html +++ b/website/generated-content/contribute/feature-branches/index.html @@ -242,7 +242,7 @@ thorough and trustworthy. Establishing a feature branch If your project is large enough to need a feature branch, there should -be a discussion on the mailing list. The first step is to engage there to raise awareness +be a discussion on the mailing list. The first step is to engage there to raise awareness that you want to start a large project. Almost any project should be accepted – there is no real cost to letting a feature branch exist – but you may find other interested contributors or gain other advice from the community. diff --git a/website/generated-content/documentation/io/built-in/google-bigquery/index.html b/website/generated-content/documentation/io/built-in/google-bigquery/index.html index 41814dd..1867b21 100644 --- a/website/generated-content/documentation/io/built-in/google-bigquery/index.html +++ b/website/generated-content/documentation/io/built-in/google-bigquery/index.html @@ -347,7 +347,7 @@ to https://cloud.google.com/bigquery";>Google BigQuery tables. https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigquery";>BigQueryIO source code - BigQueryIO Javadoc + https://beam.apache.org/releases/javadoc/2.8.0/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.html";>BigQueryIO Javadoc https://cloud.google.com/bigquery/docs";>Google BigQuery documentation @@ -360,7 +360,7 @@ running pip install apache-beam[gcp]. https://github.com/apache/beam/blob/master/sdks/python/apache_beam/io/gcp/bigquery.py";>BigQueryIO source code - BigQueryIO Pydoc + https://beam.apache.org/releases/pydoc/2.8.0/apache_beam.io.gcp.bigquery.html";>BigQueryIO Pydoc https://cloud.google.com/bigquery/docs";>Google BigQuery documentation @@ -410,10 +410,10 @@ table name. You can also omit project_id and use the [dataset_id].[table_id] format. If you omit the project ID, Beam uses the default project ID from your - pipeline options. + https://beam.apache.org/releases/javadoc/2.8.0/org/apache/beam/sdk/extensions/gcp/options/GcpOptions.html";>pipeline options. - pipeline options. + https://beam.apache.org/releases/javadoc/2.8.0/apache_beam.options.pipeline_options.html#apache_beam.options.pipeline_options.GoogleCloudOptions";>pipeline options. String tableSpec = "samples.weather_stations"; @@ -447,7 +447,7 @@ the three parts of the BigQuery table name. -The Beam SDK for Java also provides the parseTableSpec +The Beam SDK for Java also provides the https://beam.apache.org/releases/javadoc/2.8.0/org/apache/beam/sdk/io/gcp/bigquery/BigQueryHelpers.html";>parseTableSpec helper method, which constructs a TableReference object from a String that contains the fully-qualified BigQuery table name. However, the static factory methods for BigQueryIO transforms accept the table name as a String and @@ -908,7 +908,7 @@ do not set the triggering frequency. You can use withMethod to specify the desired insertion method. See -Write.Method +https://beam.apache.org/releases/javadoc/2.8.0/org/apache/beam/sdk/io/gcp/bigquery/BigQueryIO.Write.Method.html";>Write.Method for the list of the available methods and their restrictions. Note: If you use batch loads in a streaming pipeline, you must use diff --git a/website/generated-content/roadmap/index.html b/website/generated-content/roadmap/index.html index 14c12d5..f76f768 100644 --- a/website/generated-content/roadmap/index.html +++ b/website/generated-content/roadmap/index.html @@ -262,7 +262,7 @@ This is also a great opportunity for lightweight contribution! The Java SDK is eager to add support for Java’s first new LTS (Long Term Support) version. See details on -the Java SDK’s Roadmap. +the Java SDK’s Roadmap. SQL
[beam] branch asf-site updated: Publishing website 2018/11/06 13:02:50 at commit 916c3b4
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 17ea9ff Publishing website 2018/11/06 13:02:50 at commit 916c3b4 17ea9ff is described below commit 17ea9ffac97e1fcbac250ed422ed92cf854e0b22 Author: jenkins AuthorDate: Tue Nov 6 13:02:50 2018 + Publishing website 2018/11/06 13:02:50 at commit 916c3b4 --- website/generated-content/roadmap/portability/index.html | 10 +++--- 1 file changed, 7 insertions(+), 3 deletions(-) diff --git a/website/generated-content/roadmap/portability/index.html b/website/generated-content/roadmap/portability/index.html index 9950a2f..1214503 100644 --- a/website/generated-content/roadmap/portability/index.html +++ b/website/generated-content/roadmap/portability/index.html @@ -355,7 +355,11 @@ their respective components. Status -MVP in progress (near completion for Flink runner). See the +MVP, and FeatureCompletness nearly done (missing SDF, timers) for +SDKs, Python ULR, and shared java runners library. +Flink is the first runner to fully leverage this, with focus moving to +Performance. +See the https://s.apache.org/apache-beam-portability-support-table";>Portability support table for details. @@ -375,11 +379,11 @@ To run a basic Python wordcount (in batch mode) with embedded Flink: To run on a separate https://ci.apache.org/projects/flink/flink-docs-release-1.5/quickstart/setup_quickstart.html";>Flink cluster: - Start local Flink cluster + Start Flink cluster (e.g. locally on localhost:8081) Create shaded JobService jar: ./gradlew :beam-runners-flink_2.11-job-server:installShadowDist Optional optimization step: Place the generated JobServer Jar beam/runners/flink/job-server/build/libs/beam-runners-flink_2.11-job-server-2.7.0-SNAPSHOT.jar in flink/lib and change class loading order for Flink by adding classloader.resolve-order: parent-first to conf/flink-conf.yaml. Start JobService with Flink web service endpoint: ./gradlew :beam-runners-flink_2.11-job-server:runShadow -PflinkMasterUrl=localhost:8081 - Submit the pipeline. + Submit the pipeline as above.
[beam] branch asf-site updated: Publishing website 2018/11/09 17:30:40 at commit f911be4
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e969cc2 Publishing website 2018/11/09 17:30:40 at commit f911be4
e969cc2 is described below
commit e969cc2034711412bf1b0859810105788f30c98c
Author: jenkins
AuthorDate: Fri Nov 9 17:30:41 2018 +
Publishing website 2018/11/09 17:30:40 at commit f911be4
---
.../documentation/sdks/java/euphoria/index.html| 156 -
1 file changed, 57 insertions(+), 99 deletions(-)
diff --git
a/website/generated-content/documentation/sdks/java/euphoria/index.html
b/website/generated-content/documentation/sdks/java/euphoria/index.html
index 737ec98..d5db0a5 100644
--- a/website/generated-content/documentation/sdks/java/euphoria/index.html
+++ b/website/generated-content/documentation/sdks/java/euphoria/index.html
@@ -243,13 +243,11 @@
WordCount Example
Euphoria Guide
- Datasets
Inputs and Outputs
Adding Operators
Coders and Types
Metrics and Accumulators
Windowing
- Integration of Euphoria
into existing pipelines
How to get Euphoria
@@ -311,7 +309,7 @@ For each of the assigned windows the extracted value is
accumulated using a user
-->
What is Euphoria
-Easy to use Java 8 API build on top of the Beam’s Java SDK. API provides a
high-level abstraction of data
transformations, with focus on the Java 8 language features (e.g. lambdas and
streams). It is fully inter-operable with existing Beam SDK and convertible
back and forth. It allows fast prototyping through use of (optional) https://github.com/EsotericSoftware/kryo";>Kryo based coders, lambdas
and high level operators and can be Easy to use Java 8 API build on top of the Beam’s Java SDK. API provides a
high-level abstraction of data
transformations, with focus on the Java 8 language features (e.g. lambdas and
streams). It is fully inter-operable with existing Beam SDK and convertible
back and forth. It allows fast prototyping through use of (optional) https://github.com/EsotericSoftware/kryo";>Kryo based coders, lambdas
and high level operators and can be seamless [...]
https://github.com/seznam/euphoria";>Euphoria API project has
been started in 2014, with a clear goal of providing the main building block
for https://www.seznam.cz/";>Seznam.cz’s data infrastructure.
In 2015, http://www.vldb.org/pvldb/vol8/p1792-Akidau.pdf";>DataFlow
whitepaper inspired original authors to go one step further and also
provide the unified API for both stream and batch processing.
@@ -334,12 +332,8 @@ the API as a high level DSL over Beam Java SDK and share
our effort with the com
.apply(Create.of(textLineByLine))
.setTypeDescriptor(TypeDescriptor.of(String.class));
-// Transform PCollection to euphoria's Dataset.
-Dataset<String> lines
= Dataset.of(input);
-
-// FlatMap processes one input element at a time and allows
user code to emit
// zero, one, or more output elements. From input lines we
will get data set of words.
-Dataset<String> words
=
+PCollection<String> words
=
FlatMap.named("TOKENIZER")
.of(lines)
.using(
@@ -352,26 +346,23 @@ the API as a high level DSL over Beam Java SDK and share
our effort with the com
// Now we can count input words - the operator ensures that
all values for the same
// key (word in this case) end up being processed together.
Then it counts number of appearances
-// of the same key in 'words' dataset and emits it to
output.
-Dataset<KV<String, Long>> counted =
+// of the same key in 'words' PCollection and emits it to
output.
+PCollection<KV<String, Long>> counted =
CountByKey.named("COUNT")
.of(words)
.keyBy(w -> w)
.output();
// Format output.
-Dataset<String> output =
+PCollection<String> output =
MapElements.named("FORMAT")
.of(counted)
.using(p -> p.getKey() + ": " + p.getValue())
.output();
-// Transform Dataset back to PCollection. It can be done
anytime.
-PCollection<String> outputCollection = output.getPCollection();
-
// Now we can again use Beam transformation. In this case we
save words and their count
// into the text file.
-outputCollection
+output
.apply(TextIO.write()
.to("counted_words"));
@@ -383,38 +374,23 @@ the API as a high level DSL over Beam Java SDK and share
our effort with the com
Euphoria API is composed from a set of operators, which allows you to
construct Pipeline according to your
application needs.
-Datasets
-Euphoria uses the concept of ‘Datasets’ to describe data pipeline between
Operators. This con
[beam] branch asf-site updated: Publishing website 2018/11/12 06:06:33 at commit da8cbc9
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 7eda829 Publishing website 2018/11/12 06:06:33 at commit da8cbc9 7eda829 is described below commit 7eda829c5257ee098332af1cec1a3f1aa8e73677 Author: jenkins AuthorDate: Mon Nov 12 06:06:33 2018 + Publishing website 2018/11/12 06:06:33 at commit da8cbc9 --- .../generated-content/documentation/sdks/python-streaming/index.html| 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/documentation/sdks/python-streaming/index.html b/website/generated-content/documentation/sdks/python-streaming/index.html index 2c9c7f0..b25728e 100644 --- a/website/generated-content/documentation/sdks/python-streaming/index.html +++ b/website/generated-content/documentation/sdks/python-streaming/index.html @@ -357,7 +357,7 @@ testing purposes, you can use the commands in the https://cloud.google. The following simple bash script feeds lines of an input text file to your input topic: -cat <YOUR_LOCAL_TEXT_FILE> | while read line; do gcloud pubsub topics publish <YOUR_INPUT_TOPIC_NAME> “ $line”; done +cat <YOUR_LOCAL_TEXT_FILE> | while read line; do gcloud pubsub topics publish <YOUR_INPUT_TOPIC_NAME> --message "$line"; done
[beam] branch asf-site updated: Publishing website 2018/11/12 11:11:05 at commit 8c99d2f
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new a6bedcc Publishing website 2018/11/12 11:11:05 at commit 8c99d2f a6bedcc is described below commit a6bedccb506d3bace77ee11d2ad98928e544fa8c Author: jenkins AuthorDate: Mon Nov 12 11:11:05 2018 + Publishing website 2018/11/12 11:11:05 at commit 8c99d2f --- website/generated-content/documentation/io/built-in/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/documentation/io/built-in/index.html b/website/generated-content/documentation/io/built-in/index.html index af229f7..8120e71 100644 --- a/website/generated-content/documentation/io/built-in/index.html +++ b/website/generated-content/documentation/io/built-in/index.html @@ -326,7 +326,7 @@ limitations under the License. Apache Hive (HCatalog) https://github.com/apache/beam/tree/master/sdks/java/io/kudu";>Apache Kudu https://github.com/apache/beam/tree/master/sdks/java/io/solr";>Apache Solr -https://github.com/apache/beam/tree/master/sdks/java/io/elasticsearch";>Elasticsearch (v2.x and v5.x) +https://github.com/apache/beam/tree/master/sdks/java/io/elasticsearch";>Elasticsearch (v2.x, v5.x, v6.x) Google BigQuery https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/bigtable";>Google Cloud Bigtable https://github.com/apache/beam/tree/master/sdks/java/io/google-cloud-platform/src/main/java/org/apache/beam/sdk/io/gcp/datastore";>Google Cloud Datastore
[beam] branch asf-site updated: Publishing website 2018/11/12 16:12:29 at commit 7d8271e
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 62c0e9a Publishing website 2018/11/12 16:12:29 at commit 7d8271e 62c0e9a is described below commit 62c0e9a40c1e12681dd9f2c3f6bca0d1b3762390 Author: jenkins AuthorDate: Mon Nov 12 16:12:30 2018 + Publishing website 2018/11/12 16:12:29 at commit 7d8271e --- website/generated-content/roadmap/euphoria/index.html | 1 - 1 file changed, 1 deletion(-) diff --git a/website/generated-content/roadmap/euphoria/index.html b/website/generated-content/roadmap/euphoria/index.html index f8e7a2b..d93b6a4 100644 --- a/website/generated-content/roadmap/euphoria/index.html +++ b/website/generated-content/roadmap/euphoria/index.html @@ -222,7 +222,6 @@ limitations under the License. This roadmap is in progress. In the meantime, here are some resources: - Feature branch: https://github.com/apache/beam/tree/dsl-euphoria";>dsl-euphoria JIRA: https://issues.apache.org/jira/browse/BEAM-4366?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-euphoria";>dsl-euphoria / https://issues.apache.org/jira/browse/BEAM-3900";>BEAM-3900 Contact: mailto:david.mora...@gmail.com";>David Moravek
[beam] branch asf-site updated: Publishing website 2018/11/13 09:47:02 at commit 623e2f6
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 5f82aa5 Publishing website 2018/11/13 09:47:02 at commit 623e2f6 5f82aa5 is described below commit 5f82aa566da54b3053de73504089af8678671377 Author: jenkins AuthorDate: Tue Nov 13 09:47:03 2018 + Publishing website 2018/11/13 09:47:02 at commit 623e2f6 --- website/generated-content/documentation/runners/flink/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/documentation/runners/flink/index.html b/website/generated-content/documentation/runners/flink/index.html index 329f933..c73fc26 100644 --- a/website/generated-content/documentation/runners/flink/index.html +++ b/website/generated-content/documentation/runners/flink/index.html @@ -256,7 +256,7 @@ limitations under the License. Flink version - 2.7.0, 2.6.0 + 2.8.0, 2.7.0, 2.6.0 1.5.x
[beam] branch asf-site updated: Publishing website 2018/11/13 16:06:58 at commit ecb57dd
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 1405ee2 Publishing website 2018/11/13 16:06:58 at commit ecb57dd 1405ee2 is described below commit 1405ee2d64eb228b61e94cf5b33d7747c7d67d32 Author: jenkins AuthorDate: Tue Nov 13 16:06:58 2018 + Publishing website 2018/11/13 16:06:58 at commit ecb57dd --- .../documentation/sdks/java/euphoria/index.html| 75 +++--- 1 file changed, 66 insertions(+), 9 deletions(-) diff --git a/website/generated-content/documentation/sdks/java/euphoria/index.html b/website/generated-content/documentation/sdks/java/euphoria/index.html index d5db0a5..8f65e97 100644 --- a/website/generated-content/documentation/sdks/java/euphoria/index.html +++ b/website/generated-content/documentation/sdks/java/euphoria/index.html @@ -270,11 +270,14 @@ AssignEventTime - Euphoria To Beam Translation (advanced user section) + Translation - Unsupported Features + TranslationProviders + Operator Translators + Details + Unsupported Features @@ -580,7 +583,7 @@ the API as a high level DSL over Beam Java SDK and share our effort with the com // KV(3, "3+rat"), KV(1, "1+X")] -Euphoria support performance optimization called ‘BroadcastHashJoin’ for the LeftJoin. User can indicate through previous operator’s output hint .output(SizeHint.FITS_IN_MEMORY) that output PCollection of that operator fits in executors memory. And when the PCollection is used as right input, Euphoria will automatically translated [...] +Euphoria support performance optimization called ‘BroadcastHashJoin’ for the LeftJoin. Broadcast join can be very efficient when joining two datasets where one fits in memory (in LeftJoin right dataset has to fit in memory). How to use ‘Broadcast Hash Join’ is described in Translation section. RightJoin Represents right join of two (left and right) datasets on given key producing single new dataset. Key is extracted from both datasets by separate extractors so elements in left and right can have different types denoted as LeftT and RightT. The join itself is performed by user-supplied BinaryFunctor which consumes one element from both dataset, where left is present opt [...] @@ -599,7 +602,7 @@ the API as a high level DSL over Beam Java SDK and share our effort with the com // KV(8, "null+elephant"), KV(5, "null+mouse")] -Euphoria support performance optimization called ‘Broadcast Hash Join’ for the RightJoin. User can indicate through previous operator’s output hint .output(SizeHint.FITS_IN_MEMORY) that output PCollection of that operator fits in executors memory. And when the PCollection is used as left input, Euphoria will automatically translate [...] +Euphoria support performance optimization called ‘BroadcastHashJoin’ for the RightJoin. Broadcast join can be very efficient when joining two datasets where one fits in memory (in RightJoin left dataset has to fit in memory). How to use ‘Broadcast Hash Join’ is described in Translation section. FullJoin Represents full outer join of two (left and right) datasets on given key producing single new dataset. Key is extracted from both datasets by separate extractors so elements in left and right can have different types denoted as LeftT and RightT. The join itself is performed by user-supplied BinaryFunctor which consumes one element from both dataset, where both are prese [...] @@ -804,20 +807,74 @@ the API as a high level DSL over Beam Java SDK and share our effort with the com -Euphoria To Beam Translation (advanced user section) -Euphoria API is build on top of Beam Java SDK. The API is transparently translated into Beam’s PTransforms in background. Most of the translation happens in org.apache.beam.sdk.extensions.euphoria.core.translate package. Where the most interesting classes are: +Translation +Euphoria API is build on top of Beam Java SDK. The API is transparently translated into Beam’s PTransforms in background. + +The fact that Euphoria API is translated to Beam Java SDK give us option to fine tune the translation itself. Translation of an Operator is realized through implementations of OperatorTranslator. +Euphoria uses TranslationProvider to decide which translator should be used. User of Euphoria API can supply its own OperatorTranslator through TranslationProvider by extending EuphoriaOptions. +Euphoria already contains some useful implementations. + +TranslationProviders +GenericTranslatorProvider +General TranslationProvider. Allows for registration of OperatorTranslator three different ways: + + Registration of operator specific translator by operator class. + Registration operator specific translator by ope
[beam] branch asf-site updated: Publishing website 2018/11/13 17:04:53 at commit f2f0b02
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 9b8d2bd Publishing website 2018/11/13 17:04:53 at commit f2f0b02
9b8d2bd is described below
commit 9b8d2bd6c85b571252cec9f2791f59a3abc278d1
Author: jenkins
AuthorDate: Tue Nov 13 17:04:53 2018 +
Publishing website 2018/11/13 17:04:53 at commit f2f0b02
---
.../roadmap/apex-runner/index.html | 10 +
.../{apex-runner => connectors-go-sdk}/index.html | 31 ++
.../{python-sdk => connectors-java-sdk}/index.html | 43 ---
.../index.html | 49 +++---
.../{java-sdk => connectors-python-sdk}/index.html | 36 +---
.../roadmap/dataflow-runner/index.html | 10 +
.../generated-content/roadmap/euphoria/index.html | 10 +
.../roadmap/flink-runner/index.html| 10 +
.../roadmap/gearpump-runner/index.html | 10 +
.../generated-content/roadmap/go-sdk/index.html| 10 +
website/generated-content/roadmap/index.html | 10 +
.../generated-content/roadmap/java-sdk/index.html | 10 +
.../roadmap/portability/index.html | 10 +
.../roadmap/python-sdk/index.html | 10 +
.../roadmap/samza-runner/index.html| 10 +
.../roadmap/spark-runner/index.html| 10 +
website/generated-content/roadmap/sql/index.html | 10 +
17 files changed, 236 insertions(+), 53 deletions(-)
diff --git a/website/generated-content/roadmap/apex-runner/index.html
b/website/generated-content/roadmap/apex-runner/index.html
index b18ce7c..f279996 100644
--- a/website/generated-content/roadmap/apex-runner/index.html
+++ b/website/generated-content/roadmap/apex-runner/index.html
@@ -176,6 +176,16 @@
Samza Runner
+
+ Connectors
+
+
+Java SDK
+Python SDK
+Go SDK
+Multi-SDK Efforts
+
+
diff --git a/website/generated-content/roadmap/apex-runner/index.html
b/website/generated-content/roadmap/connectors-go-sdk/index.html
similarity index 92%
copy from website/generated-content/roadmap/apex-runner/index.html
copy to website/generated-content/roadmap/connectors-go-sdk/index.html
index b18ce7c..3c2bbc4 100644
--- a/website/generated-content/roadmap/apex-runner/index.html
+++ b/website/generated-content/roadmap/connectors-go-sdk/index.html
@@ -28,7 +28,7 @@
- Samza Runner Roadmap
+ Connectors - Go SDK
https://fonts.googleapis.com/css?family=Roboto:100,300,400";
rel="stylesheet">
@@ -39,7 +39,7 @@
- https://beam.apache.org/roadmap/apex-runner/";
data-proofer-ignore>
+ https://beam.apache.org/roadmap/connectors-go-sdk/"; data-proofer-ignore>
https://beam.apache.org/feed.xml";>
https://use.fontawesome.com/releases/v5.4.1/css/all.css";
integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz"
crossorigin="anonymous">
@@ -125,7 +125,7 @@
GitHub links will not resolve until the markdown source is
available on the master branch.
New pages would fail validation during development / PR test
automation.
-->
- https://github.com/apache/beam/edit/master/website/src/roadmap/apex-runner.md";
data-proofer-ignore>
+ https://github.com/apache/beam/edit/master/website/src/roadmap/connectors-go-sdk.md";
data-proofer-ignore>
@@ -176,6 +176,16 @@
Samza Runner
+
+ Connectors
+
+
+Java SDK
+Python SDK
+Go SDK
+Multi-SDK Efforts
+
+
@@ -215,13 +225,18 @@ See the License for the specific language governing
permissions and
limitations under the License.
-->
-Apache Apex Runner Roadmap
-
-This roadmap is in progress. In the meantime, here are available
resources:
+Roadmap for connectors developed using Go SDK.
- Runner documentation
- JIRA: https://issues.apache.org/jira/issues/?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20runner-apex";>runner-apex
+
+We hope to add a Splittable DoFn implementation to Go SDK to support
developing new sources. In the
+meantime bounded sources can be developed in the form of ParDos. See
+https://beam.apache.org/documentation/io/authoring-overview/";>Authoring
I/O Transforms for more details.
+
+
+Go SDK plans to utilize currently available Java and Python connectors
+through cross-language transforms feature.
+
diff --git a/website/generated-content/roadmap/python-sdk/index.html
b/website/generated-content/roadmap/connectors-java-sdk/index.html
similarity index 90%
copy from website/generated
[beam] branch asf-site updated: Publishing website 2018/11/16 21:19:04 at commit 75e9f64
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 1dc36a3 Publishing website 2018/11/16 21:19:04 at commit 75e9f64 1dc36a3 is described below commit 1dc36a3fcd170d472d9d8349f21a2322605aa305 Author: jenkins AuthorDate: Fri Nov 16 21:19:05 2018 + Publishing website 2018/11/16 21:19:04 at commit 75e9f64 --- website/generated-content/blog/2018/10/03/beam-2.7.0.html | 2 +- website/generated-content/blog/index.html | 2 +- website/generated-content/feed.xml | 2 +- website/generated-content/get-started/downloads/index.html | 6 -- 4 files changed, 7 insertions(+), 5 deletions(-) diff --git a/website/generated-content/blog/2018/10/03/beam-2.7.0.html b/website/generated-content/blog/2018/10/03/beam-2.7.0.html index d5eb60c..add12b7 100644 --- a/website/generated-content/blog/2018/10/03/beam-2.7.0.html +++ b/website/generated-content/blog/2018/10/03/beam-2.7.0.html @@ -173,7 +173,7 @@ limitations under the License. --> We are happy to present the new 2.7.0 release of Beam. This release includes both improvements and new functionality. -See the download page for this release. +See the download page for this release. For more information on changes in 2.7.0, check out the https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654";>detailed release notes. diff --git a/website/generated-content/blog/index.html b/website/generated-content/blog/index.html index 2a51368..0ad4753 100644 --- a/website/generated-content/blog/index.html +++ b/website/generated-content/blog/index.html @@ -236,7 +236,7 @@ limitations under the License. --> We are happy to present the new 2.7.0 release of Beam. This release includes both improvements and new functionality. -See the download page for this release. +See the download page for this release. diff --git a/website/generated-content/feed.xml b/website/generated-content/feed.xml index dea4452..b7b42e0 100644 --- a/website/generated-content/feed.xml +++ b/website/generated-content/feed.xml @@ -259,7 +259,7 @@ limitations under the License. --> <p>We are happy to present the new 2.7.0 release of Beam. This release includes both improvements and new functionality. -See the <a href="/get-started/downloads/#270-2018-10-02">download page</a> for this release.<!--more--> +See the <a href="/get-started/downloads/#270-lts-2018-10-02">download page</a> for this release.<!--more--> For more information on changes in 2.7.0, check out the <a href="https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654">detailed release notes</a>.</p> diff --git a/website/generated-content/get-started/downloads/index.html b/website/generated-content/get-started/downloads/index.html index 1121d07..154fd9e 100644 --- a/website/generated-content/get-started/downloads/index.html +++ b/website/generated-content/get-started/downloads/index.html @@ -201,7 +201,7 @@ Releases 2.8.0 (2018-10-26) - 2.7.0 (2018-10-02) + 2.7.0 LTS (2018-10-02) 2.6.0 (2018-08-08) 2.5.0 (2018-06-06) 2.4.0 (2018-03-20) @@ -313,13 +313,15 @@ versions denoted 0.x.y. https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343985";>Release notes. -2.7.0 (2018-10-02) +2.7.0 LTS (2018-10-02) Official http://www.apache.org/dyn/closer.cgi/beam/2.7.0/apache-beam-2.7.0-source-release.zip";>source code download. https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip.sha512";>SHA-512. https://www.apache.org/dist/beam/2.7.0/apache-beam-2.7.0-source-release.zip.asc";>signature. https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12343654";>Release notes. +2.7.0 branch is https://lists.apache.org/thread.html/896cbc9fef2e60f19b466d6b1e12ce1aeda49ce5065a0b1156233f01@%3Cdev.beam.apache.org%3E";>designated by the Beam community as a https://beam.apache.org/community/policies/";>long term support (LTS) release branch. This branch will be supported for a window of 6 months starting from the day it is marked as an LTS branch ending at 2019-05-16. Beam community will decide on which issues will be backported and when pat [...] + 2.6.0 (2018-08-08) Official https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip";>source code download. https://archive.apache.org/dist/beam/2.6.0/apache-beam-2.6.0-source-release.zip.sha512";>SHA-512.
[beam] branch asf-site updated: Publishing website 2018/11/19 15:21:51 at commit e4bb78a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new cadb3c3 Publishing website 2018/11/19 15:21:51 at commit e4bb78a cadb3c3 is described below commit cadb3c3f9c47c5cadae957fb3b7024561747eb78 Author: jenkins AuthorDate: Mon Nov 19 15:21:52 2018 + Publishing website 2018/11/19 15:21:51 at commit e4bb78a --- .../sdks/java/testing/nexmark/index.html | 60 -- 1 file changed, 43 insertions(+), 17 deletions(-) diff --git a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html index b489e0c..7f7690a 100644 --- a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html +++ b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html @@ -329,25 +329,25 @@ a bid on an auction. The queries exercise many aspects of Beam model: - Query1: What are the bid values in Euro’s? + Query1 or CURRENCY_CONVERSION: What are the bid values in Euro’s? Illustrates a simple map. - Query2: What are the auctions with particular auction numbers? + Query2 or SELECTION: What are the auctions with particular auction numbers? Illustrates a simple filter. - Query3: Who is selling in particular US states? + Query3 or LOCAL_ITEM_SUGGESTION: Who is selling in particular US states? Illustrates an incremental join (using per-key state and timer) and filter. - Query4: What is the average selling price for each auction + Query4 or AVERAGE_PRICE_FOR_CATEGORY: What is the average selling price for each auction category? Illustrates complex join (using custom window functions) and aggregation. - Query5: Which auctions have seen the most bids in the last period? + Query5 or HOT_ITEMS: Which auctions have seen the most bids in the last period? Illustrates sliding windows and combiners. - Query6: What is the average selling price per seller for their + Query6 or AVERAGE_SELLING_PRICE_BY_SELLER: What is the average selling price per seller for their last 10 closed auctions. Shares the same ‘winning bids’ core as for Query4, and illustrates a specialized combiner. - Query7: What are the highest bids per period? + Query7 or HIGHEST_BID: What are the highest bids per period? Deliberately implemented using a side input to illustrate fanout. - Query8: Who has entered the system and created an auction in + Query8 or MONITOR_NEW_USERS: Who has entered the system and created an auction in the last period? Illustrates a simple join. @@ -355,20 +355,21 @@ Illustrates a simple join. We have augmented the original queries with five more: - Query0: Pass-through. + Query0 or PASSTHROUGH: Pass-through. Allows us to measure the monitoring overhead. - Query9: Winning-bids. + Query9 or WINNING_BIDS: Winning-bids. A common sub-query shared by Query4 and Query6. - Query10: Log all events to GCS files. + Query10 or LOG_TO_SHARDED_FILES: Log all events to GCS files. Illustrates windows with large side effects on firing. - Query11: How many bids did a user make in each session they + Query11 or USER_SESSIONS: How many bids did a user make in each session they were active? Illustrates session windows. - Query12: How many bids does a user make within a fixed + Query12 or PROCESSING_TIME_WINDOWS: How many bids does a user make within a fixed processing time limit? Illustrates working in processing time in the Global window, as compared with event time in non-Global windows for all the other queries. + BOUNDED_SIDE_INPUT_JOIN: Joins a stream to a bounded side input, modeling basic stream enrichment. Benchmark workload configuration @@ -482,12 +483,20 @@ or may be published to Pub/Sub or Kafka. -Run query N: +Queries can be run by their name or by their number (number is still there for backward compatibility, only the queries 0 to 12 have a number) + +Run query N: --query=N +Run query called PASSTROUGH: + +--query=PASSTHROUGH + + + Available Suites The suite to run can be chosen using this configuration parameter: @@ -497,8 +506,11 @@ or may be published to Pub/Sub or Kafka. Available suites are: - DEFAULT: Test default configuration with query 0. - SMOKE: Run the 12 default configurations. + DEFAULT: Test default configuration with query 0. + + SMOKE: Run all the queries with the default configuration. + + STRESS: Like smoke but for 1m events. FULL_THROTTLE: Like SMOKE but 100m events. @@ -682,6 +694,13 @@ or may be published to Pub/Sub or Kafka. ok ok + + BOUNDED_SIDE_INPUT_JOIN + ok + ok + ok + ok + Streaming / Synthetic / Local @@ -785,6 +804,13 @@ or may be published to Pub/Sub or Kafka
[beam] branch asf-site updated: Publishing website 2018/11/20 09:59:48 at commit 9381031
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new f5b9c6a Publishing website 2018/11/20 09:59:48 at commit 9381031 f5b9c6a is described below commit f5b9c6a55acf375fca4fba74d9b38ebecc0ac29d Author: jenkins AuthorDate: Tue Nov 20 09:59:48 2018 + Publishing website 2018/11/20 09:59:48 at commit 9381031 --- website/generated-content/community/contact-us/index.html | 6 +- .../documentation/sdks/java/testing/nexmark/index.html | 2 +- 2 files changed, 6 insertions(+), 2 deletions(-) diff --git a/website/generated-content/community/contact-us/index.html b/website/generated-content/community/contact-us/index.html index 92a80a7..4c92f8e 100644 --- a/website/generated-content/community/contact-us/index.html +++ b/website/generated-content/community/contact-us/index.html @@ -231,6 +231,10 @@ whichever one seems best! Firehose of commits, bugs, pull requests, etc. (mailto:commits-subscr...@beam.apache.org";>Subscribe1, mailto:commits-unsubscr...@beam.apache.org";>Unsubscribe1, https://lists.apache.org/list.html?commits@beam.apache.org";>Archives) + https://lists.apache.org/list.html?bui...@beam.apache.org";>builds@ mailing list + Firehose of build notifications from Jenkins (mailto:builds-subscr...@beam.apache.org";>Subscribe1, mailto:builds-unsubscr...@beam.apache.org";>Unsubscribe1, https://lists.apache.org/list.html?bui...@beam.apache.org";>Archives) + + https://issues.apache.org/jira/browse/BEAM";>JIRA bug tracker Report bugs / discover known issues @@ -249,7 +253,7 @@ whichever one seems best! - To subscribe or unsubscribe, a blank email is fine. ↩ ↩2 ↩3 ↩4 ↩5 ↩6 + To subscribe or unsubscribe, a blank email is fine. ↩ ↩2 ↩3 ↩4 ↩5 ↩6 --query=PASSTHROUGH
[beam] branch asf-site updated: Publishing website 2018/11/21 09:48:18 at commit 469c90a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new d92f580 Publishing website 2018/11/21 09:48:18 at commit 469c90a d92f580 is described below commit d92f580594ea665d3838e326b827d8f4bcb9a5a6 Author: jenkins AuthorDate: Wed Nov 21 09:48:19 2018 + Publishing website 2018/11/21 09:48:18 at commit 469c90a --- .../generated-content/roadmap/euphoria/index.html | 28 +++--- 1 file changed, 25 insertions(+), 3 deletions(-) diff --git a/website/generated-content/roadmap/euphoria/index.html b/website/generated-content/roadmap/euphoria/index.html index 1f28ad0..cb13f83 100644 --- a/website/generated-content/roadmap/euphoria/index.html +++ b/website/generated-content/roadmap/euphoria/index.html @@ -206,6 +206,12 @@ + + “Salted” join implementation + Pipeline sampling + Fluent API + Side Outputs + @@ -229,13 +235,29 @@ limitations under the License. Easy to use Java 8 DSL for the Beam Java SDK. Provides a high-level abstraction of Beam transformations, which is both easy to read and write. Can be used as a complement to existing Beam pipelines (convertible back and forth). You can have a glimpse of the API at WordCount example. -This roadmap is in progress. In the meantime, here are some resources: - JIRA: https://issues.apache.org/jira/browse/BEAM-4366?jql=project%20%3D%20BEAM%20AND%20component%20%3D%20dsl-euphoria";>dsl-euphoria / https://issues.apache.org/jira/browse/BEAM-3900";>BEAM-3900 - Contact: mailto:david.mora...@gmail.com";>David Moravek + Contact: mailto:d...@apache.org";>David Moravek +“Salted” join implementation + +Implementation of a join, that can handle large scale join of highly skewed data sets. This implementation breaks +the large keys into multiple splits, using key distribution approximated by count min sketch data structure. + +Pipeline sampling + +In order to pick the right translation for the operator without user interference, we can leverage knowledge from +previous pipeline runs. We want to provide a convenient and portable way to gather this knowledge. + +Fluent API + +Implementation of an easy to use Fluent API on top of Euphoria DSL. + +Side Outputs + +An convenient API for multiple outputs. +
[beam] branch asf-site updated: Publishing website 2018/11/21 11:19:22 at commit 8fc0667
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 0ccdf74 Publishing website 2018/11/21 11:19:22 at commit 8fc0667 0ccdf74 is described below commit 0ccdf74f118505b6543a2d8727cc2787bbe02275 Author: jenkins AuthorDate: Wed Nov 21 11:19:23 2018 + Publishing website 2018/11/21 11:19:22 at commit 8fc0667 --- website/generated-content/roadmap/euphoria/index.html | 5 + 1 file changed, 5 insertions(+) diff --git a/website/generated-content/roadmap/euphoria/index.html b/website/generated-content/roadmap/euphoria/index.html index cb13f83..98c62d7 100644 --- a/website/generated-content/roadmap/euphoria/index.html +++ b/website/generated-content/roadmap/euphoria/index.html @@ -211,6 +211,7 @@ Pipeline sampling Fluent API Side Outputs + Table-stream joins @@ -258,6 +259,10 @@ previous pipeline runs. We want to provide a convenient and portable way to gath An convenient API for multiple outputs. +Table-stream joins + +Introduce API for converting streams to tables (KStream <-> KTable approach) and various types of (windowed and unwindowed) joins on them. +
[beam] branch asf-site updated: Publishing website 2018/11/22 13:35:13 at commit 1128372
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 69493d9 Publishing website 2018/11/22 13:35:13 at commit 1128372 69493d9 is described below commit 69493d918d14490444deb4568e2ece0b415bea0a Author: jenkins AuthorDate: Thu Nov 22 13:35:13 2018 + Publishing website 2018/11/22 13:35:13 at commit 1128372 --- website/generated-content/documentation/runners/spark/index.html | 5 + 1 file changed, 5 insertions(+) diff --git a/website/generated-content/documentation/runners/spark/index.html b/website/generated-content/documentation/runners/spark/index.html index 832fd63..011e701 100644 --- a/website/generated-content/documentation/runners/spark/index.html +++ b/website/generated-content/documentation/runners/spark/index.html @@ -350,6 +350,11 @@ For more details on the different deployment modes see: http://spark.ap Enable reporting metrics to Spark's metrics Sinks. true + + cacheDisabled + Disable caching of reused PCollections for whole Pipeline. It's useful when it's faster to recompute RDD rather than save. + false + Additional notes
[beam] branch asf-site updated: Publishing website 2018/12/04 17:04:31 at commit a3a8a32
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 488328e Publishing website 2018/12/04 17:04:31 at commit a3a8a32 488328e is described below commit 488328e19f029a6524b6c56c2c5ab256f0c03260 Author: jenkins AuthorDate: Tue Dec 4 17:04:31 2018 + Publishing website 2018/12/04 17:04:31 at commit a3a8a32 --- .../contribute/committer-guide/index.html | 46 +++--- website/generated-content/contribute/index.html| 27 +++-- .../contribute/postcommits-guides/index.html | 2 +- 3 files changed, 58 insertions(+), 17 deletions(-) diff --git a/website/generated-content/contribute/committer-guide/index.html b/website/generated-content/contribute/committer-guide/index.html index 93e90c0..bd4ad74 100644 --- a/website/generated-content/contribute/committer-guide/index.html +++ b/website/generated-content/contribute/committer-guide/index.html @@ -203,6 +203,7 @@ + Pull request review objectives Always get to LGTM (“Looks good to me!”) Contributor License Agreement Tests @@ -234,6 +235,28 @@ limitations under the License. https://www.apache.org/foundation/how-it-works.html#committers";>committers and covers Beam’s guidelines for reviewing and merging code. +Pull request review objectives + +The review process aims for: + + + Review iterations should be efficient, timely and of quality (avoid tiny or out-of-context changes or huge mega-changes) + Support efficiency of authoring (don’t want to wait on a review for a tiny bit because GitHub makes it very hard to stack up reviews in sequence / don’t want to have major changes blocked because of difficulty of review) + Ease of first-time contribution (encourage to follow contribution guildelines +but committer may absorb some extra effort for new contributors) + Pull requests and commit messages establish a clear history with purpose and origin of changes + Ability to perform a granular rollback, if necessary (also see policies) + + +Granularity of changes: + + + We prefer small independent, incremental PRs with descriptive, isolated commits. Each commit is a single clear change + It is OK to keep separate commits for different logical pieces of the code, if they make reviewing and revisiting code easier + Making commits isolated is a good practice, authors should be able to relatively easily split the PR upon reviewer’s request + Generally, every commit should compile and pass tests. + + Always get to LGTM (“Looks good to me!”) After a pull request goes through rounds of reviews and revisions, it will @@ -287,16 +310,29 @@ integration tests with “Run Java PostCommit”. complete. However, the pull request may have a collection of review-related commits that are not meaningful to preserve in the history. The reviewer should give the LGTM and then request that the author of the pull request rebase, -squash, split, etc, the commits, so that the history is most useful. Favor -commits that do just one thing. The commit is the smallest unit of easy +squash, split, etc, the commits, so that the history is most useful: + + Favor commits that do just one thing. The commit is the smallest unit of easy rollback; it is easy to roll back many commits, or a whole pull request, but -harder to roll back part of a commit. +harder to roll back part of a commit. + Commit messages should tag JIRAs and be otherwise descriptive. +It should later not be necessary to find a merge or first PR commit to find out what caused a change. + Squash the “Fixup!”, “Address comments” type of commits that resulted from review iterations. + Merging it! +While it is preferred that authors squash commits after review is complete, +there may be situations where it is more practical for the committer to handle this +(such as when the action to be taken is obvious or the author isn’t available). +The committer may use the “Squash and merge” option in Github (or modify the PR commits in other ways). +The committer is ultimately responsible and we “trust the committer’s judgment”! + After all the tests pass, there should be a green merge button at the bottom of -the pull request. There are multiple choices and you should choose “Merge pull -request” (the default). This preserves the commit history and adds a merge +the pull request. There are multiple choices. Unless you want to squash commits +as part of the merge (see above) you should choose “Merge pull +request” and ensure “Create a merge commit” is selected from the drop down. +This preserves the commit history and adds a merge commit, so be sure the commit history has been curated appropriately. Do not use the default GitHub commit message, which looks like this: diff --git a/website/generated-content/contribute/index.html b
[beam] branch asf-site updated: Publishing website 2018/12/07 22:48:39 at commit a226343
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 7ba8104 Publishing website 2018/12/07 22:48:39 at commit a226343 7ba8104 is described below commit 7ba8104c637d2ae9ac237857f9b2a6136c5aecbe Author: jenkins AuthorDate: Fri Dec 7 22:48:40 2018 + Publishing website 2018/12/07 22:48:39 at commit a226343 --- .../documentation/sdks/java/nexmark/index.html | 10 ++ 1 file changed, 10 insertions(+) diff --git a/website/generated-content/documentation/sdks/java/nexmark/index.html b/website/generated-content/documentation/sdks/java/nexmark/index.html new file mode 100644 index 000..e212d61 --- /dev/null +++ b/website/generated-content/documentation/sdks/java/nexmark/index.html @@ -0,0 +1,10 @@ + + + +Redirecting… +https://beam.apache.org/documentation/sdks/java/testing/nexmark/";> +https://beam.apache.org/documentation/sdks/java/testing/nexmark/";> +Redirecting… +https://beam.apache.org/documentation/sdks/java/testing/nexmark/";>Click here if you are not redirected. +location="<a rel="nofollow" href="https://beam.apache.org/documentation/sdks/java/testing/nexmark/"">https://beam.apache.org/documentation/sdks/java/testing/nexmark/"</a>; +
[beam] branch asf-site updated: Publishing website 2018/12/10 13:15:25 at commit 6e3cf84
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 9621a35 Publishing website 2018/12/10 13:15:25 at commit 6e3cf84 9621a35 is described below commit 9621a357adb34ac55824b2579c9db992a91a7be2 Author: jenkins AuthorDate: Mon Dec 10 13:15:25 2018 + Publishing website 2018/12/10 13:15:25 at commit 6e3cf84 --- .../postcommits-policies-details/index.html | 21 + 1 file changed, 21 insertions(+) diff --git a/website/generated-content/contribute/postcommits-policies-details/index.html b/website/generated-content/contribute/postcommits-policies-details/index.html index 71a4de1..da1fa26 100644 --- a/website/generated-content/contribute/postcommits-policies-details/index.html +++ b/website/generated-content/contribute/postcommits-policies-details/index.html @@ -208,6 +208,7 @@ A flaky test is a critical/P1 issue Flaky tests must be fixed or removed Add new pre-commit tests as part of a post-commit fix + Inform the community if Beam breaks downstream projects @@ -298,6 +299,26 @@ post-commit tests. test that will detect similar failures in the future. For example, you can implement a new unit test that covers a problematic code branch. +Inform the community if Beam breaks downstream projects + +There are multiple external projects depending on Beam which contain tests that are +outside of Beam repository. For example, Dataflow, Samza runner, and IBM Streams. + +When an external project encounters an issue caused by (a PR) in Beam +and, in consequence, requests for a change in the Beam repository, +the first thing is to create a JIRA entry that addresses +the following three questions: + + + Descriptions on what the issue is. + Does a revert fix it? (Or it is supposed to be fixed differently) + Is a revert the best way to fix it? + + +It is encouraged to bring the discussion to the dev mailing list as well. +Ideally, after the incident, we prefer to have discussions regarding +whether we should extend tests in Beam repository, with the goal of +catching similar issues early in the future.
[beam] branch asf-site updated: Publishing website 2018/12/10 13:36:14 at commit e7b2f30
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 076e1dd Publishing website 2018/12/10 13:36:14 at commit e7b2f30 076e1dd is described below commit 076e1dd877e9ff223a58cba45307d5a126055e25 Author: jenkins AuthorDate: Mon Dec 10 13:36:14 2018 + Publishing website 2018/12/10 13:36:14 at commit e7b2f30 --- website/generated-content/get-started/wordcount-example/index.html | 2 ++ 1 file changed, 2 insertions(+) diff --git a/website/generated-content/get-started/wordcount-example/index.html b/website/generated-content/get-started/wordcount-example/index.html index 372965c..7f28845 100644 --- a/website/generated-content/get-started/wordcount-example/index.html +++ b/website/generated-content/get-started/wordcount-example/index.html @@ -897,7 +897,9 @@ values for them. You can then access the options values in your pipeline code.default='gs://my-bucket/input') options = PipelineOptions(argv) +word_count_options = options.view_as(WordCountOptions) with beam.Pipeline(options=options) as p: + lines = p | beam.io.ReadFromText(word_count_options.input)
[beam] branch asf-site updated: Publishing website 2018/12/12 04:59:56 at commit 8c8b7c3
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 3caf856 Publishing website 2018/12/12 04:59:56 at commit 8c8b7c3 3caf856 is described below commit 3caf85674a4f0b6a804b9f9f0762f435821fdd33 Author: jenkins AuthorDate: Wed Dec 12 04:59:57 2018 + Publishing website 2018/12/12 04:59:56 at commit 8c8b7c3 --- website/generated-content/documentation/runners/flink/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/documentation/runners/flink/index.html b/website/generated-content/documentation/runners/flink/index.html index c73fc26..c69aae9 100644 --- a/website/generated-content/documentation/runners/flink/index.html +++ b/website/generated-content/documentation/runners/flink/index.html @@ -310,7 +310,7 @@ limitations under the License. --inputFile=/path/to/pom.xml \ --output=/path/to/counts \ --flinkMaster=<flink master url> \ - --filesToStage=target/word-count-beam--bundled-0.1.jar" + --filesToStage=target/word-count-beam-bundled-0.1.jar" If you have a Flink JobManager running on your local machine you can give localhost:8081 for
[beam] branch asf-site updated: Publishing website 2018/12/12 16:11:34 at commit a53f56a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new b0b5d8c Publishing website 2018/12/12 16:11:34 at commit a53f56a b0b5d8c is described below commit b0b5d8c4d0ff8c4e3f5a98dfe890bc1cea7ee450 Author: jenkins AuthorDate: Wed Dec 12 16:11:35 2018 + Publishing website 2018/12/12 16:11:34 at commit a53f56a --- .../documentation/sdks/java/testing/nexmark/index.html | 6 +++--- 1 file changed, 3 insertions(+), 3 deletions(-) diff --git a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html index a552cca..8e7a411 100644 --- a/website/generated-content/documentation/sdks/java/testing/nexmark/index.html +++ b/website/generated-content/documentation/sdks/java/testing/nexmark/index.html @@ -545,7 +545,7 @@ or may be published to Pub/Sub or Kafka. Flink runner specific configuration --manageResources=false --monitorJobs=true \ ---flinkMaster=local --parallelism=#numcores +--flinkMaster=[local] --parallelism=#numcores @@ -911,7 +911,7 @@ configure logging. --streaming=false --manageResources=false --monitorJobs=true ---flinkMaster=local" +--flinkMaster=[local]" @@ -926,7 +926,7 @@ configure logging. --streaming=true --manageResources=false --monitorJobs=true ---flinkMaster=local" +--flinkMaster=[local]"
[beam] branch asf-site updated: Publishing website 2018/12/14 00:48:32 at commit 0f14b40
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new bebf945 Publishing website 2018/12/14 00:48:32 at commit 0f14b40 bebf945 is described below commit bebf945750d794fa84c7982adf516906bf12a715 Author: jenkins AuthorDate: Fri Dec 14 00:48:33 2018 + Publishing website 2018/12/14 00:48:32 at commit 0f14b40 --- website/generated-content/.htaccess| 2 +- .../blog/2016/10/20/test-stream.html | 2 +- .../blog/2017/08/16/splittable-do-fn.html | 10 +- .../08/20/review-input-streaming-connectors.html | 22 +++--- .../contribute/ptransform-style-guide/index.html | 4 ++-- .../dsls/sql/aggregate-functions/index.html| 4 ++-- .../dsls/sql/create-external-table/index.html | 4 ++-- .../documentation/dsls/sql/data-types/index.html | 4 ++-- .../documentation/dsls/sql/joins/index.html| 4 ++-- .../documentation/dsls/sql/lexical/index.html | 4 ++-- .../documentation/dsls/sql/overview/index.html | 8 .../dsls/sql/scalar-functions/index.html | 4 ++-- .../documentation/dsls/sql/select/index.html | 4 ++-- .../documentation/dsls/sql/set/index.html | 4 ++-- .../documentation/dsls/sql/shell/index.html| 4 ++-- .../dsls/sql/user-defined-functions/index.html | 4 ++-- .../documentation/dsls/sql/walkthrough/index.html | 10 +- .../dsls/sql/windowing-and-triggering/index.html | 4 ++-- .../io/built-in/google-bigquery/index.html | 14 +++--- .../pipelines/test-your-pipeline/index.html| 4 ++-- .../documentation/programming-guide/index.html | 16 .../documentation/runners/dataflow/index.html | 6 +++--- .../documentation/runners/direct/index.html| 14 +++--- .../documentation/runners/flink/index.html | 4 ++-- .../documentation/runners/gearpump/index.html | 4 ++-- .../documentation/runners/jstorm/index.html| 2 +- .../documentation/runners/mapreduce/index.html | 2 +- .../documentation/runners/samza/index.html | 2 +- .../documentation/runners/spark/index.html | 2 +- .../sdks/feature-comparison/index.html | 4 ++-- .../documentation/sdks/go/index.html | 4 ++-- .../sdks/java-dependencies/index.html | 4 ++-- .../documentation/sdks/java-extensions/index.html | 4 ++-- .../documentation/sdks/java-thirdparty/index.html | 4 ++-- .../documentation/sdks/java/euphoria/index.html| 6 +++--- .../documentation/sdks/java/index.html | 4 ++-- .../sdks/java/testing/nexmark/index.html | 8 .../documentation/sdks/python-custom-io/index.html | 4 ++-- .../sdks/python-dependencies/index.html| 4 ++-- .../sdks/python-pipeline-dependencies/index.html | 4 ++-- .../documentation/sdks/python-streaming/index.html | 4 ++-- .../sdks/python-type-safety/index.html | 4 ++-- .../documentation/sdks/python/index.html | 4 ++-- website/generated-content/feed.xml | 22 +++--- .../get-started/downloads/index.html | 16 +++- .../get-started/quickstart-java/index.html | 4 ++-- .../get-started/wordcount-example/index.html | 4 ++-- website/generated-content/index.html | 4 ++-- 48 files changed, 145 insertions(+), 139 deletions(-) diff --git a/website/generated-content/.htaccess b/website/generated-content/.htaccess index 5f00051..3da5eb8 100644 --- a/website/generated-content/.htaccess +++ b/website/generated-content/.htaccess @@ -21,4 +21,4 @@ RewriteRule ^(.*)$ https://beam.apache.org/$1 [L,R=301] # The following redirect maintains the previously supported URLs. RedirectMatch permanent "/documentation/sdks/(javadoc|pydoc)(.*)" "https://beam.apache.org/releases/$1$2"; # Keep this updated to point to the current release. -RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.8.0$2"; +RedirectMatch "/releases/([^/]+)/current(.*)" "https://beam.apache.org/releases/$1/2.9.0$2"; diff --git a/website/generated-content/blog/2016/10/20/test-stream.html b/website/generated-content/blog/2016/10/20/test-stream.html index c20322a..9be232e 100644 --- a/website/generated-content/blog/2016/10/20/test-stream.html +++ b/website/generated-content/blog/2016/10/20/test-stream.html @@ -224,7 +224,7 @@ be controlled within a test. Writing Deterministic Tests to Emulate Nondeterminism The Beam testing infrastructure provides the -https://beam.apache.org/releases/javadoc/2.8.0/org/apache/beam/sdk/testing/PAssert.html";>PAssert +https://beam.apache.org/relea
[beam] branch asf-site updated: Publishing website 2018/12/14 02:43:43 at commit 5df8cb2
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 8204cac Publishing website 2018/12/14 02:43:43 at commit 5df8cb2 8204cac is described below commit 8204cac9a46ded6bc7beddd3a20b4a255673a27a Author: jenkins AuthorDate: Fri Dec 14 02:43:43 2018 + Publishing website 2018/12/14 02:43:43 at commit 5df8cb2 --- .../2018/12/13/beam-2.9.0.html}| 276 +++--- website/generated-content/blog/index.html | 32 ++ website/generated-content/feed.xml | 601 +++-- website/generated-content/index.html | 10 +- 4 files changed, 186 insertions(+), 733 deletions(-) diff --git a/website/generated-content/index.html b/website/generated-content/blog/2018/12/13/beam-2.9.0.html similarity index 57% copy from website/generated-content/index.html copy to website/generated-content/blog/2018/12/13/beam-2.9.0.html index cc1e6bf..3b1c737 100644 --- a/website/generated-content/index.html +++ b/website/generated-content/blog/2018/12/13/beam-2.9.0.html @@ -28,9 +28,8 @@ - Apache Beam - + Apache Beam 2.9.0 + https://fonts.googleapis.com/css?family=Roboto:100,300,400"; rel="stylesheet"> https://ajax.googleapis.com/ajax/libs/jquery/2.2.0/jquery.min.js"</a>;> @@ -39,7 +38,7 @@ - https://beam.apache.org/"; data-proofer-ignore> + https://beam.apache.org/blog/2018/12/13/beam-2.9.0.html"; data-proofer-ignore> https://beam.apache.org/feed.xml";> https://use.fontawesome.com/releases/v5.4.1/css/all.css"; integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz" crossorigin="anonymous"> @@ -53,7 +52,7 @@ - + - https://github.com/apache/beam/edit/master/website/src/index.md"; data-proofer-ignore> + https://github.com/apache/beam/edit/master/website/src/_posts/2018-12-13-beam-2.9.0.md"; data-proofer-ignore> @@ -135,6 +134,31 @@ + + + +http://schema.org/BlogPosting";> + + +Apache Beam 2.9.0 +Dec 13, 2018 • + + + + + + + - - - - - - -Apache Beam: An advanced unified programming model - - -Implement batch and streaming data processing jobs that run on any execution engine. - - -Learn more -Download Beam SDK 2.9.0 - - -Java Quickstart -Python Quickstart - Go Quickstart - - - - - - -The latest from the blog - - - - - Inaugural edition of the Beam Summit Europe 2018 - aftermath - Oct 31, 2018 - - - - Apache Beam 2.8.0 - Oct 29, 2018 - - - - Apache Beam 2.7.0 - Oct 3, 2018 - - - - - - - - - - -All about Apache Beam - - - - - -Unified - - -Use a single programming model for both batch and streaming use cases. - - - - - -Portable - - -Execute pipelines on multiple execution environments. - - - - - -Extensible - - -Write and share new SDKs, IO connectors, and transformation libraries. - - - - - +We are happy to present the new 2.9.0 release of Beam. This release includes both improvements and new functionality. +See the download page for this release. +For more information on changes in 2.9.0, check out the +https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12344258";>detailed release notes. - - - - - +New Features / Improvements + + Support set/delete of timers by ID in Flink runner. + Improvements to stabilize integration tests. + Updates Spark runner to show Beam metrics in web UI + Vendor gRPC and Protobuf separately from beam-model-* Java packages + Avoid reshuffle for zero and one element creates + - - -Works with - - - - - http://apex.apache.org";> - - - - http://flink.apache.org";> - - - - http://spark.apache.org/";> - - - - https://cloud.google.com/dataflow/";> - - - - http://gearpump.apache.org/";> - - - - http://samza.apache.org/";> - - - - +Known Issues -
[beam] branch asf-site updated: Publishing website 2018/12/14 03:16:53 at commit e21b80a
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 0e85a2b Publishing website 2018/12/14 03:16:53 at commit e21b80a 0e85a2b is described below commit 0e85a2b7ea55e54a2170cbdcb63d041d1a28a35f Author: jenkins AuthorDate: Fri Dec 14 03:16:53 2018 + Publishing website 2018/12/14 03:16:53 at commit e21b80a --- .../blog/2018/12/13/beam-2.9.0.html| 26 -- website/generated-content/blog/index.html | 6 ++--- website/generated-content/feed.xml | 24 +++- 3 files changed, 20 insertions(+), 36 deletions(-) diff --git a/website/generated-content/blog/2018/12/13/beam-2.9.0.html b/website/generated-content/blog/2018/12/13/beam-2.9.0.html index 3b1c737..5031e76 100644 --- a/website/generated-content/blog/2018/12/13/beam-2.9.0.html +++ b/website/generated-content/blog/2018/12/13/beam-2.9.0.html @@ -152,7 +152,7 @@ Apache Beam 2.9.0 Dec 13, 2018 • - + Chamikara Jayalath @@ -178,15 +178,6 @@ For more information on changes in 2.9.0, check out the https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12344258";>detailed release notes. New Features / Improvements - - Support set/delete of timers by ID in Flink runner. - Improvements to stabilize integration tests. - Updates Spark runner to show Beam metrics in web UI - Vendor gRPC and Protobuf separately from beam-model-* Java packages - Avoid reshuffle for zero and one element creates - - -Known Issues Dependency Upgrades @@ -196,10 +187,6 @@ For more information on changes in 2.9.0, check out the Upgrade google-apitools to 0.5.24 -SDKs - -Portability - I/Os @@ -208,9 +195,14 @@ For more information on changes in 2.9.0, check out the Add PFADD method to RedisIO. -Miscellaneous Fixes +Miscellaneous Fixes - DataflowRunner was updated to not use https://github.com/google/conscrypt";>Conscrypt as the default security provider. + Dataflow runner was updated to not use https://github.com/google/conscrypt";>Conscrypt as the default security provider. + Support set/delete of timers by ID in Flink runner. + Improvements to stabilize integration tests. + Updates Spark runner to show Beam metrics in web UI + Vendor gRPC and Protobuf separately from beam-model-* Java packages + Avoid reshuffle for zero and one element creates List of Contributors @@ -218,7 +210,7 @@ For more information on changes in 2.9.0, check out the According to git shortlog, the following people contributed to the 2.9.0 release. Thank you to all contributors! -Adam Horky ,Ahmet Altay ,Alan Myrvold ,Alex Amato ,Alexey Romanenko ,Andrea Foegler ,Andrew Fulton ,Andrew Pilloud ,Ankur ,Ankur Goenka ,Anton Kedin ,Babu ,Ben Song ,Bingfeng Shu ,Boyuan Zhang ,Brian Martin ,Brian Quinlan ,Chamikara Jayalath ,Charles Chen ,Christian Schneider ,Colm O hEigeartaigh ,Cory Brzycki ,CraigChambersG ,Daniel Oliveira ,David Moravek ,Dusan Rychnovsky ,Etienne Chauchot ,Eugene Kirpichov ,Fabien Rousseau ,Gleb Kanterov ,Heejong Lee ,Henning Rohde ,Ismaël Mejía , [...] +Adam Horky, Ahmet Altay, Alan Myrvold, Alex Amato, Alexey Romanenko, Andrea Foegler, Andrew Fulton, Andrew Pilloud, Ankur Goenka, Anton Kedin, Babu, Ben Song, Bingfeng Shu, Boyuan Zhang, Brian Martin, Brian Quinlan, Chamikara Jayalath, Charles Chen, Christian Schneider, Colm O hEigeartaigh, Cory Brzycki, CraigChambersG, Daniel Oliveira, David Moravek, Dusan Rychnovsky, Etienne Chauchot, Eugene Kirpichov, Fabien Rousseau, Gleb Kanterov, Heejong Lee, Henning Rohde, Ismaël Mejía, Jan Luk [...] diff --git a/website/generated-content/blog/index.html b/website/generated-content/blog/index.html index c1dad8e..9bd976a 100644 --- a/website/generated-content/blog/index.html +++ b/website/generated-content/blog/index.html @@ -154,9 +154,9 @@ limitations under the License. for the project. Apache Beam 2.9.0 -Dec 13, 2018 • - -</i> +Dec 13, 2018 • + Chamikara Jayalath +
[beam] branch asf-site updated: Publishing website 2018/12/14 20:15:30 at commit 5ec695b
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new de30525 Publishing website 2018/12/14 20:15:30 at commit 5ec695b de30525 is described below commit de305250739df1a016e75ab3b7518526659f1e42 Author: jenkins AuthorDate: Fri Dec 14 20:15:30 2018 + Publishing website 2018/12/14 20:15:30 at commit 5ec695b --- .../generated-content/contribute/ptransform-style-guide/index.html| 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/website/generated-content/contribute/ptransform-style-guide/index.html b/website/generated-content/contribute/ptransform-style-guide/index.html index 275ad29..445300f 100644 --- a/website/generated-content/contribute/ptransform-style-guide/index.html +++ b/website/generated-content/contribute/ptransform-style-guide/index.html @@ -728,8 +728,8 @@ Strive to make such incompatible behavior changes cause a compile error (e.g. it Do: - If possible, just use PTransform composition as an extensibility device - i.e. if the same effect can be achieved by the user applying the transform in their pipeline and composing it with another PTransform, then the transform itself should not be extensible. E.g., a transform that writes JSON objects to a third-party system should take a PCollection<JsonObject> (assuming it is possible to provide [...] - If extensibility by user code is necessary inside the transform, pass the user code as a SerializableFunction or define your own serializable function-like type (ideally single-method, for interoperability with Java 8 lambdas). Because Java erases the types of lambdas, you should be sure to have adequate type information even if a raw-type SerializableFunction is provided by the user. See PTransform, then the transform itself should not be extensible. E.g., a transform that writes JSON objects to a third-party system should take a PCollection<JsonObject> (assuming it is possible to provide [...] + If extensibility by user code is necessary inside the transform, pass the user code as a ProcessFunction or define your own serializable function-like type (ideally single-method, for interoperability with Java 8 lambdas). Because Java erases the types of lambdas, you should be sure to have adequate type information even if a raw-type ProcessFunction is provided by the user. See
[beam] branch asf-site updated: Publishing website 2018/12/17 11:05:26 at commit bd5bbf9
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 25b3956 Publishing website 2018/12/17 11:05:26 at commit bd5bbf9 25b3956 is described below commit 25b39565dc1839ad9dfb4c0f4acb2c7df8960bbf Author: jenkins AuthorDate: Mon Dec 17 11:05:26 2018 + Publishing website 2018/12/17 11:05:26 at commit bd5bbf9 --- website/generated-content/blog/2018/12/13/beam-2.9.0.html | 6 ++ website/generated-content/feed.xml| 6 ++ 2 files changed, 12 insertions(+) diff --git a/website/generated-content/blog/2018/12/13/beam-2.9.0.html b/website/generated-content/blog/2018/12/13/beam-2.9.0.html index 5031e76..1318e36 100644 --- a/website/generated-content/blog/2018/12/13/beam-2.9.0.html +++ b/website/generated-content/blog/2018/12/13/beam-2.9.0.html @@ -187,6 +187,12 @@ For more information on changes in 2.9.0, check out the Upgrade google-apitools to 0.5.24 +Portability + + + Added support for user state and timers to Flink runner. + + I/Os diff --git a/website/generated-content/feed.xml b/website/generated-content/feed.xml index 49d9ef4..c6211f3 100644 --- a/website/generated-content/feed.xml +++ b/website/generated-content/feed.xml @@ -50,6 +50,12 @@ For more information on changes in 2.9.0, check out the <li>Upgrade google-apitools to 0.5.24</li> </ul> +<h3 id="portability">Portability</h3> + +<ul> + <li>Added support for user state and timers to Flink runner.</li> +</ul> + <h3 id="ios">I/Os</h3> <ul>
[beam] branch asf-site updated: Publishing website 2018/12/18 23:56:57 at commit aa0fdc5
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e67ff56 Publishing website 2018/12/18 23:56:57 at commit aa0fdc5
e67ff56 is described below
commit e67ff56e6983d87a30f940e90bcec6880666f379
Author: jenkins
AuthorDate: Tue Dec 18 23:56:57 2018 +
Publishing website 2018/12/18 23:56:57 at commit aa0fdc5
---
website/generated-content/contribute/release-guide/index.html | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/website/generated-content/contribute/release-guide/index.html
b/website/generated-content/contribute/release-guide/index.html
index 7f0bc4d..24caad3 100644
--- a/website/generated-content/contribute/release-guide/index.html
+++ b/website/generated-content/contribute/release-guide/index.html
@@ -745,7 +745,7 @@ sed -i -e "s/'beam-master-.*'/'beam-${RELEASE}'/g"
runners/google-cloud-dataflow
Start a snapshot build
-Start a build of https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_Gradle_NightlySnapshot/";>the
nightly snapshot against master branch.
+Start a build of https://builds.apache.org/view/A-D/view/Beam/job/beam_Release_NightlySnapshot/";>the
nightly snapshot against master branch.
Some processes, including our archetype tests, rely on having a live SNAPSHOT
of the current version
from the master branch. Once the
release branch is cut, these SNAPSHOT versions are no longer found,
so builds will be broken until a new snapshot is available.
[beam] branch asf-site updated: Publishing website 2018/12/20 10:20:23 at commit bed5747
This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new e68663a Publishing website 2018/12/20 10:20:23 at commit bed5747
e68663a is described below
commit e68663ada6135cad2bd528353991a1e8b11f375a
Author: jenkins
AuthorDate: Thu Dec 20 10:20:23 2018 +
Publishing website 2018/12/20 10:20:23 at commit bed5747
---
.../community/contact-us/index.html| 1 +
.../community/{policies => in-person}/index.html | 65 ++-
.../generated-content/community/logos/index.html | 1 +
.../community/policies/index.html | 1 +
.../community/presentation-materials/index.html| 1 +
.../community/youtube-channel/index.html | 1 +
.../sdks/java-dependencies/index.html | 499 +
.../sdks/python-dependencies/index.html| 65 ++-
.../get-started/support/index.html | 8 +-
.../use/issue-tracking/index.html | 8 +-
.../generated-content/use/mailing-lists/index.html | 8 +-
11 files changed, 436 insertions(+), 222 deletions(-)
diff --git a/website/generated-content/community/contact-us/index.html
b/website/generated-content/community/contact-us/index.html
index 4c92f8e..3bcd6e6 100644
--- a/website/generated-content/community/contact-us/index.html
+++ b/website/generated-content/community/contact-us/index.html
@@ -154,6 +154,7 @@
Contact Us
Policies
YouTube channel
+In Person
Promotion
diff --git a/website/generated-content/community/policies/index.html
b/website/generated-content/community/in-person/index.html
similarity index 85%
copy from website/generated-content/community/policies/index.html
copy to website/generated-content/community/in-person/index.html
index e084ea4..442d87a 100644
--- a/website/generated-content/community/policies/index.html
+++ b/website/generated-content/community/in-person/index.html
@@ -28,7 +28,7 @@
- Policies
+ Contact Us
https://fonts.googleapis.com/css?family=Roboto:100,300,400";
rel="stylesheet">
@@ -39,7 +39,7 @@
- https://beam.apache.org/community/policies/";
data-proofer-ignore>
+ https://beam.apache.org/community/in-person/";
data-proofer-ignore>
https://beam.apache.org/feed.xml";>
https://use.fontawesome.com/releases/v5.4.1/css/all.css";
integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz"
crossorigin="anonymous">
@@ -125,7 +125,7 @@
GitHub links will not resolve until the markdown source is
available on the master branch.
New pages would fail validation during development / PR test
automation.
-->
- https://github.com/apache/beam/edit/master/website/src/community/policies.md";
data-proofer-ignore>
+ https://github.com/apache/beam/edit/master/website/src/community/in-person.md";
data-proofer-ignore>
@@ -154,6 +154,7 @@
Contact Us
Policies
YouTube channel
+In Person
Promotion
@@ -187,7 +188,8 @@
- Releases
+ Meetups
+ Conference Talks
@@ -208,19 +210,60 @@ See the License for the specific language governing
permissions and
limitations under the License.
-->
-Policies
+We are nice, find us in person
-This page contains a list of major policies agreed upon by the Apache Beam
community.
+While the official communication happens on the mailing list, and you can
find us online (see: https://beam.apache.org/community/contact-us/";>contact-us), we also
get together in person at Meetups and Conferences.
-Releases
+Meetups
-Apache Beam makes minor releases every 6 weeks. Apache Beam has a https://calendar.google.com/calendar/embed?src=0p73sl034k80oob7seouanigd0%40group.calendar.google.com";>calendar
for cutting the next release branch. After a release branch is cut, the
community works quickly to finalize that release.
+We occassionally meetup in various locations around the globe. Active or
to-be-started meetups include:
-Apache Beam aims to make 8 releases in a 12 month period. To accommodate
users with longer upgrade cycles, some of these releases will be tagged as long
term support (LTS) releases. LTS releases receive patches to fix major issues
for 12 months, starting from the release’s initial release date. There will be
at least one new LTS release in a 12 month period, and LTS releases are
considered deprecated after 12 months. The community will mark a release as a
LTS release based on various [...]
+
+
+
+ Meetup City
+ Name
+
+
+
+
+
+ Stockholm
+ https://www.meetup.com/Apache-Beam-Stockholm/";>Apache Beam
Stockholm
+
[beam] branch asf-site updated: Publishing website 2018/12/20 16:07:43 at commit 7c8f7ba
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new c63860d Publishing website 2018/12/20 16:07:43 at commit 7c8f7ba c63860d is described below commit c63860d61b476db939969c13b8a429e490514a1a Author: jenkins AuthorDate: Thu Dec 20 16:07:43 2018 + Publishing website 2018/12/20 16:07:43 at commit 7c8f7ba --- website/generated-content/get-started/downloads/index.html | 2 ++ 1 file changed, 2 insertions(+) diff --git a/website/generated-content/get-started/downloads/index.html b/website/generated-content/get-started/downloads/index.html index f7d46ae..3709e06 100644 --- a/website/generated-content/get-started/downloads/index.html +++ b/website/generated-content/get-started/downloads/index.html @@ -312,6 +312,8 @@ versions denoted 0.x.y. https://www.apache.org/dist/beam/2.9.0/apache-beam-2.9.0-source-release.zip.sha512";>SHA-512. https://www.apache.org/dist/beam/2.9.0/apache-beam-2.9.0-source-release.zip.asc";>signature. +https://issues.apache.org/jira/secure/ReleaseNote.jspa?projectId=12319527&version=12344258";>Release notes. + 2.8.0 (2018-10-26) Official http://www.apache.org/dyn/closer.cgi/beam/2.8.0/apache-beam-2.8.0-source-release.zip";>source code download. https://www.apache.org/dist/beam/2.8.0/apache-beam-2.8.0-source-release.zip.sha512";>SHA-512.
[beam] branch asf-site updated: Publishing website 2018/12/21 17:21:05 at commit 7302aef
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 375dcb6 Publishing website 2018/12/21 17:21:05 at commit 7302aef 375dcb6 is described below commit 375dcb6ff1a4db1cd9be97b5487fd3bd04ed27eb Author: jenkins AuthorDate: Fri Dec 21 17:21:05 2018 + Publishing website 2018/12/21 17:21:05 at commit 7302aef --- website/generated-content/community/contact-us/index.html | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/website/generated-content/community/contact-us/index.html b/website/generated-content/community/contact-us/index.html index 3bcd6e6..1a63c6c 100644 --- a/website/generated-content/community/contact-us/index.html +++ b/website/generated-content/community/contact-us/index.html @@ -245,7 +245,7 @@ whichever one seems best! https://s.apache.org/beam-slack-channel";>Slack - Chat with users and developers on channel #beam (https://s.apache.org/slack-invite";>Join) + Chat with users and developers in the ASF slack. Please do not ask for questions in the #general channel. Do it in the specific Beam channels #beam (https://s.apache.org/slack-invite";>Join)
[beam] branch asf-site updated: Publishing website 2018/12/21 19:35:49 at commit 941cb27
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new d4b71c6 Publishing website 2018/12/21 19:35:49 at commit 941cb27 d4b71c6 is described below commit d4b71c6eb7f4d310d63bf25bdd307ee641cfc91b Author: jenkins AuthorDate: Fri Dec 21 19:35:49 2018 + Publishing website 2018/12/21 19:35:49 at commit 941cb27 --- .../sdks/java-dependencies/index.html | 30 +++--- 1 file changed, 15 insertions(+), 15 deletions(-) diff --git a/website/generated-content/documentation/sdks/java-dependencies/index.html b/website/generated-content/documentation/sdks/java-dependencies/index.html index 1a2cd1f..d72455c 100644 --- a/website/generated-content/documentation/sdks/java-dependencies/index.html +++ b/website/generated-content/documentation/sdks/java-dependencies/index.html @@ -405,27 +405,27 @@ the listed versions that will be in scope during execution. com.google.errorproneerror_prone_annotations2.0.15 com.google.apigax-grpc1.29.0 com.google.cloud.bigdataossgcsio1.9.0 - com.google.api-clientgoogle-api-client-jackson21.23.0 - com.google.api-clientgoogle-api-client-java61.23.0 - com.google.api-clientgoogle-api-client1.23.0 - com.google.apisgoogle-api-services-bigqueryv2-rev402-1.23.0 - com.google.apisgoogle-api-services-clouddebuggerv2-rev253-1.23.0 - com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev502-1.23.0 - com.google.apisgoogle-api-services-dataflowv1b3-rev257-1.23.0 - com.google.apisgoogle-api-services-pubsubv1-rev399-1.23.0 - com.google.apisgoogle-api-services-storagev1-rev136-1.23.0 + com.google.api-clientgoogle-api-client-jackson21.24.1 + com.google.api-clientgoogle-api-client-java61.24.1 + com.google.api-clientgoogle-api-client1.24.1 + com.google.apisgoogle-api-services-bigqueryv2-rev402-1.24.1 + com.google.apisgoogle-api-services-clouddebuggerv2-rev253-1.24.1 + com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev502-1.24.1 + com.google.apisgoogle-api-services-dataflowv1b3-rev257-1.24.1 + com.google.apisgoogle-api-services-pubsubv1-rev399-1.24.1 + com.google.apisgoogle-api-services-storagev1-rev136-1.24.1 com.google.authgoogle-auth-library-credentials0.10.0 com.google.authgoogle-auth-library-oauth2-http0.10.0 com.google.cloudgoogle-cloud-core-grpc1.36.0 com.google.cloudgoogle-cloud-core1.36.0 com.google.cloud.dataflowgoogle-cloud-dataflow-java-proto-library-all0.5.160304 com.google.cloudgoogle-cloud-spanner0.54.0-beta - com.google.http-clientgoogle-http-client-jackson21.23.0 - com.google.http-clientgoogle-http-client-jackson1.23.0 - com.google.http-clientgoogle-http-client-protobuf1.23.0 - com.google.http-clientgoogle-http-client1.23.0 - com.google.oauth-clientgoogle-oauth-client-java61.23.0 - com.google.oauth-clientgoogle-oauth-client1.23.0 + com.google.http-clientgoogle-http-client-jackson21.24.1 + com.google.http-clientgoogle-http-client-jackson1.24.1 + com.google.http-clientgoogle-http-client-protobuf1.24.1 + com.google.http-clientgoogle-http-client1.24.1 + com.google.oauth-clientgoogle-oauth-client-java61.24.1 + com.google.oauth-clientgoogle-oauth-client1.24.1 io.grpcgrpc-all1.13.1 io.grpcgrpc-auth1.13.1 io.grpcgrpc-core1.13.1
[beam] branch asf-site updated: Publishing website 2018/12/21 21:02:18 at commit 76b180b
This is an automated email from the ASF dual-hosted git repository. git-site-role pushed a commit to branch asf-site in repository https://gitbox.apache.org/repos/asf/beam.git The following commit(s) were added to refs/heads/asf-site by this push: new 81b34d4 Publishing website 2018/12/21 21:02:18 at commit 76b180b 81b34d4 is described below commit 81b34d4874ef7d603778aec4e0e0a44befdc1deb Author: jenkins AuthorDate: Fri Dec 21 21:02:19 2018 + Publishing website 2018/12/21 21:02:18 at commit 76b180b --- .../documentation/sdks/java-dependencies/index.html | 12 ++-- 1 file changed, 6 insertions(+), 6 deletions(-) diff --git a/website/generated-content/documentation/sdks/java-dependencies/index.html b/website/generated-content/documentation/sdks/java-dependencies/index.html index d72455c..f71c021 100644 --- a/website/generated-content/documentation/sdks/java-dependencies/index.html +++ b/website/generated-content/documentation/sdks/java-dependencies/index.html @@ -518,12 +518,12 @@ the listed versions that will be in scope during execution. com.google.api-clientgoogle-api-client-jackson21.23.0 com.google.api-clientgoogle-api-client-java61.23.0 com.google.api-clientgoogle-api-client1.23.0 - com.google.apisgoogle-api-services-bigqueryv2-rev402-1.23.0 - com.google.apisgoogle-api-services-clouddebuggerv2-rev253-1.23.0 - com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev502-1.23.0 - com.google.apisgoogle-api-services-dataflowv1b3-rev257-1.23.0 - com.google.apisgoogle-api-services-pubsubv1-rev399-1.23.0 - com.google.apisgoogle-api-services-storagev1-rev136-1.23.0 + com.google.apisgoogle-api-services-bigqueryv2-rev374-1.23.0 + com.google.apisgoogle-api-services-clouddebuggerv2-rev233-1.23.0 + com.google.apisgoogle-api-services-cloudresourcemanagerv1-rev477-1.23.0 + com.google.apisgoogle-api-services-dataflowv1b3-rev221-1.23.0 + com.google.apisgoogle-api-services-pubsubv1-rev382-1.23.0 + com.google.apisgoogle-api-services-storagev1-rev124-1.23.0 com.google.authgoogle-auth-library-credentials0.10.0 com.google.authgoogle-auth-library-oauth2-http0.10.0 com.google.cloudgoogle-cloud-core-grpc1.36.0
