This is an automated email from the ASF dual-hosted git repository.
git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/beam.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 5ba3a1e Publishing website 2019/05/23 10:21:40 at commit 9a7b60f
5ba3a1e is described below
commit 5ba3a1ec196c07fd04ab0e23ad0f2a4599c2adcc
Author: jenkins <bui...@apache.org>
AuthorDate: Thu May 23 10:21:40 2019 +0000
Publishing website 2019/05/23 10:21:40 at commit 9a7b60f
---
website/generated-content/documentation/index.html | 1 +
.../documentation/runners/apex/index.html | 1 +
.../runners/capability-matrix/index.html | 1147 ++++++++++++++++++--
.../documentation/runners/dataflow/index.html | 1 +
.../documentation/runners/direct/index.html | 1 +
.../documentation/runners/flink/index.html | 1 +
.../documentation/runners/gearpump/index.html | 1 +
.../runners/{mapreduce => jet}/index.html | 180 +--
.../documentation/runners/mapreduce/index.html | 1 +
.../documentation/runners/nemo/index.html | 1 +
.../documentation/runners/samza/index.html | 1 +
.../documentation/runners/spark/index.html | 1 +
.../get-started/quickstart-java/index.html | 33 +-
.../generated-content/learn/runners/jet/index.html | 10 +
14 files changed, 1256 insertions(+), 124 deletions(-)
diff --git a/website/generated-content/documentation/index.html
b/website/generated-content/documentation/index.html
index d216cc9..7ee0437 100644
--- a/website/generated-content/documentation/index.html
+++ b/website/generated-content/documentation/index.html
@@ -366,6 +366,7 @@ limitations under the License.
<li><a href="/documentation/runners/gearpump/">GearpumpRunner</a>: Runs on
<a href="http://gearpump.apache.org";>Apache Gearpump (incubating)</a>.</li>
<li><a href="/documentation/runners/samza/">SamzaRunner</a>: Runs on <a
href="http://samza.apache.org";>Apache Samza</a>.</li>
<li><a href="/documentation/runners/nemo/">NemoRunner</a>: Runs on <a
href="http://nemo.apache.org";>Apache Nemo</a>.</li>
+ <li><a href="/documentation/runners/jet/">JetRunner</a>: Runs on <a
href="https://jet.hazelcast.org/";>Hazelcast Jet</a>.</li>
</ul>
<h3 id="choosing-a-runner">Choosing a Runner</h3>
diff --git a/website/generated-content/documentation/runners/apex/index.html
b/website/generated-content/documentation/runners/apex/index.html
index 0664c99..dbd0fb7 100644
--- a/website/generated-content/documentation/runners/apex/index.html
+++ b/website/generated-content/documentation/runners/apex/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git
a/website/generated-content/documentation/runners/capability-matrix/index.html
b/website/generated-content/documentation/runners/capability-matrix/index.html
index 6f8db0c..0fe1b27 100644
---
a/website/generated-content/documentation/runners/capability-matrix/index.html
+++
b/website/generated-content/documentation/runners/capability-matrix/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
@@ -289,6 +290,8 @@ limitations under the License.
<th class="cap-summary color-platform format-platform"
style="color:#ec3">Apache Nemo</th>
+ <th class="cap-summary color-platform format-platform"
style="color:#ec3">Hazelcast Jet</th>
+
</tr>
<tr class="cap-summary">
@@ -492,6 +495,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -695,6 +716,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -898,6 +937,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -1101,6 +1158,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -1304,6 +1379,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>~</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -1507,6 +1600,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>~</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -1710,6 +1821,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -1913,6 +2042,24 @@ limitations under the License.
<center><b>✕</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ddd;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✕</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -2116,6 +2263,24 @@ limitations under the License.
<center><b>✕</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>~</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -2319,6 +2484,24 @@ limitations under the License.
<center><b>✕</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>~</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -2353,6 +2536,8 @@ limitations under the License.
<th class="cap-summary color-platform format-platform"
style="color:#59f">Apache Nemo</th>
+ <th class="cap-summary color-platform format-platform"
style="color:#59f">Hazelcast Jet</th>
+
</tr>
<tr class="cap-summary">
@@ -2556,6 +2741,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -2759,11 +2962,6 @@ limitations under the License.
<center><b>✓</b></center>
</td>
- </tr>
-
- <tr class="cap-summary">
- <th class="cap-summary color-capability format-capability"
style="color:#59f">Sliding windows</th>
-
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -2782,6 +2980,11 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+ </tr>
+
+ <tr class="cap-summary">
+ <th class="cap-summary color-capability format-capability"
style="color:#59f">Sliding windows</th>
+
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -2962,11 +3165,6 @@ limitations under the License.
<center><b>✓</b></center>
</td>
- </tr>
-
- <tr class="cap-summary">
- <th class="cap-summary color-capability format-capability"
style="color:#59f">Session windows</th>
-
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3003,6 +3201,11 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+ </tr>
+
+ <tr class="cap-summary">
+ <th class="cap-summary color-capability format-capability"
style="color:#59f">Session windows</th>
+
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3165,11 +3368,6 @@ limitations under the License.
<center><b>✓</b></center>
</td>
- </tr>
-
- <tr class="cap-summary">
- <th class="cap-summary color-capability format-capability"
style="color:#59f">Custom windows</th>
-
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3224,6 +3422,11 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+ </tr>
+
+ <tr class="cap-summary">
+ <th class="cap-summary color-capability format-capability"
style="color:#59f">Custom windows</th>
+
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3368,11 +3571,6 @@ limitations under the License.
<center><b>✓</b></center>
</td>
- </tr>
-
- <tr class="cap-summary">
- <th class="cap-summary color-capability format-capability"
style="color:#59f">Custom merging windows</th>
-
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3445,6 +3643,11 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+ </tr>
+
+ <tr class="cap-summary">
+ <th class="cap-summary color-capability format-capability"
style="color:#59f">Custom merging windows</th>
+
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3571,11 +3774,6 @@ limitations under the License.
<center><b>✓</b></center>
</td>
- </tr>
-
- <tr class="cap-summary">
- <th class="cap-summary color-capability format-capability"
style="color:#59f">Timestamp control</th>
-
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3666,6 +3864,11 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+ </tr>
+
+ <tr class="cap-summary">
+ <th class="cap-summary color-capability format-capability"
style="color:#59f">Timestamp control</th>
+
<td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
@@ -3774,12 +3977,120 @@ limitations under the License.
<center><b>✓</b></center>
</td>
- </tr>
-
- <tr class="cap-summary">
- <td class="cap-summary color-blank cap-blank" colspan="5"></td>
- </tr>
-
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
+ </tr>
+
+ <tr class="cap-summary">
+ <td class="cap-summary color-blank cap-blank" colspan="5"></td>
+ </tr>
+
<tr class="cap-summary" id="cap-summary-when">
<th class="cap-summary color-metadata format-category" colspan="5"
style="color:#6a4"><div class="cap-toggle" onclick="ToggleTables(1,
"cap-full-when")">(expand details)</div>When in processing time?</th>
</tr>
@@ -3808,6 +4119,8 @@ limitations under the License.
<th class="cap-summary color-platform format-platform"
style="color:#8c6">Apache Nemo</th>
+ <th class="cap-summary color-platform format-platform"
style="color:#8c6">Hazelcast Jet</th>
+
</tr>
<tr class="cap-summary">
@@ -4011,6 +4324,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -4214,6 +4545,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -4417,6 +4766,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -4620,6 +4987,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -4823,6 +5208,24 @@ limitations under the License.
<center><b>✕</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ddd;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✕</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -5026,6 +5429,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -5229,6 +5650,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -5432,6 +5871,24 @@ limitations under the License.
<center><b>✕</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ae8;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>~</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -5466,6 +5923,8 @@ limitations under the License.
<th class="cap-summary color-platform format-platform"
style="color:#d77">Apache Nemo</th>
+ <th class="cap-summary color-platform format-platform"
style="color:#d77">Hazelcast Jet</th>
+
</tr>
<tr class="cap-summary">
@@ -5669,6 +6128,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#d77;border-color:#b55"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -5872,6 +6349,24 @@ limitations under the License.
<center><b>✓</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#d77;border-color:#b55"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✓</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -6075,6 +6570,24 @@ limitations under the License.
<center><b>✕</b></center>
</td>
+
+
+ <td width="25%" class="cap-summary"
style="background-color:#ddd;border-color:#b55"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>✕</b></center>
+</td>
+
</tr>
<tr class="cap-summary">
@@ -6136,6 +6649,8 @@ limitations under the License.
<th class="cap color-platform format-platform" style="color:#ec3">Apache
Nemo</th>
+ <th class="cap color-platform format-platform"
style="color:#ec3">Hazelcast Jet</th>
+
</tr>
<tr class="cap">
@@ -6339,6 +6854,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -6542,6 +7075,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -6745,6 +7296,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -6948,6 +7517,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />Batch mode uses
pre-aggregation
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />Batch mode uses
pre-aggregation
+</td>
+
</tr>
<tr class="cap">
@@ -7151,6 +7738,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Partially: supported via inlining</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -7354,6 +7959,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Partially: with restrictions</b></center><br />Supported only when
the side input source is bounded and windowing uses global window
+</td>
+
</tr>
<tr class="cap">
@@ -7557,6 +8180,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ec3;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -7760,6 +8401,24 @@ limitations under the License.
<center><b>No: not implemented</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ddd;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>No: not implemented</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -7963,6 +8622,24 @@ limitations under the License.
<center><b>No: not implemented</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Partially: All metrics types supported, both in batching and
streaming mode.</b></center><br />Doesn't differentiate between committed and
attempted values.
+</td>
+
</tr>
<tr class="cap">
@@ -8166,6 +8843,24 @@ limitations under the License.
<center><b>No: not implemented</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#fe5;border-color:#ca1"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Partially: non-merging windows</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -8200,6 +8895,8 @@ limitations under the License.
<th class="cap color-platform format-platform" style="color:#59f">Apache
Nemo</th>
+ <th class="cap color-platform format-platform"
style="color:#59f">Hazelcast Jet</th>
+
</tr>
<tr class="cap">
@@ -8403,6 +9100,24 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -8606,6 +9321,24 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -8752,7 +9485,102 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: supported</b></center><br />
+<center><b>Yes: supported</b></center><br />
+</td>
+
+
+
+ <td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: supported</b></center><br />
+</td>
+
+
+
+ <td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: supported</b></center><br />
+</td>
+
+
+
+ <td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: supported</b></center><br />
+</td>
+
+
+
+ <td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: supported</b></center><br />
+</td>
+
+ </tr>
+
+ <tr class="cap">
+ <th class="cap color-capability format-capability"
style="color:#59f">Session windows</th>
+
+
+
+ <td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: activity-based</b></center><br />Based on bursts of activity
separated by a gap size. Different per key.
</td>
@@ -8770,7 +9598,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: supported</b></center><br />
+<center><b>Yes: built-in</b></center><br />
</td>
@@ -8809,11 +9637,6 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
- </tr>
-
- <tr class="cap">
- <th class="cap color-capability format-capability"
style="color:#59f">Session windows</th>
-
<td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
@@ -8829,7 +9652,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: activity-based</b></center><br />Based on bursts of activity
separated by a gap size. Different per key.
+<center><b>Yes: supported</b></center><br />
</td>
@@ -8847,7 +9670,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: built-in</b></center><br />
+<center><b>Yes: supported</b></center><br />
</td>
@@ -8958,6 +9781,11 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
+ </tr>
+
+ <tr class="cap">
+ <th class="cap color-capability format-capability"
style="color:#59f">Custom windows</th>
+
<td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
@@ -8973,7 +9801,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: supported</b></center><br />
+<center><b>Yes: user-defined windows</b></center><br />All windows must
implement <tt>BoundedWindow</tt>, which specifies a max timestamp. Each
<tt>WindowFn</tt> assigns elements to an associated window.
</td>
@@ -9012,11 +9840,6 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
- </tr>
-
- <tr class="cap">
- <th class="cap color-capability format-capability"
style="color:#59f">Custom windows</th>
-
<td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
@@ -9032,7 +9855,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: user-defined windows</b></center><br />All windows must
implement <tt>BoundedWindow</tt>, which specifies a max timestamp. Each
<tt>WindowFn</tt> assigns elements to an associated window.
+<center><b>Yes: supported</b></center><br />
</td>
@@ -9179,6 +10002,11 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
+ </tr>
+
+ <tr class="cap">
+ <th class="cap color-capability format-capability"
style="color:#59f">Custom merging windows</th>
+
<td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
@@ -9194,7 +10022,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: supported</b></center><br />
+<center><b>Yes: user-defined merging windows</b></center><br />A custom
<tt>WindowFn</tt> additionally specifies whether and how to merge windows.
</td>
@@ -9215,11 +10043,6 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
- </tr>
-
- <tr class="cap">
- <th class="cap color-capability format-capability"
style="color:#59f">Custom merging windows</th>
-
<td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
@@ -9235,7 +10058,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: user-defined merging windows</b></center><br />A custom
<tt>WindowFn</tt> additionally specifies whether and how to merge windows.
+<center><b>Yes: supported</b></center><br />
</td>
@@ -9400,6 +10223,11 @@ limitations under the License.
<center><b>Yes: supported</b></center><br />
</td>
+ </tr>
+
+ <tr class="cap">
+ <th class="cap color-capability format-capability"
style="color:#59f">Timestamp control</th>
+
<td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
@@ -9415,14 +10243,9 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: supported</b></center><br />
+<center><b>Yes: output timestamp for window panes</b></center><br />For a
grouping transform, such as GBK or Combine, an OutputTimeFn specifies (1) how
to combine input timestamps within a window and (2) how to merge aggregated
timestamps when windows merge.
</td>
- </tr>
-
- <tr class="cap">
- <th class="cap color-capability format-capability"
style="color:#59f">Timestamp control</th>
-
<td width="25%" class="cap"
style="background-color:#59f;border-color:#37d"><!--
@@ -9438,7 +10261,7 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<center><b>Yes: output timestamp for window panes</b></center><br />For a
grouping transform, such as GBK or Combine, an OutputTimeFn specifies (1) how
to combine input timestamps within a window and (2) how to merge aggregated
timestamps when windows merge.
+<center><b>Yes: supported</b></center><br />
</td>
@@ -9655,6 +10478,8 @@ limitations under the License.
<th class="cap color-platform format-platform" style="color:#8c6">Apache
Nemo</th>
+ <th class="cap color-platform format-platform"
style="color:#8c6">Hazelcast Jet</th>
+
</tr>
<tr class="cap">
@@ -9858,6 +10683,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -10061,6 +10904,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -10264,6 +11125,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -10467,6 +11346,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -10670,6 +11567,24 @@ limitations under the License.
<center><b>No: pending model support</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ddd;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>No: pending model support</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -10873,6 +11788,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -11076,6 +12009,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#8c6;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -11279,6 +12230,24 @@ limitations under the License.
<center><b>No: not implemented</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ae8;border-color:#6a4"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Partially: non-merging windows</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -11313,6 +12282,8 @@ limitations under the License.
<th class="cap color-platform format-platform" style="color:#d77">Apache
Nemo</th>
+ <th class="cap color-platform format-platform"
style="color:#d77">Hazelcast Jet</th>
+
</tr>
<tr class="cap">
@@ -11516,6 +12487,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#d77;border-color:#b55"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -11719,6 +12708,24 @@ limitations under the License.
<center><b>Yes: fully supported</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#d77;border-color:#b55"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>Yes: fully supported</b></center><br />
+</td>
+
</tr>
<tr class="cap">
@@ -11922,6 +12929,24 @@ limitations under the License.
<center><b>No: pending model support</b></center><br />
</td>
+
+
+ <td width="25%" class="cap"
style="background-color:#ddd;border-color:#b55"><!--
+Licensed under the Apache License, Version 2.0 (the "License");
+you may not use this file except in compliance with the License.
+You may obtain a copy of the License at
+
+http://www.apache.org/licenses/LICENSE-2.0
+
+Unless required by applicable law or agreed to in writing, software
+distributed under the License is distributed on an "AS IS" BASIS,
+WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+See the License for the specific language governing permissions and
+limitations under the License.
+-->
+<center><b>No: pending model support</b></center><br />
+</td>
+
</tr>
<tr class="cap">
diff --git
a/website/generated-content/documentation/runners/dataflow/index.html
b/website/generated-content/documentation/runners/dataflow/index.html
index 4fdd0e1..a6d3f8d 100644
--- a/website/generated-content/documentation/runners/dataflow/index.html
+++ b/website/generated-content/documentation/runners/dataflow/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git a/website/generated-content/documentation/runners/direct/index.html
b/website/generated-content/documentation/runners/direct/index.html
index 031fc6c..2684f9d 100644
--- a/website/generated-content/documentation/runners/direct/index.html
+++ b/website/generated-content/documentation/runners/direct/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git a/website/generated-content/documentation/runners/flink/index.html
b/website/generated-content/documentation/runners/flink/index.html
index 78bf951..1f8bfd0 100644
--- a/website/generated-content/documentation/runners/flink/index.html
+++ b/website/generated-content/documentation/runners/flink/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git
a/website/generated-content/documentation/runners/gearpump/index.html
b/website/generated-content/documentation/runners/gearpump/index.html
index eae2357..eae5572 100644
--- a/website/generated-content/documentation/runners/gearpump/index.html
+++ b/website/generated-content/documentation/runners/gearpump/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git
a/website/generated-content/documentation/runners/mapreduce/index.html
b/website/generated-content/documentation/runners/jet/index.html
similarity index 67%
copy from website/generated-content/documentation/runners/mapreduce/index.html
copy to website/generated-content/documentation/runners/jet/index.html
index d099fde..2376316 100644
--- a/website/generated-content/documentation/runners/mapreduce/index.html
+++ b/website/generated-content/documentation/runners/jet/index.html
@@ -28,7 +28,7 @@
<meta charset="utf-8">
<meta http-equiv="X-UA-Compatible" content="IE=edge">
<meta name="viewport" content="width=device-width, initial-scale=1">
- <title>Apache Hadoop MapReduce Runner</title>
+ <title>Hazelcast Jet Runner</title>
<meta name="description" content="Apache Beam is an open source, unified
model and set of language-specific SDKs for defining and executing data
processing workflows, and also data ingestion and integration flows, supporting
Enterprise Integration Patterns (EIPs) and Domain Specific Languages (DSLs).
Dataflow pipelines simplify the mechanics of large-scale batch and streaming
data processing and can run on a number of runtimes like Apache Flink, Apache
Spark, and Google Cloud Dataflow [...]
">
<link href="https://fonts.googleapis.com/css?family=Roboto:100,300,400";
rel="stylesheet">
@@ -39,7 +39,7 @@
<script src="/js/fix-menu.js"></script>
<script src="/js/section-nav.js"></script>
<script src="/js/page-nav.js"></script>
- <link rel="canonical"
href="https://beam.apache.org/documentation/runners/mapreduce/";
data-proofer-ignore>
+ <link rel="canonical"
href="https://beam.apache.org/documentation/runners/jet/"; data-proofer-ignore>
<link rel="shortcut icon" type="image/x-icon" href="/images/favicon.ico">
<link rel="alternate" type="application/rss+xml" title="Apache Beam"
href="https://beam.apache.org/feed.xml";>
<link rel="stylesheet"
href="https://use.fontawesome.com/releases/v5.4.1/css/all.css";
integrity="sha384-5sAR7xN1Nv6T6+dT2mhtzEpVJvfS3NScPQTrOxhwjIuvcA67KV2R5Jz6kr4abQsz"
crossorigin="anonymous">
@@ -125,7 +125,7 @@
GitHub links will not resolve until the markdown source is
available on the master branch.
New pages would fail validation during development / PR test
automation.
-->
- <a
href="https://github.com/apache/beam/edit/master/website/src/documentation/runners/mapreduce.md";
data-proofer-ignore>
+ <a
href="https://github.com/apache/beam/edit/master/website/src/documentation/runners/jet.md";
data-proofer-ignore>
<i class="far fa-edit fa-lg" alt="Edit on GitHub" title="Edit on
GitHub"></i>
</a>
</li>
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
@@ -181,9 +182,10 @@
<ul class="nav">
- <li><a href="#apache-hadoop-mapreduce-runner-prerequisites-and-setup">Apache
Hadoop MapReduce Runner prerequisites and setup</a></li>
- <li><a
href="#deploying-apache-hadoop-mapreduce-with-your-application">Deploying
Apache Hadoop MapReduce with your application</a></li>
- <li><a
href="#pipeline-options-for-the-apache-hadoop-mapreduce-runner">Pipeline
options for the Apache Hadoop MapReduce Runner</a></li>
+ <li><a
href="#generating-the-beam-examples-project-from-snapshot-versions-of-beam">Generating
the Beam examples project from SNAPSHOT versions of Beam</a></li>
+ <li><a
href="#generating-the-beam-examples-project-from-released-versions-of-beam">Generating
the Beam examples project from RELEASED versions of Beam</a></li>
+ <li><a href="#running-wordcount-on-a-local-jet-cluster">Running WordCount on
a Local Jet Cluster</a></li>
+ <li><a href="#running-wordcount-on-a-remote-jet-cluster">Running WordCount
on a Remote Jet Cluster</a></li>
</ul>
@@ -203,80 +205,134 @@ WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either
express or implied.
See the License for the specific language governing permissions and
limitations under the License.
-->
-<h1 id="using-the-apache-hadoop-mapreduce-runner">Using the Apache Hadoop
MapReduce Runner</h1>
-<p>The Apache Hadoop MapReduce Runner can be used to execute Beam pipelines
using <a href="http://hadoop.apache.org/";>Apache Hadoop</a>.</p>
+<h1 id="overview">Overview</h1>
-<p>The <a href="/documentation/runners/capability-matrix/">Beam Capability
Matrix</a> documents the currently supported capabilities of the Apache Hadoop
MapReduce Runner.</p>
+<p>The Hazelcast Jet Runner can be used to execute Beam pipelines using <a
href="https://jet.hazelcast.org/";>Hazelcat
+Jet</a>.</p>
-<h2 id="apache-hadoop-mapreduce-runner-prerequisites-and-setup">Apache Hadoop
MapReduce Runner prerequisites and setup</h2>
-<p>You need to have an Apache Hadoop environment with either <a
href="https://hadoop.apache.org/docs/r1.2.1/single_node_setup.html";>Single Node
Setup</a> or <a
href="https://hadoop.apache.org/docs/r1.2.1/cluster_setup.html";>Cluster
Setup</a></p>
+<p>The Jet Runner and Jet are suitable for large scale continuous jobs and
provide:</p>
+<ul>
+ <li>Support for both batch (bounded) and streaming (unbounded) data sets</li>
+ <li>A runtime that supports very high throughput and low event latency at
the same time</li>
+ <li>Natural back-pressure in streaming programs</li>
+ <li>Distributed massively parallel data processing engine with in memory
storage</li>
+</ul>
+
+<p>It’s important to note that the Jet Runner is currently in an
<em>EXPERIMENTAL</em> state and can not make use of many of
+the capabilities present in Jet:</p>
+<ul>
+ <li>Jet has full Fault Tolerance support, the Jet Runner does not; if a job
fails it must be restarted</li>
+ <li>Internal performance of Jet is extremely high.
+The Runner can’t match it as of now because Beam pipeline optimization/surgery
has not been fully implemented.</li>
+</ul>
-<p>The Apache Hadoop MapReduce runner currently supports Apache Hadoop version
2.8.1.</p>
+<p>The <a href="/documentation/runners/capability-matrix/">Beam Capability
Matrix</a> documents the
+supported capabilities of the Jet Runner.</p>
+
+<h1 id="running-wordcount-with-the-hazelcast-jet-runner">Running WordCount
with the Hazelcast Jet Runner</h1>
+
+<h2
id="generating-the-beam-examples-project-from-snapshot-versions-of-beam">Generating
the Beam examples project from SNAPSHOT versions of Beam</h2>
+<p>Make sure that your maven config (~/.m2/settings.xml) is set up to have
access to the Apache Snapshot Repository. It
+should contain this:</p>
+<div class="highlighter-rouge"><pre class="highlight"><code>
<repositories>
+ <repository>
+ <id>apache.snapshots</id>
+ <name>Apache Development Snapshot Repository</name>
+
<url>https://repository.apache.org/content/repositories/snapshots/</url>
+ <releases>
+ <enabled>true</enabled>
+ </releases>
+ <snapshots>
+ <enabled>true</enabled>
+ </snapshots>
+ </repository>
+ </repositories>
+</code></pre>
+</div>
-<p>You can add a dependency on the latest version of the Apache Hadoop
MapReduce runner by adding the following to your pom.xml:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code><dependency>
- <groupId>org.apache.beam</groupId>
- <artifactId>beam-runners-mapreduce</artifactId>
- <version>2.12.0</version>
-</dependency>
+<p>Generate the Examples Maven Project just like when the archetype is
local:</p>
+<div class="highlighter-rouge"><pre class="highlight"><code> $ cd
../../../../..
+ $ mvn archetype:generate \
+ -DarchetypeGroupId=org.apache.beam \
+ -DarchetypeArtifactId=beam-sdks-java-maven-archetypes-examples \
+ -DarchetypeVersion=2.14.0-SNAPSHOT \
+ -DgroupId=org.example \
+ -DartifactId=word-count-beam \
+ -Dversion="0.1" \
+ -Dpackage=org.apache.beam.examples \
+ -DinteractiveMode=false
</code></pre>
</div>
-<h2 id="deploying-apache-hadoop-mapreduce-with-your-application">Deploying
Apache Hadoop MapReduce with your application</h2>
-<p>To execute in a local Hadoop environment, use this command:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ mvn exec:java
-Dexec.mainClass=org.apache.beam.examples.WordCount \
- -Pmapreduce-runner \
- -Dexec.args="--runner=MapReduceRunner \
- --inputFile=/path/to/pom.xml \
- --output=/path/to/counts \
- --fileOutputDir=<directory for intermediate outputs>"
+<h2
id="generating-the-beam-examples-project-from-released-versions-of-beam">Generating
the Beam examples project from RELEASED versions of Beam</h2>
+
+<p>Caution: The released Beam versions don’t contain the Jet Runner yet. The
SNAPSHOT version has to be used until Jet is released.</p>
+
+<h2 id="running-wordcount-on-a-local-jet-cluster">Running WordCount on a Local
Jet Cluster</h2>
+<p>Issue following command in the Beam examples project to start new Jet
cluster and run the WordCount example on it.</p>
+<div class="highlighter-rouge"><pre class="highlight"><code> $ mvn package
exec:java \
+ -DskipTests \
+ -Dexec.mainClass=org.apache.beam.examples.WordCount \
+ -Dexec.args="\
+ --runner=JetRunner \
+ --jetGroupName=jet \
+ --jetLocalMode=3
+ --inputFile=pom.xml \
+ --output=counts" \
+ -Pjet-runner
</code></pre>
</div>
-<p>To execute in a Hadoop cluster, package your program along with all
dependencies in a fat jar.</p>
+<h2 id="running-wordcount-on-a-remote-jet-cluster">Running WordCount on a
Remote Jet Cluster</h2>
+<p>Download latest stable Hazelcast Jet code from <a
href="https://jet.hazelcast.org/download/";>Hazelcast Website</a> and
+start Jet cluster.
+The simplest way is to start Jet cluster member using the <code
class="highlighter-rouge">jet-start</code> script that comes with Jet
distribution.
+The members use the <a
href="https://docs.hazelcast.org/docs/3.12/manual/html-single/index.html#setting-up-clusters";>auto
discovery feature</a> to form a cluster.</p>
-<p>If you are following through the <a
href="/get-started/quickstart-java/">Beam Java SDK Quickstart</a>, you can run
this command:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ mvn package
-Pflink-runner
+<div class="highlighter-rouge"><pre class="highlight"><code> $ cd
hazelcast-jet/bin/
+ $ ./jet-start.sh &
+ $ ./jet-start.sh &
</code></pre>
</div>
-<p>For actually running the pipeline you would use this command</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>$ yarn jar
word-count-beam-bundled-0.1.jar \
- org.apache.beam.examples.WordCount \
- --runner=MapReduceRunner \
- --inputFile=/path/to/pom.xml \
- --output=/path/to/counts \
- --fileOutputDir=<directory for intermediate outputs>"
+<p>Check the cluster is up and running:</p>
+<div class="highlighter-rouge"><pre class="highlight"><code> $ ./jet.sh
cluster
</code></pre>
</div>
-<h2 id="pipeline-options-for-the-apache-hadoop-mapreduce-runner">Pipeline
options for the Apache Hadoop MapReduce Runner</h2>
-
-<p>When executing your pipeline with the Apache Hadoop MapReduce Runner, you
should consider the following pipeline options.</p>
-
-<table class="table table-bordered">
-<tr>
- <th>Field</th>
- <th>Description</th>
- <th>Default Value</th>
-</tr>
-<tr>
- <td><code>runner</code></td>
- <td>The pipeline runner to use. This option allows you to determine the
pipeline runner at runtime.</td>
- <td>Set to <code>MapReduceRunner</code> to run using Apache Hadoop
MapReduce.</td>
-</tr>
-<tr>
- <td><code>jarClass</code></td>
- <td>The jar class of the user Beam program.</td>
- <td>JarClassInstanceFactory.class</td>
-</tr>
-<tr>
- <td><code>fileOutputDir</code></td>
- <td>The directory for output files.</td>
- <td>"/tmp/mapreduce/"</td>
-</tr>
-</table>
+<p>You should see something like:</p>
+<div class="highlighter-rouge"><pre class="highlight"><code>State: ACTIVE
+Version: 3.0
+Size: 2
+
+ADDRESS UUID
+[192.168.0.117]:5701 76bea7ba-f032-4c25-ad04-bdef6782f481
+[192.168.0.117]:5702 03ecfaa2-be16-41b6-b5cf-eea584d7fb86
+</code></pre>
+</div>
+
+<p>Download <a
href="https://docs.hazelcast.org/docs/jet-management-center/3.0/manual/";>Jet
Management Center</a>
+from the same location and use it to monitor your cluster and later
executions.</p>
+
+<p>Change directory to the Beam Examples project and issue following command
to submit and execute your
+Pipeline on the remote Jet cluster.
+Make sure to distribute the input file (file with the words to be counted) to
all machines where the
+cluster runs. The word count job won’t be able to read the data otherwise.</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code> $ mvn package
exec:java \
+ -DskipTests \
+ -Dexec.mainClass=org.apache.beam.examples.WordCount \
+ -Dexec.args="\
+ --runner=JetRunner \
+ --jetGroupName=jet \
+ --jetServers=192.168.0.117:5701,192.168.0.117:5702 \
+ --codeJarPathname=target/word-count-beam-bundled-0.1.jar \
+ --inputFile=~/hazelcast-jet-3.0/license/apache-v2-license.txt \
+ --output=/tmp/counts" \
+ -Pjet-runner
+</code></pre>
+</div>
</div>
</div>
diff --git
a/website/generated-content/documentation/runners/mapreduce/index.html
b/website/generated-content/documentation/runners/mapreduce/index.html
index d099fde..f14e2f3 100644
--- a/website/generated-content/documentation/runners/mapreduce/index.html
+++ b/website/generated-content/documentation/runners/mapreduce/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git a/website/generated-content/documentation/runners/nemo/index.html
b/website/generated-content/documentation/runners/nemo/index.html
index a8f0f72..db87ce9 100644
--- a/website/generated-content/documentation/runners/nemo/index.html
+++ b/website/generated-content/documentation/runners/nemo/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git a/website/generated-content/documentation/runners/samza/index.html
b/website/generated-content/documentation/runners/samza/index.html
index 0d5b21d..31badff 100644
--- a/website/generated-content/documentation/runners/samza/index.html
+++ b/website/generated-content/documentation/runners/samza/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git a/website/generated-content/documentation/runners/spark/index.html
b/website/generated-content/documentation/runners/spark/index.html
index 4582b94..9cb9fea 100644
--- a/website/generated-content/documentation/runners/spark/index.html
+++ b/website/generated-content/documentation/runners/spark/index.html
@@ -160,6 +160,7 @@
<li><a href="/documentation/runners/samza/">Apache Samza</a></li>
<li><a href="/documentation/runners/spark/">Apache Spark</a></li>
<li><a href="/documentation/runners/dataflow/">Google Cloud Dataflow</a></li>
+<li><a href="/documentation/runners/jet/">Hazelcast Jet</a></li>
</ul>
</nav>
diff --git a/website/generated-content/get-started/quickstart-java/index.html
b/website/generated-content/get-started/quickstart-java/index.html
index 55cf704..84e3565 100644
--- a/website/generated-content/get-started/quickstart-java/index.html
+++ b/website/generated-content/get-started/quickstart-java/index.html
@@ -313,7 +313,7 @@ d----- 7/19/2018 11:00 PM subprocess
<h2 id="run-wordcount">Run WordCount</h2>
-<p>A single Beam pipeline can run on multiple Beam <a
href="/documentation#runners">runners</a>, including the <a
href="/documentation/runners/apex">ApexRunner</a>, <a
href="/documentation/runners/flink">FlinkRunner</a>, <a
href="/documentation/runners/spark">SparkRunner</a>, <a
href="/documentation/runners/nemo">NemoRunner</a>, or <a
href="/documentation/runners/dataflow">DataflowRunner</a>. The <a
href="/documentation/runners/direct">DirectRunner</a> is a common runner for
getting star [...]
+<p>A single Beam pipeline can run on multiple Beam <a
href="/documentation#runners">runners</a>, including the <a
href="/documentation/runners/apex">ApexRunner</a>, <a
href="/documentation/runners/flink">FlinkRunner</a>, <a
href="/documentation/runners/spark">SparkRunner</a>, <a
href="/documentation/runners/nemo">NemoRunner</a>, <a
href="/documentation/runners/jet">JetRunner</a>, or <a
href="/documentation/runners/dataflow">DataflowRunner</a>. The <a
href="/documentation/runners/direct"> [...]
<p>After you’ve chosen which runner you’d like to use:</p>
@@ -379,6 +379,12 @@ $ mvn compile exec:java
-Dexec.mainClass=org.apache.beam.examples.WordCount \
</code></pre>
</div>
+<div class="runner-jet highlighter-rouge"><pre class="highlight"><code>$ mvn
package -Pjet-runner -DskipTests
+$ java -cp target/word-count-beam-bundled-0.1.jar
org.apache.beam.examples.WordCount \
+ --runner=JetRunner --jetGroupName=jet --inputFile=`pwd`/pom.xml
--output=counts
+</code></pre>
+</div>
+
<p>For Windows PowerShell:</p>
<div class="runner-direct highlighter-rouge"><pre
class="highlight"><code>PS> mvn compile exec:java -D
exec.mainClass=org.apache.beam.examples.WordCount `
@@ -430,6 +436,12 @@ PS> java -cp target/word-count-beam-bundled-0.1.jar
org.apache.beam.examples.
</code></pre>
</div>
+<div class="runner-jet highlighter-rouge"><pre class="highlight"><code>PS>
mvn package -P jet-runner -DskipTests
+PS> java -cp target/word-count-beam-bundled-0.1.jar
org.apache.beam.examples.WordCount `
+ --runner=JetRunner --jetGroupName=jet --inputFile=`pwd`/pom.xml
--output=counts
+</code></pre>
+</div>
+
<h2 id="inspect-the-results">Inspect the results</h2>
<p>Once the pipeline has completed, you can view the output. You’ll notice
that there may be multiple output files prefixed by <code
class="highlighter-rouge">count</code>. The exact number of these files is
decided by the runner, giving it the flexibility to do efficient, distributed
execution.</p>
@@ -466,6 +478,10 @@ PS> java -cp target/word-count-beam-bundled-0.1.jar
org.apache.beam.examples.
</code></pre>
</div>
+<div class="runner-jet highlighter-rouge"><pre class="highlight"><code>$ ls
counts*
+</code></pre>
+</div>
+
<p>When you look into the contents of the file, you’ll see that they contain
unique words and the number of occurrences of each word. The order of elements
within the file may differ because the Beam model does not generally guarantee
ordering, again to allow runners to optimize for efficiency.</p>
<div class="runner-direct highlighter-rouge"><pre class="highlight"><code>$
more counts*
@@ -565,6 +581,21 @@ xml: 1
</code></pre>
</div>
+<div class="runner-jet highlighter-rouge"><pre class="highlight"><code>$ more
counts*
+FlinkRunner: 1
+cleanupDaemonThreads: 2
+sdks: 4
+unit: 1
+Apache: 3
+IO: 2
+copyright: 1
+governing: 1
+overrides: 1
+YARN: 1
+...
+</code></pre>
+</div>
+
<h2 id="next-steps">Next Steps</h2>
<ul>
diff --git a/website/generated-content/learn/runners/jet/index.html
b/website/generated-content/learn/runners/jet/index.html
new file mode 100644
index 0000000..a7a3dde
--- /dev/null
+++ b/website/generated-content/learn/runners/jet/index.html
@@ -0,0 +1,10 @@
+<!DOCTYPE html>
+<html lang="en-US">
+<meta charset="utf-8">
+<title>Redirecting…</title>
+<link rel="canonical"
href="https://beam.apache.org/documentation/runners/jet/";>
+<meta http-equiv="refresh" content="0;
url=https://beam.apache.org/documentation/runners/jet/";>
+<h1>Redirecting…</h1>
+<a href="https://beam.apache.org/documentation/runners/jet/";>Click here if you
are not redirected.</a>
+<script>location="https://beam.apache.org/documentation/runners/jet/";</script>
+</html>
