Added: samza/site/releases/1.8.0.html URL: http://svn.apache.org/viewvc/samza/site/releases/1.8.0.html?rev=1906774&view=auto ============================================================================== --- samza/site/releases/1.8.0.html (added) +++ samza/site/releases/1.8.0.html Wed Jan 18 19:33:25 2023 @@ -0,0 +1,660 @@ +<!DOCTYPE html> +<!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> +<html lang="en"> + +<head> + <meta http-equiv="X-UA-Compatible" content="IE=edge"> + <meta name="viewport" content="width=device-width, initial-scale=1, shrink-to-fit=no"> + <meta charset="utf-8"> + <title>Samza - Apache Samza 1.8.0 <a href="/learn/documentation/1.8.0/"> [Docs] </a></title> + <link rel="apple-touch-icon-precomposed" sizes="57x57" href="/img/favicon/apple-touch-icon-57x57.png" /> + <link rel="apple-touch-icon-precomposed" sizes="114x114" href="/img/favicon/apple-touch-icon-114x114.png" /> + <link rel="apple-touch-icon-precomposed" sizes="72x72" href="/img/favicon/apple-touch-icon-72x72.png" /> + <link rel="apple-touch-icon-precomposed" sizes="144x144" href="/img/favicon/apple-touch-icon-144x144.png" /> + <link rel="apple-touch-icon-precomposed" sizes="60x60" href="/img/favicon/apple-touch-icon-60x60.png" /> + <link rel="apple-touch-icon-precomposed" sizes="120x120" href="/img/favicon/apple-touch-icon-120x120.png" /> + <link rel="apple-touch-icon-precomposed" sizes="76x76" href="/img/favicon/apple-touch-icon-76x76.png" /> + <link rel="apple-touch-icon-precomposed" sizes="152x152" href="/img/favicon/apple-touch-icon-152x152.png" /> + <link rel="icon" type="image/png" href="/img/favicon/favicon-196x196.png" sizes="196x196" /> + <link rel="icon" type="image/png" href="/img/favicon/favicon-96x96.png" sizes="96x96" /> + <link rel="icon" type="image/png" href="/img/favicon/favicon-32x32.png" sizes="32x32" /> + <link rel="icon" type="image/png" href="/img/favicon/favicon-16x16.png" sizes="16x16" /> + <link rel="icon" type="image/png" href="/img/favicon/favicon-128.png" sizes="128x128" /> + <meta name="application-name" content="https://samza.apache.org"; /> + <meta name="msapplication-TileColor" content="#FFFFFF" /> + <meta name="msapplication-TileImage" content="/img/favicon/mstile-144x144.png" /> + <meta name="msapplication-square70x70logo" content="/img/favicon/mstile-70x70.png" /> + <meta name="msapplication-square150x150logo" content="/img/favicon/mstile-150x150.png" /> + <meta name="msapplication-wide310x150logo" content="/img/favicon/mstile-310x150.png" /> + <meta name="msapplication-square310x310logo" content="/img/favicon/mstile-310x310.png" /> + <link href="/css/ionicons.min.css" rel="stylesheet"> + <link href="/css/google-fonts.css" rel="stylesheet"> + <link href="/css/syntax.css" rel="stylesheet"/> + <link rel="stylesheet" href="/css/main.new.css" /> +</head> + +<body class="page"> + <!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> +<div class="main-navigation" data-plugin="menu"> + <div class="main-navigation__toggle" data-menu-closed> + <i class="icon ion-md-menu"></i> + </div> + <div class="main-navigation__toggle main-navigation__toggle--opened" data-menu-opened> + <i class="icon ion-md-close"></i> + </div> + <div class="main-navigation__inner"> + <div class="main-navigation__logo"> + <a href="/"> + <img class="main-navigation__logo-img" src="/img/samza-logo.png" srcset="/img/samza-logo.png 1x, /img/[email protected] 2x" + alt="Samza Logo" /> + </a> + </div> + <div class="main-navigation__items" data-menu-opened> + <a class="main-navigation__item" href="/">Home</a> + <a class="main-navigation__item" href="/learn/documentation/latest/core-concepts/core-concepts.html">Docs</a> + <a class="main-navigation__item" href="/powered-by/">Powered By</a> + <a class="main-navigation__item" href="/startup/download/">Downloads</a> + <a class="main-navigation__item" href="/blog/">Blog</a> + <div class="main-navigation__item main-navigation__item--group"> + <div class="main-navigation__item-group-title"> + Community + <i class="icon ion-md-arrow-dropdown"></i> + </div> + <div class="main-navigation__item-group-list"> + <a class="main-navigation__item" href="/community/contact-us.html">Contact Us</a> + <a class="main-navigation__item" href="/contribute/contributors-corner.html">Contributor's Corner</a> + <a class="main-navigation__item" href="/community/committers.html">PMC Members and committers</a> + <a class="main-navigation__item" href="/meetups/">Talks and Meetups</a> + </div> + </div> + </div> + </div> +</div> + + <div class="container"> + <div class="container__toggle"> + <i class="icon ion-md-arrow-dropleft-circle container__toggle-icon"></i> + <i class="icon ion-md-arrow-dropright-circle container__toggle-icon container__toggle-icon--opened"></i> + </div> + + <!-- There is only one menu, but made it as a no-output collection to grab data only --> + + <!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> + + +<div class="side-navigation"> + + + + + + + <!-- Start Group --> + + <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible"> + + + <!-- Make menu_title, and start items group if needed --> + + <div class="side-navigation__group-title"> + <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> + Getting Started + </div> + <div class="side-navigation__group-items " data-sub-menu > + + + <!-- Handle sub navigation items from data --> + + + + <a class="side-navigation__group-item" data-match-active="" href="/startup/quick-start/latest/">QuickStart</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/startup/code-examples/latest/">Code Examples</a> + + + + + <!-- Handle sub nagivation from site collections --> + + + <!-- Close sub nav group --> + + </div> + + + <!-- Close menu group --> + </div> + + + + + + + <!-- Start Group --> + + <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible"> + + + <!-- Make menu_title, and start items group if needed --> + + <div class="side-navigation__group-title"> + <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> + Documentation + </div> + <div class="side-navigation__group-items side-navigation__group-has-submenus" data-sub-menu data-documentation="/learn/documentation/latest/"> + + + <!-- Handle sub navigation items from data --> + + + <!-- Handle sub nagivation from site collections --> + + + <!-- Close sub nav group --> + + </div> + + + <!-- Close menu group --> + </div> + + + + + + + <!-- Start Group --> + + <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible"> + + + <!-- Make menu_title, and start items group if needed --> + + <div class="side-navigation__group-title"> + <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> + Releases + </div> + <div class="side-navigation__group-items " data-sub-menu > + + + <!-- Handle sub navigation items from data --> + + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.5.1">1.5.1</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.5.0">1.5.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.4.0">1.4.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.3.1">1.3.1</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.3.0">1.3.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.2.0">1.2.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.1.0">1.1.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.0.0">1.0.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/0.14">0.14</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/0.13">0.13</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/0.12">0.12</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/0.11">0.11</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/0.10">0.10</a> + + + + + <!-- Handle sub nagivation from site collections --> + + + <!-- Close sub nav group --> + + </div> + + + <!-- Close menu group --> + </div> + + + + + + + <!-- Start Group --> + + <div class="side-navigation__group"> + + + <!-- Make menu_title, and start items group if needed --> + + <a class="side-navigation__group-title" data-plugin="top-menu" data-match-active="" href="/blog/"> + Blog + </a> + + + <!-- Handle sub navigation items from data --> + + + <!-- Handle sub nagivation from site collections --> + + + <!-- Close sub nav group --> + + + <!-- Close menu group --> + </div> + + + + + + + <!-- Start Group --> + + <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible"> + + + <!-- Make menu_title, and start items group if needed --> + + <div class="side-navigation__group-title"> + <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> + Community + </div> + <div class="side-navigation__group-items " data-sub-menu > + + + <!-- Handle sub navigation items from data --> + + + + <a class="side-navigation__group-item" data-match-active="" href="/community/contact-us.html">Contact Us</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/contribute/contributors-corner.html">Contributor's Corner</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/contribute/enhancement-proposal.html">Enhancement Proposal</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/community/committers.html">PMC members & Committers</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/meetups/">Talks and Meetups</a> + + + + + <!-- Handle sub nagivation from site collections --> + + + <!-- Close sub nav group --> + + </div> + + + <!-- Close menu group --> + </div> + + + + + + + <!-- Start Group --> + + <div class="side-navigation__group side-navigation__group--has-nested" data-plugin="sub-menu" data-sub-menu-show-class="side-navigation__group--has-nested-visible"> + + + <!-- Make menu_title, and start items group if needed --> + + <div class="side-navigation__group-title"> + <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> + Case Studies + </div> + <div class="side-navigation__group-items " data-sub-menu > + + + <!-- Handle sub navigation items from data --> + + + + <a class="side-navigation__group-item" data-match-active="exact" href="/case-studies/">View All</a> + + + <hr> + + + + + <!-- Handle sub nagivation from site collections --> + + + + + + + + + + + + + + + + + + + + + + + + <a class="side-navigation__group-item" href="/case-studies/ebay" data-match-active="">eBay</a> + + + + + + + + + + + + + + + + + + + + <a class="side-navigation__group-item" href="/case-studies/tripadvisor" data-match-active="">TripAdvisor</a> + + + + + + + + + + + + + + + + <a class="side-navigation__group-item" href="/case-studies/slack" data-match-active="">Slack</a> + + + + + + + + + + + + + + <a class="side-navigation__group-item" href="/case-studies/optimizely" data-match-active="">Optimizely</a> + + + + + + + + + + + + + + <a class="side-navigation__group-item" href="/case-studies/redfin" data-match-active="">Redfin</a> + + + + + + + + + + + + + + <a class="side-navigation__group-item" href="/case-studies/linkedin" data-match-active="">LinkedIn</a> + + + + + + + + + + + <!-- Close sub nav group --> + + </div> + + + <!-- Close menu group --> + </div> + + + +</div> + + + + <div class="section"> + <div class="content"> + + <h2>Apache Samza 1.8.0 <a href="/learn/documentation/1.8.0/"> [Docs] </a></h2> + + + + + <!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> + +<p>We are thrilled to announce the release of Apache Samza 1.8.0.</p> + +<h3 id="key-features">Key Features:</h3> +<p>Below is a list of key features that we intend to include in this release:</p> +<ul> + <li><a href="https://cwiki.apache.org/confluence/display/SAMZA/SEP-31%3A+Pipeline+Drain-+Support+the+ability+to+drain+pipelines+to+allow+incompatible+intermediate+schema+changes";>SEP-31</a>: Pipeline Drain- Support the ability to drain pipelines to allow incompatible intermediate schema changes</li> + <li><a href="https://issues.apache.org/jira/browse/SAMZA-2757";>SAMZA-2757</a>: Make Samza Compatible with Java 11</li> +</ul> + +<p>Full list of the jira tickets addressed in this release can be found <a href="https://issues.apache.org/jira/browse/SAMZA-2744?jql=project%20%3D%20SAMZA%20AND%20fixVersion%20%3D%201.8";>here</a></p> + +<h4 id="upgrade-instructions">Upgrade Instructions</h4> +<p>For applications that are already on Samza 1.7.0, updating your dependencies to use Samza 1.8.0 should be sufficient to upgrade. +For applications that are on version 1.6 & below, please see instructions for 1.7.0 upgrade.</p> + +<h3 id="sources-downloads">Sources downloads</h3> +<p>A source download of Samza 1.8.0 is available <a href="https://dist.apache.org/repos/dist/release/samza/1.8.0/";>here</a>, and is also available in Apacheâs Maven repository. See Samzaâs download <a href="https://samza.apache.org/startup/download/";>page</a> for details and Samzaâs feature preview for new features.</p> + + + </div> + </div> + + </div> + + + <!-- footer starts here --> + + <!-- + Licensed to the Apache Software Foundation (ASF) under one or more + contributor license agreements. See the NOTICE file distributed with + this work for additional information regarding copyright ownership. + The ASF licenses this file to You under the Apache License, Version 2.0 + (the "License"); you may not use this file except in compliance with + the License. You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. +--> + +<footer> + <div class="footer-inner"> + <div class="side-by-side"> + <div> + <div class="footer__heading">Learn More</div> + <div class="footer__items"> + <a class="footer__item" href="/meetups/">Meetups</a> + <a class="footer__item" href="/blog/">Blog</a> + <a class="footer__item" href="/learn/documentation/latest/introduction/background.html">About</a> + </div> + </div> + <div> + <div class="footer__heading">Community</div> + <div class="footer__items"> + <a class="footer__item" href="/community/contact-us.html">Contact Us</a> + <a class="footer__item" href="/contribute/contributors-corner.html">Contributors' Corner</a> + <a class="footer__item" href="/community/committers.html">PMC members and committers</a> + <a class="footer__item" href="/powered-by/">Powered By</a> + </div> + </div> + + <div> + <div class="quick-links"> + <a class="quick-link" href="/startup/download" target="_blank"> + <i class="icon ion-md-download"></i> + </a> + <a class="quick-link" href="https://git-wip-us.apache.org/repos/asf?p=samza.git;a=tree"; target="_blank"> + <i class="icon ion-md-code"></i> + </a> + <a class="quick-link" href="https://twitter.com/samzastream"; target="_blank"> + <i class="icon ion-logo-twitter"></i> + </a> + </div> + + <p> + <script>document.write(new Date().getFullYear());</script> © samza.apache.org</p> + </div> + + </div> + </div> + +</footer> + + + +<!-- Google Analytics --> +<script> + (function (i, s, o, g, r, a, m) { + i['GoogleAnalyticsObject'] = r; i[r] = i[r] || function () { + (i[r].q = i[r].q || []).push(arguments) + }, i[r].l = 1 * new Date(); a = s.createElement(o), + m = s.getElementsByTagName(o)[0]; a.async = 1; a.src = g; m.parentNode.insertBefore(a, m) + })(window, document, 'script', '//www.google-analytics.com/analytics.js', 'ga'); + + ga('create', 'UA-43122768-1', 'apache.org'); + ga('send', 'pageview'); + +</script> +<script src="/js/main.new.js"></script> + +</body> + +</html> \ No newline at end of file
Modified: samza/site/releases/older.html URL: http://svn.apache.org/viewvc/samza/site/releases/older.html?rev=1906774&r1=1906773&r2=1906774&view=diff ============================================================================== --- samza/site/releases/older.html (original) +++ samza/site/releases/older.html Wed Jan 18 19:33:25 2023 @@ -81,7 +81,7 @@ </div> <div class="main-navigation__items" data-menu-opened> <a class="main-navigation__item" href="/">Home</a> - <a class="main-navigation__item" href="/learn/documentation/1.8.0/core-concepts/core-concepts.html">Docs</a> + <a class="main-navigation__item" href="/learn/documentation/latest/core-concepts/core-concepts.html">Docs</a> <a class="main-navigation__item" href="/powered-by/">Powered By</a> <a class="main-navigation__item" href="/startup/download/">Downloads</a> <a class="main-navigation__item" href="/blog/">Blog</a> @@ -152,10 +152,10 @@ - <a class="side-navigation__group-item" data-match-active="" href="/startup/quick-start/1.8.0/">QuickStart</a> + <a class="side-navigation__group-item" data-match-active="" href="/startup/quick-start/latest/">QuickStart</a> - <a class="side-navigation__group-item" data-match-active="" href="/startup/code-examples/1.8.0/">Code Examples</a> + <a class="side-navigation__group-item" data-match-active="" href="/startup/code-examples/latest/">Code Examples</a> @@ -187,7 +187,7 @@ <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> Documentation </div> - <div class="side-navigation__group-items side-navigation__group-has-submenus" data-sub-menu data-documentation="/learn/documentation/1.8.0/"> + <div class="side-navigation__group-items side-navigation__group-has-submenus" data-sub-menu data-documentation="/learn/documentation/latest/"> <!-- Handle sub navigation items from data --> @@ -227,6 +227,12 @@ + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> @@ -586,7 +592,7 @@ <div class="footer__items"> <a class="footer__item" href="/meetups/">Meetups</a> <a class="footer__item" href="/blog/">Blog</a> - <a class="footer__item" href="/learn/documentation/1.8.0/introduction/background.html">About</a> + <a class="footer__item" href="/learn/documentation/latest/introduction/background.html">About</a> </div> </div> <div> Modified: samza/site/startup/code-examples/latest/beam.html URL: http://svn.apache.org/viewvc/samza/site/startup/code-examples/latest/beam.html?rev=1906774&r1=1906773&r2=1906774&view=diff ============================================================================== --- samza/site/startup/code-examples/latest/beam.html (original) +++ samza/site/startup/code-examples/latest/beam.html Wed Jan 18 19:33:25 2023 @@ -227,6 +227,12 @@ + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> @@ -545,15 +551,18 @@ limitations under the License. --> -<p>The <a href="https://github.com/apache/samza-beam-examples";>samza-beam-examples</a> project contains examples to demonstrate running Beam pipelines with SamzaRunner locally, in Yarn cluster, or in standalone cluster with Zookeeper. More complex pipelines can be built from this project and run in similar manner. </p> +<p>The <a href="https://github.com/apache/samza-beam-examples";>samza-beam-examples</a> project contains examples to demonstrate running Beam pipelines with SamzaRunner locally, in Yarn cluster, or in standalone cluster with Zookeeper. More complex pipelines can be built from this project and run in similar manner.</p> <h3 id="example-pipelines">Example Pipelines</h3> - <p>The following examples are included:</p> <ol> -<li><p><a href="https://github.com/apache/samza-beam-examples/blob/master/src/main/java/org/apache/beam/examples/WordCount.java";><code>WordCount</code></a> reads a file as input (bounded data source), and computes word frequencies. </p></li> -<li><p><a href="https://github.com/apache/samza-beam-examples/blob/master/src/main/java/org/apache/beam/examples/KafkaWordCount.java";><code>KafkaWordCount</code></a> does the same word-count computation but reading from a Kafka stream (unbounded data source). It uses a fixed 10-sec window to aggregate the counts.</p></li> + <li> + <p><a href="https://github.com/apache/samza-beam-examples/blob/master/src/main/java/org/apache/beam/examples/WordCount.java";><code class="language-plaintext highlighter-rouge">WordCount</code></a> reads a file as input (bounded data source), and computes word frequencies.</p> + </li> + <li> + <p><a href="https://github.com/apache/samza-beam-examples/blob/master/src/main/java/org/apache/beam/examples/KafkaWordCount.java";><code class="language-plaintext highlighter-rouge">KafkaWordCount</code></a> does the same word-count computation but reading from a Kafka stream (unbounded data source). It uses a fixed 10-sec window to aggregate the counts.</p> + </li> </ol> <h3 id="run-the-examples">Run the Examples</h3> @@ -561,71 +570,89 @@ <p>Each example can be run locally, in Yarn cluster or in standalone cluster. Here we use KafkaWordCount as an example.</p> <h4 id="set-up">Set Up</h4> - <ol> -<li><p>Download and install <a href="https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html";>JDK version 8</a>. Verify that the JAVA_HOME environment variable is set and points to your JDK installation.</p></li> -<li><p>Download and install <a href="http://maven.apache.org/download.cgi";>Apache Maven</a> by following Mavenâs <a href="http://maven.apache.org/install.html";>installation guide</a> for your specific operating system.</p></li> + <li> + <p>Download and install <a href="https://www.oracle.com/technetwork/java/javase/downloads/jdk8-downloads-2133151.html";>JDK version 8</a>. Verify that the JAVA_HOME environment variable is set and points to your JDK installation.</p> + </li> + <li> + <p>Download and install <a href="http://maven.apache.org/download.cgi";>Apache Maven</a> by following Mavenâs <a href="http://maven.apache.org/install.html";>installation guide</a> for your specific operating system.</p> + </li> </ol> -<p>Check out the <code>samza-beam-examples</code> repo:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ git clone https://github.com/apache/samza-beam-examples.git +<p>Check out the <code class="language-plaintext highlighter-rouge">samza-beam-examples</code> repo:</p> + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ git clone https://github.com/apache/samza-beam-examples.git $ cd samza-beam-examples -</code></pre></div> -<p>A script named “grid” is included in this project which allows you to easily download and install Zookeeper, Kafka, and Yarn. +</code></pre></div></div> + +<p>A script named âgridâ is included in this project which allows you to easily download and install Zookeeper, Kafka, and Yarn. You can run the following to bring them all up running in your local machine:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ scripts/grid bootstrap -</code></pre></div> -<p>All the downloaded package files will be put under <code>deploy</code> folder. Once the grid command completes, + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ scripts/grid bootstrap +</code></pre></div></div> + +<p>All the downloaded package files will be put under <code class="language-plaintext highlighter-rouge">deploy</code> folder. Once the grid command completes, you can verify that Yarn is up and running by going to http://localhost:8088. You can also choose to bring them up separately, e.g.:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ scripts/grid install zookeeper + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ scripts/grid install zookeeper $ scripts/grid start zookeeper -</code></pre></div> -<p>Now let’s create a Kafka topic named “input-text” for this example:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ ./deploy/kafka/bin/kafka-topics.sh --zookeeper localhost:2181 --create --topic input-text --partitions 10 --replication-factor 1 -</code></pre></div> -<h4 id="run-locally">Run Locally</h4> +</code></pre></div></div> +<p>Now letâs create a Kafka topic named âinput-textâ for this example:</p> +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ ./deploy/kafka/bin/kafka-topics.sh --zookeeper localhost:2181 --create --topic input-text --partitions 10 --replication-factor 1 +</code></pre></div></div> + +<h4 id="run-locally">Run Locally</h4> <p>You can run directly within the project using maven:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.KafkaWordCount \ - -Dexec.args="--runner=SamzaRunner" -P samza-runner -</code></pre></div> -<h4 id="packaging-your-application">Packaging Your Application</h4> +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ mvn compile exec:java -Dexec.mainClass=org.apache.beam.examples.KafkaWordCount \ + -Dexec.args="--runner=SamzaRunner" -P samza-runner +</code></pre></div></div> + +<h4 id="packaging-your-application">Packaging Your Application</h4> <p>To execute the example in either Yarn or standalone, you need to package it first. After packaging, we deploy and explode the tgz in the deploy folder:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span> $ mkdir -p deploy/examples + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code> $ mkdir -p deploy/examples $ mvn package && tar -xvf target/samza-beam-examples-0.1-dist.tar.gz -C deploy/examples/ -</code></pre></div> -<h4 id="run-in-standalone-cluster-with-zookeeper">Run in Standalone Cluster with Zookeeper</h4> +</code></pre></div></div> -<p>You can use the <code>run-beam-standalone.sh</code> script included in this repo to run an example -in standalone mode. The config file is provided as <code>config/standalone.properties</code>. Note by -default we create one single split for the whole input (–maxSourceParallelism=1). To -set each Kafka partition in a split, we can set a large “maxSourceParallelism” value which +<h4 id="run-in-standalone-cluster-with-zookeeper">Run in Standalone Cluster with Zookeeper</h4> +<p>You can use the <code class="language-plaintext highlighter-rouge">run-beam-standalone.sh</code> script included in this repo to run an example +in standalone mode. The config file is provided as <code class="language-plaintext highlighter-rouge">config/standalone.properties</code>. Note by +default we create one single split for the whole input (âmaxSourceParallelism=1). To +set each Kafka partition in a split, we can set a large âmaxSourceParallelismâ value which is the upper bound of the number of splits.</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ deploy/examples/bin/run-beam-standalone.sh org.apache.beam.examples.KafkaWordCount \ + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ deploy/examples/bin/run-beam-standalone.sh org.apache.beam.examples.KafkaWordCount \ --configFilePath=$PWD/deploy/examples/config/standalone.properties --maxSourceParallelism=1024 -</code></pre></div> -<h4 id="run-yarn-cluster">Run Yarn Cluster</h4> +</code></pre></div></div> -<p>Similar to running standalone, we can use the <code>run-beam-yarn.sh</code> to run the examples -in Yarn cluster. The config file is provided as <code>config/yarn.properties</code>. To run the +<h4 id="run-yarn-cluster">Run Yarn Cluster</h4> +<p>Similar to running standalone, we can use the <code class="language-plaintext highlighter-rouge">run-beam-yarn.sh</code> to run the examples +in Yarn cluster. The config file is provided as <code class="language-plaintext highlighter-rouge">config/yarn.properties</code>. To run the KafkaWordCount example in yarn:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ deploy/examples/bin/run-beam-yarn.sh org.apache.beam.examples.KafkaWordCount \ + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ deploy/examples/bin/run-beam-yarn.sh org.apache.beam.examples.KafkaWordCount \ --configFilePath=$PWD/deploy/examples/config/yarn.properties --maxSourceParallelism=1024 -</code></pre></div> +</code></pre></div></div> + <h4 id="validate-the-pipeline-results">Validate the Pipeline Results</h4> +<p>Now the pipeline is deployed to either locally, standalone or Yarn. Letâs check out the results. First we start a kakfa consumer to listen to the output:</p> + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ ./deploy/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic word-count --property print.key=true +</code></pre></div></div> -<p>Now the pipeline is deployed to either locally, standalone or Yarn. Let’s check out the results. First we start a kakfa consumer to listen to the output:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ ./deploy/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic word-count --property print.key=true -</code></pre></div> -<p>Then let’s publish a few lines to the input Kafka topic:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>$ ./deploy/kafka/bin/kafka-console-producer.sh --topic input-text --broker-list localhost:9092 +<p>Then letâs publish a few lines to the input Kafka topic:</p> + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>$ ./deploy/kafka/bin/kafka-console-producer.sh --topic input-text --broker-list localhost:9092 Nory was a Catholic because her mother was a Catholic, and Noryâs mother was a Catholic because her father was a Catholic, and her father was a Catholic because his mother was a Catholic, or had been. -</code></pre></div> +</code></pre></div></div> + <p>You should see the word count shows up in the consumer console in about 10 secs:</p> -<div class="highlight"><pre><code class="language-text" data-lang="text"><span></span>a 6 + +<div class="language-plaintext highlighter-rouge"><div class="highlight"><pre class="highlight"><code>a 6 br 1 mother 3 was 6 @@ -640,22 +667,26 @@ and 2 her 3 or 1 because 3 -</code></pre></div> -<h3 id="beyond-examples">Beyond Examples</h3> +</code></pre></div></div> +<h3 id="beyond-examples">Beyond Examples</h3> <p>Feel free to build more complex pipelines based on the examples above, and reach out to us:</p> <ul> -<li><p>Subscribe and mail to <a href="mailto:[email protected]";>[email protected]</a> for any Beam questions.</p></li> -<li><p>Subscribe and mail to <a href="mailto:[email protected]";>[email protected]</a> for any Samza questions.</p></li> + <li> + <p>Subscribe and mail to <a href="mailto:[email protected]";>[email protected]</a> for any Beam questions.</p> + </li> + <li> + <p>Subscribe and mail to <a href="mailto:[email protected]";>[email protected]</a> for any Samza questions.</p> + </li> </ul> <h3 id="more-information">More Information</h3> <ul> -<li><a href="http://beam.apache.org";>Apache Beam</a></li> -<li><a href="https://samza.apache.org/";>Apache Samza</a></li> -<li>Quickstart: <a href="https://beam.apache.org/get-started/quickstart-java";>Java</a>, <a href="https://beam.apache.org/get-started/quickstart-py";>Python</a>, <a href="https://beam.apache.org/get-started/quickstart-go";>Go</a></li> + <li><a href="http://beam.apache.org";>Apache Beam</a></li> + <li><a href="https://samza.apache.org/";>Apache Samza</a></li> + <li>Quickstart: <a href="https://beam.apache.org/get-started/quickstart-java";>Java</a>, <a href="https://beam.apache.org/get-started/quickstart-py";>Python</a>, <a href="https://beam.apache.org/get-started/quickstart-go";>Go</a></li> </ul> Modified: samza/site/startup/code-examples/latest/index.html URL: http://svn.apache.org/viewvc/samza/site/startup/code-examples/latest/index.html?rev=1906774&r1=1906773&r2=1906774&view=diff ============================================================================== --- samza/site/startup/code-examples/latest/index.html (original) +++ samza/site/startup/code-examples/latest/index.html Wed Jan 18 19:33:25 2023 @@ -227,6 +227,12 @@ + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> Modified: samza/site/startup/code-examples/latest/samza.html URL: http://svn.apache.org/viewvc/samza/site/startup/code-examples/latest/samza.html?rev=1906774&r1=1906773&r2=1906774&view=diff ============================================================================== --- samza/site/startup/code-examples/latest/samza.html (original) +++ samza/site/startup/code-examples/latest/samza.html Wed Jan 18 19:33:25 2023 @@ -227,6 +227,12 @@ + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> @@ -549,36 +555,45 @@ <p>The <a href="https://github.com/apache/samza-hello-samza";>hello-samza</a> project contains several examples to help you create your Samza applications. To checkout the hello-samza project:</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>> git clone https://gitbox.apache.org/repos/asf/samza-hello-samza.git hello-samza</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span class="o">></span> git clone https://gitbox.apache.org/repos/asf/samza-hello-samza.git hello-samza</code></pre></figure> <h4 id="high-level-api-examples">High-level API examples</h4> - <p><a href="https://github.com/apache/samza-hello-samza/tree/master/src/main/java/samza/examples/cookbook";>The Samza Cookbook</a> contains various recipes using the Samza high-level API. These include:</p> <ul> -<li><p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/FilterExample.java";>Filter example</a> demonstrates how to perform stateless operations on a stream. </p></li> -<li><p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/JoinExample.java";>Join example</a> demonstrates how you can join a Kafka stream of page-views with a stream of ad-clicks</p></li> -<li><p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/RemoteTableJoinExample.java";>Stream-Table Join example</a> demonstrates how to use the Samza Table API. It joins a Kafka stream with a remote dataset accessed through a REST service.</p></li> -<li><p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/SessionWindowExample.java";>SessionWindow</a> and <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/TumblingWindowExample.java";>TumblingWindow</a> examples illustrate Samza’s rich windowing and triggering capabilities.</p></li> + <li> + <p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/FilterExample.java";>Filter example</a> demonstrates how to perform stateless operations on a stream.</p> + </li> + <li> + <p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/JoinExample.java";>Join example</a> demonstrates how you can join a Kafka stream of page-views with a stream of ad-clicks</p> + </li> + <li> + <p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/RemoteTableJoinExample.java";>Stream-Table Join example</a> demonstrates how to use the Samza Table API. It joins a Kafka stream with a remote dataset accessed through a REST service.</p> + </li> + <li> + <p>The <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/SessionWindowExample.java";>SessionWindow</a> and <a href="https://github.com/apache/samza-hello-samza/blob/latest/src/main/java/samza/examples/cookbook/TumblingWindowExample.java";>TumblingWindow</a> examples illustrate Samzaâs rich windowing and triggering capabilities.</p> + </li> </ul> <p>In addition to the cookbook, you can also consult these:</p> <ul> -<li><p><a href="https://github.com/apache/samza-hello-samza/tree/master/src/main/java/samza/examples/wikipedia";>Wikipedia Parser</a>: An advanced example that builds a streaming pipeline consuming a live-feed of wikipedia edits, parsing each message and generating statistics from them.</p></li> -<li><p><a href="https://github.com/apache/samza-hello-samza/tree/master/src/main/java/samza/examples/kinesis";>Amazon Kinesis</a> and <a href="https://github.com/apache/samza-hello-samza/tree/latest/src/main/java/samza/examples/azure";>Azure Eventhubs</a> examples that cover how to consume input data from the respective systems.</p></li> + <li> + <p><a href="https://github.com/apache/samza-hello-samza/tree/master/src/main/java/samza/examples/wikipedia";>Wikipedia Parser</a>: An advanced example that builds a streaming pipeline consuming a live-feed of wikipedia edits, parsing each message and generating statistics from them.</p> + </li> + <li> + <p><a href="https://github.com/apache/samza-hello-samza/tree/master/src/main/java/samza/examples/kinesis";>Amazon Kinesis</a> and <a href="https://github.com/apache/samza-hello-samza/tree/latest/src/main/java/samza/examples/azure";>Azure Eventhubs</a> examples that cover how to consume input data from the respective systems.</p> + </li> </ul> <h4 id="low-level-api-examples">Low-level API examples</h4> - <p>The <a href="https://github.com/apache/samza-hello-samza/tree/latest/src/main/java/samza/examples/wikipedia/task/application";>Wikipedia Parser (low-level API)</a>: Same example that builds a streaming pipeline consuming a live-feed of wikipedia edits, parsing each message and generating statistics from them, but -using low-level APIs. </p> +using low-level APIs.</p> <h4 id="samza-sql-api-examples">Samza SQL API examples</h4> - <p>You can easily create a Samza job declaratively using <a href="https://samza.apache.org/learn/tutorials/latest/samza-sql.html";>Samza SQL</a>.</p> Modified: samza/site/startup/download/index.html URL: http://svn.apache.org/viewvc/samza/site/startup/download/index.html?rev=1906774&r1=1906773&r2=1906774&view=diff ============================================================================== --- samza/site/startup/download/index.html (original) +++ samza/site/startup/download/index.html Wed Jan 18 19:33:25 2023 @@ -81,7 +81,7 @@ </div> <div class="main-navigation__items" data-menu-opened> <a class="main-navigation__item" href="/">Home</a> - <a class="main-navigation__item" href="/learn/documentation/1.8.0/core-concepts/core-concepts.html">Docs</a> + <a class="main-navigation__item" href="/learn/documentation/latest/core-concepts/core-concepts.html">Docs</a> <a class="main-navigation__item" href="/powered-by/">Powered By</a> <a class="main-navigation__item" href="/startup/download/">Downloads</a> <a class="main-navigation__item" href="/blog/">Blog</a> @@ -152,10 +152,10 @@ - <a class="side-navigation__group-item" data-match-active="" href="/startup/quick-start/1.8.0/">QuickStart</a> + <a class="side-navigation__group-item" data-match-active="" href="/startup/quick-start/latest/">QuickStart</a> - <a class="side-navigation__group-item" data-match-active="" href="/startup/code-examples/1.8.0/">Code Examples</a> + <a class="side-navigation__group-item" data-match-active="" href="/startup/code-examples/latest/">Code Examples</a> @@ -187,7 +187,7 @@ <i class="side-navigation__group-title-icon icon ion-md-arrow-dropdown"></i> Documentation </div> - <div class="side-navigation__group-items side-navigation__group-has-submenus" data-sub-menu data-documentation="/learn/documentation/1.8.0/"> + <div class="side-navigation__group-items side-navigation__group-has-submenus" data-sub-menu data-documentation="/learn/documentation/latest/"> <!-- Handle sub navigation items from data --> @@ -227,6 +227,12 @@ + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> @@ -547,7 +553,7 @@ <p>Samza is released as a source artifact, and also through Maven.</p> -<p>If you just want to play around with Samza for the first time, go to <a href="/startup/hello-samza/1.8.0">Hello Samza</a>.</p> +<p>If you just want to play around with Samza for the first time, go to <a href="/startup/hello-samza/latest">Hello Samza</a>.</p> <h3 id="jdk-notice">JDK Notice</h3> @@ -558,6 +564,8 @@ <p>Samza tools package contains command line tools that user can run to use Samza and itâs input/output systems.</p> <ul> + <li><a href="http://www-us.apache.org/dist/samza/1.8.0/samza-tools_2.12-1.8.0.tgz";>samza-tools_2.12-1.8.0.tgz</a></li> + <li><a href="http://www-us.apache.org/dist/samza/1.7.0/samza-tools_2.12-1.7.0.tgz";>samza-tools_2.12-1.7.0.tgz</a></li> <li><a href="http://www-us.apache.org/dist/samza/1.6.0/samza-tools_2.11-1.6.0.tgz";>samza-tools_2.11-1.6.0.tgz</a></li> <li><a href="http://www-us.apache.org/dist/samza/1.5.1/samza-tools_2.11-1.5.1.tgz";>samza-tools_2.11-1.5.1.tgz</a></li> <li><a href="http://www-us.apache.org/dist/samza/1.5.0/samza-tools_2.11-1.5.0.tgz";>samza-tools_2.11-1.5.0.tgz</a></li> @@ -573,6 +581,8 @@ <h3 id="source-releases">Source Releases</h3> <ul> + <li><a href="http://www.apache.org/dyn/closer.lua/samza/1.8._0";>samza-sources-1.8.0.tgz</a></li> + <li><a href="http://www.apache.org/dyn/closer.lua/samza/1.7.0";>samza-sources-1.7.0.tgz</a></li> <li><a href="http://www.apache.org/dyn/closer.lua/samza/1.6.0";>samza-sources-1.6.0.tgz</a></li> <li><a href="http://www.apache.org/dyn/closer.lua/samza/1.5.1";>samza-sources-1.5.1.tgz</a></li> <li><a href="http://www.apache.org/dyn/closer.lua/samza/1.5.0";>samza-sources-1.5.0.tgz</a></li> @@ -670,7 +680,7 @@ <span class="nt"><version></span>0.8.1<span class="nt"></version></span> <span class="nt"></dependency></span></code></pre></figure> -<p><a href="/startup/hello-samza/1.8.0">Hello Samza</a> is a working Maven project that illustrates how to build projects that have Samza jobs in them.</p> +<p><a href="/startup/hello-samza/latest">Hello Samza</a> is a working Maven project that illustrates how to build projects that have Samza jobs in them.</p> <h4 id="repositories">Repositories</h4> @@ -732,7 +742,7 @@ <div class="footer__items"> <a class="footer__item" href="/meetups/">Meetups</a> <a class="footer__item" href="/blog/">Blog</a> - <a class="footer__item" href="/learn/documentation/1.8.0/introduction/background.html">About</a> + <a class="footer__item" href="/learn/documentation/latest/introduction/background.html">About</a> </div> </div> <div> Modified: samza/site/startup/hello-samza/latest/index.html URL: http://svn.apache.org/viewvc/samza/site/startup/hello-samza/latest/index.html?rev=1906774&r1=1906773&r2=1906774&view=diff ============================================================================== --- samza/site/startup/hello-samza/latest/index.html (original) +++ samza/site/startup/hello-samza/latest/index.html Wed Jan 18 19:33:25 2023 @@ -227,6 +227,12 @@ + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.8.0">1.8.0</a> + + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.7.0">1.7.0</a> + + <a class="side-navigation__group-item" data-match-active="" href="/releases/1.6.0">1.6.0</a> @@ -544,27 +550,26 @@ See the License for the specific language governing permissions and limitations under the License. --> - <p>The <a href="https://github.com/apache/samza-hello-samza";>hello-samza</a> project is an example project designed to help you run your first Samza job.</p> <h3 id="get-the-code">Get the Code</h3> <p>Check out the hello-samza project:</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>git clone https://gitbox.apache.org/repos/asf/samza-hello-samza.git hello-samza -<span class="nb">cd</span> hello-samza</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">git clone https://gitbox.apache.org/repos/asf/samza-hello-samza.git hello-samza +<span class="nb">cd </span>hello-samza</code></pre></figure> -<p>This project contains everything you’ll need to run your first Samza jobs.</p> +<p>This project contains everything youâll need to run your first Samza jobs.</p> <h3 id="start-a-grid">Start a Grid</h3> -<p>A Samza grid usually comprises three different systems: <a href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html";>YARN</a>, <a href="http://kafka.apache.org/";>Kafka</a>, and <a href="http://zookeeper.apache.org/";>ZooKeeper</a>. The hello-samza project comes with a script called “grid” to help you setup these systems. Start by running:</p> +<p>A Samza grid usually comprises three different systems: <a href="http://hadoop.apache.org/docs/current/hadoop-yarn/hadoop-yarn-site/YARN.html";>YARN</a>, <a href="http://kafka.apache.org/";>Kafka</a>, and <a href="http://zookeeper.apache.org/";>ZooKeeper</a>. The hello-samza project comes with a script called âgridâ to help you setup these systems. Start by running:</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>bin/grid bootstrap</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">bin/grid bootstrap</code></pre></figure> -<p>This command will download, install, and start ZooKeeper, Kafka, and YARN. It will also check out the latest version of Samza and build it. All package files will be put in a sub-directory called “deploy” inside hello-samza’s root folder.</p> +<p>This command will download, install, and start ZooKeeper, Kafka, and YARN. It will also check out the latest version of Samza and build it. All package files will be put in a sub-directory called âdeployâ inside hello-samzaâs root folder.</p> -<p>If you get a complaint that JAVA_HOME is not set, then you’ll need to set it to the path where Java is installed on your system.</p> +<p>If you get a complaint that JAVA_HOME is not set, then youâll need to set it to the path where Java is installed on your system.</p> <p>Once the grid command completes, you can verify that YARN is up and running by going to <a href="http://localhost:8088";>http://localhost:8088</a>. This is the YARN UI.</p> @@ -575,66 +580,66 @@ <p><strong>(Optional)</strong> NOTE: if you want the hello-samza jobs to run with a local Samza build (e.g., if you are a Samza developer), make sure that you run the following steps, otherwise skip them.</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>In your hello-samza project, +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">In your hello-samza project, git checkout latest -In your <span class="nb">local</span> Samza project, +In your <span class="nb">local </span>Samza project, ./gradlew publishToMavenLocal </code></pre></figure> <p>Then, you can continue w/ the following command in hello-samza project:</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>mvn clean package -mkdir -p deploy/samza -tar -xvf ./target/hello-samza-1.7.0-SNAPSHOT-dist.tar.gz -C deploy/samza</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">mvn clean package +<span class="nb">mkdir</span> <span class="nt">-p</span> deploy/samza +<span class="nb">tar</span> <span class="nt">-xvf</span> ./target/hello-samza-1.9.0-SNAPSHOT-dist.tar.gz <span class="nt">-C</span> deploy/samza</code></pre></figure> <h3 id="run-a-samza-job">Run a Samza Job</h3> -<p>After you’ve built your Samza package, you can start a job on the grid using the run-app.sh script.</p> +<p>After youâve built your Samza package, you can start a job on the grid using the run-app.sh script.</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>deploy/samza/bin/run-app.sh --config-path<span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-feed.properties</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">deploy/samza/bin/run-app.sh <span class="nt">--config-path</span><span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-feed.properties</code></pre></figure> -<p>The job will consume a feed of real-time edits from Wikipedia, and produce them to a Kafka topic called “wikipedia-raw”. Give the job a minute to startup, and then tail the Kafka topic:</p> +<p>The job will consume a feed of real-time edits from Wikipedia, and produce them to a Kafka topic called âwikipedia-rawâ. Give the job a minute to startup, and then tail the Kafka topic:</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>deploy/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic wikipedia-raw</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">deploy/kafka/bin/kafka-console-consumer.sh <span class="nt">--bootstrap-server</span> localhost:9092 <span class="nt">--topic</span> wikipedia-raw</code></pre></figure> -<p>Pretty neat, right? Now, check out the YARN UI again (<a href="http://localhost:8088";>http://localhost:8088</a>). This time around, you’ll see your Samza job is running!</p> +<p>Pretty neat, right? Now, check out the YARN UI again (<a href="http://localhost:8088";>http://localhost:8088</a>). This time around, youâll see your Samza job is running!</p> <p>If you can not see any output from Kafka consumer, you may have connection problem. Check <a href="../../../learn/tutorials/latest/run-hello-samza-without-internet.html">here</a>.</p> <h3 id="generate-wikipedia-statistics">Generate Wikipedia Statistics</h3> -<p>Let’s calculate some statistics based on the messages in the wikipedia-raw topic. Start two more jobs:</p> +<p>Letâs calculate some statistics based on the messages in the wikipedia-raw topic. Start two more jobs:</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>deploy/samza/bin/run-app.sh --config-path<span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-parser.properties -deploy/samza/bin/run-app.sh --config-path<span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-stats.properties</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">deploy/samza/bin/run-app.sh <span class="nt">--config-path</span><span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-parser.properties +deploy/samza/bin/run-app.sh <span class="nt">--config-path</span><span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-stats.properties</code></pre></figure> <p>The first job (wikipedia-parser) parses the messages in wikipedia-raw, and extracts information about the size of the edit, who made the change, etc. You can take a look at its output with:</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>deploy/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic wikipedia-edits</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">deploy/kafka/bin/kafka-console-consumer.sh <span class="nt">--bootstrap-server</span> localhost:9092 <span class="nt">--topic</span> wikipedia-edits</code></pre></figure> <p>The last job (wikipedia-stats) reads messages from the wikipedia-edits topic, and calculates counts, every ten seconds, for all edits that were made during that window. It outputs these counts to the wikipedia-stats topic.</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>deploy/kafka/bin/kafka-console-consumer.sh --bootstrap-server localhost:9092 --topic wikipedia-stats</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">deploy/kafka/bin/kafka-console-consumer.sh <span class="nt">--bootstrap-server</span> localhost:9092 <span class="nt">--topic</span> wikipedia-stats</code></pre></figure> <p>The messages in the stats topic look like this:</p> -<figure class="highlight"><pre><code class="language-json" data-lang="json"><span></span><span class="p">{</span><span class="nt">"is-talk"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nt">"bytes-added"</span><span class="p">:</span><span class="mi">5276</span><span class="p">,</span><span class="nt">"edits"</span><span class="p">:</span><span class="mi">13</span><span class="p">,</span><span class="nt">"unique-titles"</span><span class="p">:</span><span class="mi">13</span><span class="p">}</span> -<span class="p">{</span><span class="nt">"is-bot-edit"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nt">"is-talk"</span><span class="p">:</span><span class="mi">3</span><span class="p">,</span><span class="nt">"bytes-added"</span><span class="p">:</span><span class="mi">4211</span><span class="p">,</span><span class="nt">"edits"</span><span class="p">:</span><span class="mi">30</span><span class="p">,</span><span class="nt">"unique-titles"</span><span class="p">:</span><span class="mi">30</span><span class="p">,</span><span class="nt">"is-unpatrolled"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nt">"is-new"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nt">"is-minor"</span><span class="p">:</span><span class="mi">7</span><span class="p">}</span> -<span class="p">{</span><span class="nt">"bytes-added"</span><span class="p">:</span><span class="mi">3180</span><span class="p">,</span><span class="nt">"edits"</span><span class="p">:</span><span class="mi">19</span><span class="p">,</span><span class="nt">"unique-titles"</span><span class="p">:</span><span class="mi">19</span><span class="p">,</span><span class="nt">"is-unpatrolled"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nt">"is-new"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nt">"is-minor"</span><span class="p">:</span><span class="mi">3</span><span class="p">}</span> -<span class="p">{</span><span class="nt">"bytes-added"</span><span class="p">:</span><span class="mi">2218</span><span class="p">,</span><span class="nt">"edits"</span><span class="p">:</span><span class="mi">18</span><span class="p">,</span><span class="nt">"unique-titles"</span><span class="p">:</span><span class="mi">18</span><span class="p">,</span><span class="nt">"is-unpatrolled"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nt">"is-new"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nt">"is-minor"</span><span class="p">:</span><span class="mi">3</span><span class="p">}</span></code></pre></figure> +<figure class="highlight"><pre><code class="language-json" data-lang="json"><span class="p">{</span><span class="nl">"is-talk"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nl">"bytes-added"</span><span class="p">:</span><span class="mi">5276</span><span class="p">,</span><span class="nl">"edits"</span><span class="p">:</span><span class="mi">13</span><span class="p">,</span><span class="nl">"unique-titles"</span><span class="p">:</span><span class="mi">13</span><span class="p">}</span><span class="w"> +</span><span class="p">{</span><span class="nl">"is-bot-edit"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nl">"is-talk"</span><span class="p">:</span><span class="mi">3</span><span class="p">,</span><span class="nl">"bytes-added"</span><span class="p">:</span><span class="mi">4211</span><span class="p">,</span><span class="nl">"edits"</span><span class="p">:</span><span class="mi">30</span><span class="p">,</span><span class="nl">"unique-titles"</span><span class="p">:</span><span class="mi">30</span><span class="p">,</span><span class="nl">"is-unpatrolled"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nl">"is-new"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nl">"is-minor"</span><span class="p">:</span><span class="mi">7</span><span class="p">}</span><span class="w"> +</span><span class="p">{</span><span class="nl">"bytes-added"</span><span class="p">:</span><span class="mi">3180</span><span class="p">,</span><span class="nl">"edits"</span><span class="p">:</span><span class="mi">19</span><span class="p">,</span><span class="nl">"unique-titles"</span><span class="p">:</span><span class="mi">19</span><span class="p">,</span><span class="nl">"is-unpatrolled"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nl">"is-new"</span><span class="p">:</span><span class="mi">1</span><span class="p">,</span><span class="nl">"is-minor"</span><span class="p">:</span><span class="mi">3</span><span class="p">}</span><span class="w"> +</span><span class="p">{</span><span class="nl">"bytes-added"</span><span class="p">:</span><span class="mi">2218</span><span class="p">,</span><span class="nl">"edits"</span><span class="p">:</span><span class="mi">18</span><span class="p">,</span><span class="nl">"unique-titles"</span><span class="p">:</span><span class="mi">18</span><span class="p">,</span><span class="nl">"is-unpatrolled"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nl">"is-new"</span><span class="p">:</span><span class="mi">2</span><span class="p">,</span><span class="nl">"is-minor"</span><span class="p">:</span><span class="mi">3</span><span class="p">}</span></code></pre></figure> -<p>If you check the YARN UI, again, you’ll see that all three jobs are now listed.</p> +<p>If you check the YARN UI, again, youâll see that all three jobs are now listed.</p> <h3 id="shutdown">Shutdown</h3> -<p>To shutdown one of the jobs, use the same script with an extra ‘–operation=kill’ argument</p> +<p>To shutdown one of the jobs, use the same script with an extra ââoperation=killâ argument</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>deploy/samza/bin/run-app.sh --config-path<span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-feed.properties --operation<span class="o">=</span><span class="nb">kill</span></code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">deploy/samza/bin/run-app.sh <span class="nt">--config-path</span><span class="o">=</span><span class="nv">$PWD</span>/deploy/samza/config/wikipedia-feed.properties <span class="nt">--operation</span><span class="o">=</span><span class="nb">kill</span></code></pre></figure> -<p>After you’re done, you can clean everything up using the same grid script.</p> +<p>After youâre done, you can clean everything up using the same grid script.</p> -<figure class="highlight"><pre><code class="language-bash" data-lang="bash"><span></span>bin/grid stop all</code></pre></figure> +<figure class="highlight"><pre><code class="language-bash" data-lang="bash">bin/grid stop all</code></pre></figure> -<p>Congratulations! You’ve now setup a local grid that includes YARN, Kafka, and ZooKeeper, and run a Samza job on it. Next up, check out the <a href="/learn/documentation/latest/introduction/background.html">Background</a> and <a href="/learn/documentation/latest/api/overview.html">API Overview</a> pages.</p> +<p>Congratulations! Youâve now setup a local grid that includes YARN, Kafka, and ZooKeeper, and run a Samza job on it. Next up, check out the <a href="/learn/documentation/latest/introduction/background.html">Background</a> and <a href="/learn/documentation/latest/api/overview.html">API Overview</a> pages.</p> </div>
