Author: buildbot Date: Tue Jan 13 15:53:22 2015 New Revision: 936055 Log: Staging update by buildbot for slider
Modified: websites/staging/slider/trunk/content/ (props changed) websites/staging/slider/trunk/content/design/index.html websites/staging/slider/trunk/content/design/ssl_implementation.html websites/staging/slider/trunk/content/developing/index.html websites/staging/slider/trunk/content/developing/releasing.html websites/staging/slider/trunk/content/docs/high_availability.html websites/staging/slider/trunk/content/docs/index.html Propchange: websites/staging/slider/trunk/content/ ------------------------------------------------------------------------------ --- cms:source-revision (original) +++ cms:source-revision Tue Jan 13 15:53:22 2015 @@ -1 +1 @@ -1646432 +1651392 Modified: websites/staging/slider/trunk/content/design/index.html ============================================================================== --- websites/staging/slider/trunk/content/design/index.html (original) +++ websites/staging/slider/trunk/content/design/index.html Tue Jan 13 15:53:22 2015 @@ -179,7 +179,7 @@ Latest release: <strong>0.60.0-incubatin <h1 id="apache-slider-architecture">Apache Slider Architecture</h1> <ul> -<li><a href="/design/architecture.html">Overview</a></li> +<li><a href="/design/architecture.html">Architecture</a></li> <li><a href="/docs/slider_specs/application_needs.html">Application Needs</a></li> <li><a href="/design/specification/index.html">Specification</a></li> <li><a href="/design/registry/index.html">Service Registry</a></li> Modified: websites/staging/slider/trunk/content/design/ssl_implementation.html ============================================================================== --- websites/staging/slider/trunk/content/design/ssl_implementation.html (original) +++ websites/staging/slider/trunk/content/design/ssl_implementation.html Tue Jan 13 15:53:22 2015 @@ -160,7 +160,21 @@ Latest release: <strong>0.60.0-incubatin <h1 class="title"></h1> - <h1 id="agent-to-application-master-ssl-communication">Agent to Application Master SSL Communication</h1> + <!--- + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. See accompanying LICENSE file. +--> + +<h1 id="agent-to-application-master-ssl-communication">Agent to Application Master SSL Communication</h1> <p>Slider agents are configured to communicate with the Slider Application Master using SSL. By default, one-way SSL authentication is enabled (i.e., the agent verifies the identity of the application master). However, two-way SSL authentication can be enabled to further secure the communication channel.</p> <h2 id="application-master-ssl-support">Application Master SSL Support</h2> <p>There are two primary components enabling server-side SSL support:</p> Modified: websites/staging/slider/trunk/content/developing/index.html ============================================================================== --- websites/staging/slider/trunk/content/developing/index.html (original) +++ websites/staging/slider/trunk/content/developing/index.html Tue Jan 13 15:53:22 2015 @@ -189,7 +189,6 @@ Slider</p> <li><a href="functional_tests.html">Functional Testing</a></li> <li><a href="manual_testing.html">Manual Testing</a></li> <li><a href="releasing.html">Releasing</a></li> -<li><a href="releasing.html">Releasing</a></li> <li><a href="style.html">Style Guide</a></li> <li><a href="submitting_patches.html">Submitting Patches</a></li> <li><a href="windows.html">Windows Development and Testing</a></li> Modified: websites/staging/slider/trunk/content/developing/releasing.html ============================================================================== --- websites/staging/slider/trunk/content/developing/releasing.html (original) +++ websites/staging/slider/trunk/content/developing/releasing.html Tue Jan 13 15:53:22 2015 @@ -209,7 +209,8 @@ create HBase and Accumulo clusters in th <p><em>Make sure that the integration tests are passing (and not being skipped) before starting to make a release</em></p> <p><em>2.</em> Check out the latest version of <code>origin/master</code>.</p> -<p><em>3.</em> If you are not building against a stable Hadoop release</p> +<p><em>3.</em> Make sure there are no uncommitted files in your local repo. </p> +<p><em>4.</em> If you are not building against a stable Hadoop release</p> <ol> <li>Check out the hadoop branch you intend to build and test against âand include in the redistributable artifacts.</li> @@ -220,8 +221,16 @@ starting to make a release</em></p> <h5 id="profiles">Profiles</h5> <p>The slider POMs offer different profiles of hadoop versions to build against. The instructions below do not choose one. If a profile is needed, append it to all the maven commands.</p> -<p>e.g. {{mvn clean install -DskipTests -Prelease-2.6}}</p> -<h2 id="wzxhzdk42wzxhzdk43phase-i"><a name="phase1"></a>Phase - I</h2> +<p>e.g. <code>mvn clean install -DskipTests -Prelease-2.6</code></p> +<h2 id="wzxhzdk44wzxhzdk45phase-i"><a name="phase1"></a>Phase - I</h2> +<p><strong>Step #0:</strong> Sync up with the ASF repo. You do not want to release the wrong +code.</p> +<div class="codehilite"><pre><span class="n">git</span> <span class="n">checkout</span> <span class="n">develop</span> +<span class="n">git</span> <span class="n">pull</span> <span class="n">origin</span> +<span class="n">git</span> <span class="n">push</span> <span class="n">origin</span> +</pre></div> + + <p><strong>Step #1:</strong> Create a JIRA for the release, estimate 3h (so you don't try to skip the tests)</p> <div class="codehilite"><pre><span class="n">export</span> <span class="n">SLIDER_RELEASE_JIRA</span><span class="p">=</span><span class="n">SLIDER</span><span class="o">-</span>544 @@ -238,7 +247,9 @@ versions plugin</a></p> <p><strong>Step #5:</strong> Commit the changed POM files</p> -<div class="codehilite"><pre><span class="n">git</span> <span class="n">add</span> <span class="o">--</span><span class="n">all</span> +<div class="codehilite"><pre><span class="n">git</span> <span class="n">status</span> + +<span class="n">git</span> <span class="n">add</span> <span class="o">--</span><span class="n">all</span> <span class="n">git</span> <span class="n">commit</span> <span class="o">-</span><span class="n">m</span> "$<span class="n">SLIDER_RELEASE_JIRA</span> <span class="n">updating</span> <span class="n">release</span> <span class="n">POMs</span> <span class="k">for</span> $<span class="n">SLIDER_RELEASE</span>" </pre></div> @@ -257,7 +268,7 @@ versions plugin</a></p> <p>(Make sure the build isn't trying to pull down its JARs from the Apache Staging repo) -Once everything is built- including .tar files, run the tests</p> +Once everything is built- including <code>.tar</code> files, run the tests</p> <div class="codehilite"><pre><span class="n">mvn</span> <span class="n">test</span> </pre></div> @@ -274,25 +285,28 @@ the tests time out.</p> <p>As the test run takes 30-60+ minutes, now is a good time to consider finalizing the release notes.</p> <p><strong>Step #7:</strong> Build the release package</p> -<p>Run the <code>package</code> goal:</p> -<div class="codehilite"><pre><span class="n">mvn</span> <span class="n">clean</span> <span class="n">site</span><span class="p">:</span><span class="n">site</span> <span class="n">site</span><span class="p">:</span><span class="n">stage</span> <span class="n">package</span> <span class="o">-</span><span class="n">DskipTests</span> +<p>Run a clean install, followed by a site build and package goal:</p> +<div class="codehilite"><pre><span class="n">mvn</span> <span class="n">clean</span> <span class="n">install</span> <span class="o">-</span><span class="n">DskipTests</span> +<span class="n">mvn</span> <span class="n">site</span><span class="p">:</span><span class="n">site</span> <span class="n">site</span><span class="p">:</span><span class="n">stage</span> <span class="n">package</span> <span class="o">-</span><span class="n">DskipTests</span> </pre></div> -<p><strong>Step #8:</strong> Validate the tar file</p> +<p><strong>Step #8:</strong> Validate the tarball</p> <p>Look in <code>slider-assembly/target</code> to find the <code>.tar.gz</code> file, and the expanded version of it. Inspect that expanded version to make sure that everything looks good -and that the versions of all the dependent artifacts look good too: there must be no <code>-SNAPSHOT</code> dependencies. [Exception, when the release is deliberately made against an unreleased version of Hadoop or other dependencies. -in that situation the unreleased dependency is expected to consist of <code>-SNAPSHORT</code> +in that situation the unreleased dependency is expected to consist of <code>-SNAPSHOT</code> artifacts]</p> <p>tip: the lib dir can be viewed with</p> -<div class="codehilite"><pre><span class="n">ls</span> <span class="o">-</span><span class="n">l</span> <span class="n">slider</span><span class="o">-</span><span class="n">assembly</span><span class="o">/</span><span class="n">target</span><span class="o">/</span><span class="n">lib</span> +<div class="codehilite"><pre><span class="n">ls</span> <span class="o">-</span><span class="n">l</span> <span class="n">slider</span><span class="o">-</span><span class="n">assembly</span><span class="o">/</span><span class="n">target</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">all</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">/</span><span class="n">lib</span> </pre></div> -<p>Verify that there is a <code>slider-agent</code> <code>.tar.gz</code> file.</p> +<p><strong>Important</strong> Verify that there is a <code>slider-agent</code> <code>.tar.gz</code> file. The two-phase +install/site build gets it in there, but doing a single build doesn't always seem +to.</p> <p><strong>Step #9:</strong> Build the release notes</p> <p>Create a a one-line plain text release note for commits and tags and a multi-line markdown release note which will be used for artifacts.</p> @@ -341,9 +355,16 @@ sprint -so wrap that up too.</p> <p><em>At this point you are ready for Apache release from master.</em></p> -<h2 id="wzxhzdk44wzxhzdk45phase-ii"><a name="phase2"></a>Phase - II</h2> +<h2 id="wzxhzdk46wzxhzdk47phase-ii-publish-to-the-asf"><a name="phase2"></a>Phase - II: publish to the ASF</h2> +<p>This phase of the process creates the artifacts for the ASF. +This is done in a separate directory to ensure that nothing accidentally gets in.</p> +<p>Preamble: set up the RC Version </p> +<div class="codehilite"><pre><span class="n">export</span> <span class="n">RELEASE_RC</span><span class="p">=</span><span class="n">rc0</span> +</pre></div> + + <p><strong>Step 1</strong></p> -<p>Get a clean enlistment.</p> +<p>Get a clean git clone in its own directory.</p> <div class="codehilite"><pre><span class="n">mkdir</span> <span class="n">release</span> <span class="n">cd</span> <span class="n">release</span> <span class="n">git</span> <span class="n">clone</span> <span class="n">https</span><span class="p">:</span><span class="o">//</span><span class="n">git</span><span class="o">-</span><span class="n">wip</span><span class="o">-</span><span class="n">us</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/</span><span class="n">repos</span><span class="o">/</span><span class="n">asf</span><span class="o">/</span><span class="n">incubator</span><span class="o">-</span><span class="n">slider</span><span class="p">.</span><span class="n">git</span> <span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span> @@ -367,7 +388,7 @@ sprint -so wrap that up too.</p> <p><strong>Step 4</strong></p> <p>Tag for the release. Start with RC0 and move to RC1, RC2 if you need to restart the release process for this version.</p> -<div class="codehilite"><pre><span class="n">git</span> <span class="n">tag</span> <span class="o">-</span><span class="n">a</span> <span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">rc1</span> <span class="o">-</span><span class="n">m</span> <span class="s">'Slider $SLIDER_RELEASE-RC1'</span> +<div class="codehilite"><pre><span class="n">git</span> <span class="n">tag</span> <span class="o">-</span><span class="n">a</span> <span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span> <span class="o">-</span><span class="n">m</span> <span class="s">'Slider $SLIDER_RELEASE-$RELEASE_RC'</span> <span class="n">git</span> <span class="n">push</span> <span class="o">--</span><span class="n">tags</span> <span class="n">origin</span> </pre></div> @@ -381,12 +402,16 @@ sprint -so wrap that up too.</p> <p>You should find a <code>*.tar.gz</code> at target folder (e.g. <code>./target/apache-slider-$SLIDER_RELEASE-source-release.tar.gz</code> and <code>.zip</code>) Rename it with <em>incubator</em> in the name.</p> <div class="codehilite"><pre><span class="n">cd</span> <span class="n">target</span> + <span class="n">rm</span> <span class="nb">rat</span><span class="p">.</span><span class="n">txt</span> +<span class="n">rm</span> <span class="p">.</span><span class="n">plxarc</span> <span class="n">rm</span> <span class="o">-</span><span class="n">rf</span> <span class="n">archive</span><span class="o">-</span><span class="n">tmp</span> +<span class="n">rm</span> <span class="o">-</span><span class="n">rf</span> <span class="n">maven</span><span class="o">-</span><span class="n">shared</span><span class="o">-</span><span class="n">archive</span><span class="o">-</span><span class="n">resources</span> </pre></div> -<p><strong>Step 6</strong></p> +<p><strong>Step 6</strong> +<!-- this is now automated</p> <p>Sign the tarball</p> <div class="codehilite"><pre><span class="n">export</span> <span class="n">ASF_USER</span><span class="p">=</span><span class="n">stevel</span> @@ -395,8 +420,10 @@ Rename it with <em>incubator</em> in the </pre></div> +<p>--></p> <p><strong>Step 7</strong></p> <p>Generate MD5 checksums. <em>md5sum</em> and <em>sha1sum</em> or <em>gpg</em> are all capable of creating checksum files.</p> +<p>Either</p> <div class="codehilite"><pre><span class="n">openssl</span> <span class="n">md5</span> <span class="n">apache</span><span class="o">-</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">source</span><span class="o">-</span><span class="n">release</span><span class="p">.</span><span class="n">tar</span><span class="p">.</span><span class="n">gz</span> <span class="o">></span> <span class="n">apache</span><span class="o">-</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">source</span><span class="o">-</span><span class="n">release</span><span class="p">.</span><span class="n">tar</span><span class="p">.</span><span class="n">gz</span><span class="p">.</span><span class="n">md5</span> <span class="n">openssl</span> <span class="n">sha1</span> <span class="n">apache</span><span class="o">-</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">source</span><span class="o">-</span><span class="n">release</span><span class="p">.</span><span class="n">tar</span><span class="p">.</span><span class="n">gz</span> <span class="o">></span> <span class="n">apache</span><span class="o">-</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">source</span><span class="o">-</span><span class="n">release</span><span class="p">.</span><span class="n">tar</span><span class="p">.</span><span class="n">gz</span><span class="p">.</span><span class="n">sha</span> <span class="n">openssl</span> <span class="n">md5</span> <span class="n">apache</span><span class="o">-</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">source</span><span class="o">-</span><span class="n">release</span><span class="p">.</span><span class="n">zip</span> <span class="o">></span> <span class="n">apache</span><span class="o">-</span><span class="n">slider</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">source</span><span class="o">-</span><span class="n">release</span><span class="p">.</span><span class="n">zip</span><span class="p">.</span><span class="n">md5</span> @@ -414,71 +441,64 @@ Rename it with <em>incubator</em> in the <p><strong>Step 8</strong></p> <p>Upload the artifacts to your apache home:</p> -<p>The artifacts then need to be copied over to ~/public_html/slider-release-$SLIDER_RELEASE-rc0</p> +<p>The artifacts then need to be copied over to <code>~/public_html/slider-release-$SLIDER_RELEASE-rcX</code></p> <div class="codehilite"><pre><span class="n">cd</span> <span class="p">..</span> -<span class="n">mv</span> <span class="n">target</span> <span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">rc1</span> -<span class="n">scp</span> <span class="o">-</span><span class="n">r</span> <span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">rc1</span> $<span class="n">ASF_USER</span><span class="p">@</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="p">:</span><span class="n">public_html</span><span class="o">/</span><span class="n">slider</span><span class="o">/</span> +<span class="n">mv</span> <span class="n">target</span> <span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span> + +<span class="n">scp</span> <span class="o">-</span><span class="n">r</span> <span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span> $<span class="n">ASF_USER</span><span class="p">@</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="p">:</span><span class="n">public_html</span><span class="o">/</span><span class="n">slider</span><span class="o">/</span> </pre></div> <p>(if you don't get the authentication for the copy, go to https://id.apache.org/ and add your ssh keys to your profile)</p> <p>The entire directory should now be uploaded, check it:</p> -<div class="codehilite"><pre><span class="n">echo</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/~</span>$<span class="n">ASF_USER</span><span class="o">/</span><span class="n">slider</span> +<div class="codehilite"><pre><span class="n">echo</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/~</span>$<span class="n">ASF_USER</span><span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span> </pre></div> -<p><strong>Step 9</strong></p> -<p>Tell JIRA there's a new release. You must be registered as an admin for the -Slider project on JIRA.</p> -<p>Go to the <a href="https://issues.apache.org/jira/plugins/servlet/project-config/SLIDER/versions">Slider Versions page</a></p> -<p>Release the version you've done, carrying forward issues that haven't been done -yet.</p> -<p><strong>Step 10</strong></p> -<p>Call for a release VOTE to the dev mailing list (d...@slider.incubator.apache.org).</p> -<p>To build the URLs, echo them then verify in your browser that they are present</p> -<div class="codehilite"><pre><span class="n">echo</span> "<span class="n">artifacts</span> <span class="n">at</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/~</span>$<span class="n">ASF_USER</span><span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">rc1</span>" - -<span class="n">echo</span> "<span class="n">source</span> <span class="n">at</span> <span class="n">https</span><span class="p">:</span><span class="o">//</span><span class="n">git</span><span class="o">-</span><span class="n">wip</span><span class="o">-</span><span class="n">us</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/</span><span class="n">repos</span><span class="o">/</span><span class="n">asf</span>?<span class="n">p</span><span class="p">=</span><span class="n">incubator</span><span class="o">-</span><span class="n">slider</span><span class="p">.</span><span class="n">git</span><span class="p">;</span><span class="n">a</span><span class="p">=</span><span class="n">shortlog</span><span class="p">;</span><span class="n">h</span><span class="p">=</span><span class="n">refs</span><span class="o">/</span><span class="n">tags</span><span class="o">/</span><span class="n">release</span><span cla ss="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">rc0</span>" - -<span class="n">echo</span> "<span class="n">PGP</span> <span class="n">keys</span> <span class="n">at</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">pgp</span><span class="p">.</span><span class="n">mit</span><span class="p">.</span><span class="n">edu</span><span class="p">:</span>11371<span class="o">/</span><span class="n">pks</span><span class="o">/</span><span class="n">lookup</span>?<span class="n">op</span><span class="p">=</span><span class="n">vindex</span><span class="o">&</span><span class="n">search</span><span class="p">=</span>$<span class="n">ASF_USER</span><span class="p">@</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span>" - -<span class="n">echo</span> <span class="p">[</span><span class="n">VOTE</span><span class="p">]</span> <span class="n">Apache</span> <span class="n">Slider</span> <span class="n">Incubating</span> <span class="n">Release</span> $<span class="n">SLIDER_RELEASE</span> <span class="n">RC0</span> +<p>on OS/X, you can have it opened in your chosen browser</p> +<div class="codehilite"><pre><span class="n">open</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/~</span>$<span class="n">ASF_USER</span><span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span> </pre></div> -<p>Sample:</p> -<div class="codehilite"><pre><span class="n">Title</span><span class="p">:</span> <span class="p">[</span><span class="n">VOTE</span><span class="p">]</span> <span class="n">Apache</span> <span class="n">Slider</span> <span class="n">Incubating</span> <span class="n">Release</span> $<span class="n">SLIDER_RELEASE</span> <span class="n">RC0</span> - -<span class="n">Hello</span> <span class="n">folks</span><span class="p">,</span> - -<span class="n">This</span> <span class="n">is</span> <span class="n">a</span> <span class="n">call</span> <span class="k">for</span> <span class="n">a</span> <span class="n">vote</span> <span class="n">on</span> <span class="n">Apache</span> <span class="n">Slider</span> $<span class="n">SLIDER_RELEASE</span> <span class="n">release</span><span class="p">.</span> -<span class="n">Thanks</span> <span class="n">to</span> <span class="n">everyone</span> <span class="n">who</span> <span class="n">have</span> <span class="n">contributed</span> <span class="n">to</span> <span class="n">this</span> <span class="n">release</span><span class="p">.</span> - -<span class="n">Git</span> <span class="n">source</span> <span class="n">tag</span><span class="p">:</span> -<span class="n">https</span><span class="p">:</span><span class="o">//</span><span class="n">git</span><span class="o">-</span><span class="n">wip</span><span class="o">-</span><span class="n">us</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/</span><span class="n">repos</span><span class="o">/</span><span class="n">asf</span>?<span class="n">p</span><span class="p">=</span><span class="n">incubator</span><span class="o">-</span><span class="n">slider</span><span class="p">.</span><span class="n">git</span><span class="p">;</span><span class="n">a</span><span class="p">=</span><span class="n">shortlog</span><span class="p">;</span><span class="n">h</span><span class="p">=</span><span class="n">refs</span><span class="o">/</span><span class="n">tags</span><span class="o">/</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class=" n">rc0</span> - -<span class="n">Staging</span> <span class="n">site</span><span class="p">:</span> -<span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/~</span>$<span class="n">ASF_USER</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">rc0</span>" - -<span class="n">PGP</span> <span class="n">release</span> <span class="n">keys</span> <span class="p">(</span><span class="n">signed</span> <span class="n">using</span> $<span class="n">ASF_USER</span><span class="p">)</span> -<span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">pgp</span><span class="p">.</span><span class="n">mit</span><span class="p">.</span><span class="n">edu</span><span class="p">:</span>11371<span class="o">/</span><span class="n">pks</span><span class="o">/</span><span class="n">lookup</span>?<span class="n">op</span><span class="p">=</span><span class="n">vindex</span><span class="o">&</span><span class="n">search</span><span class="p">=</span>$<span class="n">ASF_USER</span><span class="p">@</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span> - -<span class="n">The</span> <span class="n">issues</span> <span class="n">fixed</span> <span class="n">in</span> <span class="n">this</span> <span class="n">release</span> <span class="n">are</span> <span class="n">listed</span> <span class="n">at</span> <span class="n">at</span><span class="p">:</span> -<span class="n">https</span><span class="p">:</span><span class="o">//</span><span class="n">issues</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/</span><span class="n">jira</span><span class="o">/</span><span class="n">browse</span><span class="o">/</span><span class="n">SLIDER</span><span class="o">/</span><span class="n">fixforversion</span><span class="o">/<</span><span class="n">FIX</span> <span class="n">VERSION</span> <span class="n">OF</span> <span class="n">THIS</span> <span class="n">RELEASE</span><span class="o">></span> +<p><strong>Step 9</strong></p> +<p>(omitted)</p> +<p><strong>Step 10</strong></p> +<p>Call for a release VOTE to the dev mailing list (<code>d...@slider.incubator.apache.org</code>).</p> +<p>To build the URLs, echo them then verify in your browser that they are present</p> +<div class="codehilite"><pre><span class="n">echo</span> <span class="p">[</span><span class="n">VOTE</span><span class="p">]</span> <span class="n">Apache</span> <span class="n">Slider</span> <span class="n">Incubating</span> <span class="n">Release</span> $<span class="n">SLIDER_RELEASE</span> $<span class="n">RELEASE_RC</span> -<span class="n">Note</span> <span class="n">that</span> <span class="n">this</span> <span class="n">is</span> <span class="n">a</span> <span class="n">source</span> <span class="n">only</span> <span class="n">release</span> <span class="n">and</span> <span class="n">we</span> <span class="n">are</span> <span class="n">voting</span> <span class="n">on</span> <span class="n">the</span> <span class="n">source</span><span class="p">.</span> +<span class="n">echo</span> "<span class="n">This</span> <span class="n">is</span> <span class="n">a</span> <span class="n">call</span> <span class="k">for</span> <span class="n">a</span> <span class="n">vote</span> <span class="n">on</span> <span class="n">Apache</span> <span class="n">Slider</span> $<span class="n">SLIDER_RELEASE</span> <span class="n">release</span>" -<span class="n">Build</span> <span class="n">instructions</span> <span class="n">at</span><span class="p">:</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">slider</span><span class="p">.</span><span class="n">incubator</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/</span><span class="n">developing</span><span class="o">/</span><span class="n">building</span><span class="p">.</span><span class="n">html</span> +<span class="n">echo</span> "<span class="n">Artifacts</span> <span class="n">at</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">people</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/~</span>$<span class="n">ASF_USER</span><span class="o">/</span><span class="n">slider</span><span class="o">/</span><span class="n">slider</span><span class="o">-</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span>" -<span class="n">Vote</span> <span class="n">will</span> <span class="n">be</span> <span class="n">open</span> <span class="k">for</span> 72 <span class="n">hours</span> +<span class="n">echo</span> "<span class="n">Git</span> <span class="n">source</span> <span class="n">tag</span><span class="p">:</span> <span class="n">https</span><span class="p">:</span><span class="o">//</span><span class="n">git</span><span class="o">-</span><span class="n">wip</span><span class="o">-</span><span class="n">us</span><span class="p">.</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span><span class="o">/</span><span class="n">repos</span><span class="o">/</span><span class="n">asf</span>?<span class="n">p</span><span class="p">=</span><span class="n">incubator</span><span class="o">-</span><span class="n">slider</span><span class="p">.</span><span class="n">git</span><span class="p">;</span><span class="n">a</span><span class="p">=</span><span class="n">shortlog</span><span class="p">;</span><span class="n">h</span><span class="p">=</span><span class="n">refs</span><span class="o">/</span><span class="n">tags</span><span class ="o">/</span><span class="n">release</span><span class="o">-</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span>" -<span class="p">[</span> <span class="p">]</span> <span class="o">+</span>1 <span class="n">approve</span> -<span class="p">[</span> <span class="p">]</span> <span class="o">+</span>0 <span class="n">no</span> <span class="n">opinion</span> -<span class="p">[</span> <span class="p">]</span> <span class="o">-</span>1 <span class="n">disapprove</span> <span class="p">(</span><span class="n">and</span> <span class="n">reason</span> <span class="nb">why</span><span class="p">)</span> +<span class="n">echo</span> "<span class="n">PGP</span> <span class="n">keys</span> <span class="n">at</span> <span class="n">http</span><span class="p">:</span><span class="o">//</span><span class="n">pgp</span><span class="p">.</span><span class="n">mit</span><span class="p">.</span><span class="n">edu</span><span class="p">:</span>11371<span class="o">/</span><span class="n">pks</span><span class="o">/</span><span class="n">lookup</span>?<span class="n">op</span><span class="p">=</span><span class="n">vindex</span><span class="o">&</span><span class="n">search</span><span class="p">=</span>$<span class="n">ASF_USER</span><span class="p">@</span><span class="n">apache</span><span class="p">.</span><span class="n">org</span>" </pre></div> +<p>Sample:</p> +<p>```</p> +<p>Title: [VOTE] Apache Slider Incubating Release $SLIDER_RELEASE $RELEASE_RC</p> +<p>Hello folks,</p> +<p>This is a call for a vote on Apache Slider $SLIDER_RELEASE release. +Thanks to everyone who have contributed to this release.</p> +<p>Git source tag: +https://git-wip-us.apache.org/repos/asf?p=incubator-slider.git;a=shortlog;h=refs/tags/release-$SLIDER_RELEASE-$RELEASE_RC</p> +<p>Staging site: +http://people.apache.org/~$ASF_USER/slider-release-$SLIDER_RELEASE-$RELEASE_RC"</p> +<p>PGP release keys (signed using $ASF_USER) +http://pgp.mit.edu:11371/pks/lookup?op=vindex&search=$asf_u...@apache.org</p> +<p>The issues fixed in this release are listed at at: +https://issues.apache.org/jira/browse/SLIDER/fixforversion/<FIX VERSION OF THIS RELEASE></p> +<p>Note that this is a source only release and we are voting on the source.</p> +<p>Build instructions at: http://slider.incubator.apache.org/developing/building.html </p> +<p>Vote will be open for 72 hours </p> +<p>[ ] +1 approve +[ ] +0 no opinion +[ ] -1 disapprove (and reason why)</p> +<p>```</p> <ul> <li>CHECK ALL THE URLS FIRST *</li> </ul> @@ -486,7 +506,7 @@ yet.</p> <p>If the VOTE passes, call for VOTE from IPMC. Include the VOTE and RESULT thread from the dev alias. If that VOTE passes with the IPMC send a RESULT mail.</p> <p>Sample:</p> -<div class="codehilite"><pre><span class="n">Title</span><span class="p">:</span> <span class="p">[</span><span class="n">RESULT</span><span class="p">][</span><span class="n">VOTE</span><span class="p">]</span> <span class="n">Apache</span> <span class="n">Slider</span> $<span class="n">SLIDER_RELEASE</span> <span class="n">RC0</span> +<div class="codehilite"><pre><span class="n">Title</span><span class="p">:</span> <span class="p">[</span><span class="n">RESULT</span><span class="p">][</span><span class="n">VOTE</span><span class="p">]</span> <span class="n">Apache</span> <span class="n">Slider</span> $<span class="n">SLIDER_RELEASE</span> $<span class="n">RELEASE_RC</span> <span class="n">Thanks</span> <span class="k">for</span> <span class="n">the</span> <span class="n">votes</span><span class="p">.</span> <span class="n">The</span> <span class="n">VOTE</span> <span class="n">passes</span> <span class="n">with</span> 5<span class="p">,</span> <span class="o">+</span>1 <span class="n">votes</span> <span class="n">from</span> <span class="n">IPMC</span><span class="p">.</span> @@ -521,7 +541,7 @@ are at the top of the file</p> <p>Then...</p> <div class="codehilite"><pre><span class="n">mkdir</span> $<span class="n">SLIDER_RELEASE</span> $<span class="n">SLIDER_RELEASE</span><span class="o">/</span><span class="n">src</span> <span class="n">cd</span> $<span class="n">SLIDER_RELEASE</span><span class="o">/</span><span class="n">src</span> -<span class="n">scp</span> <span class="o">~/</span><span class="n">public_html</span><span class="o">/</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span><span class="n">rc0</span><span class="o">/*</span> <span class="p">.</span> +<span class="n">scp</span> <span class="o">~/</span><span class="n">public_html</span><span class="o">/</span>$<span class="n">SLIDER_RELEASE</span><span class="o">-</span>$<span class="n">RELEASE_RC</span><span class="o">/*</span> <span class="p">.</span> <span class="n">cd</span> <span class="p">..</span> <span class="n">svn</span> <span class="n">add</span> $<span class="n">SLIDER_RELEASE</span> <span class="n">svn</span> <span class="n">commit</span> <span class="o">-</span><span class="n">m</span> "<span class="n">SLIDER_RELEASE_JIRA</span> <span class="n">Committing</span> <span class="n">Release</span> $<span class="n">SLIDER_RELEASE</span>" @@ -564,6 +584,12 @@ To send the message to announcement@apac </pre></div> +<p><strong>Step 17</strong></p> +<p>Tell JIRA there's a new release. You must be registered as an admin for the +Slider project on JIRA.</p> +<p>Go to the <a href="https://issues.apache.org/jira/plugins/servlet/project-config/SLIDER/versions">Slider Versions page</a></p> +<p>Release the version you've done, carrying forward issues that haven't been done +yet.</p> <h2 id="hotfixing-a-release">Hotfixing a release</h2> <p>If you need to change a release âsuch as to issue a new RC, you must create a hotfix release which updates the <code>master/</code> and <code>develop/</code> branches. @@ -654,7 +680,7 @@ the actual development version.</p> <h4 id="important-app-package-versions">Important: App package versions</h4> <p>The (slider 0.60) app package versions mean the artifacts are not suitable for uploading; they generate files such as <code>slider-storm-app-package-${pkg.version}.pom</code> which don't contain a valid version number.</p> -<p>We have fixed this this by moving the app packages out of the slider project itself, so drive them off other version information.</p> +<p>We have fixed this this from Slider 0.61/0.70 by moving the app packages out of the slider project itself, so drive them off other version information.</p> <h2 id="dry-run-of-release">Dry run of release</h2> <div class="codehilite"><pre><span class="n">mvn</span> <span class="n">release</span><span class="p">:</span><span class="n">prepare</span> <span class="o">-</span><span class="n">DdryRun</span><span class="p">=</span><span class="n">true</span> <span class="o">-</span><span class="n">DautoVersionSubmodules</span><span class="p">=</span><span class="n">true</span> <span class="o">-</span><span class="n">Darguments</span><span class="p">=</span>"<span class="o">-</span><span class="n">DskipTests</span> <span class="o">-</span><span class="n">DskipITs</span>" </pre></div> @@ -665,9 +691,30 @@ the actual development version.</p> </pre></div> +<h2 id="uploading-for-a-vote">uploading for a vote</h2> +<p>mvn release:clean + mvn release:prepare -DautoVersionSubmodules=true -Darguments="-DskipTests -DskipITs" -Dresume=false + mvn release:perform </p> <h3 id="closing-the-release">Closing the release</h3> <p>log in to <a href="https://repository.apache.org/index.html">https://repository.apache.org/index.html</a> with your ASF username & LDAP password</p> +<h1 id="notes-on-a-changed-process">Notes on a changed process</h1> +<p>This is some working notes on the 0.61 release</p> +<ul> +<li>see: <a href="http://www.apache.org/dev/publishing-maven-artifacts.html">Publishing Maven Artifacts</a></li> +<li>see: <a href="https://wiki.apache.org/commons/UsingNexus">https://wiki.apache.org/commons/UsingNexus</a></li> +</ul> +<p>Key: the mvn release package is what should be doing the automation</p> +<p>you can log in to nexus at </p> +<p>https://repository.apache.org/service/local/staging/deploy/maven2/org/apache/slider</p> +<p>using your ASF username and LDAP passwd</p> +<p>proposed</p> +<ol> +<li>mvn deploy of the snapshot</li> +<li>publish the src</li> +<li>vote on it</li> +<li>if people are happy issue a release with the same files, rebadged</li> +</ol> </div> <div id="footer"> Modified: websites/staging/slider/trunk/content/docs/high_availability.html ============================================================================== --- websites/staging/slider/trunk/content/docs/high_availability.html (original) +++ websites/staging/slider/trunk/content/docs/high_availability.html Tue Jan 13 15:53:22 2015 @@ -160,7 +160,21 @@ Latest release: <strong>0.60.0-incubatin <h1 class="title"></h1> - <h1 id="high-availability">High Availability:</h1> + <!--- + Licensed under the Apache License, Version 2.0 (the "License"); + you may not use this file except in compliance with the License. + You may obtain a copy of the License at + + http://www.apache.org/licenses/LICENSE-2.0 + + Unless required by applicable law or agreed to in writing, software + distributed under the License is distributed on an "AS IS" BASIS, + WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. + See the License for the specific language governing permissions and + limitations under the License. See accompanying LICENSE file. +--> + +<h1 id="high-availability">High Availability:</h1> <h3 id="setup-resource-manager-ha-name-node-ha-work-preserving-resource-manager-restart-and-work-preserving-node-manager-restart">Setup Resource Manager HA, Name Node HA, Work Preserving Resource Manager restart and Work Preserving Node Manager restart</h3> <p>Setting up High Availability ensures uninterrupted service provided by long running applications installed by Slider in the event of any or all of the following YARN component failures - Resource Manager, Modified: websites/staging/slider/trunk/content/docs/index.html ============================================================================== --- websites/staging/slider/trunk/content/docs/index.html (original) +++ websites/staging/slider/trunk/content/docs/index.html Tue Jan 13 15:53:22 2015 @@ -185,6 +185,7 @@ Latest release: <strong>0.60.0-incubatin <li><a href="client-configuration.html">Client Configuration</a></li> <li><a href="exitcodes.html">Client Exit Codes</a></li> <li><a href="security.html">Security</a></li> +<li><a href="api/index.html">REST API</a></li> <li><a href="ssl.html">Agent to AM SSL</a></li> <li><a href="high_availability.html">High Availability</a></li> <li><a href="troubleshooting.html">Troubleshooting</a></li>