http://git-wip-us.apache.org/repos/asf/hbase-site/blob/81cde4ce/apidocs/overview-tree.html ---------------------------------------------------------------------- diff --git a/apidocs/overview-tree.html b/apidocs/overview-tree.html index 030c910..0e9aafb 100644 --- a/apidocs/overview-tree.html +++ b/apidocs/overview-tree.html @@ -889,33 +889,33 @@ <li type="circle">java.lang.<a href="https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true" title="class or interface in java.lang"><span class="typeNameLink">Enum</span></a><E> (implements java.lang.<a href="https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true" title="class or interface in java.lang">Comparable</a><T>, java.io.<a href="https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true" title="class or interface in java.io">Serializable</a>) <ul> <li type="circle">org.apache.hadoop.hbase.util.<a href="org/apache/hadoop/hbase/util/Order.html" title="enum in org.apache.hadoop.hbase.util"><span class="typeNameLink">Order</span></a></li> -<li type="circle">org.apache.hadoop.hbase.<a href="org/apache/hadoop/hbase/KeepDeletedCells.html" title="enum in org.apache.hadoop.hbase"><span class="typeNameLink">KeepDeletedCells</span></a></li> <li type="circle">org.apache.hadoop.hbase.<a href="org/apache/hadoop/hbase/MemoryCompactionPolicy.html" title="enum in org.apache.hadoop.hbase"><span class="typeNameLink">MemoryCompactionPolicy</span></a></li> +<li type="circle">org.apache.hadoop.hbase.<a href="org/apache/hadoop/hbase/KeepDeletedCells.html" title="enum in org.apache.hadoop.hbase"><span class="typeNameLink">KeepDeletedCells</span></a></li> <li type="circle">org.apache.hadoop.hbase.<a href="org/apache/hadoop/hbase/CompareOperator.html" title="enum in org.apache.hadoop.hbase"><span class="typeNameLink">CompareOperator</span></a></li> <li type="circle">org.apache.hadoop.hbase.<a href="org/apache/hadoop/hbase/ProcedureState.html" title="enum in org.apache.hadoop.hbase"><span class="typeNameLink">ProcedureState</span></a></li> <li type="circle">org.apache.hadoop.hbase.<a href="org/apache/hadoop/hbase/CellBuilderType.html" title="enum in org.apache.hadoop.hbase"><span class="typeNameLink">CellBuilderType</span></a></li> -<li type="circle">org.apache.hadoop.hbase.filter.<a href="org/apache/hadoop/hbase/filter/BitComparator.BitwiseOp.html" title="enum in org.apache.hadoop.hbase.filter"><span class="typeNameLink">BitComparator.BitwiseOp</span></a></li> <li type="circle">org.apache.hadoop.hbase.filter.<a href="org/apache/hadoop/hbase/filter/FilterList.Operator.html" title="enum in org.apache.hadoop.hbase.filter"><span class="typeNameLink">FilterList.Operator</span></a></li> <li type="circle">org.apache.hadoop.hbase.filter.<a href="org/apache/hadoop/hbase/filter/CompareFilter.CompareOp.html" title="enum in org.apache.hadoop.hbase.filter"><span class="typeNameLink">CompareFilter.CompareOp</span></a></li> -<li type="circle">org.apache.hadoop.hbase.filter.<a href="org/apache/hadoop/hbase/filter/Filter.ReturnCode.html" title="enum in org.apache.hadoop.hbase.filter"><span class="typeNameLink">Filter.ReturnCode</span></a></li> +<li type="circle">org.apache.hadoop.hbase.filter.<a href="org/apache/hadoop/hbase/filter/BitComparator.BitwiseOp.html" title="enum in org.apache.hadoop.hbase.filter"><span class="typeNameLink">BitComparator.BitwiseOp</span></a></li> <li type="circle">org.apache.hadoop.hbase.filter.<a href="org/apache/hadoop/hbase/filter/RegexStringComparator.EngineType.html" title="enum in org.apache.hadoop.hbase.filter"><span class="typeNameLink">RegexStringComparator.EngineType</span></a></li> +<li type="circle">org.apache.hadoop.hbase.filter.<a href="org/apache/hadoop/hbase/filter/Filter.ReturnCode.html" title="enum in org.apache.hadoop.hbase.filter"><span class="typeNameLink">Filter.ReturnCode</span></a></li> <li type="circle">org.apache.hadoop.hbase.io.encoding.<a href="org/apache/hadoop/hbase/io/encoding/DataBlockEncoding.html" title="enum in org.apache.hadoop.hbase.io.encoding"><span class="typeNameLink">DataBlockEncoding</span></a></li> <li type="circle">org.apache.hadoop.hbase.regionserver.<a href="org/apache/hadoop/hbase/regionserver/BloomType.html" title="enum in org.apache.hadoop.hbase.regionserver"><span class="typeNameLink">BloomType</span></a></li> +<li type="circle">org.apache.hadoop.hbase.quotas.<a href="org/apache/hadoop/hbase/quotas/SpaceViolationPolicy.html" title="enum in org.apache.hadoop.hbase.quotas"><span class="typeNameLink">SpaceViolationPolicy</span></a></li> <li type="circle">org.apache.hadoop.hbase.quotas.<a href="org/apache/hadoop/hbase/quotas/ThrottlingException.Type.html" title="enum in org.apache.hadoop.hbase.quotas"><span class="typeNameLink">ThrottlingException.Type</span></a></li> <li type="circle">org.apache.hadoop.hbase.quotas.<a href="org/apache/hadoop/hbase/quotas/QuotaScope.html" title="enum in org.apache.hadoop.hbase.quotas"><span class="typeNameLink">QuotaScope</span></a></li> -<li type="circle">org.apache.hadoop.hbase.quotas.<a href="org/apache/hadoop/hbase/quotas/ThrottleType.html" title="enum in org.apache.hadoop.hbase.quotas"><span class="typeNameLink">ThrottleType</span></a></li> <li type="circle">org.apache.hadoop.hbase.quotas.<a href="org/apache/hadoop/hbase/quotas/QuotaType.html" title="enum in org.apache.hadoop.hbase.quotas"><span class="typeNameLink">QuotaType</span></a></li> -<li type="circle">org.apache.hadoop.hbase.quotas.<a href="org/apache/hadoop/hbase/quotas/SpaceViolationPolicy.html" title="enum in org.apache.hadoop.hbase.quotas"><span class="typeNameLink">SpaceViolationPolicy</span></a></li> -<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/Durability.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">Durability</span></a></li> +<li type="circle">org.apache.hadoop.hbase.quotas.<a href="org/apache/hadoop/hbase/quotas/ThrottleType.html" title="enum in org.apache.hadoop.hbase.quotas"><span class="typeNameLink">ThrottleType</span></a></li> <li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/SnapshotType.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">SnapshotType</span></a></li> -<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/MasterSwitchType.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">MasterSwitchType</span></a></li> -<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/CompactType.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">CompactType</span></a></li> +<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/Durability.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">Durability</span></a></li> <li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/MobCompactPartitionPolicy.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">MobCompactPartitionPolicy</span></a></li> -<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/CompactionState.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">CompactionState</span></a></li> -<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/Scan.ReadType.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">Scan.ReadType</span></a></li> -<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/RequestController.ReturnCode.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">RequestController.ReturnCode</span></a></li> <li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/IsolationLevel.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">IsolationLevel</span></a></li> +<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/RequestController.ReturnCode.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">RequestController.ReturnCode</span></a></li> +<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/Scan.ReadType.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">Scan.ReadType</span></a></li> +<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/CompactionState.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">CompactionState</span></a></li> +<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/MasterSwitchType.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">MasterSwitchType</span></a></li> <li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/Consistency.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">Consistency</span></a></li> +<li type="circle">org.apache.hadoop.hbase.client.<a href="org/apache/hadoop/hbase/client/CompactType.html" title="enum in org.apache.hadoop.hbase.client"><span class="typeNameLink">CompactType</span></a></li> <li type="circle">org.apache.hadoop.hbase.client.security.<a href="org/apache/hadoop/hbase/client/security/SecurityCapability.html" title="enum in org.apache.hadoop.hbase.client.security"><span class="typeNameLink">SecurityCapability</span></a></li> </ul> </li>
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/81cde4ce/book.html ---------------------------------------------------------------------- diff --git a/book.html b/book.html index 4ee0401..7373777 100644 --- a/book.html +++ b/book.html @@ -1448,11 +1448,6 @@ For most configurations, a restart is needed for servers to pick up changes. Dyn <td class="tableblock halign-left valign-top"><p class="tableblock">yes</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">yes</p></td> </tr> -<tr> -<td class="tableblock halign-left valign-top"><p class="tableblock">1.1</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">yes</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">Running with JDK 8 will work but is not well tested.</p></td> -</tr> </tbody> </table> <div class="admonitionblock note"> @@ -1612,16 +1607,14 @@ earlier versions of Hadoop. See the table below for requirements specific to dif </div> <table class="tableblock frame-all grid-all spread"> <colgroup> -<col style="width: 20%;"> -<col style="width: 20%;"> -<col style="width: 20%;"> -<col style="width: 20%;"> -<col style="width: 20%;"> +<col style="width: 25%;"> +<col style="width: 25%;"> +<col style="width: 25%;"> +<col style="width: 25%;"> </colgroup> <thead> <tr> <th class="tableblock halign-left valign-top"></th> -<th class="tableblock halign-left valign-top">HBase-1.1.x</th> <th class="tableblock halign-left valign-top">HBase-1.2.x</th> <th class="tableblock halign-left valign-top">HBase-1.3.x</th> <th class="tableblock halign-left valign-top">HBase-2.0.x</th> @@ -1633,25 +1626,21 @@ earlier versions of Hadoop. See the table below for requirements specific to dif <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.1.0-beta</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.2.0</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.3.x</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> @@ -1660,14 +1649,12 @@ earlier versions of Hadoop. See the table below for requirements specific to dif <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.4.x</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.5.x</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> @@ -1675,11 +1662,9 @@ earlier versions of Hadoop. See the table below for requirements specific to dif <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.6.1+</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> @@ -1689,11 +1674,9 @@ earlier versions of Hadoop. See the table below for requirements specific to dif <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.7.1+</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">S</p></td> @@ -1703,21 +1686,18 @@ earlier versions of Hadoop. See the table below for requirements specific to dif <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-2.8.1</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">X</p></td> </tr> <tr> <td class="tableblock halign-left valign-top"><p class="tableblock">Hadoop-3.0.0</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> <td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> -<td class="tableblock halign-left valign-top"><p class="tableblock">NT</p></td> </tr> </tbody> </table> @@ -8092,8 +8072,10 @@ In particular:</p> <div class="paragraph"> <p>Below we describe how the version dimension in HBase currently works. See <a href="https://issues.apache.org/jira/browse/HBASE-2406">HBASE-2406</a> for discussion of HBase versions. <a href="https://www.ngdata.com/bending-time-in-hbase/">Bending time in HBase</a> makes for a good read on the version, or time, dimension in HBase. -It has more detail on versioning than is provided here. -As of this writing, the limitation <em>Overwriting values at existing timestamps</em> mentioned in the article no longer holds in HBase. +It has more detail on versioning than is provided here.</p> +</div> +<div class="paragraph"> +<p>As of this writing, the limitation <em>Overwriting values at existing timestamps</em> mentioned in the article no longer holds in HBase. This section is basically a synopsis of this article by Bruno Dumon.</p> </div> <div class="sect2"> @@ -8308,9 +8290,46 @@ The change has been backported to HBase 0.94 and newer branches. </div> </div> <div class="sect2"> -<h3 id="_current_limitations"><a class="anchor" href="#_current_limitations"></a>28.3. Current Limitations</h3> +<h3 id="new.version.behavior"><a class="anchor" href="#new.version.behavior"></a>28.3. Optional New Version and Delete behavior in HBase-2.0.0</h3> +<div class="paragraph"> +<p>In <code>hbase-2.0.0</code>, the operator can specify an alternate version and +delete treatment by setting the column descriptor property +<code>NEW_VERSION_BEHAVIOR</code> to true (To set a property on a column family +descriptor, you must first disable the table and then alter the +column family descriptor; see <a href="#cf.keep.deleted">Keeping Deleted Cells</a> for an example +of editing an attribute on a column family descriptor).</p> +</div> +<div class="paragraph"> +<p>The 'new version behavior', undoes the limitations listed below +whereby a <code>Delete</code> ALWAYS overshadows a <code>Put</code> if at the same +location — i.e. same row, column family, qualifier and timestamp — regardless of which arrived first. Version accounting is also +changed as deleted versions are considered toward total version count. +This is done to ensure results are not changed should a major +compaction intercede. See <code>HBASE-15968</code> and linked issues for +discussion.</p> +</div> +<div class="paragraph"> +<p>Running with this new configuration currently costs; we factor +the Cell MVCC on every compare so we burn more CPU. The slow +down will depend. In testing we’ve seen between 0% and 25% +degradation.</p> +</div> +<div class="paragraph"> +<p>If replicating, it is advised that you run with the new +serial replication feature (See <code>HBASE-9465</code>; the serial +replication feature did NOT make it into <code>hbase-2.0.0</code> but +should arrive in a subsequent hbase-2.x release) as now +the order in which Mutations arrive is a factor.</p> +</div> +</div> +<div class="sect2"> +<h3 id="_current_limitations"><a class="anchor" href="#_current_limitations"></a>28.4. Current Limitations</h3> +<div class="paragraph"> +<p>The below limitations are addressed in hbase-2.0.0. See +the section above, <a href="#new.version.behavior">Optional New Version and Delete behavior in HBase-2.0.0</a>.</p> +</div> <div class="sect3"> -<h4 id="_deletes_mask_puts"><a class="anchor" href="#_deletes_mask_puts"></a>28.3.1. Deletes mask Puts</h4> +<h4 id="_deletes_mask_puts"><a class="anchor" href="#_deletes_mask_puts"></a>28.4.1. Deletes mask Puts</h4> <div class="paragraph"> <p>Deletes mask puts, even puts that happened after the delete was entered. See <a href="https://issues.apache.org/jira/browse/HBASE-2256">HBASE-2256</a>. @@ -8325,7 +8344,7 @@ But they can occur even if you do not care about time: just do delete and put im </div> </div> <div class="sect3"> -<h4 id="major.compactions.change.query.results"><a class="anchor" href="#major.compactions.change.query.results"></a>28.3.2. Major compactions change query results</h4> +<h4 id="major.compactions.change.query.results"><a class="anchor" href="#major.compactions.change.query.results"></a>28.4.2. Major compactions change query results</h4> <div class="paragraph"> <p><em>…​create three cell versions at t1, t2 and t3, with a maximum-versions setting of 2. So when getting all versions, only the values at t2 and t3 will be @@ -37267,7 +37286,7 @@ The server will return cellblocks compressed using this same compressor as long <div id="footer"> <div id="footer-text"> Version 3.0.0-SNAPSHOT<br> -Last updated 2018-03-06 14:30:05 UTC +Last updated 2018-03-07 14:29:56 UTC </div> </div> </body> http://git-wip-us.apache.org/repos/asf/hbase-site/blob/81cde4ce/bulk-loads.html ---------------------------------------------------------------------- diff --git a/bulk-loads.html b/bulk-loads.html index 7d61b14..fe3a7d7 100644 --- a/bulk-loads.html +++ b/bulk-loads.html @@ -7,7 +7,7 @@ <head> <meta charset="UTF-8" /> <meta name="viewport" content="width=device-width, initial-scale=1.0" /> - <meta name="Date-Revision-yyyymmdd" content="20180306" /> + <meta name="Date-Revision-yyyymmdd" content="20180307" /> <meta http-equiv="Content-Language" content="en" /> <title>Apache HBase – Bulk Loads in Apache HBase (TM) @@ -299,7 +299,7 @@ under the License. --> <a href="https://www.apache.org/">The Apache Software Foundation</a>. All rights reserved. - <li id="publishDate" class="pull-right">Last Published: 2018-03-06</li> + <li id="publishDate" class="pull-right">Last Published: 2018-03-07</li> </p> </div>