hbase git commit: HBASE-20726 Update RELEASENOTES.md and CHANGES.md for 2.0.1RC
Repository: hbase Updated Branches: refs/heads/branch-2.0 dd99e2880 -> 987f7b6d3 HBASE-20726 Update RELEASENOTES.md and CHANGES.md for 2.0.1RC Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/987f7b6d Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/987f7b6d Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/987f7b6d Branch: refs/heads/branch-2.0 Commit: 987f7b6d37c2fcacc942cc66e5c5122aba8fdfbe Parents: dd99e28 Author: Michael Stack Authored: Tue Jun 12 22:37:44 2018 -0700 Committer: Michael Stack Committed: Tue Jun 12 22:37:44 2018 -0700 -- CHANGES.md | 107 +++ RELEASENOTES.md | 70 - 2 files changed, 176 insertions(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/987f7b6d/CHANGES.md -- diff --git a/CHANGES.md b/CHANGES.md index dc4f5da..03f3599 100644 --- a/CHANGES.md +++ b/CHANGES.md @@ -40,6 +40,113 @@ document title above the apache license so markdown readers work. You may have to bulk import old-style CHANGES.txt on to the end in a code comment to preserve continuity of the CHANGELOG. --> +## Release 2.0.1 - Unreleased (as of 2018-06-13) + +### NEW FEATURES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-20656](https://issues.apache.org/jira/browse/HBASE-20656) | Validate pre-2.0 coprocessors against HBase 2.0+ | Major | tooling | +| [HBASE-20592](https://issues.apache.org/jira/browse/HBASE-20592) | Create a tool to verify tables do not have prefix tree encoding | Minor | Operability, tooling | + + +### IMPROVEMENTS: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-20640](https://issues.apache.org/jira/browse/HBASE-20640) | TestQuotaGlobalsSettingsBypass missing test category and ClassRule | Critical | test | +| [HBASE-20548](https://issues.apache.org/jira/browse/HBASE-20548) | Master fails to startup on large clusters, refreshing block distribution | Major | . | +| [HBASE-20567](https://issues.apache.org/jira/browse/HBASE-20567) | Pass both old and new descriptors to pre/post hooks of modify operations for table and namespace | Major | . | +| [HBASE-20523](https://issues.apache.org/jira/browse/HBASE-20523) | PE tool should support configuring client side buffering sizes | Minor | . | +| [HBASE-20527](https://issues.apache.org/jira/browse/HBASE-20527) | Remove unused code in MetaTableAccessor | Trivial | . | +| [HBASE-20507](https://issues.apache.org/jira/browse/HBASE-20507) | Do not need to call recoverLease on the broken file when we fail to create a wal writer | Major | wal | +| [HBASE-20484](https://issues.apache.org/jira/browse/HBASE-20484) | Remove the unnecessary autoboxing in FilterListBase | Trivial | . | +| [HBASE-20327](https://issues.apache.org/jira/browse/HBASE-20327) | When qualifier is not specified, append and incr operation do not work (shell) | Minor | shell | +| [HBASE-20389](https://issues.apache.org/jira/browse/HBASE-20389) | Move website building flags into a profile | Minor | build, website | +| [HBASE-20379](https://issues.apache.org/jira/browse/HBASE-20379) | shadedjars yetus plugin should add a footer link | Major | test | + + +### BUG FIXES: + +| JIRA | Summary | Priority | Component | +|: |: | :--- |: | +| [HBASE-19377](https://issues.apache.org/jira/browse/HBASE-19377) | Compatibility checker complaining about hash collisions | Major | community | +| [HBASE-20689](https://issues.apache.org/jira/browse/HBASE-20689) | Docker fails to install rubocop for precommit | Blocker | build | +| [HBASE-20698](https://issues.apache.org/jira/browse/HBASE-20698) | Master don't record right server version until new started region server call regionServerReport method | Major | proc-v2 | +| [HBASE-20699](https://issues.apache.org/jira/browse/HBASE-20699) | QuotaCache should cancel the QuotaRefresherChore service inside its stop() | Major | . | +| [HBASE-20590](https://issues.apache.org/jira/browse/HBASE-20590) | REST Java client is not able to negotiate with the server in the secure mode | Critical | REST, security | +| [HBASE-20683](https://issues.apache.org/jira/browse/HBASE-20683) | Incorrect return value for PreUpgradeValidator | Critical | . | +| [HBASE-20684](https://issues.apache.org/jira/browse/HBASE-20684) | org.apache.hadoop.hbase.client.Scan#setStopRow javadoc uses incorrect method | Trivial | Client, documentation | +| [HBASE-20670](https://issues.apache.org/jira/browse/HBASE-20670) | NPE in HMaster#isInMaintenanceMode | Minor | . | +| [HBASE-20634](https://issues.apache.org/jira/browse/HBASE-20634) | Reopen region while server crash
hbase git commit: HBASE-20725 Copy down docs from master branch (absent chapters on features not in 2.0.x)
Repository: hbase Updated Branches: refs/heads/branch-2.0 abe5fd071 -> dd99e2880 HBASE-20725 Copy down docs from master branch (absent chapters on features not in 2.0.x) Copied over from master minus backup, spark. Added qualifier on serial replication section. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/dd99e288 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/dd99e288 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/dd99e288 Branch: refs/heads/branch-2.0 Commit: dd99e288061ab2a61d2a56246670a7989cb7f656 Parents: abe5fd0 Author: Michael Stack Authored: Tue Jun 12 22:23:06 2018 -0700 Committer: Michael Stack Committed: Tue Jun 12 22:23:16 2018 -0700 -- src/main/asciidoc/_chapters/compression.adoc| 2 +- src/main/asciidoc/_chapters/configuration.adoc | 26 +++ src/main/asciidoc/_chapters/developer.adoc | 44 +++ src/main/asciidoc/_chapters/external_apis.adoc | 8 +- .../asciidoc/_chapters/inmemory_compaction.adoc | 11 +-- src/main/asciidoc/_chapters/ops_mgt.adoc| 78 +++- src/main/asciidoc/_chapters/security.adoc | 1 + src/main/asciidoc/_chapters/upgrading.adoc | 12 ++- 8 files changed, 155 insertions(+), 27 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/dd99e288/src/main/asciidoc/_chapters/compression.adoc -- diff --git a/src/main/asciidoc/_chapters/compression.adoc b/src/main/asciidoc/_chapters/compression.adoc index b21f106..b2ff5ce 100644 --- a/src/main/asciidoc/_chapters/compression.adoc +++ b/src/main/asciidoc/_chapters/compression.adoc @@ -377,7 +377,7 @@ Options: LZ4] -data_block_encodingEncoding algorithm (e.g. prefix compression) to use for data blocks in the test column family, one - of [NONE, PREFIX, DIFF, FAST_DIFF, PREFIX_TREE]. + of [NONE, PREFIX, DIFF, FAST_DIFF, ROW_INDEX_V1]. -encryption Enables transparent encryption on the test table, one of [AES] -generator The class which generates load for the tool. Any http://git-wip-us.apache.org/repos/asf/hbase/blob/dd99e288/src/main/asciidoc/_chapters/configuration.adoc -- diff --git a/src/main/asciidoc/_chapters/configuration.adoc b/src/main/asciidoc/_chapters/configuration.adoc index 1be9e13..31250ff 100644 --- a/src/main/asciidoc/_chapters/configuration.adoc +++ b/src/main/asciidoc/_chapters/configuration.adoc @@ -217,20 +217,20 @@ Use the following legend to interpret this table: * "X" = not supported * "NT" = Not tested -[cols="1,1,1,1", options="header"] +[cols="1,1,1,1,1,1", options="header"] |=== -| | HBase-1.2.x | HBase-1.3.x | HBase-2.0.x -|Hadoop-2.4.x | S | S | X -|Hadoop-2.5.x | S | S | X -|Hadoop-2.6.0 | X | X | X -|Hadoop-2.6.1+ | S | S | S -|Hadoop-2.7.0 | X | X | X -|Hadoop-2.7.1+ | S | S | S -|Hadoop-2.8.[0-1] | X | X | X -|Hadoop-2.8.2 | NT | NT | NT -|Hadoop-2.8.3+ | NT | NT | S -|Hadoop-2.9.0 | X | X | X -|Hadoop-3.0.0 | NT | NT | NT +| | HBase-1.2.x | HBase-1.3.x | HBase-1.5.x | HBase-2.0.x | HBase-2.1.x +|Hadoop-2.4.x | S | S | X | X | X +|Hadoop-2.5.x | S | S | X | X | X +|Hadoop-2.6.0 | X | X | X | X | X +|Hadoop-2.6.1+ | S | S | X | S | X +|Hadoop-2.7.0 | X | X | X | X | X +|Hadoop-2.7.1+ | S | S | S | S | S +|Hadoop-2.8.[0-1] | X | X | X | X | X +|Hadoop-2.8.2 | NT | NT | NT | NT | NT +|Hadoop-2.8.3+ | NT | NT | NT | S | S +|Hadoop-2.9.0 | X | X | X | X | X +|Hadoop-3.0.0 | NT | NT | NT | NT | NT |=== .Hadoop Pre-2.6.1 and JDK 1.8 Kerberos http://git-wip-us.apache.org/repos/asf/hbase/blob/dd99e288/src/main/asciidoc/_chapters/developer.adoc -- diff --git a/src/main/asciidoc/_chapters/developer.adoc b/src/main/asciidoc/_chapters/developer.adoc index 957f68b..6d0a7d1 100644 --- a/src/main/asciidoc/_chapters/developer.adoc +++ b/src/main/asciidoc/_chapters/developer.adoc @@ -870,6 +870,50 @@ See link:http://search-hadoop.com/m/DHED4dhFaU[HBase, mail # dev - On recent discussion clarifying ASF release policy]. for how we arrived at this process. +[[hbase.release.announcement]] +== Announcing Releases + +Once an RC has passed successfully and the needed artifacts have been staged for disribution, you'll need to let everyone know about our shiny new release. It's not a requirement, but to make things easier for release managers we have a template you can start with. Be sure you replace \_version_ and other markers with the relevant version numbers. You should manually verify all links
hbase git commit: HBASE-20699 QuotaCache should cancel the QuotaRefresherChore service inside its stop()
Repository: hbase Updated Branches: refs/heads/branch-2.0 c2a7d57d3 -> abe5fd071 HBASE-20699 QuotaCache should cancel the QuotaRefresherChore service inside its stop() Signed-off-by: tedyu Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/abe5fd07 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/abe5fd07 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/abe5fd07 Branch: refs/heads/branch-2.0 Commit: abe5fd071b323596d502dedbf2af87adfa7bbd1a Parents: c2a7d57 Author: Nihal Jain Authored: Thu Jun 7 18:42:15 2018 +0530 Committer: Michael Stack Committed: Tue Jun 12 21:34:32 2018 -0700 -- .../src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java | 4 1 file changed, 4 insertions(+) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/abe5fd07/hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java index 927816a..0664cc5 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/quotas/QuotaCache.java @@ -90,6 +90,10 @@ public class QuotaCache implements Stoppable { @Override public void stop(final String why) { +if (refreshChore != null) { + LOG.debug("Stopping QuotaRefresherChore chore."); + refreshChore.cancel(true); +} stopped = true; }
hbase git commit: HBASE-20721 Set version on branch-2.0 to 2.0.1 in prep for 2.0.1 RC
Repository: hbase Updated Branches: refs/heads/branch-2.0 ec5a463a8 -> c2a7d57d3 HBASE-20721 Set version on branch-2.0 to 2.0.1 in prep for 2.0.1 RC Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/c2a7d57d Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/c2a7d57d Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/c2a7d57d Branch: refs/heads/branch-2.0 Commit: c2a7d57d3a417ddd893d8c820eb2d4070f6237c2 Parents: ec5a463 Author: Michael Stack Authored: Tue Jun 12 16:59:17 2018 -0700 Committer: Michael Stack Committed: Tue Jun 12 16:59:17 2018 -0700 -- hbase-annotations/pom.xml| 2 +- hbase-archetypes/hbase-archetype-builder/pom.xml | 2 +- hbase-archetypes/hbase-client-project/pom.xml| 2 +- hbase-archetypes/hbase-shaded-client-project/pom.xml | 2 +- hbase-archetypes/pom.xml | 2 +- hbase-assembly/pom.xml | 2 +- hbase-build-configuration/pom.xml| 2 +- hbase-build-support/hbase-error-prone/pom.xml| 4 ++-- hbase-build-support/pom.xml | 2 +- hbase-checkstyle/pom.xml | 4 ++-- hbase-client/pom.xml | 2 +- hbase-common/pom.xml | 2 +- hbase-endpoint/pom.xml | 2 +- hbase-examples/pom.xml | 2 +- hbase-external-blockcache/pom.xml| 2 +- hbase-hadoop-compat/pom.xml | 2 +- hbase-hadoop2-compat/pom.xml | 2 +- hbase-http/pom.xml | 2 +- hbase-it/pom.xml | 2 +- hbase-mapreduce/pom.xml | 2 +- hbase-metrics-api/pom.xml| 2 +- hbase-metrics/pom.xml| 2 +- hbase-procedure/pom.xml | 2 +- hbase-protocol-shaded/pom.xml| 2 +- hbase-protocol/pom.xml | 2 +- hbase-replication/pom.xml| 2 +- hbase-resource-bundle/pom.xml| 2 +- hbase-rest/pom.xml | 2 +- hbase-rsgroup/pom.xml| 2 +- hbase-server/pom.xml | 2 +- hbase-shaded/hbase-shaded-check-invariants/pom.xml | 2 +- hbase-shaded/hbase-shaded-client/pom.xml | 2 +- hbase-shaded/hbase-shaded-mapreduce/pom.xml | 2 +- hbase-shaded/pom.xml | 2 +- hbase-shell/pom.xml | 2 +- hbase-testing-util/pom.xml | 2 +- hbase-thrift/pom.xml | 2 +- hbase-zookeeper/pom.xml | 2 +- pom.xml | 2 +- 39 files changed, 41 insertions(+), 41 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/c2a7d57d/hbase-annotations/pom.xml -- diff --git a/hbase-annotations/pom.xml b/hbase-annotations/pom.xml index e4e162a..50b5ec3 100644 --- a/hbase-annotations/pom.xml +++ b/hbase-annotations/pom.xml @@ -23,7 +23,7 @@ hbase org.apache.hbase -2.0.1-SNAPSHOT +2.0.1 .. http://git-wip-us.apache.org/repos/asf/hbase/blob/c2a7d57d/hbase-archetypes/hbase-archetype-builder/pom.xml -- diff --git a/hbase-archetypes/hbase-archetype-builder/pom.xml b/hbase-archetypes/hbase-archetype-builder/pom.xml index 189cd3f..1ccba33 100644 --- a/hbase-archetypes/hbase-archetype-builder/pom.xml +++ b/hbase-archetypes/hbase-archetype-builder/pom.xml @@ -25,7 +25,7 @@ hbase-archetypes org.apache.hbase -2.0.1-SNAPSHOT +2.0.1 .. http://git-wip-us.apache.org/repos/asf/hbase/blob/c2a7d57d/hbase-archetypes/hbase-client-project/pom.xml -- diff --git a/hbase-archetypes/hbase-client-project/pom.xml b/hbase-archetypes/hbase-client-project/pom.xml index cec1e40..b36d4a1 100644 --- a/hbase-archetypes/hbase-client-project/pom.xml +++ b/hbase-archetypes/hbase-client-project/pom.xml @@ -26,7 +26,7 @@ hbase-archetypes org.apache.hbase -2.0.1-SNAPSHOT +2.0.1 .. hbase-client-project http://git-wip-us.apache.org/repos/asf/hbase/blob/c2a7d57d/hbase-archetypes/hbase-shaded-client-project/pom.xml -- diff --git a/hbase-archetypes/hbase-shaded-client-project/pom.xml
[5/7] hbase git commit: HBASE-19377 Update Java API CC version
HBASE-19377 Update Java API CC version Compatibility checker complaining about hash collisions, newer versions use longer id strings. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/2a35205f Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/2a35205f Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/2a35205f Branch: refs/heads/branch-1.4 Commit: 2a35205fd9dcd609111312490e72f1c0a4f924ee Parents: 9f6be5a Author: Mike Drob Authored: Tue Jun 12 13:23:13 2018 -0500 Committer: Mike Drob Committed: Tue Jun 12 15:14:09 2018 -0500 -- dev-support/checkcompatibility.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/2a35205f/dev-support/checkcompatibility.py -- diff --git a/dev-support/checkcompatibility.py b/dev-support/checkcompatibility.py index ad1f774..220faaa 100755 --- a/dev-support/checkcompatibility.py +++ b/dev-support/checkcompatibility.py @@ -156,7 +156,7 @@ def checkout_java_acc(force): logging.info("Downloading Java ACC...") -url = "https://github.com/lvc/japi-compliance-checker/archive/2.1.tar.gz; +url = "https://github.com/lvc/japi-compliance-checker/archive/2.4.tar.gz; scratch_dir = get_scratch_dir() path = os.path.join(scratch_dir, os.path.basename(url)) jacc = urllib2.urlopen(url) @@ -166,7 +166,7 @@ def checkout_java_acc(force): subprocess.check_call(["tar", "xzf", path], cwd=scratch_dir) -shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.1"), +shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.4"), os.path.join(acc_dir)) @@ -266,6 +266,12 @@ def process_java_acc_output(output): return_value[line[:6]] = values return return_value +def log_java_acc_version(): +java_acc_path = os.path.join( +get_java_acc_dir(), "japi-compliance-checker.pl") + +args = ["perl", java_acc_path, "-version"] +logging.info(check_output(args)) def run_java_acc(src_name, src_jars, dst_name, dst_jars, annotations, skip_annotations, name): """ Run the compliance checker to compare 'src' and 'dst'. """ @@ -479,6 +485,7 @@ def main(): # Download deps. checkout_java_acc(args.force_download) +log_java_acc_version() # Set up the build. scratch_dir = get_scratch_dir()
[3/7] hbase git commit: HBASE-19377 Update Java API CC version
HBASE-19377 Update Java API CC version Compatibility checker complaining about hash collisions, newer versions use longer id strings. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/ec5a463a Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/ec5a463a Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/ec5a463a Branch: refs/heads/branch-2.0 Commit: ec5a463a8548859ce8ca1223dacd5e1ad10ef19c Parents: a73d005 Author: Mike Drob Authored: Tue Jun 12 13:23:13 2018 -0500 Committer: Mike Drob Committed: Tue Jun 12 15:13:44 2018 -0500 -- dev-support/checkcompatibility.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/ec5a463a/dev-support/checkcompatibility.py -- diff --git a/dev-support/checkcompatibility.py b/dev-support/checkcompatibility.py index ea9c229..d132c35 100755 --- a/dev-support/checkcompatibility.py +++ b/dev-support/checkcompatibility.py @@ -156,7 +156,7 @@ def checkout_java_acc(force): logging.info("Downloading Java ACC...") -url = "https://github.com/lvc/japi-compliance-checker/archive/2.1.tar.gz; +url = "https://github.com/lvc/japi-compliance-checker/archive/2.4.tar.gz; scratch_dir = get_scratch_dir() path = os.path.join(scratch_dir, os.path.basename(url)) jacc = urllib2.urlopen(url) @@ -166,7 +166,7 @@ def checkout_java_acc(force): subprocess.check_call(["tar", "xzf", path], cwd=scratch_dir) -shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.1"), +shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.4"), os.path.join(acc_dir)) @@ -266,6 +266,12 @@ def process_java_acc_output(output): return_value[line[:6]] = values return return_value +def log_java_acc_version(): +java_acc_path = os.path.join( +get_java_acc_dir(), "japi-compliance-checker.pl") + +args = ["perl", java_acc_path, "-dumpversion"] +logging.info("Java ACC version: " + check_output(args)) def run_java_acc(src_name, src_jars, dst_name, dst_jars, annotations, skip_annotations, name): """ Run the compliance checker to compare 'src' and 'dst'. """ @@ -479,6 +485,7 @@ def main(): # Download deps. checkout_java_acc(args.force_download) +log_java_acc_version() # Set up the build. scratch_dir = get_scratch_dir()
[4/7] hbase git commit: HBASE-19377 Update Java API CC version
HBASE-19377 Update Java API CC version Compatibility checker complaining about hash collisions, newer versions use longer id strings. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/b8626415 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/b8626415 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/b8626415 Branch: refs/heads/branch-1 Commit: b86264156ee5215cd7204c6b664686c95cbcc4c0 Parents: bed3b2b Author: Mike Drob Authored: Tue Jun 12 13:23:13 2018 -0500 Committer: Mike Drob Committed: Tue Jun 12 15:13:57 2018 -0500 -- dev-support/checkcompatibility.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/b8626415/dev-support/checkcompatibility.py -- diff --git a/dev-support/checkcompatibility.py b/dev-support/checkcompatibility.py index ad1f774..220faaa 100755 --- a/dev-support/checkcompatibility.py +++ b/dev-support/checkcompatibility.py @@ -156,7 +156,7 @@ def checkout_java_acc(force): logging.info("Downloading Java ACC...") -url = "https://github.com/lvc/japi-compliance-checker/archive/2.1.tar.gz; +url = "https://github.com/lvc/japi-compliance-checker/archive/2.4.tar.gz; scratch_dir = get_scratch_dir() path = os.path.join(scratch_dir, os.path.basename(url)) jacc = urllib2.urlopen(url) @@ -166,7 +166,7 @@ def checkout_java_acc(force): subprocess.check_call(["tar", "xzf", path], cwd=scratch_dir) -shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.1"), +shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.4"), os.path.join(acc_dir)) @@ -266,6 +266,12 @@ def process_java_acc_output(output): return_value[line[:6]] = values return return_value +def log_java_acc_version(): +java_acc_path = os.path.join( +get_java_acc_dir(), "japi-compliance-checker.pl") + +args = ["perl", java_acc_path, "-version"] +logging.info(check_output(args)) def run_java_acc(src_name, src_jars, dst_name, dst_jars, annotations, skip_annotations, name): """ Run the compliance checker to compare 'src' and 'dst'. """ @@ -479,6 +485,7 @@ def main(): # Download deps. checkout_java_acc(args.force_download) +log_java_acc_version() # Set up the build. scratch_dir = get_scratch_dir()
[6/7] hbase git commit: HBASE-19377 Update Java API CC version
HBASE-19377 Update Java API CC version Compatibility checker complaining about hash collisions, newer versions use longer id strings. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/7d51f607 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/7d51f607 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/7d51f607 Branch: refs/heads/branch-1.3 Commit: 7d51f6077b7ccd33293f8bca4ae4e8958b4b7952 Parents: c57ccf7 Author: Mike Drob Authored: Tue Jun 12 13:23:13 2018 -0500 Committer: Mike Drob Committed: Tue Jun 12 15:14:25 2018 -0500 -- dev-support/checkcompatibility.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/7d51f607/dev-support/checkcompatibility.py -- diff --git a/dev-support/checkcompatibility.py b/dev-support/checkcompatibility.py index ad1f774..220faaa 100755 --- a/dev-support/checkcompatibility.py +++ b/dev-support/checkcompatibility.py @@ -156,7 +156,7 @@ def checkout_java_acc(force): logging.info("Downloading Java ACC...") -url = "https://github.com/lvc/japi-compliance-checker/archive/2.1.tar.gz; +url = "https://github.com/lvc/japi-compliance-checker/archive/2.4.tar.gz; scratch_dir = get_scratch_dir() path = os.path.join(scratch_dir, os.path.basename(url)) jacc = urllib2.urlopen(url) @@ -166,7 +166,7 @@ def checkout_java_acc(force): subprocess.check_call(["tar", "xzf", path], cwd=scratch_dir) -shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.1"), +shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.4"), os.path.join(acc_dir)) @@ -266,6 +266,12 @@ def process_java_acc_output(output): return_value[line[:6]] = values return return_value +def log_java_acc_version(): +java_acc_path = os.path.join( +get_java_acc_dir(), "japi-compliance-checker.pl") + +args = ["perl", java_acc_path, "-version"] +logging.info(check_output(args)) def run_java_acc(src_name, src_jars, dst_name, dst_jars, annotations, skip_annotations, name): """ Run the compliance checker to compare 'src' and 'dst'. """ @@ -479,6 +485,7 @@ def main(): # Download deps. checkout_java_acc(args.force_download) +log_java_acc_version() # Set up the build. scratch_dir = get_scratch_dir()
[2/7] hbase git commit: HBASE-19377 Update Java API CC version
HBASE-19377 Update Java API CC version Compatibility checker complaining about hash collisions, newer versions use longer id strings. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/0a6aec49 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/0a6aec49 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/0a6aec49 Branch: refs/heads/branch-2 Commit: 0a6aec49813e794d7ed5d6608e0ee4fab5587ccd Parents: c0d6720 Author: Mike Drob Authored: Tue Jun 12 13:23:13 2018 -0500 Committer: Mike Drob Committed: Tue Jun 12 15:13:35 2018 -0500 -- dev-support/checkcompatibility.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/0a6aec49/dev-support/checkcompatibility.py -- diff --git a/dev-support/checkcompatibility.py b/dev-support/checkcompatibility.py index ea9c229..d132c35 100755 --- a/dev-support/checkcompatibility.py +++ b/dev-support/checkcompatibility.py @@ -156,7 +156,7 @@ def checkout_java_acc(force): logging.info("Downloading Java ACC...") -url = "https://github.com/lvc/japi-compliance-checker/archive/2.1.tar.gz; +url = "https://github.com/lvc/japi-compliance-checker/archive/2.4.tar.gz; scratch_dir = get_scratch_dir() path = os.path.join(scratch_dir, os.path.basename(url)) jacc = urllib2.urlopen(url) @@ -166,7 +166,7 @@ def checkout_java_acc(force): subprocess.check_call(["tar", "xzf", path], cwd=scratch_dir) -shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.1"), +shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.4"), os.path.join(acc_dir)) @@ -266,6 +266,12 @@ def process_java_acc_output(output): return_value[line[:6]] = values return return_value +def log_java_acc_version(): +java_acc_path = os.path.join( +get_java_acc_dir(), "japi-compliance-checker.pl") + +args = ["perl", java_acc_path, "-dumpversion"] +logging.info("Java ACC version: " + check_output(args)) def run_java_acc(src_name, src_jars, dst_name, dst_jars, annotations, skip_annotations, name): """ Run the compliance checker to compare 'src' and 'dst'. """ @@ -479,6 +485,7 @@ def main(): # Download deps. checkout_java_acc(args.force_download) +log_java_acc_version() # Set up the build. scratch_dir = get_scratch_dir()
[1/7] hbase git commit: HBASE-19377 Update Java API CC version
Repository: hbase Updated Branches: refs/heads/branch-1 bed3b2bba -> b86264156 refs/heads/branch-1.2 13ca256b0 -> 595307f25 refs/heads/branch-1.3 c57ccf7b0 -> 7d51f6077 refs/heads/branch-1.4 9f6be5a87 -> 2a35205fd refs/heads/branch-2 c0d67209d -> 0a6aec498 refs/heads/branch-2.0 a73d00546 -> ec5a463a8 refs/heads/master edf60b965 -> 8648af07d HBASE-19377 Update Java API CC version Compatibility checker complaining about hash collisions, newer versions use longer id strings. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/8648af07 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/8648af07 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/8648af07 Branch: refs/heads/master Commit: 8648af07d4acc6cd31e0a55b6958aa739c7d0551 Parents: edf60b9 Author: Mike Drob Authored: Tue Jun 12 13:23:13 2018 -0500 Committer: Mike Drob Committed: Tue Jun 12 14:19:13 2018 -0500 -- dev-support/checkcompatibility.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/8648af07/dev-support/checkcompatibility.py -- diff --git a/dev-support/checkcompatibility.py b/dev-support/checkcompatibility.py index ea9c229..d132c35 100755 --- a/dev-support/checkcompatibility.py +++ b/dev-support/checkcompatibility.py @@ -156,7 +156,7 @@ def checkout_java_acc(force): logging.info("Downloading Java ACC...") -url = "https://github.com/lvc/japi-compliance-checker/archive/2.1.tar.gz; +url = "https://github.com/lvc/japi-compliance-checker/archive/2.4.tar.gz; scratch_dir = get_scratch_dir() path = os.path.join(scratch_dir, os.path.basename(url)) jacc = urllib2.urlopen(url) @@ -166,7 +166,7 @@ def checkout_java_acc(force): subprocess.check_call(["tar", "xzf", path], cwd=scratch_dir) -shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.1"), +shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.4"), os.path.join(acc_dir)) @@ -266,6 +266,12 @@ def process_java_acc_output(output): return_value[line[:6]] = values return return_value +def log_java_acc_version(): +java_acc_path = os.path.join( +get_java_acc_dir(), "japi-compliance-checker.pl") + +args = ["perl", java_acc_path, "-dumpversion"] +logging.info("Java ACC version: " + check_output(args)) def run_java_acc(src_name, src_jars, dst_name, dst_jars, annotations, skip_annotations, name): """ Run the compliance checker to compare 'src' and 'dst'. """ @@ -479,6 +485,7 @@ def main(): # Download deps. checkout_java_acc(args.force_download) +log_java_acc_version() # Set up the build. scratch_dir = get_scratch_dir()
[7/7] hbase git commit: HBASE-19377 Update Java API CC version
HBASE-19377 Update Java API CC version Compatibility checker complaining about hash collisions, newer versions use longer id strings. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/595307f2 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/595307f2 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/595307f2 Branch: refs/heads/branch-1.2 Commit: 595307f258338cedab4304b78af111376e656ff3 Parents: 13ca256 Author: Mike Drob Authored: Tue Jun 12 13:23:13 2018 -0500 Committer: Mike Drob Committed: Tue Jun 12 15:14:37 2018 -0500 -- dev-support/checkcompatibility.py | 11 +-- 1 file changed, 9 insertions(+), 2 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/595307f2/dev-support/checkcompatibility.py -- diff --git a/dev-support/checkcompatibility.py b/dev-support/checkcompatibility.py index ad1f774..220faaa 100755 --- a/dev-support/checkcompatibility.py +++ b/dev-support/checkcompatibility.py @@ -156,7 +156,7 @@ def checkout_java_acc(force): logging.info("Downloading Java ACC...") -url = "https://github.com/lvc/japi-compliance-checker/archive/2.1.tar.gz; +url = "https://github.com/lvc/japi-compliance-checker/archive/2.4.tar.gz; scratch_dir = get_scratch_dir() path = os.path.join(scratch_dir, os.path.basename(url)) jacc = urllib2.urlopen(url) @@ -166,7 +166,7 @@ def checkout_java_acc(force): subprocess.check_call(["tar", "xzf", path], cwd=scratch_dir) -shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.1"), +shutil.move(os.path.join(scratch_dir, "japi-compliance-checker-2.4"), os.path.join(acc_dir)) @@ -266,6 +266,12 @@ def process_java_acc_output(output): return_value[line[:6]] = values return return_value +def log_java_acc_version(): +java_acc_path = os.path.join( +get_java_acc_dir(), "japi-compliance-checker.pl") + +args = ["perl", java_acc_path, "-version"] +logging.info(check_output(args)) def run_java_acc(src_name, src_jars, dst_name, dst_jars, annotations, skip_annotations, name): """ Run the compliance checker to compare 'src' and 'dst'. """ @@ -479,6 +485,7 @@ def main(): # Download deps. checkout_java_acc(args.force_download) +log_java_acc_version() # Set up the build. scratch_dir = get_scratch_dir()
hbase git commit: HBASE-20556 Backport HBASE-16490 to branch-1
Repository: hbase Updated Branches: refs/heads/branch-1.4 4b0a87ab8 -> 9f6be5a87 HBASE-20556 Backport HBASE-16490 to branch-1 Backport by: taklo...@gmail.com Signed-off-by: Zach York Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/9f6be5a8 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/9f6be5a8 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/9f6be5a8 Branch: refs/heads/branch-1.4 Commit: 9f6be5a875286ce8dc12eb81a3816a0ac83421fe Parents: 4b0a87a Author: Zach York Authored: Fri Jun 8 11:39:05 2018 -0700 Committer: Zach York Committed: Tue Jun 12 12:35:42 2018 -0700 -- .../org/apache/hadoop/hbase/master/HMaster.java | 5 +++- .../master/cleaner/BaseFileCleanerDelegate.java | 7 + .../hbase/master/cleaner/CleanerChore.java | 14 -- .../master/cleaner/FileCleanerDelegate.java | 8 ++ .../hbase/master/cleaner/HFileCleaner.java | 12 +++-- .../snapshot/DisabledTableSnapshotHandler.java | 4 +-- .../snapshot/EnabledTableSnapshotHandler.java | 2 +- .../master/snapshot/SnapshotFileCache.java | 28 +--- .../master/snapshot/SnapshotHFileCleaner.java | 15 ++- .../hbase/master/snapshot/SnapshotManager.java | 18 - .../master/snapshot/TakeSnapshotHandler.java| 10 +-- .../master/snapshot/TestSnapshotFileCache.java | 11 .../snapshot/TestSnapshotHFileCleaner.java | 18 ++--- 13 files changed, 116 insertions(+), 36 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/9f6be5a8/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java index b8d8435..4bbeed5 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java @@ -29,6 +29,7 @@ import java.util.ArrayList; import java.util.Collection; import java.util.Collections; import java.util.Comparator; +import java.util.HashMap; import java.util.HashSet; import java.util.Iterator; import java.util.List; @@ -1239,8 +1240,10 @@ public class HMaster extends HRegionServer implements MasterServices, Server { //start the hfile archive cleaner thread Path archiveDir = HFileArchiveUtil.getArchivePath(conf); +Map params = new HashMap(); +params.put(MASTER, this); this.hfileCleaner = new HFileCleaner(cleanerInterval, this, conf, getMasterFileSystem() -.getFileSystem(), archiveDir); +.getFileSystem(), archiveDir, params); getChoreService().scheduleChore(hfileCleaner); serviceStarted = true; if (LOG.isTraceEnabled()) { http://git-wip-us.apache.org/repos/asf/hbase/blob/9f6be5a8/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java index c6955d0..891db22 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java @@ -23,6 +23,8 @@ import org.apache.hadoop.hbase.BaseConfigurable; import com.google.common.base.Predicate; import com.google.common.collect.Iterables; +import java.util.Map; + /** * Base class for file cleaners which allows subclasses to implement a simple * isFileDeletable method (which used to be the FileCleanerDelegate contract). @@ -39,6 +41,11 @@ implements FileCleanerDelegate { }}); } + @Override + public void init(Map params) { +// subclass could override it if needed. + } + /** * Should the master delete the file or keep it? * @param fStat file status of the file to check http://git-wip-us.apache.org/repos/asf/hbase/blob/9f6be5a8/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java index f073d30..8d95cd4 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java @@ -20,6 +20,7 @@ package
hbase git commit: HBASE-20556 Backport HBASE-16490 to branch-1
Repository: hbase Updated Branches: refs/heads/branch-1 1f3957dda -> bed3b2bba HBASE-20556 Backport HBASE-16490 to branch-1 Backport by: taklo...@gmail.com Signed-off-by: Zach York Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/bed3b2bb Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/bed3b2bb Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/bed3b2bb Branch: refs/heads/branch-1 Commit: bed3b2bbae29e66a2442364a13afd77b96c55093 Parents: 1f3957d Author: Zach York Authored: Fri Jun 8 11:39:05 2018 -0700 Committer: Zach York Committed: Tue Jun 12 12:34:05 2018 -0700 -- .../org/apache/hadoop/hbase/master/HMaster.java | 5 +++- .../master/cleaner/BaseFileCleanerDelegate.java | 7 + .../hbase/master/cleaner/CleanerChore.java | 14 -- .../master/cleaner/FileCleanerDelegate.java | 8 ++ .../hbase/master/cleaner/HFileCleaner.java | 12 +++-- .../snapshot/DisabledTableSnapshotHandler.java | 4 +-- .../snapshot/EnabledTableSnapshotHandler.java | 2 +- .../master/snapshot/SnapshotFileCache.java | 28 +--- .../master/snapshot/SnapshotHFileCleaner.java | 15 ++- .../hbase/master/snapshot/SnapshotManager.java | 18 - .../master/snapshot/TakeSnapshotHandler.java| 10 +-- .../master/snapshot/TestSnapshotFileCache.java | 11 .../snapshot/TestSnapshotHFileCleaner.java | 18 ++--- 13 files changed, 116 insertions(+), 36 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/bed3b2bb/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java index 8bff5d2..da52ede 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java @@ -29,6 +29,7 @@ import java.util.ArrayList; import java.util.Collection; import java.util.Collections; import java.util.Comparator; +import java.util.HashMap; import java.util.HashSet; import java.util.Iterator; import java.util.List; @@ -1240,8 +1241,10 @@ public class HMaster extends HRegionServer implements MasterServices, Server { //start the hfile archive cleaner thread Path archiveDir = HFileArchiveUtil.getArchivePath(conf); +Map params = new HashMap(); +params.put(MASTER, this); this.hfileCleaner = new HFileCleaner(cleanerInterval, this, conf, getMasterFileSystem() -.getFileSystem(), archiveDir); +.getFileSystem(), archiveDir, params); getChoreService().scheduleChore(hfileCleaner); serviceStarted = true; if (LOG.isTraceEnabled()) { http://git-wip-us.apache.org/repos/asf/hbase/blob/bed3b2bb/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java index c6955d0..891db22 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/BaseFileCleanerDelegate.java @@ -23,6 +23,8 @@ import org.apache.hadoop.hbase.BaseConfigurable; import com.google.common.base.Predicate; import com.google.common.collect.Iterables; +import java.util.Map; + /** * Base class for file cleaners which allows subclasses to implement a simple * isFileDeletable method (which used to be the FileCleanerDelegate contract). @@ -39,6 +41,11 @@ implements FileCleanerDelegate { }}); } + @Override + public void init(Map params) { +// subclass could override it if needed. + } + /** * Should the master delete the file or keep it? * @param fStat file status of the file to check http://git-wip-us.apache.org/repos/asf/hbase/blob/bed3b2bb/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java index f073d30..8d95cd4 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java @@ -20,6 +20,7 @@ package
[05/11] hbase git commit: HBASE-20672 Adding new Metrics readRequestRate and writeRequestRate - revert pending discussion
HBASE-20672 Adding new Metrics readRequestRate and writeRequestRate - revert pending discussion Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/edf60b96 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/edf60b96 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/edf60b96 Branch: refs/heads/HBASE-20331 Commit: edf60b965be903f205ec689b59c55229e0cb1dbf Parents: 40f0a43 Author: tedyu Authored: Mon Jun 11 18:47:30 2018 -0700 Committer: tedyu Committed: Mon Jun 11 18:47:30 2018 -0700 -- .../regionserver/MetricsRegionServerSource.java | 6 .../MetricsRegionServerWrapper.java | 10 --- .../MetricsRegionServerSourceImpl.java | 6 +--- .../MetricsRegionServerWrapperImpl.java | 29 .../MetricsRegionServerWrapperStub.java | 10 --- 5 files changed, 1 insertion(+), 60 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/edf60b96/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java -- diff --git a/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java b/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java index c02ca26..4636fe0 100644 --- a/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java +++ b/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java @@ -256,18 +256,12 @@ public interface MetricsRegionServerSource extends BaseSource, JvmPauseMonitorSo String READ_REQUEST_COUNT = "readRequestCount"; String READ_REQUEST_COUNT_DESC = "Number of read requests with non-empty Results that this RegionServer has answered."; - String READ_REQUEST_RATE_PER_SECOND = "readRequestRatePerSecond"; - String READ_REQUEST_RATE_DESC = - "Rate of answering the read requests by this region server per second."; String FILTERED_READ_REQUEST_COUNT = "filteredReadRequestCount"; String FILTERED_READ_REQUEST_COUNT_DESC = "Number of filtered read requests this RegionServer has answered."; String WRITE_REQUEST_COUNT = "writeRequestCount"; String WRITE_REQUEST_COUNT_DESC = "Number of mutation requests this RegionServer has answered."; - String WRITE_REQUEST_RATE_PER_SECOND = "writeRequestRatePerSecond"; - String WRITE_REQUEST_RATE_DESC = - "Rate of answering the mutation requests by this region server per second."; String CHECK_MUTATE_FAILED_COUNT = "checkMutateFailedCount"; String CHECK_MUTATE_FAILED_COUNT_DESC = "Number of Check and Mutate calls that failed the checks."; http://git-wip-us.apache.org/repos/asf/hbase/blob/edf60b96/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java -- diff --git a/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java b/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java index 13a5d84..83a8339 100644 --- a/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java +++ b/hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java @@ -136,11 +136,6 @@ public interface MetricsRegionServerWrapper { long getReadRequestsCount(); /** - * Get the rate of read requests per second to regions hosted on this region server. - */ - double getReadRequestsRatePerSecond(); - - /** * Get the number of filtered read requests to regions hosted on this region server. */ long getFilteredReadRequestsCount(); @@ -151,11 +146,6 @@ public interface MetricsRegionServerWrapper { long getWriteRequestsCount(); /** - * Get the rate of write requests per second to regions hosted on this region server. - */ - double getWriteRequestsRatePerSecond(); - - /** * Get the number of CAS operations that failed. */ long getCheckAndMutateChecksFailed(); http://git-wip-us.apache.org/repos/asf/hbase/blob/edf60b96/hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java -- diff --git a/hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java b/hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java index 88d9e06..94b8389 100644 ---
[09/11] hbase git commit: WIP tune down build retention while troubleshooting.
WIP tune down build retention while troubleshooting. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/ca0b5488 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/ca0b5488 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/ca0b5488 Branch: refs/heads/HBASE-20331 Commit: ca0b54884ded1898fe394f74a7d00249e8043fd4 Parents: 448a7c4 Author: Sean Busbey Authored: Wed May 23 14:14:45 2018 -0500 Committer: Sean Busbey Committed: Tue Jun 12 12:52:42 2018 -0500 -- dev-support/Jenkinsfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/ca0b5488/dev-support/Jenkinsfile -- diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile index 59d3227..64144e9 100644 --- a/dev-support/Jenkinsfile +++ b/dev-support/Jenkinsfile @@ -24,7 +24,7 @@ pipeline { cron('@daily') } options { -buildDiscarder(logRotator(numToKeepStr: '30')) +buildDiscarder(logRotator(numToKeepStr: '1')) timeout (time: 9, unit: 'HOURS') timestamps() skipDefaultCheckout()
[04/11] hbase git commit: HBASE-20635 Add missing shaded-pb conversion method for UserPermission
HBASE-20635 Add missing shaded-pb conversion method for UserPermission Signed-off-by: Josh Elser Signed-off-by: Ted Yu Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/40f0a434 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/40f0a434 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/40f0a434 Branch: refs/heads/HBASE-20331 Commit: 40f0a434626215634ad5922f028b4c54a2e4c895 Parents: b25c782 Author: Rajeshbabu Chintaguntla Authored: Mon Jun 11 14:58:18 2018 -0400 Committer: Josh Elser Committed: Mon Jun 11 14:58:18 2018 -0400 -- .../hbase/security/access/ShadedAccessControlUtil.java | 11 +++ 1 file changed, 11 insertions(+) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/40f0a434/hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.java -- diff --git a/hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.java b/hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.java index de26f39..5a94805 100644 --- a/hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.java +++ b/hbase-client/src/main/java/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.java @@ -274,4 +274,15 @@ public class ShadedAccessControlUtil { } return builder.build(); } + + /** + * Converts a user permission proto to a client user permission object. + * + * @param proto the protobuf UserPermission + * @return the converted UserPermission + */ + public static UserPermission toUserPermission(org.apache.hadoop.hbase.shaded.protobuf.generated.AccessControlProtos.UserPermission proto) { +return new UserPermission(proto.getUser().toByteArray(), +toTablePermission(proto.getPermission())); + } }
[11/11] hbase git commit: HBASE-19735 Create a client-tarball assembly
HBASE-19735 Create a client-tarball assembly Provides an extra client descriptor to build a second tarball with a reduced set of dependencies. Not of great impact now, but will build the way for better in the future. Signed-off-by: Sean Busbey Conflicts: hbase-assembly/pom.xml Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/5f831142 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/5f831142 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/5f831142 Branch: refs/heads/HBASE-20331 Commit: 5f831142b1515549864d3e9b64af1f3be3c31c31 Parents: 44fedb0 Author: Josh Elser Authored: Wed Feb 7 18:37:39 2018 -0500 Committer: Sean Busbey Committed: Tue Jun 12 12:52:42 2018 -0500 -- hbase-assembly/pom.xml | 33 +++-- .../src/main/assembly/client-components.xml | 92 + hbase-assembly/src/main/assembly/client.xml | 137 +++ hbase-procedure/pom.xml | 4 +- hbase-spark/pom.xml | 6 + pom.xml | 10 ++ 6 files changed, 268 insertions(+), 14 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/5f831142/hbase-assembly/pom.xml -- diff --git a/hbase-assembly/pom.xml b/hbase-assembly/pom.xml index 5da105b..4fa859a 100644 --- a/hbase-assembly/pom.xml +++ b/hbase-assembly/pom.xml @@ -95,6 +95,7 @@ gnu ${assembly.file} +src/main/assembly/client.xml @@ -220,22 +221,22 @@ test -org.apache.hbase -hbase-hadoop-compat - - -com.google.guava -guava - - + org.apache.hbase + hbase-hadoop-compat + + + com.google.guava + guava + + -org.apache.hbase -${compat.module} + org.apache.hbase + ${compat.module} - org.apache.hbase - hbase-shell + org.apache.hbase + hbase-shell org.apache.hbase @@ -315,6 +316,14 @@ jline jline + + org.apache.hbase + hbase-shaded-client + + + org.apache.hbase + hbase-shaded-mapreduce + http://git-wip-us.apache.org/repos/asf/hbase/blob/5f831142/hbase-assembly/src/main/assembly/client-components.xml -- diff --git a/hbase-assembly/src/main/assembly/client-components.xml b/hbase-assembly/src/main/assembly/client-components.xml new file mode 100644 index 000..2fd1b57 --- /dev/null +++ b/hbase-assembly/src/main/assembly/client-components.xml @@ -0,0 +1,92 @@ + + + + + + + + + ${project.basedir}/../target/site + docs + + + + ${project.basedir}/.. + . + +CHANGES.txt +README.txt + + 0644 + + + + ${project.basedir}/../conf + conf + 0644 + 0755 + + + + + ${project.basedir}/../bin + bin + +get-active-master.rb +hbase +hbase-common.sh +hbase-config.sh +hbase-jruby +hirb.rb + + + 0755 + 0755 + + + + ${project.basedir}/../bin + bin + +hbase.cmd +hbase-config.cmd + + + + + ${project.basedir}/../hbase-shell/src/main/ruby + lib/ruby + 0644 + 0755 + + + + ${project.basedir}/../hbase-server/target/native + lib/native + 0755 + 0755 + +*.so +*.dylib + + + + http://git-wip-us.apache.org/repos/asf/hbase/blob/5f831142/hbase-assembly/src/main/assembly/client.xml -- diff --git a/hbase-assembly/src/main/assembly/client.xml b/hbase-assembly/src/main/assembly/client.xml new file mode 100644 index 000..7951961 --- /dev/null +++ b/hbase-assembly/src/main/assembly/client.xml @@ -0,0 +1,137 @@ + +http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.1; xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; xsi:schemaLocation="http://maven.apache.org/plugins/maven-assembly-plugin/assembly/1.1.1 http://maven.apache.org/xsd/assembly-1.1.1.xsd;> + + + + client-bin + +tar.gz + + + hbase-${project.version}-client + + src/main/assembly/client-components.xml + + + + true + + +org.apache.hbase:hbase-annotations +org.apache.hbase:hbase-client +org.apache.hbase:hbase-common +org.apache.hbase:hbase-hadoop-compat +
[07/11] hbase git commit: HBASE-20333 Provide a shaded client that allows downstream to provide Hadoop needs.
HBASE-20333 Provide a shaded client that allows downstream to provide Hadoop needs. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/44fedb0e Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/44fedb0e Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/44fedb0e Branch: refs/heads/HBASE-20331 Commit: 44fedb0e5d3930796674a70b8fe125d66f4dbf86 Parents: f344902 Author: Sean Busbey Authored: Tue Apr 24 14:51:12 2018 -0500 Committer: Sean Busbey Committed: Tue Jun 12 12:52:35 2018 -0500 -- .../hbase-shaded-check-invariants/pom.xml | 5 ++ .../hbase-shaded-client-byo-hadoop/pom.xml | 70 hbase-shaded/hbase-shaded-client/pom.xml| 35 -- hbase-shaded/hbase-shaded-mapreduce/pom.xml | 30 ++--- hbase-shaded/pom.xml| 6 ++ 5 files changed, 115 insertions(+), 31 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/44fedb0e/hbase-shaded/hbase-shaded-check-invariants/pom.xml -- diff --git a/hbase-shaded/hbase-shaded-check-invariants/pom.xml b/hbase-shaded/hbase-shaded-check-invariants/pom.xml index 7ba4a41..287a986 100644 --- a/hbase-shaded/hbase-shaded-check-invariants/pom.xml +++ b/hbase-shaded/hbase-shaded-check-invariants/pom.xml @@ -48,6 +48,11 @@ hbase-shaded-mapreduce ${project.version} + + org.apache.hbase + hbase-shaded-client-byo-hadoop + ${project.version} + com.github.stephenc.findbugs http://git-wip-us.apache.org/repos/asf/hbase/blob/44fedb0e/hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml -- diff --git a/hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml b/hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml new file mode 100644 index 000..c51a1af --- /dev/null +++ b/hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml @@ -0,0 +1,70 @@ +http://maven.apache.org/POM/4.0.0; + xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance; + xsi:schemaLocation="http://maven.apache.org/POM/4.0.0 http://maven.apache.org/xsd/maven-4.0.0.xsd;> + +4.0.0 + +hbase-shaded +org.apache.hbase +3.0.0-SNAPSHOT +.. + +hbase-shaded-client-byo-hadoop +Apache HBase - Shaded - Client + + + +org.apache.maven.plugins +maven-site-plugin + +true + + + + +maven-assembly-plugin + +true + + + + + + +org.apache.hbase +hbase-client + + + + + +release + + + +org.apache.maven.plugins +maven-shade-plugin + + + + + + http://git-wip-us.apache.org/repos/asf/hbase/blob/44fedb0e/hbase-shaded/hbase-shaded-client/pom.xml -- diff --git a/hbase-shaded/hbase-shaded-client/pom.xml b/hbase-shaded/hbase-shaded-client/pom.xml index 72a5b60..6152aad 100644 --- a/hbase-shaded/hbase-shaded-client/pom.xml +++ b/hbase-shaded/hbase-shaded-client/pom.xml @@ -28,7 +28,7 @@ .. hbase-shaded-client -Apache HBase - Shaded - Client +Apache HBase - Shaded - Client (with Hadoop bundled) @@ -51,6 +51,7 @@ org.apache.hbase hbase-client +${project.version} @@ -59,10 +60,34 @@ release - -org.apache.maven.plugins -maven-shade-plugin - + +org.apache.maven.plugins +maven-shade-plugin + + + aggregate-into-a-jar-with-relocated-third-parties + + + + + + org.apache.hbase:hbase-resource-bundle +org.slf4j:* + com.google.code.findbugs:* + com.github.stephenc.findbugs:* +org.apache.htrace:* +
[06/11] hbase git commit: HBASE-20332 shaded mapreduce module shouldn't include hadoop
HBASE-20332 shaded mapreduce module shouldn't include hadoop * modify the jar checking script to take args; make hadoop stuff optional * separate out checking the artifacts that have hadoop vs those that don't. * * Unfortunately means we need two modules for checking things * * put in a safety check that the support script for checking jar contents is maintained in both modules * * have to carve out an exception for o.a.hadoop.metrics2. :( * fix duplicated class warning * clean up dependencies in hbase-server and some modules that depend on it. * allow Hadoop to have its own htrace where it needs it * add a precommit check to make sure we're not using old htrace imports Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/f3449025 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/f3449025 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/f3449025 Branch: refs/heads/HBASE-20331 Commit: f3449025fc38c2f7d1b1f7a73fa658649b0dc94b Parents: edf60b9 Author: Sean Busbey Authored: Mon Apr 9 13:37:44 2018 -0500 Committer: Sean Busbey Committed: Tue Jun 12 12:51:50 2018 -0500 -- hbase-backup/pom.xml| 12 +- .../src/main/resources/hbase/checkstyle.xml | 4 +- hbase-client/pom.xml| 4 - hbase-common/pom.xml| 12 -- hbase-endpoint/pom.xml | 14 -- hbase-examples/pom.xml | 12 -- hbase-external-blockcache/pom.xml | 4 - hbase-hadoop2-compat/pom.xml| 6 - hbase-it/pom.xml| 6 - hbase-mapreduce/pom.xml | 30 +-- hbase-replication/pom.xml | 4 - hbase-rest/pom.xml | 19 +- hbase-rsgroup/pom.xml | 4 - hbase-server/pom.xml| 103 - .../hbase-shaded-check-invariants/pom.xml | 54 +++-- .../ensure-jars-have-correct-contents.sh| 92 ++-- hbase-shaded/hbase-shaded-mapreduce/pom.xml | 190 +++- .../pom.xml | 215 +++ .../ensure-jars-have-correct-contents.sh| 129 +++ hbase-shaded/pom.xml| 13 ++ hbase-shell/pom.xml | 14 -- hbase-testing-util/pom.xml | 16 -- hbase-thrift/pom.xml| 16 -- pom.xml | 65 +++--- 24 files changed, 773 insertions(+), 265 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/f3449025/hbase-backup/pom.xml -- diff --git a/hbase-backup/pom.xml b/hbase-backup/pom.xml index 7afd51e..00a996f 100644 --- a/hbase-backup/pom.xml +++ b/hbase-backup/pom.xml @@ -155,10 +155,6 @@ hadoop-common - org.apache.htrace - htrace-core - - net.java.dev.jets3t jets3t @@ -264,9 +260,6 @@ 3.0 - -3.0-SNAPSHOT - org.apache.hadoop @@ -276,6 +269,11 @@ org.apache.hadoop hadoop-mapreduce-client-core + + org.apache.hadoop + hadoop-distcp + ${hadoop.version} + http://git-wip-us.apache.org/repos/asf/hbase/blob/f3449025/hbase-checkstyle/src/main/resources/hbase/checkstyle.xml -- diff --git a/hbase-checkstyle/src/main/resources/hbase/checkstyle.xml b/hbase-checkstyle/src/main/resources/hbase/checkstyle.xml index 7ad797c..148e256 100644 --- a/hbase-checkstyle/src/main/resources/hbase/checkstyle.xml +++ b/hbase-checkstyle/src/main/resources/hbase/checkstyle.xml @@ -86,8 +86,10 @@ org.apache.commons.lang, org.apache.curator.shaded, org.apache.hadoop.classification, + org.apache.htrace, org.apache.htrace.shaded, - org.codehaus.jackson"/> + org.codehaus.jackson, + org.htrace"/> http://git-wip-us.apache.org/repos/asf/hbase/blob/f3449025/hbase-client/pom.xml -- diff --git a/hbase-client/pom.xml b/hbase-client/pom.xml index f6247e3..bb99eec 100644 --- a/hbase-client/pom.xml +++ b/hbase-client/pom.xml @@ -235,10 +235,6 @@ hadoop-common - org.apache.htrace - htrace-core - - net.java.dev.jets3t jets3t
[08/11] hbase git commit: HBASE-20615 emphasize shaded artifacts in client tarball.
HBASE-20615 emphasize shaded artifacts in client tarball. Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/66530747 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/66530747 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/66530747 Branch: refs/heads/HBASE-20331 Commit: 665307478a164d8196e6154bb6649f33e0d7bc2b Parents: 5f83114 Author: Sean Busbey Authored: Fri May 18 11:11:42 2018 -0500 Committer: Sean Busbey Committed: Tue Jun 12 12:52:42 2018 -0500 -- bin/hbase | 226 --- bin/hbase-config.sh | 10 + hbase-assembly/pom.xml | 21 +- .../src/main/assembly/client-components.xml | 43 +++- hbase-assembly/src/main/assembly/client.xml | 131 ++- hbase-assembly/src/main/assembly/components.xml | 3 +- .../src/main/assembly/hadoop-two-compat.xml | 80 ++- pom.xml | 6 + 8 files changed, 417 insertions(+), 103 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/66530747/bin/hbase -- diff --git a/bin/hbase b/bin/hbase index 4f1c854..559a02e 100755 --- a/bin/hbase +++ b/bin/hbase @@ -71,11 +71,18 @@ if [ -d "${HBASE_HOME}/target" ]; then in_dev_env=true fi +# Detect if we are in the omnibus tarball +in_omnibus_tarball="false" +if [ -f "${HBASE_HOME}/bin/hbase-daemons.sh" ]; then + in_omnibus_tarball="true" +fi + read -d '' options_string << EOF Options: - --config DIR Configuration direction to use. Default: ./conf - --hosts HOSTSOverride the list in 'regionservers' file - --auth-as-server Authenticate to ZooKeeper using servers configuration + --config DIR Configuration direction to use. Default: ./conf + --hosts HOSTSOverride the list in 'regionservers' file + --auth-as-server Authenticate to ZooKeeper using servers configuration + --internal-classpath Skip attempting to use client facing jars (WARNING: unstable results between versions) EOF # if no args specified, show usage if [ $# = 0 ]; then @@ -87,16 +94,18 @@ if [ $# = 0 ]; then echo " shell Run the HBase shell" echo " hbckRun the hbase 'fsck' tool" echo " snapshotTool for managing snapshots" - echo " wal Write-ahead-log analyzer" - echo " hfile Store file analyzer" - echo " zkcli Run the ZooKeeper shell" - echo " master Run an HBase HMaster node" - echo " regionserverRun an HBase HRegionServer node" - echo " zookeeper Run a ZooKeeper server" - echo " restRun an HBase REST server" - echo " thrift Run the HBase Thrift server" - echo " thrift2 Run the HBase Thrift2 server" - echo " clean Run the HBase clean up script" + if [ "${in_omnibus_tarball}" = "true" ]; then +echo " wal Write-ahead-log analyzer" +echo " hfile Store file analyzer" +echo " zkcli Run the ZooKeeper shell" +echo " master Run an HBase HMaster node" +echo " regionserverRun an HBase HRegionServer node" +echo " zookeeper Run a ZooKeeper server" +echo " restRun an HBase REST server" +echo " thrift Run the HBase Thrift server" +echo " thrift2 Run the HBase Thrift2 server" +echo " clean Run the HBase clean up script" + fi echo " classpath Dump hbase CLASSPATH" echo " mapredcpDump CLASSPATH entries required by mapreduce" echo " pe Run PerformanceEvaluation" @@ -186,9 +195,99 @@ for f in $HBASE_HOME/hbase-jars/hbase*.jar; do fi done +#If avail, add Hadoop to the CLASSPATH and to the JAVA_LIBRARY_PATH +# Allow this functionality to be disabled +if [ "$HBASE_DISABLE_HADOOP_CLASSPATH_LOOKUP" != "true" ] ; then + HADOOP_IN_PATH=$(PATH="${HADOOP_HOME:-${HADOOP_PREFIX}}/bin:$PATH" which hadoop 2>/dev/null) +fi + # Add libs to CLASSPATH -for f in $HBASE_HOME/lib/*.jar; do - CLASSPATH=${CLASSPATH}:$f; +declare shaded_jar + +if [ "${INTERNAL_CLASSPATH}" != "true" ]; then + # find our shaded jars + declare shaded_client + declare shaded_client_byo_hadoop + declare shaded_mapreduce + for f in "${HBASE_HOME}"/lib/shaded-clients/hbase-shaded-client*.jar; do +if [[ "${f}" =~ byo-hadoop ]]; then + shaded_client_byo_hadoop="${f}" +else + shaded_client="${f}" +fi + done + for f in "${HBASE_HOME}"/lib/shaded-clients/hbase-shaded-mapreduce*.jar; do +shaded_mapreduce="${f}" + done + + # If command can use our shaded client, use it + declare -a commands_in_client_jar=("classpath" "version") + for c in
[01/11] hbase git commit: HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+ [Forced Update!]
Repository: hbase Updated Branches: refs/heads/HBASE-20331 227de1b96 -> ca0b54884 (forced update) http://git-wip-us.apache.org/repos/asf/hbase/blob/c323e7bf/src/main/asciidoc/_chapters/ops_mgt.adoc -- diff --git a/src/main/asciidoc/_chapters/ops_mgt.adoc b/src/main/asciidoc/_chapters/ops_mgt.adoc index 6fef714..60b749f 100644 --- a/src/main/asciidoc/_chapters/ops_mgt.adoc +++ b/src/main/asciidoc/_chapters/ops_mgt.adoc @@ -845,11 +845,39 @@ The LoadTestTool has received many updates in recent HBase releases, including s [[ops.pre-upgrade]] === Pre-Upgrade validator Pre-Upgrade validator tool can be used to check the cluster for known incompatibilities before upgrading from HBase 1 to HBase 2. -To run all the checks use the `-all` flag. [source, bash] -$ bin/hbase pre-upgrade -all +$ bin/hbase pre-upgrade command ... + + + Coprocessor validation + +HBase supports co-processors for a long time, but the co-processor API can be changed between major releases. Co-processor validator tries to determine +whether the old co-processors are still compatible with the actual HBase version. + +[source, bash] + +$ bin/hbase pre-upgrade validate-cp -scan| +Options: + -e Treat warnings as errors. + -scan Scan jar for observers. + + +The first parameter of the tool is the `jar` file which holds the co-processor implementation. Further parameters can be `-scan` when the tool will +search the jar file for `Coprocessor` implementations or the `classes` can be explicitly given. + +The tool can report errors and warnings. Errors mean that HBase won't be able to load the coprocessor, because it is incompatible with the current version +of HBase. Warnings mean that the co-processors can be loaded, but they won't work as expected. If `-e` option is given, then the tool will also fail +for warnings. + +Please note that this tool cannot validate every aspect of jar files, it just does some static checks. + +For example: + +[source, bash] + +$ bin/hbase pre-upgrade validate-cp my-coprocessor.jar MyMasterObserver MyRegionObserver DataBlockEncoding validation @@ -858,7 +886,7 @@ To verify that none of the column families are using incompatible Data Block Enc [source, bash] -$ bin/hbase pre-upgrade -validateDBE +$ bin/hbase pre-upgrade validate-dbe This check validates all column families and print out any incompatibilities.
[02/11] hbase git commit: HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+
HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+ Signed-off-by: Mike Drob Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/c323e7bf Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/c323e7bf Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/c323e7bf Branch: refs/heads/HBASE-20331 Commit: c323e7bfaa180dc9a9420ece2e191c21cd04b99a Parents: eb13cdd Author: Balazs Meszaros Authored: Wed May 23 13:49:19 2018 +0200 Committer: Mike Drob Committed: Mon Jun 11 10:26:58 2018 -0500 -- .../resources/hbase/checkstyle-suppressions.xml |1 + .../hadoop/hbase/util/AbstractHBaseTool.java|7 +- .../hbase/coprocessor/BulkLoadObserver.java |8 +- .../hbase/tool/DataBlockEncodingValidator.java | 108 ++ .../hadoop/hbase/tool/PreUpgradeValidator.java | 136 +-- .../coprocessor/Branch1CoprocessorMethods.java | 1137 ++ .../tool/coprocessor/CoprocessorMethod.java | 73 ++ .../tool/coprocessor/CoprocessorMethods.java| 66 + .../tool/coprocessor/CoprocessorValidator.java | 247 .../tool/coprocessor/CoprocessorViolation.java | 56 + .../coprocessor/CurrentCoprocessorMethods.java | 47 + .../coprocessor/CoprocessorValidatorTest.java | 177 +++ src/main/asciidoc/_chapters/ops_mgt.adoc| 34 +- 13 files changed, 2010 insertions(+), 87 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/c323e7bf/hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml -- diff --git a/hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml b/hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml index 9feb555..ad79163 100644 --- a/hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml +++ b/hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml @@ -38,4 +38,5 @@ + http://git-wip-us.apache.org/repos/asf/hbase/blob/c323e7bf/hbase-common/src/main/java/org/apache/hadoop/hbase/util/AbstractHBaseTool.java -- diff --git a/hbase-common/src/main/java/org/apache/hadoop/hbase/util/AbstractHBaseTool.java b/hbase-common/src/main/java/org/apache/hadoop/hbase/util/AbstractHBaseTool.java index 1dd7201..b454884 100644 --- a/hbase-common/src/main/java/org/apache/hadoop/hbase/util/AbstractHBaseTool.java +++ b/hbase-common/src/main/java/org/apache/hadoop/hbase/util/AbstractHBaseTool.java @@ -22,7 +22,6 @@ import java.util.Comparator; import java.util.HashMap; import java.util.List; -import org.apache.hadoop.conf.Configurable; import org.apache.hadoop.conf.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.util.Tool; @@ -46,9 +45,9 @@ import org.apache.hbase.thirdparty.org.apache.commons.cli.ParseException; * command-line argument parsing. */ @InterfaceAudience.Private -public abstract class AbstractHBaseTool implements Tool, Configurable { - protected static final int EXIT_SUCCESS = 0; - protected static final int EXIT_FAILURE = 1; +public abstract class AbstractHBaseTool implements Tool { + public static final int EXIT_SUCCESS = 0; + public static final int EXIT_FAILURE = 1; public static final String SHORT_HELP_OPTION = "h"; public static final String LONG_HELP_OPTION = "help"; http://git-wip-us.apache.org/repos/asf/hbase/blob/c323e7bf/hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/BulkLoadObserver.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/BulkLoadObserver.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/BulkLoadObserver.java index 25e6522..b69a727 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/BulkLoadObserver.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/BulkLoadObserver.java @@ -21,13 +21,9 @@ package org.apache.hadoop.hbase.coprocessor; import java.io.IOException; -import org.apache.hadoop.hbase.Coprocessor; import org.apache.hadoop.hbase.HBaseInterfaceAudience; -import org.apache.hadoop.hbase.TableName; import org.apache.yetus.audience.InterfaceAudience; import org.apache.yetus.audience.InterfaceStability; -import org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos.PrepareBulkLoadRequest; -import org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos.CleanupBulkLoadRequest; /** * Coprocessors implement this interface to observe and mediate bulk load operations. @@ -55,7 +51,7 @@ public interface BulkLoadObserver { * It can't bypass the default action, e.g., ctx.bypass() won't have effect. * If
[10/11] hbase git commit: HBASE-20334 add a test that verifies basic client and MR integration
HBASE-20334 add a test that verifies basic client and MR integration Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/448a7c40 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/448a7c40 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/448a7c40 Branch: refs/heads/HBASE-20331 Commit: 448a7c40f1b204006a55da738a91f0ce82dc1e58 Parents: 6653074 Author: Sean Busbey Authored: Tue May 1 14:28:52 2018 -0500 Committer: Sean Busbey Committed: Tue Jun 12 12:52:42 2018 -0500 -- dev-support/Jenkinsfile | 233 +++-- .../hbase_nightly_pseudo-distributed-test.sh| 516 +++ dev-support/hbase_nightly_source-artifact.sh| 14 +- .../cache-apache-project-artifact.sh| 131 + 4 files changed, 836 insertions(+), 58 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/448a7c40/dev-support/Jenkinsfile -- diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile index 2311e35..59d3227 100644 --- a/dev-support/Jenkinsfile +++ b/dev-support/Jenkinsfile @@ -60,54 +60,109 @@ pipeline { booleanParam(name: 'DEBUG', defaultValue: false, description: 'Produce a lot more meta-information.') } stages { -stage ('yetus install') { +stage ('scm-checkout') { steps { -sh '''#!/usr/bin/env bash -set -e -echo "Ensure we have a copy of Apache Yetus." -if [[ true != "${USE_YETUS_PRERELEASE}" ]]; then - YETUS_DIR="${WORKSPACE}/yetus-${YETUS_RELEASE}" - echo "Checking for Yetus ${YETUS_RELEASE} in '${YETUS_DIR}'" - if [ ! -d "${YETUS_DIR}" ]; then -echo "New download of Apache Yetus version ${YETUS_RELEASE}." -rm -rf "${WORKSPACE}/.gpg" -mkdir -p "${WORKSPACE}/.gpg" -chmod -R 700 "${WORKSPACE}/.gpg" - -echo "install yetus project KEYS" -curl -L --fail -o "${WORKSPACE}/KEYS_YETUS" https://dist.apache.org/repos/dist/release/yetus/KEYS -gpg --homedir "${WORKSPACE}/.gpg" --import "${WORKSPACE}/KEYS_YETUS" - -echo "download yetus release ${YETUS_RELEASE}" -curl -L --fail -O "https://dist.apache.org/repos/dist/release/yetus/${YETUS_RELEASE}/yetus-${YETUS_RELEASE}-bin.tar.gz; -curl -L --fail -O "https://dist.apache.org/repos/dist/release/yetus/${YETUS_RELEASE}/yetus-${YETUS_RELEASE}-bin.tar.gz.asc; -echo "verifying yetus release" -gpg --homedir "${WORKSPACE}/.gpg" --verify "yetus-${YETUS_RELEASE}-bin.tar.gz.asc" -mv "yetus-${YETUS_RELEASE}-bin.tar.gz" yetus.tar.gz - else -echo "Reusing cached download of Apache Yetus version ${YETUS_RELEASE}." - fi -else - YETUS_DIR="${WORKSPACE}/yetus-git" - rm -rf "${YETUS_DIR}" - echo "downloading from github" - curl -L --fail https://api.github.com/repos/apache/yetus/tarball/HEAD -o yetus.tar.gz -fi -if [ ! -d "${YETUS_DIR}" ]; then - echo "unpacking yetus into '${YETUS_DIR}'" - mkdir -p "${YETUS_DIR}" - gunzip -c yetus.tar.gz | tar xpf - -C "${YETUS_DIR}" --strip-components 1 -fi -''' -// Set up the file we need at PERSONALITY_FILE location -dir ("tools") { - sh """#!/usr/bin/env bash -set -e -echo "Downloading Project personality." -curl -L -o personality.sh "${env.PROJECT_PERSONALITY}" - """ +dir('component') { + checkout scm +} + } +} +stage ('thirdparty installs') { + parallel { +stage ('yetus install') { + steps { +// directory must be unique for each parallel stage, because jenkins runs them in the same workspace :( +dir('downloads-yetus') { + // can't just do a simple echo or the directory won't be created. :( + sh '''#!/usr/bin/env bash +echo "Make sure we have a directory for downloading dependencies: $(pwd)" +''' +} +sh '''#!/usr/bin/env bash + set -e + echo "Ensure we have a copy of Apache Yetus." + if [[ true != "${USE_YETUS_PRERELEASE}" ]]; then +YETUS_DIR="${WORKSPACE}/yetus-${YETUS_RELEASE}" +echo "Checking for Yetus ${YETUS_RELEASE} in '${YETUS_DIR}'" +if [ ! -d "${YETUS_DIR}" ]; then + "${WORKSPACE}/component/dev-support/jenkins-scripts/cache-apache-project-artifact.sh" \ + --working-dir "${WORKSPACE}/downloads-yetus" \ + --keys 'https://www.apache.org/dist/yetus/KEYS' \ + "${WORKSPACE}/yetus-${YETUS_RELEASE}-bin.tar.gz" \ + "yetus/${YETUS_RELEASE}/yetus-${YETUS_RELEASE}-bin.tar.gz" + mv "yetus-${YETUS_RELEASE}-bin.tar.gz" yetus.tar.gz +else + echo "Reusing cached install of Apache
[03/11] hbase git commit: HBASE-19852 HBase Thrift should use a SPNEGO HTTP/hostname principal for checking HTTP Kerberos authentication
HBASE-19852 HBase Thrift should use a SPNEGO HTTP/hostname principal for checking HTTP Kerberos authentication Return 401 sooner when AUTHORIZATION header is missing HBase Thrift server was checking for the AUTHORIZATION header and assuming it was always present even when it was the first request. Many clients will not send the AUTHORIZATION header until a 401 is received. HBase Thrift in the case of no header was throwing multiple exceptions and filling the logs with exceptions. This was fixed by checking that if the AUTHORIZATION header is empty then return a 401 immediately if security is enabled. Signed-off-by: Josh Elser Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/b25c782f Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/b25c782f Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/b25c782f Branch: refs/heads/HBASE-20331 Commit: b25c782f0d8cbc159e774633f872f4509d1a840a Parents: c323e7b Author: Kevin Risden Authored: Thu Dec 14 10:32:00 2017 -0600 Committer: Josh Elser Committed: Mon Jun 11 12:52:19 2018 -0400 -- hbase-thrift/pom.xml| 5 + .../hadoop/hbase/thrift/ThriftHttpServlet.java | 90 -- .../hadoop/hbase/thrift/ThriftServer.java | 10 +- .../hadoop/hbase/thrift/ThriftServerRunner.java | 211 +++--- .../hbase/thrift/TestThriftHttpServer.java | 15 +- .../hbase/thrift/TestThriftServerCmdLine.java | 2 +- .../thrift/TestThriftSpnegoHttpServer.java | 280 +++ 7 files changed, 460 insertions(+), 153 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/b25c782f/hbase-thrift/pom.xml -- diff --git a/hbase-thrift/pom.xml b/hbase-thrift/pom.xml index 0142ccd..814650d 100644 --- a/hbase-thrift/pom.xml +++ b/hbase-thrift/pom.xml @@ -291,6 +291,11 @@ org.glassfish javax.el + + org.apache.kerby + kerb-simplekdc + test + http://git-wip-us.apache.org/repos/asf/hbase/blob/b25c782f/hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.java -- diff --git a/hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.java b/hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.java index 8d68964..f35e11b 100644 --- a/hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.java +++ b/hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.java @@ -1,4 +1,4 @@ -/** +/* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this work for additional information @@ -18,6 +18,9 @@ package org.apache.hadoop.hbase.thrift; +import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_KEYTAB_FILE_KEY; +import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_PRINCIPAL_KEY; + import java.io.IOException; import java.security.PrivilegedExceptionAction; @@ -31,6 +34,7 @@ import org.apache.hadoop.hbase.util.Base64; import org.apache.hadoop.security.UserGroupInformation; import org.apache.hadoop.security.authorize.AuthorizationException; import org.apache.hadoop.security.authorize.ProxyUsers; +import org.apache.http.HttpHeaders; import org.apache.thrift.TProcessor; import org.apache.thrift.protocol.TProtocolFactory; import org.apache.thrift.server.TServlet; @@ -52,26 +56,35 @@ import org.slf4j.LoggerFactory; public class ThriftHttpServlet extends TServlet { private static final long serialVersionUID = 1L; private static final Logger LOG = LoggerFactory.getLogger(ThriftHttpServlet.class.getName()); - private transient final UserGroupInformation realUser; - private transient final Configuration conf; - private final boolean securityEnabled; + private final transient UserGroupInformation serviceUGI; + private final transient UserGroupInformation httpUGI; + private final transient ThriftServerRunner.HBaseHandler hbaseHandler; private final boolean doAsEnabled; - private transient ThriftServerRunner.HBaseHandler hbaseHandler; + private final boolean securityEnabled; // HTTP Header related constants. - public static final String WWW_AUTHENTICATE = "WWW-Authenticate"; - public static final String AUTHORIZATION = "Authorization"; public static final String NEGOTIATE = "Negotiate"; public ThriftHttpServlet(TProcessor processor, TProtocolFactory protocolFactory, - UserGroupInformation realUser, Configuration conf, ThriftServerRunner.HBaseHandler - hbaseHandler, boolean securityEnabled, boolean doAsEnabled) { +
svn commit: r27402 - in /release/hbase: 1.2.6/ stable
Author: busbey Date: Tue Jun 12 16:15:41 2018 New Revision: 27402 Log: Updating stable pointer for 1.2.6.1 release. archiving 1.2.6 release. Removed: release/hbase/1.2.6/ Modified: release/hbase/stable Modified: release/hbase/stable == --- release/hbase/stable (original) +++ release/hbase/stable Tue Jun 12 16:15:41 2018 @@ -1 +1 @@ -link 1.2.6 \ No newline at end of file +link 1.2.6.1 \ No newline at end of file
svn commit: r27401 - /dev/hbase/1.2.6.1RC0/ /release/hbase/1.2.6.1/
Author: busbey Date: Tue Jun 12 16:06:10 2018 New Revision: 27401 Log: Publish Apache HBase 1.2.6.1 vote: https://s.apache.org/hbase-1.2.6.1-vote results: https://s.apache.org/hbase-1.2.6.1-vote-results Added: release/hbase/1.2.6.1/ - copied from r27400, dev/hbase/1.2.6.1RC0/ Removed: dev/hbase/1.2.6.1RC0/
[33/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html b/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html index 5ed293d..3ecfe2f 100644 --- a/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html +++ b/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html @@ -114,7 +114,7 @@ var activeTableTab = "activeTableTab"; @InterfaceAudience.Private -public class ThriftServerRunner +public class ThriftServerRunner extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object implements https://docs.oracle.com/javase/8/docs/api/java/lang/Runnable.html?is-external=true; title="class or interface in java.lang">Runnable ThriftServerRunner - this class starts up a Thrift server which implements @@ -231,11 +231,11 @@ implements https://docs.oracle.com/javase/8/docs/api/java/lang/Runnable (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -HTTP_MAX_THREADS +HTTP_MAX_THREADS_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -HTTP_MIN_THREADS +HTTP_MIN_THREADS_KEY (package private) org.eclipse.jetty.server.Server @@ -270,16 +270,24 @@ implements https://docs.oracle.com/javase/8/docs/api/java/lang/Runnable qop +private boolean +securityEnabled + + +(package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +SERVER_TYPE_CONF_KEY + + private org.apache.hadoop.security.UserGroupInformation -realUser +serviceUGI -private boolean -securityEnabled +(package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +THRIFT_DNS_INTERFACE_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -SERVER_TYPE_CONF_KEY +THRIFT_DNS_NAMESERVER_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String @@ -291,6 +299,14 @@ implements https://docs.oracle.com/javase/8/docs/api/java/lang/Runnable (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +THRIFT_KERBEROS_PRINCIPAL_KEY + + +(package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +THRIFT_KEYTAB_FILE_KEY + + +(package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String THRIFT_QOP_KEY Thrift quality of protection configuration key. @@ -308,39 +324,47 @@ implements https://docs.oracle.com/javase/8/docs/api/java/lang/Runnable (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -THRIFT_SSL_ENABLED +THRIFT_SPNEGO_KEYTAB_FILE_KEY + + +(package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +THRIFT_SPNEGO_PRINCIPAL_KEY + + +(package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +THRIFT_SSL_ENABLED_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -THRIFT_SSL_EXCLUDE_CIPHER_SUITES +THRIFT_SSL_EXCLUDE_CIPHER_SUITES_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -THRIFT_SSL_EXCLUDE_PROTOCOLS +THRIFT_SSL_EXCLUDE_PROTOCOLS_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -THRIFT_SSL_INCLUDE_CIPHER_SUITES +THRIFT_SSL_INCLUDE_CIPHER_SUITES_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -THRIFT_SSL_INCLUDE_PROTOCOLS +THRIFT_SSL_INCLUDE_PROTOCOLS_KEY (package private) static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or
[12/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html b/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html new file mode 100644 index 000..3645ce8 --- /dev/null +++ b/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html @@ -0,0 +1,145 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + +Source code + + + + +001/** +002 * +003 * Licensed to the Apache Software Foundation (ASF) under one +004 * or more contributor license agreements. See the NOTICE file +005 * distributed with this work for additional information +006 * regarding copyright ownership. The ASF licenses this file +007 * to you under the Apache License, Version 2.0 (the +008 * "License"); you may not use this file except in compliance +009 * with the License. You may obtain a copy of the License at +010 * +011 * http://www.apache.org/licenses/LICENSE-2.0 +012 * +013 * Unless required by applicable law or agreed to in writing, software +014 * distributed under the License is distributed on an "AS IS" BASIS, +015 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +016 * See the License for the specific language governing permissions and +017 * limitations under the License. +018 */ +019 +020package org.apache.hadoop.hbase.tool.coprocessor; +021 +022import java.util.ArrayList; +023import java.util.List; +024import java.util.Objects; +025 +026import org.apache.yetus.audience.InterfaceAudience; +027 +028@InterfaceAudience.Private +029public class CoprocessorMethod { +030 private final String name; +031 private final ListString parameters; +032 +033 public CoprocessorMethod(String name) { +034this.name = name; +035 +036parameters = new ArrayList(); +037 } +038 +039 public CoprocessorMethod withParameters(String ... parameters) { +040for (String parameter : parameters) { +041 this.parameters.add(parameter); +042} +043 +044return this; +045 } +046 +047 public CoprocessorMethod withParameters(Class? ... parameters) { +048for (Class? parameter : parameters) { +049 this.parameters.add(parameter.getCanonicalName()); +050} +051 +052return this; +053 } +054 +055 @Override +056 public boolean equals(Object obj) { +057if (obj == this) { +058 return true; +059} else if (!(obj instanceof CoprocessorMethod)) { +060 return false; +061} +062 +063CoprocessorMethod other = (CoprocessorMethod)obj; +064 +065return Objects.equals(name, other.name) +066Objects.equals(parameters, other.parameters); +067 } +068 +069 @Override +070 public int hashCode() { +071return Objects.hash(name, parameters); +072 } +073} + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + + http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethods.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethods.html b/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethods.html new file mode 100644 index 000..aac3b08 --- /dev/null +++ b/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethods.html @@ -0,0 +1,138 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + +Source code + + + + +001/** +002 * Licensed to the Apache Software Foundation (ASF) under one +003 * or more contributor license agreements. See the NOTICE file +004 * distributed with this work for additional information +005 * regarding copyright ownership. The ASF licenses this file +006 * to you under the Apache License, Version 2.0 (the +007 * "License"); you may not use this file except in compliance +008 * with the License. You may obtain a copy of the License at +009 * +010 * http://www.apache.org/licenses/LICENSE-2.0 +011 * +012 * Unless required by applicable law or agreed to in writing, software +013 * distributed under the License is distributed on an "AS IS" BASIS, +014 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +015 * See the License for the specific language governing permissions and +016 * limitations under the License. +017 */ +018 +019package org.apache.hadoop.hbase.tool.coprocessor; +020 +021import java.lang.reflect.Method; +022import java.util.HashSet; +023import java.util.Set; +024 +025import org.apache.yetus.audience.InterfaceAudience; +026 +027@InterfaceAudience.Private +028public class CoprocessorMethods { +029 private final SetCoprocessorMethod methods; +030 +031 public
[27/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/overview-frame.html -- diff --git a/devapidocs/overview-frame.html b/devapidocs/overview-frame.html index 160712c..8b6c541 100644 --- a/devapidocs/overview-frame.html +++ b/devapidocs/overview-frame.html @@ -117,6 +117,7 @@ org.apache.hadoop.hbase.tmpl.master org.apache.hadoop.hbase.tmpl.regionserver org.apache.hadoop.hbase.tool +org.apache.hadoop.hbase.tool.coprocessor org.apache.hadoop.hbase.trace org.apache.hadoop.hbase.types org.apache.hadoop.hbase.util http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/overview-summary.html -- diff --git a/devapidocs/overview-summary.html b/devapidocs/overview-summary.html index ef3e619..4e61f69 100644 --- a/devapidocs/overview-summary.html +++ b/devapidocs/overview-summary.html @@ -552,10 +552,14 @@ service. -org.apache.hadoop.hbase.trace +org.apache.hadoop.hbase.tool.coprocessor +org.apache.hadoop.hbase.trace + + + org.apache.hadoop.hbase.types @@ -563,43 +567,43 @@ service. extensible data type API. - + org.apache.hadoop.hbase.util - + org.apache.hadoop.hbase.util.compaction - + org.apache.hadoop.hbase.util.hbck - + org.apache.hadoop.hbase.wal - + org.apache.hadoop.hbase.zookeeper - + org.apache.hadoop.metrics2 - + org.apache.hadoop.metrics2.impl - + org.apache.hadoop.metrics2.lib - + org.apache.hadoop.metrics2.util - + org.apache.hbase.archetypes.exemplars.client This package provides fully-functional exemplar Java code demonstrating @@ -607,7 +611,7 @@ service. archetype with hbase-client dependency. - + org.apache.hbase.archetypes.exemplars.shaded_client This package provides fully-functional exemplar Java code demonstrating http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/overview-tree.html -- diff --git a/devapidocs/overview-tree.html b/devapidocs/overview-tree.html index bf046e5..c2f57dc 100644 --- a/devapidocs/overview-tree.html +++ b/devapidocs/overview-tree.html @@ -177,6 +177,7 @@ org.apache.hadoop.hbase.tmpl.master, org.apache.hadoop.hbase.tmpl.regionserver, org.apache.hadoop.hbase.tool, +org.apache.hadoop.hbase.tool.coprocessor, org.apache.hadoop.hbase.trace, org.apache.hadoop.hbase.types, org.apache.hadoop.hbase.util, @@ -328,16 +329,17 @@ org.apache.hadoop.hbase.security.AbstractHBaseSaslRpcClient.SaslClientCallbackHandler (implements javax.security.auth.callback.https://docs.oracle.com/javase/8/docs/api/javax/security/auth/callback/CallbackHandler.html?is-external=true; title="class or interface in javax.security.auth.callback">CallbackHandler) -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.backup.BackupDriver +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator org.apache.hadoop.hbase.snapshot.CreateSnapshot +org.apache.hadoop.hbase.tool.DataBlockEncodingValidator org.apache.hadoop.hbase.snapshot.ExportSnapshot (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.backup.mapreduce.MapReduceBackupCopyJob.SnapshotCopy -org.apache.hadoop.hbase.tool.PreUpgradeValidator org.apache.hadoop.hbase.util.RegionMover org.apache.hadoop.hbase.backup.RestoreDriver org.apache.hadoop.hbase.snapshot.SnapshotInfo @@ -1052,6 +1054,7 @@ org.apache.hadoop.hbase.util.DynamicClassLoader +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator.ResolverUrlClassLoader @@ -1368,12 +1371,20 @@ org.apache.hadoop.hbase.coprocessor.CoprocessorHost.EnvironmentPriorityComparator (implements java.util.https://docs.oracle.com/javase/8/docs/api/java/util/Comparator.html?is-external=true; title="class or interface in java.util">ComparatorT) +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethod +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods + +org.apache.hadoop.hbase.tool.coprocessor.Branch1CoprocessorMethods +org.apache.hadoop.hbase.tool.coprocessor.CurrentCoprocessorMethods + + org.apache.hadoop.hbase.ipc.CoprocessorRpcUtils org.apache.hadoop.hbase.ipc.CoprocessorRpcUtils.BlockingRpcCallbackR (implements com.google.protobuf.RpcCallbackParameterType) org.apache.hadoop.hbase.coprocessor.CoprocessorServiceBackwardCompatiblity org.apache.hadoop.hbase.coprocessor.CoprocessorServiceBackwardCompatiblity.MasterCoprocessorService (implements org.apache.hadoop.hbase.coprocessor.MasterCoprocessor) org.apache.hadoop.hbase.coprocessor.CoprocessorServiceBackwardCompatiblity.RegionCoprocessorService (implements org.apache.hadoop.hbase.coprocessor.RegionCoprocessor)
[13/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/Branch1CoprocessorMethods.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/Branch1CoprocessorMethods.html b/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/Branch1CoprocessorMethods.html new file mode 100644 index 000..3fa3183 --- /dev/null +++ b/devapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/Branch1CoprocessorMethods.html @@ -0,0 +1,1209 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + +Source code + + + + +001/** +002 * Licensed to the Apache Software Foundation (ASF) under one +003 * or more contributor license agreements. See the NOTICE file +004 * distributed with this work for additional information +005 * regarding copyright ownership. The ASF licenses this file +006 * to you under the Apache License, Version 2.0 (the +007 * "License"); you may not use this file except in compliance +008 * with the License. You may obtain a copy of the License at +009 * +010 * http://www.apache.org/licenses/LICENSE-2.0 +011 * +012 * Unless required by applicable law or agreed to in writing, software +013 * distributed under the License is distributed on an "AS IS" BASIS, +014 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +015 * See the License for the specific language governing permissions and +016 * limitations under the License. +017 */ +018 +019package org.apache.hadoop.hbase.tool.coprocessor; +020 +021import org.apache.yetus.audience.InterfaceAudience; +022 +023@InterfaceAudience.Private +024public class Branch1CoprocessorMethods extends CoprocessorMethods { +025 public Branch1CoprocessorMethods() { +026addMethods(); +027 } +028 +029 /* +030 * This list of methods was generated from HBase 1.4.4. +031 */ +032 private void addMethods() { +033/* BulkLoadObserver */ +034 +035addMethod("prePrepareBulkLoad", +036 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +037 "org.apache.hadoop.hbase.protobuf.generated.SecureBulkLoadProtos.PrepareBulkLoadRequest"); +038 +039addMethod("preCleanupBulkLoad", +040 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +041 "org.apache.hadoop.hbase.protobuf.generated.SecureBulkLoadProtos.CleanupBulkLoadRequest"); +042 +043/* EndpointObserver */ +044 +045addMethod("postEndpointInvocation", +046 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +047"com.google.protobuf.Service", +048"java.lang.String", +049"com.google.protobuf.Message", +050 "com.google.protobuf.Message.Builder"); +051 +052addMethod("preEndpointInvocation", +053 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +054"com.google.protobuf.Service", +055"java.lang.String", +056"com.google.protobuf.Message"); +057 +058/* MasterObserver */ +059 +060addMethod("preCreateTable", +061 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +062 "org.apache.hadoop.hbase.HTableDescriptor", +063 "org.apache.hadoop.hbase.HRegionInfo[]"); +064 +065addMethod("postCreateTable", +066 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +067 "org.apache.hadoop.hbase.HTableDescriptor", +068 "org.apache.hadoop.hbase.HRegionInfo[]"); +069 +070addMethod("preDeleteTable", +071 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +072 "org.apache.hadoop.hbase.TableName"); +073 +074addMethod("postDeleteTable", +075 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +076 "org.apache.hadoop.hbase.TableName"); +077 +078addMethod("preDeleteTableHandler", +079 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +080 "org.apache.hadoop.hbase.TableName"); +081 +082addMethod("preMove", +083 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +084 "org.apache.hadoop.hbase.HRegionInfo", +085 "org.apache.hadoop.hbase.ServerName", +086 "org.apache.hadoop.hbase.ServerName"); +087 +088addMethod("preCreateTableHandler", +089 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +090 "org.apache.hadoop.hbase.HTableDescriptor", +091 "org.apache.hadoop.hbase.HRegionInfo[]"); +092 +093addMethod("postCreateTableHandler", +094 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +095 "org.apache.hadoop.hbase.HTableDescriptor", +096 "org.apache.hadoop.hbase.HRegionInfo[]"); +097 +098addMethod("postMove", +099 "org.apache.hadoop.hbase.coprocessor.ObserverContext", +100 "org.apache.hadoop.hbase.HRegionInfo", +101 "org.apache.hadoop.hbase.ServerName", +102 "org.apache.hadoop.hbase.ServerName"); +103 +104addMethod("postDeleteTableHandler", +105
[38/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.html b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.html index 02e9f76..5335c61 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.html @@ -332,7 +332,7 @@ implements MetricsRegionServerSource -APPEND_KEY, AVERAGE_REGION_SIZE, AVERAGE_REGION_SIZE_DESC, AVG_STORE_FILE_AGE, AVG_STORE_FILE_AGE_DESC, BLOCK_CACHE_BLOOM_CHUNK_HIT_COUNT, BLOCK_CAC HE_BLOOM_CHUNK_MISS_COUNT, BLOCK_CACHE_COUNT, BLOCK_CACHE_COUNT_DESC, BLOCK_CACHE_DATA_HIT_COUNT, BLOCK_CACHE_DATA_MISS_COUNT, BLOCK_CACHE_DELETE_FAMILY_BLOOM_HIT_COUNT, BLOCK_CACHE_DELETE_FAMILY_BLOOM_MISS_COUNT, BLOCK_CACHE_ENCODED_DATA_HIT_COUNT, BLOCK_CACHE_ENCODED_DATA_MISS_COUNT, BLOCK_CACHE_EVICTION_COUNT, BLOCK_CACHE_EVICTION_COUNT_DESC, BLOCK_CACHE_EXPRESS_HIT_PERCENT, BLOCK_CACHE_EXPRESS_HIT_PERCENT_DESC, BLOCK_CACHE_FAILED_INSERTION_COUNT, BLOCK_CACHE_FAILED_INSERTION_COUNT_DESC, BLOCK_CACHE_FILE_INFO_HIT_COUNT, BLOCK_CACHE_FILE_INFO_MISS_COUNT, BLOCK_CACHE_FREE_DESC, BLOCK_CACHE_FREE_SIZE, BLOCK_CACHE_GENERAL_BLOOM_META_HIT_COUNT, BLOCK_CACHE_GENERAL_BLOOM_META_MISS_COUNT, BLOCK_CACHE_HIT_COUNT, BLOCK_CACHE_HIT_COUNT_DESC, BLOCK_CACHE_HIT_PERCENT, BLOCK_CACHE_HIT_PERCENT_DESC, BLOCK_CACHE_INTERMEDIATE_INDEX_HIT_COUNT, BLOCK_CACHE_INTERMEDIATE_INDEX_MISS_COUNT, BLOCK_CACHE_LEAF_INDEX_HIT_COUNT, BLOCK_CACHE_LEAF_INDEX_MISS_COUNT, BLOCK_CACHE_META_HIT_COUNT, BLOCK_CACHE_META_MISS_COUNT, BLOCK_CACHE_MISS_COUNT, BLOCK_CACHE_PRIMARY_EVICTION_COUNT, BLOCK_CACHE_PRIMARY_EVICTION_COUNT_DESC, BLOCK_CACHE_PRIMARY_HIT_COUNT, BLOCK_CACHE_PRIMARY_HIT_COUNT_DESC, BLOCK_CACHE_PRIMARY_MISS_COUNT, B LOCK_CACHE_ROOT_INDEX_HIT_COUNT, BLOCK_CACHE_ROOT_INDEX_MISS_COUNT, BLOCK_CACHE_SIZE, BLOCK_CACHE_SIZE_DESC, BLOCK_CACHE_TRAILER_HIT_COUNT, BLOCK_CACHE_TRAILER_MISS_COUNT, BLOCK_COUNT_MISS_COUNT_DESC, BLOCK_COUNT_PRIMARY_MISS_COUNT_DESC, BLOCKED_REQUESTS_COUNT, BLOCKED_REQUESTS_COUNT_DESC, CELLS_COUNT_COMPACTED_FROM_MOB, CELLS_COUNT_COMPACTED_FROM_MOB_DESC, CELLS_COUNT_COMPACTED_TO_MOB, CELLS_COUNT_COMPACTED_TO_MOB_DESC, CELLS_SIZE_COMPACTED_FROM_MOB, CELLS_SIZE_COMPACTED_FROM_MOB_DESC, CELLS_SIZE_COMPACTED_TO_MOB, CELLS_SIZE_COMPACTED_TO_MOB_DESC, CHECK_AND_DELETE_KEY, CHECK_AND_PUT_KEY, CHECK_MUTATE_FAILED_COUNT, CHECK_MUTATE_FAILED_COUNT_DESC, CHECK_MUTATE_PASSED_COUNT, CHECK_MUTATE_PASSED_COUNT_DESC, CLUSTER_ID_DESC, CLUSTER_ID_NAME, COMPACTED_CE LLS, COMPACTED_CELLS_DESC, COMPACTED_CELLS_SIZE, COMPACTED_CELLS_SIZE_DESC, COMPACTED_INPUT_BYTES, COMPACTED_INPUT_BYTES_DESC, COMPACTED_OUTPUT_BYTES, COMPACTED_OUTPUT_BYTES_DESC, href="../../../../../org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html#COMPACTION_INPUT_FILE_COUNT">COMPACTION_INPUT_FILE_COUNT, > href="../../../../../org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html#COMPACTION_INPUT_FILE_COUNT_DESC">COMPACTION_INPUT_FILE_COUNT_DESC, > href="../../../../../org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html#COMPACTION_INPUT_SIZE">COMPACTION_INPUT_SIZE, > href="../../../../../org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html#COMPACTION_INPUT_SIZE_DESC">COMPACTION_INPUT_SIZE_DESC, > href="../../../../../org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html#COMPACTION_OUTPUT_FILE_COUNT">COMPACTION_OUTPUT_FILE_COUNT, > href="../../../../../org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html#COMPACTION_OUTPUT_FILE_COUNT_DESC">COMPACTION_OUTPUT_FILE_COUNT_DESC, > COMPACTION_OUTPUT_SIZE, COMPACTION_OUTPUT_SIZE_DESC, COMPACTION_QUEUE_LENGTH, COMPACTION_QUEUE_LENGTH_DESC, COMPACTION_TIME, COMPACTION_TIME_DESC, DATA_SIZE_WITHOUT_WAL, DATA_SIZE_WITHOUT_WAL_DESC, DELETE_BATCH_KEY, DELETE_KEY, FILTERED_READ_REQUEST_COUNT, FILTERED_READ_REQUEST_COUNT_DESC, FLUSH_MEMSTORE_SIZE, FLUSH_MEMSTORE_SIZE_DESC, FLUSH_OUTPUT_SIZE, FLUSH_OUTPUT_SIZE_DESC, FLUSH_QUEUE_LENGTH, FLUSH_QUEUE_LENGTH_DESC, FLUSH_TIME, FLUSH_TIME_DESC, FLUSHED_CELLS, FLUSHED_CELLS_DESC, FLUSHED_CELLS_SIZE, FLUSHED_CELLS_SIZE_DESC, FLUSHED_MEMSTORE_BYTES, FLUSHED_MEMSTORE_BYTES_DESC, FLUSHED_OUTPUT_BYTES, FLUSHED_OUTPUT_BYTES_DESC, GET_KEY, GET_SIZE_KEY, HEDGED_READ_WINS, HEDGED_READ_WINS_DESC, HEDGED_READS, HEDGED_READS_DESC, INCREMENT_KEY, L1_CACHE_HIT_COUNT, L1_CACHE_HIT_COUNT_DESC, L1_CACHE_HIT_RATIO, L1_CACHE_HIT_RATIO_DESC, L1_CACHE_MISS_COUNT, L1_CACHE_MISS_COUNT_DESC, L1_CACHE_MISS_RATIO, L1_CACHE_MISS_RATIO_DESC, L2_CACHE_HIT_COUNT, L2_CACHE_HIT_COUNT_DESC, L2_CACHE_HIT_RATIO,
[11/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.OptionsOrderComparator.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.OptionsOrderComparator.html b/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.OptionsOrderComparator.html index 5616ff0..d2e20ee 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.OptionsOrderComparator.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.OptionsOrderComparator.html @@ -30,271 +30,270 @@ 022import java.util.HashMap; 023import java.util.List; 024 -025import org.apache.hadoop.conf.Configurable; -026import org.apache.hadoop.conf.Configuration; -027import org.apache.hadoop.hbase.HBaseConfiguration; -028import org.apache.hadoop.util.Tool; -029import org.apache.hadoop.util.ToolRunner; -030import org.apache.yetus.audience.InterfaceAudience; -031import org.slf4j.Logger; -032import org.slf4j.LoggerFactory; -033 -034import org.apache.hbase.thirdparty.org.apache.commons.cli.BasicParser; -035import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; -036import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLineParser; -037import org.apache.hbase.thirdparty.org.apache.commons.cli.DefaultParser; -038import org.apache.hbase.thirdparty.org.apache.commons.cli.HelpFormatter; -039import org.apache.hbase.thirdparty.org.apache.commons.cli.MissingOptionException; -040import org.apache.hbase.thirdparty.org.apache.commons.cli.Option; -041import org.apache.hbase.thirdparty.org.apache.commons.cli.Options; -042import org.apache.hbase.thirdparty.org.apache.commons.cli.ParseException; -043 -044/** -045 * Common base class used for HBase command-line tools. Simplifies workflow and -046 * command-line argument parsing. -047 */ -048@InterfaceAudience.Private -049public abstract class AbstractHBaseTool implements Tool, Configurable { -050 protected static final int EXIT_SUCCESS = 0; -051 protected static final int EXIT_FAILURE = 1; -052 -053 public static final String SHORT_HELP_OPTION = "h"; -054 public static final String LONG_HELP_OPTION = "help"; -055 -056 private static final Option HELP_OPTION = new Option("h", "help", false, -057 "Prints help for this tool."); -058 -059 private static final Logger LOG = LoggerFactory.getLogger(AbstractHBaseTool.class); -060 -061 protected final Options options = new Options(); -062 -063 protected Configuration conf = null; -064 -065 protected String[] cmdLineArgs = null; -066 -067 // To print options in order they were added in help text. -068 private HashMapOption, Integer optionsOrder = new HashMap(); -069 private int optionsCount = 0; -070 -071 private class OptionsOrderComparator implements ComparatorOption { -072@Override -073public int compare(Option o1, Option o2) { -074 return optionsOrder.get(o1) - optionsOrder.get(o2); -075} -076 } -077 -078 /** -079 * Override this to add command-line options using {@link #addOptWithArg} -080 * and similar methods. -081 */ -082 protected abstract void addOptions(); -083 -084 /** -085 * This method is called to process the options after they have been parsed. -086 */ -087 protected abstract void processOptions(CommandLine cmd); -088 -089 /** The "main function" of the tool */ -090 protected abstract int doWork() throws Exception; -091 -092 /** -093 * For backward compatibility. DO NOT use it for new tools. -094 * We have options in existing tools which can't be ported to Apache CLI's {@link Option}. -095 * (because they don't pass validation, for e.g. "-copy-to". "-" means short name -096 * which doesn't allow '-' in name). This function is to allow tools to have, for time being, -097 * parameters which can't be parsed using {@link Option}. -098 * Overrides should consume all valid legacy arguments. If the param 'args' is not empty on -099 * return, it means there were invalid options, in which case we'll exit from the tool. -100 * Note that it's called before {@link #processOptions(CommandLine)}, which means new options' -101 * values will override old ones'. -102 */ -103 protected void processOldArgs(ListString args) { -104 } -105 -106 @Override -107 public Configuration getConf() { -108return conf; -109 } -110 -111 @Override -112 public void setConf(Configuration conf) { -113this.conf = conf; -114 } -115 -116 @Override -117 public int run(String[] args) throws IOException { -118cmdLineArgs = args; -119if (conf == null) { -120 LOG.error("Tool configuration is not initialized"); -121 throw new NullPointerException("conf"); -122} -123 -124CommandLine cmd; -125ListString argsList = new ArrayList(args.length); -126for (String arg : args) { -127
hbase-site git commit: INFRA-10751 Empty commit
Repository: hbase-site Updated Branches: refs/heads/asf-site 78d8c5d7d -> ddf69c75f INFRA-10751 Empty commit Project: http://git-wip-us.apache.org/repos/asf/hbase-site/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase-site/commit/ddf69c75 Tree: http://git-wip-us.apache.org/repos/asf/hbase-site/tree/ddf69c75 Diff: http://git-wip-us.apache.org/repos/asf/hbase-site/diff/ddf69c75 Branch: refs/heads/asf-site Commit: ddf69c75f6f6b3ca8e7bf4707d62292fa3936be1 Parents: 78d8c5d Author: jenkins Authored: Tue Jun 12 14:49:51 2018 + Committer: jenkins Committed: Tue Jun 12 14:49:51 2018 + -- --
[18/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.IOErrorWithCause.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.IOErrorWithCause.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.IOErrorWithCause.html index 3f84557..e692633 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.IOErrorWithCause.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.IOErrorWithCause.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -118,826 +118,826 @@ 110import org.apache.thrift.TProcessor; 111import org.apache.thrift.protocol.TBinaryProtocol; 112import org.apache.thrift.protocol.TCompactProtocol; -113import org.apache.thrift.protocol.TProtocol; -114import org.apache.thrift.protocol.TProtocolFactory; -115import org.apache.thrift.server.THsHaServer; -116import org.apache.thrift.server.TNonblockingServer; -117import org.apache.thrift.server.TServer; -118import org.apache.thrift.server.TServlet; -119import org.apache.thrift.server.TThreadedSelectorServer; -120import org.apache.thrift.transport.TFramedTransport; -121import org.apache.thrift.transport.TNonblockingServerSocket; -122import org.apache.thrift.transport.TNonblockingServerTransport; -123import org.apache.thrift.transport.TSaslServerTransport; -124import org.apache.thrift.transport.TServerSocket; -125import org.apache.thrift.transport.TServerTransport; -126import org.apache.thrift.transport.TTransportFactory; -127import org.apache.yetus.audience.InterfaceAudience; -128import org.eclipse.jetty.http.HttpVersion; -129import org.eclipse.jetty.server.HttpConfiguration; -130import org.eclipse.jetty.server.HttpConnectionFactory; -131import org.eclipse.jetty.server.SecureRequestCustomizer; -132import org.eclipse.jetty.server.Server; -133import org.eclipse.jetty.server.ServerConnector; -134import org.eclipse.jetty.server.SslConnectionFactory; -135import org.eclipse.jetty.servlet.ServletContextHandler; -136import org.eclipse.jetty.servlet.ServletHolder; -137import org.eclipse.jetty.util.ssl.SslContextFactory; -138import org.eclipse.jetty.util.thread.QueuedThreadPool; -139import org.slf4j.Logger; -140import org.slf4j.LoggerFactory; -141import org.apache.hbase.thirdparty.com.google.common.base.Joiner; -142import org.apache.hbase.thirdparty.com.google.common.base.Splitter; -143import org.apache.hbase.thirdparty.com.google.common.base.Throwables; -144import org.apache.hbase.thirdparty.com.google.common.util.concurrent.ThreadFactoryBuilder; -145import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; -146import org.apache.hbase.thirdparty.org.apache.commons.cli.Option; -147import org.apache.hbase.thirdparty.org.apache.commons.cli.OptionGroup; -148 -149/** -150 * ThriftServerRunner - this class starts up a Thrift server which implements -151 * the Hbase API specified in the Hbase.thrift IDL file. -152 */ -153@InterfaceAudience.Private -154public class ThriftServerRunner implements Runnable { -155 -156 private static final Logger LOG = LoggerFactory.getLogger(ThriftServerRunner.class); -157 -158 private static final int DEFAULT_HTTP_MAX_HEADER_SIZE = 64 * 1024; // 64k -159 -160 static final String SERVER_TYPE_CONF_KEY = -161 "hbase.regionserver.thrift.server.type"; -162 -163 static final String BIND_CONF_KEY = "hbase.regionserver.thrift.ipaddress"; -164 static final String COMPACT_CONF_KEY = "hbase.regionserver.thrift.compact"; -165 static final String FRAMED_CONF_KEY = "hbase.regionserver.thrift.framed"; -166 static final String MAX_FRAME_SIZE_CONF_KEY = -167 "hbase.regionserver.thrift.framed.max_frame_size_in_mb"; -168 static final String PORT_CONF_KEY = "hbase.regionserver.thrift.port"; -169 static final String COALESCE_INC_KEY = "hbase.regionserver.thrift.coalesceIncrement"; -170 static final String USE_HTTP_CONF_KEY = "hbase.regionserver.thrift.http"; -171 static final String HTTP_MIN_THREADS = "hbase.thrift.http_threads.min"; -172 static final String HTTP_MAX_THREADS = "hbase.thrift.http_threads.max"; -173 -174 static final String THRIFT_SSL_ENABLED = "hbase.thrift.ssl.enabled"; -175 static final String THRIFT_SSL_KEYSTORE_STORE = "hbase.thrift.ssl.keystore.store"; -176 static final String THRIFT_SSL_KEYSTORE_PASSWORD = "hbase.thrift.ssl.keystore.password"; -177 static final String THRIFT_SSL_KEYSTORE_KEYPASSWORD = "hbase.thrift.ssl.keystore.keypassword"; -178 static final String THRIFT_SSL_EXCLUDE_CIPHER_SUITES = "hbase.thrift.ssl.exclude.cipher.suites"; -179 static final String
[39/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html index 51f0ea4..4ba1d04 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html @@ -925,14 +925,6 @@ extends static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -READ_REQUEST_RATE_DESC - - -static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -READ_REQUEST_RATE_PER_SECOND - - -static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String REGION_COUNT @@ -1177,14 +1169,6 @@ extends static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -WRITE_REQUEST_RATE_DESC - - -static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String -WRITE_REQUEST_RATE_PER_SECOND - - -static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String ZOOKEEPER_QUORUM_DESC @@ -1842,39 +1826,13 @@ extends - - - - - -READ_REQUEST_RATE_PER_SECOND -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String READ_REQUEST_RATE_PER_SECOND - -See Also: -Constant Field Values - - - - - - - - -READ_REQUEST_RATE_DESC -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String READ_REQUEST_RATE_DESC - -See Also: -Constant Field Values - - - FILTERED_READ_REQUEST_COUNT -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String FILTERED_READ_REQUEST_COUNT +static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String FILTERED_READ_REQUEST_COUNT See Also: Constant Field Values @@ -1887,7 +1845,7 @@ extends FILTERED_READ_REQUEST_COUNT_DESC -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String FILTERED_READ_REQUEST_COUNT_DESC +static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String FILTERED_READ_REQUEST_COUNT_DESC See Also: Constant Field Values @@ -1900,7 +1858,7 @@ extends WRITE_REQUEST_COUNT -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String WRITE_REQUEST_COUNT +static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String WRITE_REQUEST_COUNT See Also: Constant Field Values @@ -1913,46 +1871,20 @@ extends WRITE_REQUEST_COUNT_DESC -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String WRITE_REQUEST_COUNT_DESC +static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String WRITE_REQUEST_COUNT_DESC See Also: Constant Field Values - - - - - -WRITE_REQUEST_RATE_PER_SECOND -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String WRITE_REQUEST_RATE_PER_SECOND - -See Also: -Constant Field Values - - - - - - - - -WRITE_REQUEST_RATE_DESC -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String WRITE_REQUEST_RATE_DESC - -See Also: -Constant Field Values - - - CHECK_MUTATE_FAILED_COUNT -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String CHECK_MUTATE_FAILED_COUNT +static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String CHECK_MUTATE_FAILED_COUNT See Also: Constant Field Values @@ -1965,7 +1897,7 @@ extends CHECK_MUTATE_FAILED_COUNT_DESC -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true;
[37/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html index ebdfa9e..4d28f9d 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html @@ -18,7 +18,7 @@ catch(err) { } //--> -var methods = {"i0":6,"i1":6,"i2":6,"i3":6,"i4":6,"i5":6,"i6":6,"i7":6,"i8":6,"i9":6,"i10":6,"i11":6,"i12":6,"i13":6,"i14":6,"i15":6,"i16":6,"i17":6,"i18":6,"i19":6,"i20":6,"i21":6,"i22":6,"i23":6,"i24":6,"i25":6,"i26":6,"i27":6,"i28":6,"i29":6,"i30":6,"i31":6,"i32":6,"i33":6,"i34":6,"i35":6,"i36":6,"i37":6,"i38":6,"i39":6,"i40":6,"i41":6,"i42":6,"i43":6,"i44":6,"i45":6,"i46":6,"i47":6,"i48":6,"i49":6,"i50":6,"i51":6,"i52":6,"i53":6,"i54":6,"i55":6,"i56":6,"i57":6,"i58":6,"i59":6,"i60":6,"i61":6,"i62":6,"i63":6,"i64":6,"i65":6,"i66":6,"i67":6,"i68":6,"i69":6,"i70":6,"i71":6,"i72":6,"i73":6,"i74":6,"i75":6,"i76":6,"i77":6,"i78":6,"i79":6,"i80":6,"i81":6,"i82":6,"i83":6,"i84":6,"i85":6,"i86":6,"i87":6,"i88":6,"i89":6,"i90":6,"i91":6,"i92":6,"i93":6,"i94":6,"i95":6,"i96":6,"i97":6,"i98":6,"i99":6,"i100":6,"i101":6,"i102":6,"i103":6,"i104":6,"i105":6,"i106":6,"i107":6,"i108":6,"i109":6}; +var methods = {"i0":6,"i1":6,"i2":6,"i3":6,"i4":6,"i5":6,"i6":6,"i7":6,"i8":6,"i9":6,"i10":6,"i11":6,"i12":6,"i13":6,"i14":6,"i15":6,"i16":6,"i17":6,"i18":6,"i19":6,"i20":6,"i21":6,"i22":6,"i23":6,"i24":6,"i25":6,"i26":6,"i27":6,"i28":6,"i29":6,"i30":6,"i31":6,"i32":6,"i33":6,"i34":6,"i35":6,"i36":6,"i37":6,"i38":6,"i39":6,"i40":6,"i41":6,"i42":6,"i43":6,"i44":6,"i45":6,"i46":6,"i47":6,"i48":6,"i49":6,"i50":6,"i51":6,"i52":6,"i53":6,"i54":6,"i55":6,"i56":6,"i57":6,"i58":6,"i59":6,"i60":6,"i61":6,"i62":6,"i63":6,"i64":6,"i65":6,"i66":6,"i67":6,"i68":6,"i69":6,"i70":6,"i71":6,"i72":6,"i73":6,"i74":6,"i75":6,"i76":6,"i77":6,"i78":6,"i79":6,"i80":6,"i81":6,"i82":6,"i83":6,"i84":6,"i85":6,"i86":6,"i87":6,"i88":6,"i89":6,"i90":6,"i91":6,"i92":6,"i93":6,"i94":6,"i95":6,"i96":6,"i97":6,"i98":6,"i99":6,"i100":6,"i101":6,"i102":6,"i103":6,"i104":6,"i105":6,"i106":6,"i107":6}; var tabs = {65535:["t0","All Methods"],2:["t2","Instance Methods"],4:["t3","Abstract Methods"]}; var altColor = "altColor"; var rowColor = "rowColor"; @@ -590,137 +590,125 @@ public interface double -getReadRequestsRatePerSecond() -Get the rate of read requests per second to regions hosted on this region server. - - - -double getRequestsPerSecond() Get the number of requests per second. - + long getRootIndexHitCount() - + long getRootIndexMissCount() - + long getRpcGetRequestsCount() Get the number of rpc get requests to this region server. - + long getRpcMultiRequestsCount() Get the number of rpc multi requests to this region server. - + long getRpcMutateRequestsCount() Get the number of rpc mutate requests to this region server. - + long getRpcScanRequestsCount() Get the number of rpc scan requests to this region server. - + https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String getServerName() Get ServerName - + int getSmallCompactionQueueSize() - + int getSplitQueueSize() Get the size of the split queue - + long getStartCode() Get HRegionServer start time - + long getStoreFileIndexSize() Get the Size (in bytes) of indexes in storefiles on disk. - + long getStoreFileSize() Get the total size of the store files this region server is serving from. - + long getTotalRequestCount() Get the total number of requests per second. - + long getTotalRowActionRequestCount() - + long getTotalStaticBloomSize() Get the size (in bytes) of the static bloom filters. - + long getTotalStaticIndexSize() Get the size (in bytes) of of the static indexes including the roots. - + long getTrailerHitCount() - + long getTrailerMissCount() - + long getUpdatesBlockedTime() Get the amount of time that updates were blocked. - + long getWALFileSize() Get the size of WAL files of this region server. - + long getWriteRequestsCount() Get the number of write requests to regions hosted on this region server. - -double -getWriteRequestsRatePerSecond() -Get the rate of write requests per second to regions hosted on this region server. - - - + https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String getZookeeperQuorum() Get the ZooKeeper Quorum Info @@ -969,23 +957,13 @@ public interface Get the number of read requests to regions hosted on this region server. - -
[23/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html index 5d53c29..9ec6b6f 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html @@ -82,1053 +82,1024 @@ 074 private volatile long numReferenceFiles = 0; 075 private volatile double requestsPerSecond = 0.0; 076 private volatile long readRequestsCount = 0; -077 private volatile double readRequestsRatePerSecond = 0; -078 private volatile long filteredReadRequestsCount = 0; -079 private volatile long writeRequestsCount = 0; -080 private volatile double writeRequestsRatePerSecond = 0; -081 private volatile long checkAndMutateChecksFailed = 0; -082 private volatile long checkAndMutateChecksPassed = 0; -083 private volatile long storefileIndexSize = 0; -084 private volatile long totalStaticIndexSize = 0; -085 private volatile long totalStaticBloomSize = 0; -086 private volatile long numMutationsWithoutWAL = 0; -087 private volatile long dataInMemoryWithoutWAL = 0; -088 private volatile double percentFileLocal = 0; -089 private volatile double percentFileLocalSecondaryRegions = 0; -090 private volatile long flushedCellsCount = 0; -091 private volatile long compactedCellsCount = 0; -092 private volatile long majorCompactedCellsCount = 0; -093 private volatile long flushedCellsSize = 0; -094 private volatile long compactedCellsSize = 0; -095 private volatile long majorCompactedCellsSize = 0; -096 private volatile long cellsCountCompactedToMob = 0; -097 private volatile long cellsCountCompactedFromMob = 0; -098 private volatile long cellsSizeCompactedToMob = 0; -099 private volatile long cellsSizeCompactedFromMob = 0; -100 private volatile long mobFlushCount = 0; -101 private volatile long mobFlushedCellsCount = 0; -102 private volatile long mobFlushedCellsSize = 0; -103 private volatile long mobScanCellsCount = 0; -104 private volatile long mobScanCellsSize = 0; -105 private volatile long mobFileCacheAccessCount = 0; -106 private volatile long mobFileCacheMissCount = 0; -107 private volatile double mobFileCacheHitRatio = 0; -108 private volatile long mobFileCacheEvictedCount = 0; -109 private volatile long mobFileCacheCount = 0; -110 private volatile long blockedRequestsCount = 0L; -111 private volatile long averageRegionSize = 0L; -112 -113 private CacheStats cacheStats; -114 private CacheStats l1Stats = null; -115 private CacheStats l2Stats = null; -116 private ScheduledExecutorService executor; -117 private Runnable runnable; -118 private long period; -119 -120 /** -121 * Can be null if not on hdfs. -122 */ -123 private DFSHedgedReadMetrics dfsHedgedReadMetrics; -124 -125 public MetricsRegionServerWrapperImpl(final HRegionServer regionServer) { -126this.regionServer = regionServer; -127initBlockCache(); -128initMobFileCache(); -129 -130this.period = -131 regionServer.conf.getLong(HConstants.REGIONSERVER_METRICS_PERIOD, -132 HConstants.DEFAULT_REGIONSERVER_METRICS_PERIOD); -133 -134this.executor = CompatibilitySingletonFactory.getInstance(MetricsExecutor.class).getExecutor(); -135this.runnable = new RegionServerMetricsWrapperRunnable(); -136 this.executor.scheduleWithFixedDelay(this.runnable, this.period, this.period, -137 TimeUnit.MILLISECONDS); -138this.metricsWALSource = CompatibilitySingletonFactory.getInstance(MetricsWALSource.class); -139 -140try { -141 this.dfsHedgedReadMetrics = FSUtils.getDFSHedgedReadMetrics(regionServer.getConfiguration()); -142} catch (IOException e) { -143 LOG.warn("Failed to get hedged metrics", e); -144} -145if (LOG.isInfoEnabled()) { -146 LOG.info("Computing regionserver metrics every " + this.period + " milliseconds"); -147} -148 } -149 -150 /** -151 * It's possible that due to threading the block cache could not be initialized -152 * yet (testing multiple region servers in one jvm). So we need to try and initialize -153 * the blockCache and cacheStats reference multiple times until we succeed. -154 */ -155 private synchronized void initBlockCache() { -156CacheConfig cacheConfig = this.regionServer.cacheConfig; -157if (cacheConfig != null) { -158 l1Stats = cacheConfig.getOnHeapCacheStats(); -159 l2Stats = cacheConfig.getL2CacheStats(); -160 if (this.blockCache == null) { -161this.blockCache = cacheConfig.getBlockCache(); -162 } -163} -164 -165if
[07/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html index 2658a1a..0d786c6 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html @@ -659,11 +659,11 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) -org.apache.hadoop.hbase.regionserver.DataBlockEncodingTool.Manipulation -org.apache.hadoop.hbase.regionserver.TestRegionServerReadRequestMetrics.Metric -org.apache.hadoop.hbase.regionserver.TestCacheOnWriteInSchema.CacheOnWriteType org.apache.hadoop.hbase.regionserver.TestAtomicOperation.TestStep org.apache.hadoop.hbase.regionserver.TestMultiLogThreshold.ActionType +org.apache.hadoop.hbase.regionserver.DataBlockEncodingTool.Manipulation +org.apache.hadoop.hbase.regionserver.TestCacheOnWriteInSchema.CacheOnWriteType +org.apache.hadoop.hbase.regionserver.TestRegionServerReadRequestMetrics.Metric http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/test/package-tree.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/test/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/test/package-tree.html index 2acdb55..29ba8c2 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/test/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/test/package-tree.html @@ -81,7 +81,7 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.chaos.util.ChaosMonkeyRunner @@ -253,10 +253,10 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) -org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList.Verify.Counts -org.apache.hadoop.hbase.test.IntegrationTestWithCellVisibilityLoadAndVerify.Counters org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList.Generator.Counts +org.apache.hadoop.hbase.test.IntegrationTestBigLinkedList.Verify.Counts org.apache.hadoop.hbase.test.IntegrationTestLoadAndVerify.Counters +org.apache.hadoop.hbase.test.IntegrationTestWithCellVisibilityLoadAndVerify.Counters http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html b/testdevapidocs/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html index 4ca1fb5..de37ab0 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html +++ b/testdevapidocs/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html @@ -107,6 +107,10 @@ var activeTableTab = "activeTableTab"; + +Direct Known Subclasses: +TestThriftSpnegoHttpServer + public class TestThriftHttpServer @@ -156,15 +160,15 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html LOG -private int +(package private) int port -private static boolean +(package private) static boolean tableCreated -private static HBaseTestingUtility +(package private) static HBaseTestingUtility TEST_UTIL @@ -208,7 +212,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html checkHttpMethods(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">Stringurl) -private void +(package private) void runThriftServer(intcustomHeaderSize) @@ -224,7 +228,7 @@ extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html stopHttpServerThread()
[05/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html b/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html new file mode 100644 index 000..dfc009b --- /dev/null +++ b/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html @@ -0,0 +1,469 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +CoprocessorValidatorTest (Apache HBase 3.0.0-SNAPSHOT Test API) + + + + + +var methods = {"i0":9,"i1":9,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10}; +var tabs = {65535:["t0","All Methods"],1:["t1","Static Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]}; +var altColor = "altColor"; +var rowColor = "rowColor"; +var tableTab = "tableTab"; +var activeTableTab = "activeTableTab"; + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevClass +NextClass + + +Frames +NoFrames + + +AllClasses + + + + + + + +Summary: +Nested| +Field| +Constr| +Method + + +Detail: +Field| +Constr| +Method + + + + + + + + +org.apache.hadoop.hbase.tool.coprocessor +Class CoprocessorValidatorTest + + + +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">java.lang.Object + + +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidatorTest + + + + + + + + +public class CoprocessorValidatorTest +extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object + + + + + + + + + + + +Nested Class Summary + +Nested Classes + +Modifier and Type +Class and Description + + +private static class +CoprocessorValidatorTest.MissingClass + + +private static class +CoprocessorValidatorTest.MissingClassClassLoader + + +private static class +CoprocessorValidatorTest.MissingClassObserver + + +private static class +CoprocessorValidatorTest.ObsoleteMethodObserver + + +private static class +CoprocessorValidatorTest.TestObserver + + + + + + + + + +Field Summary + +Fields + +Modifier and Type +Field and Description + + +static HBaseClassTestRule +CLASS_RULE + + +private org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator +validator + + + + + + + + + +Constructor Summary + +Constructors + +Constructor and Description + + +CoprocessorValidatorTest() + + + + + + + + + +Method Summary + +All MethodsStatic MethodsInstance MethodsConcrete Methods + +Modifier and Type +Method and Description + + +private static https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true; title="class or interface in java.lang">ClassLoader +getClassLoader() + + +private static https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +getFullClassName(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">StringclassName) + + +void +testFilterObservers() + + +void +testMissingClass() + + +void +testNoSuchClass() + + +void +testObsoleteMethod() + + +private https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">Listorg.apache.hadoop.hbase.tool.coprocessor.CoprocessorViolation +validate(https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true; title="class or interface in java.lang">ClassLoaderclassLoader, +https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">StringclassName) + + +private https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">Listorg.apache.hadoop.hbase.tool.coprocessor.CoprocessorViolation +validate(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">StringclassName) + + + + + + +Methods inherited from classjava.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#clone--; title="class or
[25/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html index 39acd5d..ed5ecc3 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.html @@ -144,384 +144,374 @@ 136 long getReadRequestsCount(); 137 138 /** -139 * Get the rate of read requests per second to regions hosted on this region server. +139 * Get the number of filtered read requests to regions hosted on this region server. 140 */ -141 double getReadRequestsRatePerSecond(); +141 long getFilteredReadRequestsCount(); 142 143 /** -144 * Get the number of filtered read requests to regions hosted on this region server. +144 * Get the number of write requests to regions hosted on this region server. 145 */ -146 long getFilteredReadRequestsCount(); +146 long getWriteRequestsCount(); 147 148 /** -149 * Get the number of write requests to regions hosted on this region server. +149 * Get the number of CAS operations that failed. 150 */ -151 long getWriteRequestsCount(); +151 long getCheckAndMutateChecksFailed(); 152 153 /** -154 * Get the rate of write requests per second to regions hosted on this region server. +154 * Get the number of CAS operations that passed. 155 */ -156 double getWriteRequestsRatePerSecond(); +156 long getCheckAndMutateChecksPassed(); 157 158 /** -159 * Get the number of CAS operations that failed. +159 * Get the Size (in bytes) of indexes in storefiles on disk. 160 */ -161 long getCheckAndMutateChecksFailed(); +161 long getStoreFileIndexSize(); 162 163 /** -164 * Get the number of CAS operations that passed. +164 * Get the size (in bytes) of of the static indexes including the roots. 165 */ -166 long getCheckAndMutateChecksPassed(); +166 long getTotalStaticIndexSize(); 167 168 /** -169 * Get the Size (in bytes) of indexes in storefiles on disk. +169 * Get the size (in bytes) of the static bloom filters. 170 */ -171 long getStoreFileIndexSize(); +171 long getTotalStaticBloomSize(); 172 173 /** -174 * Get the size (in bytes) of of the static indexes including the roots. +174 * Number of mutations received with WAL explicitly turned off. 175 */ -176 long getTotalStaticIndexSize(); +176 long getNumMutationsWithoutWAL(); 177 178 /** -179 * Get the size (in bytes) of the static bloom filters. -180 */ -181 long getTotalStaticBloomSize(); -182 -183 /** -184 * Number of mutations received with WAL explicitly turned off. -185 */ -186 long getNumMutationsWithoutWAL(); -187 -188 /** -189 * Ammount of data in the memstore but not in the WAL because mutations explicitly had their -190 * WAL turned off. +179 * Ammount of data in the memstore but not in the WAL because mutations explicitly had their +180 * WAL turned off. +181 */ +182 long getDataInMemoryWithoutWAL(); +183 +184 /** +185 * Get the percent of HFiles' that are local. +186 */ +187 double getPercentFileLocal(); +188 +189 /** +190 * Get the percent of HFiles' that are local for secondary region replicas. 191 */ -192 long getDataInMemoryWithoutWAL(); +192 double getPercentFileLocalSecondaryRegions(); 193 194 /** -195 * Get the percent of HFiles' that are local. +195 * Get the size of the split queue 196 */ -197 double getPercentFileLocal(); +197 int getSplitQueueSize(); 198 199 /** -200 * Get the percent of HFiles' that are local for secondary region replicas. +200 * Get the size of the compaction queue 201 */ -202 double getPercentFileLocalSecondaryRegions(); +202 int getCompactionQueueSize(); 203 -204 /** -205 * Get the size of the split queue -206 */ -207 int getSplitQueueSize(); -208 -209 /** -210 * Get the size of the compaction queue -211 */ -212 int getCompactionQueueSize(); -213 -214 int getSmallCompactionQueueSize(); -215 -216 int getLargeCompactionQueueSize(); -217 -218 /** -219 * Get the size of the flush queue. -220 */ -221 int getFlushQueueSize(); -222 -223 public long getMemStoreLimit(); +204 int getSmallCompactionQueueSize(); +205 +206 int getLargeCompactionQueueSize(); +207 +208 /** +209 * Get the size of the flush queue. +210 */ +211 int getFlushQueueSize(); +212 +213 public long getMemStoreLimit(); +214 /** +215 * Get the size (in bytes) of the block cache that is free. +216 */ +217 long getBlockCacheFreeSize(); +218 +219 /** +220 * Get the number of items in the block cache. +221 */ +222 long getBlockCacheCount(); +223 224 /** -225 * Get
[44/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/apidocs/org/apache/hadoop/hbase/snapshot/package-tree.html -- diff --git a/apidocs/org/apache/hadoop/hbase/snapshot/package-tree.html b/apidocs/org/apache/hadoop/hbase/snapshot/package-tree.html index 32d5053..d6bca3e 100644 --- a/apidocs/org/apache/hadoop/hbase/snapshot/package-tree.html +++ b/apidocs/org/apache/hadoop/hbase/snapshot/package-tree.html @@ -81,7 +81,7 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.snapshot.ExportSnapshot (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.snapshot.SnapshotInfo http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/apidocs/org/apache/hadoop/hbase/util/package-tree.html -- diff --git a/apidocs/org/apache/hadoop/hbase/util/package-tree.html b/apidocs/org/apache/hadoop/hbase/util/package-tree.html index 4da8d98..b0a4ae8 100644 --- a/apidocs/org/apache/hadoop/hbase/util/package-tree.html +++ b/apidocs/org/apache/hadoop/hbase/util/package-tree.html @@ -93,7 +93,7 @@ org.apache.hadoop.hbase.util.SimpleMutableByteRange -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.util.RegionMover http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/apidocs/overview-tree.html -- diff --git a/apidocs/overview-tree.html b/apidocs/overview-tree.html index 61351d8..d990666 100644 --- a/apidocs/overview-tree.html +++ b/apidocs/overview-tree.html @@ -153,7 +153,7 @@ org.apache.hadoop.hbase.util.SimpleMutableByteRange -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.snapshot.ExportSnapshot (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.util.RegionMover http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/book.html -- diff --git a/book.html b/book.html index 3b247c8..98f28fa 100644 --- a/book.html +++ b/book.html @@ -27395,23 +27395,57 @@ For general usage instructions, pass the -h option. 146.22. Pre-Upgrade validator -Pre-Upgrade validator tool can be used to check the cluster for known incompatibilities before upgrading from HBase 1 to HBase 2. -To run all the checks use the -all flag. +Pre-Upgrade validator tool can be used to check the cluster for known incompatibilities before upgrading from HBase 1 to HBase 2. -$ bin/hbase pre-upgrade -all +$ bin/hbase pre-upgrade command ... -146.22.1. DataBlockEncoding validation +146.22.1. Coprocessor validation + +HBase supports co-processors for a long time, but the co-processor API can be changed between major releases. Co-processor validator tries to determine +whether the old co-processors are still compatible with the actual HBase version. + + + +$ bin/hbase pre-upgrade validate-cp jar -scan|classes +Options: + -e Treat warnings as errors. + -scan Scan jar for observers. + + + +The first parameter of the tool is the jar file which holds the co-processor implementation. Further parameters can be -scan when the tool will +search the jar file for Coprocessor implementations or the classes can be explicitly given. + + +The tool can report errors and warnings. Errors mean that HBase wont be able to load the coprocessor, because it is incompatible with the current version +of HBase. Warnings mean that the co-processors can be loaded, but they wont work as expected. If -e option is given, then the tool will also fail +for warnings. + + +Please note that this tool cannot validate every aspect of jar files, it just does some static checks. + + +For example: + + + +$ bin/hbase pre-upgrade validate-cp my-coprocessor.jar MyMasterObserver MyRegionObserver + + + + +146.22.2. DataBlockEncoding validation HBase 2.0 removed PREFIX_TREE Data Block Encoding from column families. To verify that none of the column families are using incompatible Data Block Encodings in the cluster run the following command. -$ bin/hbase pre-upgrade -validateDBE +$ bin/hbase pre-upgrade validate-dbe @@ -38051,7 +38085,7 @@ The server will return cellblocks compressed using this
[45/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/apache_hbase_reference_guide.pdf -- diff --git a/apache_hbase_reference_guide.pdf b/apache_hbase_reference_guide.pdf index 99572df..30102bd 100644 --- a/apache_hbase_reference_guide.pdf +++ b/apache_hbase_reference_guide.pdf @@ -5,16 +5,16 @@ /Author (Apache HBase Team) /Creator (Asciidoctor PDF 1.5.0.alpha.15, based on Prawn 2.2.2) /Producer (Apache HBase Team) -/ModDate (D:20180611151951+00'00') -/CreationDate (D:20180611153536+00'00') +/ModDate (D:20180612142956+00'00') +/CreationDate (D:20180612144600+00'00') >> endobj 2 0 obj << /Type /Catalog /Pages 3 0 R /Names 26 0 R -/Outlines 4655 0 R -/PageLabels 4882 0 R +/Outlines 4656 0 R +/PageLabels 4883 0 R /PageMode /UseOutlines /OpenAction [7 0 R /FitH 842.89] /ViewerPreferences << /DisplayDocTitle true @@ -24,7 +24,7 @@ endobj 3 0 obj << /Type /Pages /Count 727 -/Kids [7 0 R 12 0 R 14 0 R 16 0 R 18 0 R 20 0 R 22 0 R 24 0 R 44 0 R 47 0 R 50 0 R 54 0 R 61 0 R 63 0 R 67 0 R 69 0 R 71 0 R 78 0 R 81 0 R 83 0 R 89 0 R 92 0 R 94 0 R 96 0 R 103 0 R 110 0 R 115 0 R 117 0 R 133 0 R 138 0 R 146 0 R 155 0 R 163 0 R 172 0 R 183 0 R 187 0 R 189 0 R 193 0 R 202 0 R 211 0 R 219 0 R 228 0 R 233 0 R 242 0 R 250 0 R 259 0 R 272 0 R 279 0 R 289 0 R 297 0 R 305 0 R 312 0 R 320 0 R 327 0 R 333 0 R 340 0 R 348 0 R 357 0 R 366 0 R 380 0 R 387 0 R 395 0 R 402 0 R 410 0 R 419 0 R 429 0 R 437 0 R 444 0 R 453 0 R 465 0 R 475 0 R 482 0 R 489 0 R 497 0 R 506 0 R 514 0 R 519 0 R 523 0 R 528 0 R 532 0 R 548 0 R 559 0 R 563 0 R 578 0 R 583 0 R 588 0 R 590 0 R 592 0 R 595 0 R 597 0 R 599 0 R 607 0 R 613 0 R 616 0 R 620 0 R 629 0 R 640 0 R 648 0 R 652 0 R 656 0 R 658 0 R 668 0 R 683 0 R 690 0 R 701 0 R 711 0 R 722 0 R 734 0 R 754 0 R 763 0 R 767 0 R 773 0 R 776 0 R 780 0 R 784 0 R 787 0 R 790 0 R 792 0 R 795 0 R 799 0 R 801 0 R 805 0 R 811 0 R 816 0 R 820 0 R 823 0 R 829 0 R 831 0 R 835 0 R 843 0 R 845 0 R 848 0 R 851 0 R 854 0 R 857 0 R 871 0 R 879 0 R 890 0 R 901 0 R 907 0 R 917 0 R 928 0 R 931 0 R 935 0 R 938 0 R 943 0 R 952 0 R 960 0 R 964 0 R 968 0 R 973 0 R 977 0 R 979 0 R 995 0 R 1006 0 R 1011 0 R 1018 0 R 1021 0 R 1029 0 R 1037 0 R 1042 0 R 1047 0 R 1052 0 R 1054 0 R 1056 0 R 1058 0 R 1068 0 R 1076 0 R 1080 0 R 1087 0 R 1094 0 R 1102 0 R 1106 0 R 1112 0 R 1117 0 R 1125 0 R 1129 0 R 1134 0 R 1136 0 R 1142 0 R 1150 0 R 1156 0 R 1163 0 R 1174 0 R 1178 0 R 1180 0 R 1182 0 R 1186 0 R 1189 0 R 1194 0 R 1197 0 R 1209 0 R 1213 0 R 1219 0 R 1227 0 R 1232 0 R 1236 0 R 1240 0 R 1242 0 R 1245 0 R 1248 0 R 1251 0 R 1255 0 R 1259 0 R 1263 0 R 1268 0 R 1272 0 R 1275 0 R 1277 0 R 1287 0 R 1290 0 R 1298 0 R 1307 0 R 1313 0 R 1317 0 R 1319 0 R 1330 0 R 1333 0 R 1339 0 R 1347 0 R 1350 0 R 1357 0 R 1364 0 R 1367 0 R 1369 0 R 1378 0 R 1380 0 R 1382 0 R 1385 0 R 1387 0 R 1389 0 R 1391 0 R 1393 0 R 1396 0 R 1400 0 R 1405 0 R 1407 0 R 1409 0 R 1411 0 R 1416 0 R 1423 0 R 1429 0 R 1432 0 R 1434 0 R 1437 0 R 1441 0 R 1445 0 R 1448 0 R 1450 0 R 1452 0 R 1455 0 R 1460 0 R 1466 0 R 1474 0 R 1488 0 R 1502 0 R 1505 0 R 1510 0 R 1523 0 R 1528 0 R 1543 0 R 1551 0 R 1555 0 R 1564 0 R 1579 0 R 1593 0 R 1601 0 R 1606 0 R 1617 0 R 1622 0 R 1628 0 R 1634 0 R 1646 0 R 1649 0 R 1658 0 R 1661 0 R 1670 0 R 1676 0 R 1680 0 R 1692 0 R 1697 0 R 1703 0 R 1705 0 R 1712 0 R 1720 0 R 1728 0 R 1732 0 R 1734 0 R 1736 0 R 1748 0 R 1754 0 R 1763 0 R 1769 0 R 1782 0 R 1788 0 R 1794 0 R 1805 0 R 1811 0 R 1816 0 R 1821 0 R 1824 0 R 1827 0 R 1832 0 R 1837 0 R 1844 0 R 1848 0 R 1853 0 R 1862 0 R 1867 0 R 1872 0 R 1874 0 R 1883 0 R 1890 0 R 1896 0 R 1901 0 R 1905 0 R 1909 0 R 1914 0 R 1919 0 R 1925 0 R 1927 0 R 1929 0 R 1932 0 R 1943 0 R 1946 0 R 1953 0 R 1961 0 R 1966 0 R 1970 0 R 1975 0 R 1977 0 R 1980 0 R 1985 0 R 1988 0 R 1990 0 R 1993 0 R 1996 0 R 1999 0 R 2009 0 R 2014 0 R 2019 0 R 2021 0 R 2029 0 R 2036 0 R 2043 0 R 2049 0 R 2054 0 R 2056 0 R 2065 0 R 2075 0 R 2085 0 R 2091 0 R 2098 0 R 2100 0 R 2105 0 R 2107 0 R 2109 0 R 2113 0 R 2116 0 R 2119 0 R 2124 0 R 2128 0 R 2139 0 R 2142 0 R 2147 0 R 2150 0 R 2152 0 R 2157 0 R 2167 0 R 2169 0 R 2171 0 R 2173 0 R 2175 0 R 2178 0 R 2180 0 R 2182 0 R 2185 0 R 2187 0 R 2189 0 R 2193 0 R 2198 0 R 2207 0 R 2209 0 R 2211 0 R 2217 0 R 2219 0 R 2224 0 R 2226 0 R 2228 0 R 2235 0 R 2240 0 R 2244 0 R 2249 0 R 2253 0 R 2255 0 R 2257 0 R 2261 0 R 2264 0 R 2266 0 R 2268 0 R 2272 0 R 2274 0 R 2277 0 R 2279 0 R 2281 0 R 2283 0 R 2290 0 R 2293 0 R 2298 0 R 2300 0 R 2302 0 R 2304 0 R 2306 0 R 2314 0 R 2325 0 R 2339 0 R 2350 0 R 2354 0 R 2359 0 R 2363 0 R 2366 0 R 2371 0 R 2377 0 R 2379 0 R 2382 0 R 2384 0 R 2386 0 R 2388 0 R 2393 0 R 2395 0 R 2408 0 R 2411 0 R 2419 0 R 2425 0 R 2437 0 R 2451 0 R 2464 0 R 2483 0 R 2485 0 R 2487 0 R 2491 0 R 2509 0 R 2515 0 R 2527 0 R 2531 0 R 2535 0 R 2544 0 R 2556 0 R 2561 0 R 2571 0 R 2584 0 R 2603 0 R 2612 0 R 2615 0 R 2624 0 R 2641 0 R 2648 0 R 2651 0 R 2656 0 R 2660 0 R
[29/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CurrentCoprocessorMethods.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CurrentCoprocessorMethods.html b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CurrentCoprocessorMethods.html new file mode 100644 index 000..98fc1b8 --- /dev/null +++ b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CurrentCoprocessorMethods.html @@ -0,0 +1,285 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +CurrentCoprocessorMethods (Apache HBase 3.0.0-SNAPSHOT API) + + + + + +var methods = {"i0":10}; +var tabs = {65535:["t0","All Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]}; +var altColor = "altColor"; +var rowColor = "rowColor"; +var tableTab = "tableTab"; +var activeTableTab = "activeTableTab"; + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevClass +NextClass + + +Frames +NoFrames + + +AllClasses + + + + + + + +Summary: +Nested| +Field| +Constr| +Method + + +Detail: +Field| +Constr| +Method + + + + + + + + +org.apache.hadoop.hbase.tool.coprocessor +Class CurrentCoprocessorMethods + + + +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">java.lang.Object + + +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods + + +org.apache.hadoop.hbase.tool.coprocessor.CurrentCoprocessorMethods + + + + + + + + + + +@InterfaceAudience.Private +public class CurrentCoprocessorMethods +extends CoprocessorMethods + + + + + + + + + + + +Constructor Summary + +Constructors + +Constructor and Description + + +CurrentCoprocessorMethods() + + + + + + + + + +Method Summary + +All MethodsInstance MethodsConcrete Methods + +Modifier and Type +Method and Description + + +private void +addMethods(https://docs.oracle.com/javase/8/docs/api/java/lang/Class.html?is-external=true; title="class or interface in java.lang">Class?clazz) + + + + + + +Methods inherited from classorg.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods +addMethod, addMethod, addMethod, hasMethod, hasMethod, hasMethod + + + + + +Methods inherited from classjava.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#clone--; title="class or interface in java.lang">clone, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-; title="class or interface in java.lang">equals, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#finalize--; title="class or interface in java.lang">finalize, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#getClass--; title="class or interface in java.lang">getClass, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#hashCode--; title="class or interface in java.lang">hashCode, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#notify--; title="class or interface in java.lang">notify, https://docs.oracle.com/javase/8/docs/api/ja va/lang/Object.html?is-external=true#notifyAll--" title="class or interface in java.lang">notifyAll, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#toString--; title="class or interface in java.lang">toString, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#wait--; title="class or interface in java.lang">wait, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#wait-long-; title="class or interface in java.lang">wait, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#wait-long-int-; title="class or interface in java.lang">wait + + + + + + + + + + + + + + +Constructor Detail + + + + + +CurrentCoprocessorMethods +publicCurrentCoprocessorMethods() + + + + + + + + + +Method Detail + + + + + +addMethods +privatevoidaddMethods(https://docs.oracle.com/javase/8/docs/api/java/lang/Class.html?is-external=true; title="class or interface in java.lang">Class?clazz) + + + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevClass
[16/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ResultScannerWrapper.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ResultScannerWrapper.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ResultScannerWrapper.html index 3f84557..e692633 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ResultScannerWrapper.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ResultScannerWrapper.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -118,826 +118,826 @@ 110import org.apache.thrift.TProcessor; 111import org.apache.thrift.protocol.TBinaryProtocol; 112import org.apache.thrift.protocol.TCompactProtocol; -113import org.apache.thrift.protocol.TProtocol; -114import org.apache.thrift.protocol.TProtocolFactory; -115import org.apache.thrift.server.THsHaServer; -116import org.apache.thrift.server.TNonblockingServer; -117import org.apache.thrift.server.TServer; -118import org.apache.thrift.server.TServlet; -119import org.apache.thrift.server.TThreadedSelectorServer; -120import org.apache.thrift.transport.TFramedTransport; -121import org.apache.thrift.transport.TNonblockingServerSocket; -122import org.apache.thrift.transport.TNonblockingServerTransport; -123import org.apache.thrift.transport.TSaslServerTransport; -124import org.apache.thrift.transport.TServerSocket; -125import org.apache.thrift.transport.TServerTransport; -126import org.apache.thrift.transport.TTransportFactory; -127import org.apache.yetus.audience.InterfaceAudience; -128import org.eclipse.jetty.http.HttpVersion; -129import org.eclipse.jetty.server.HttpConfiguration; -130import org.eclipse.jetty.server.HttpConnectionFactory; -131import org.eclipse.jetty.server.SecureRequestCustomizer; -132import org.eclipse.jetty.server.Server; -133import org.eclipse.jetty.server.ServerConnector; -134import org.eclipse.jetty.server.SslConnectionFactory; -135import org.eclipse.jetty.servlet.ServletContextHandler; -136import org.eclipse.jetty.servlet.ServletHolder; -137import org.eclipse.jetty.util.ssl.SslContextFactory; -138import org.eclipse.jetty.util.thread.QueuedThreadPool; -139import org.slf4j.Logger; -140import org.slf4j.LoggerFactory; -141import org.apache.hbase.thirdparty.com.google.common.base.Joiner; -142import org.apache.hbase.thirdparty.com.google.common.base.Splitter; -143import org.apache.hbase.thirdparty.com.google.common.base.Throwables; -144import org.apache.hbase.thirdparty.com.google.common.util.concurrent.ThreadFactoryBuilder; -145import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; -146import org.apache.hbase.thirdparty.org.apache.commons.cli.Option; -147import org.apache.hbase.thirdparty.org.apache.commons.cli.OptionGroup; -148 -149/** -150 * ThriftServerRunner - this class starts up a Thrift server which implements -151 * the Hbase API specified in the Hbase.thrift IDL file. -152 */ -153@InterfaceAudience.Private -154public class ThriftServerRunner implements Runnable { -155 -156 private static final Logger LOG = LoggerFactory.getLogger(ThriftServerRunner.class); -157 -158 private static final int DEFAULT_HTTP_MAX_HEADER_SIZE = 64 * 1024; // 64k -159 -160 static final String SERVER_TYPE_CONF_KEY = -161 "hbase.regionserver.thrift.server.type"; -162 -163 static final String BIND_CONF_KEY = "hbase.regionserver.thrift.ipaddress"; -164 static final String COMPACT_CONF_KEY = "hbase.regionserver.thrift.compact"; -165 static final String FRAMED_CONF_KEY = "hbase.regionserver.thrift.framed"; -166 static final String MAX_FRAME_SIZE_CONF_KEY = -167 "hbase.regionserver.thrift.framed.max_frame_size_in_mb"; -168 static final String PORT_CONF_KEY = "hbase.regionserver.thrift.port"; -169 static final String COALESCE_INC_KEY = "hbase.regionserver.thrift.coalesceIncrement"; -170 static final String USE_HTTP_CONF_KEY = "hbase.regionserver.thrift.http"; -171 static final String HTTP_MIN_THREADS = "hbase.thrift.http_threads.min"; -172 static final String HTTP_MAX_THREADS = "hbase.thrift.http_threads.max"; -173 -174 static final String THRIFT_SSL_ENABLED = "hbase.thrift.ssl.enabled"; -175 static final String THRIFT_SSL_KEYSTORE_STORE = "hbase.thrift.ssl.keystore.store"; -176 static final String THRIFT_SSL_KEYSTORE_PASSWORD = "hbase.thrift.ssl.keystore.password"; -177 static final String THRIFT_SSL_KEYSTORE_KEYPASSWORD = "hbase.thrift.ssl.keystore.keypassword"; -178 static final String THRIFT_SSL_EXCLUDE_CIPHER_SUITES = "hbase.thrift.ssl.exclude.cipher.suites"; -179 static final String
[31/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html new file mode 100644 index 000..bbd7b71 --- /dev/null +++ b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.html @@ -0,0 +1,369 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +CoprocessorMethod (Apache HBase 3.0.0-SNAPSHOT API) + + + + + +var methods = {"i0":10,"i1":10,"i2":10,"i3":10}; +var tabs = {65535:["t0","All Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]}; +var altColor = "altColor"; +var rowColor = "rowColor"; +var tableTab = "tableTab"; +var activeTableTab = "activeTableTab"; + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevClass +NextClass + + +Frames +NoFrames + + +AllClasses + + + + + + + +Summary: +Nested| +Field| +Constr| +Method + + +Detail: +Field| +Constr| +Method + + + + + + + + +org.apache.hadoop.hbase.tool.coprocessor +Class CoprocessorMethod + + + +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">java.lang.Object + + +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethod + + + + + + + + +@InterfaceAudience.Private +public class CoprocessorMethod +extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object + + + + + + + + + + + +Field Summary + +Fields + +Modifier and Type +Field and Description + + +private https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +name + + +private https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">Listhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +parameters + + + + + + + + + +Constructor Summary + +Constructors + +Constructor and Description + + +CoprocessorMethod(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">Stringname) + + + + + + + + + +Method Summary + +All MethodsInstance MethodsConcrete Methods + +Modifier and Type +Method and Description + + +boolean +equals(https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Objectobj) + + +int +hashCode() + + +CoprocessorMethod +withParameters(https://docs.oracle.com/javase/8/docs/api/java/lang/Class.html?is-external=true; title="class or interface in java.lang">Class?...parameters) + + +CoprocessorMethod +withParameters(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String...parameters) + + + + + + +Methods inherited from classjava.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#clone--; title="class or interface in java.lang">clone, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#finalize--; title="class or interface in java.lang">finalize, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#getClass--; title="class or interface in java.lang">getClass, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#notify--; title="class or interface in java.lang">notify, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#notifyAll--; title="class or interface in java.lang">notifyAll, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#toString--; title="class or interface in java.lang">toString, https://docs.oracle.com/javase/8/docs/api/java/lang/Ob ject.html?is-external=true#wait--" title="class or interface in java.lang">wait, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#wait-long-; title="class or interface in java.lang">wait,
[34/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html b/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html index 62e28c8..fc0f696 100644 --- a/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html +++ b/devapidocs/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html @@ -117,7 +117,7 @@ var activeTableTab = "activeTableTab"; -public static class ThriftServerRunner.HBaseHandler +public static class ThriftServerRunner.HBaseHandler extends https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface The HBaseHandler is a glue object that connects Thrift RPC calls to the @@ -721,7 +721,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface conf -protectedorg.apache.hadoop.conf.Configuration conf +protectedorg.apache.hadoop.conf.Configuration conf @@ -730,7 +730,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface LOG -protected static finalorg.slf4j.Logger LOG +protected static finalorg.slf4j.Logger LOG @@ -739,7 +739,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface nextScannerId -protectedint nextScannerId +protectedint nextScannerId @@ -748,7 +748,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface scannerMap -protectedhttps://docs.oracle.com/javase/8/docs/api/java/util/HashMap.html?is-external=true; title="class or interface in java.util">HashMaphttps://docs.oracle.com/javase/8/docs/api/java/lang/Integer.html?is-external=true; title="class or interface in java.lang">Integer,ThriftServerRunner.ResultScannerWrapper scannerMap +protectedhttps://docs.oracle.com/javase/8/docs/api/java/util/HashMap.html?is-external=true; title="class or interface in java.util">HashMaphttps://docs.oracle.com/javase/8/docs/api/java/lang/Integer.html?is-external=true; title="class or interface in java.lang">Integer,ThriftServerRunner.ResultScannerWrapper scannerMap @@ -757,7 +757,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface metrics -privateThriftMetrics metrics +privateThriftMetrics metrics @@ -766,7 +766,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface connectionCache -private finalConnectionCache connectionCache +private finalConnectionCache connectionCache @@ -775,7 +775,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface coalescer -IncrementCoalescer coalescer +IncrementCoalescer coalescer @@ -784,7 +784,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface CLEANUP_INTERVAL -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String CLEANUP_INTERVAL +static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String CLEANUP_INTERVAL See Also: Constant Field Values @@ -797,7 +797,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface MAX_IDLETIME -static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String MAX_IDLETIME +static finalhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String MAX_IDLETIME See Also: Constant Field Values @@ -818,7 +818,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface HBaseHandler -protectedHBaseHandler(org.apache.hadoop.conf.Configurationc, +protectedHBaseHandler(org.apache.hadoop.conf.Configurationc, UserProvideruserProvider) throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true; title="class or interface in java.io">IOException @@ -841,7 +841,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface getAllColumns -byte[][]getAllColumns(Tabletable) +byte[][]getAllColumns(Tabletable) throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true; title="class or interface in java.io">IOException Returns a list of all the column families for a given Table. @@ -858,7 +858,7 @@ implements org.apache.hadoop.hbase.thrift.generated.Hbase.Iface getTable -publicTablegetTable(byte[]tableName) +publicTablegetTable(byte[]tableName) throws https://docs.oracle.com/javase/8/docs/api/java/io/IOException.html?is-external=true; title="class or interface in java.io">IOException Creates and
[01/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
Repository: hbase-site Updated Branches: refs/heads/asf-site 7b0c87cf8 -> 78d8c5d7d http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html -- diff --git a/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html b/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html new file mode 100644 index 000..7896c2f --- /dev/null +++ b/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.html @@ -0,0 +1,249 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + +Source code + + + + +001/** +002 * Licensed to the Apache Software Foundation (ASF) under one +003 * or more contributor license agreements. See the NOTICE file +004 * distributed with this work for additional information +005 * regarding copyright ownership. The ASF licenses this file +006 * to you under the Apache License, Version 2.0 (the +007 * "License"); you may not use this file except in compliance +008 * with the License. You may obtain a copy of the License at +009 * +010 * http://www.apache.org/licenses/LICENSE-2.0 +011 * +012 * Unless required by applicable law or agreed to in writing, software +013 * distributed under the License is distributed on an "AS IS" BASIS, +014 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +015 * See the License for the specific language governing permissions and +016 * limitations under the License. +017 */ +018 +019package org.apache.hadoop.hbase.tool.coprocessor; +020 +021import static org.junit.Assert.assertEquals; +022import static org.junit.Assert.assertTrue; +023 +024import java.io.IOException; +025import java.util.List; +026 +027import org.apache.hadoop.hbase.Coprocessor; +028import org.apache.hadoop.hbase.CoprocessorEnvironment; +029import org.apache.hadoop.hbase.HBaseClassTestRule; +030import org.apache.hadoop.hbase.HRegionInfo; +031import org.apache.hadoop.hbase.HTableDescriptor; +032import org.apache.hadoop.hbase.coprocessor.MasterCoprocessorEnvironment; +033import org.apache.hadoop.hbase.coprocessor.ObserverContext; +034import org.apache.hadoop.hbase.testclassification.SmallTests; +035import org.apache.hadoop.hbase.tool.coprocessor.CoprocessorViolation.Severity; +036import org.junit.ClassRule; +037import org.junit.Test; +038import org.junit.experimental.categories.Category; +039 +040import org.apache.hbase.thirdparty.com.google.common.collect.Lists; +041 +042@Category({ SmallTests.class }) +043@SuppressWarnings("deprecation") +044public class CoprocessorValidatorTest { +045 @ClassRule +046 public static final HBaseClassTestRule CLASS_RULE = +047 HBaseClassTestRule.forClass(CoprocessorValidatorTest.class); +048 +049 private CoprocessorValidator validator; +050 +051 public CoprocessorValidatorTest() { +052validator = new CoprocessorValidator(); +053 } +054 +055 private static ClassLoader getClassLoader() { +056return CoprocessorValidatorTest.class.getClassLoader(); +057 } +058 +059 private static String getFullClassName(String className) { +060return CoprocessorValidatorTest.class.getName() + "$" + className; +061 } +062 +063 @SuppressWarnings({"rawtypes", "unused"}) +064 private static class TestObserver implements Coprocessor { +065@Override +066public void start(CoprocessorEnvironment env) throws IOException { +067} +068 +069@Override +070public void stop(CoprocessorEnvironment env) throws IOException { +071} +072 } +073 +074 @Test +075 public void testFilterObservers() throws Exception { +076String filterObservers = getFullClassName("TestObserver"); +077ListString classNames = Lists.newArrayList( +078filterObservers, getClass().getName()); +079ListString filteredClassNames = validator.filterObservers(getClassLoader(), classNames); +080 +081assertEquals(1, filteredClassNames.size()); +082assertEquals(filterObservers, filteredClassNames.get(0)); +083 } +084 +085 private ListCoprocessorViolation validate(String className) { +086ClassLoader classLoader = getClass().getClassLoader(); +087return validate(classLoader, className); +088 } +089 +090 private ListCoprocessorViolation validate(ClassLoader classLoader, String className) { +091ListString classNames = Lists.newArrayList(getClass().getName() + "$" + className); +092return validator.validate(classLoader, classNames); +093 } +094 +095 /* +096 * In this test case, we are try to load a not-existent class. +097 */ +098 @Test +099 public void testNoSuchClass() throws IOException { +100ListCoprocessorViolation violations = validate("NoSuchClass"); +101assertEquals(1, violations.size()); +102 +103CoprocessorViolation violation = violations.get(0); +104
[20/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.html index b479b6b..c5277a9 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -26,224 +26,252 @@ 018 019package org.apache.hadoop.hbase.thrift; 020 -021import java.io.IOException; -022import java.security.PrivilegedExceptionAction; +021import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_KEYTAB_FILE_KEY; +022import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_PRINCIPAL_KEY; 023 -024import javax.servlet.ServletException; -025import javax.servlet.http.HttpServletRequest; -026import javax.servlet.http.HttpServletResponse; -027 -028import org.apache.hadoop.conf.Configuration; -029import org.apache.hadoop.hbase.security.SecurityUtil; -030import org.apache.hadoop.hbase.util.Base64; -031import org.apache.hadoop.security.UserGroupInformation; -032import org.apache.hadoop.security.authorize.AuthorizationException; -033import org.apache.hadoop.security.authorize.ProxyUsers; -034import org.apache.thrift.TProcessor; -035import org.apache.thrift.protocol.TProtocolFactory; -036import org.apache.thrift.server.TServlet; -037import org.apache.yetus.audience.InterfaceAudience; -038import org.ietf.jgss.GSSContext; -039import org.ietf.jgss.GSSCredential; -040import org.ietf.jgss.GSSException; -041import org.ietf.jgss.GSSManager; -042import org.ietf.jgss.GSSName; -043import org.ietf.jgss.Oid; -044import org.slf4j.Logger; -045import org.slf4j.LoggerFactory; -046 -047/** -048 * Thrift Http Servlet is used for performing Kerberos authentication if security is enabled and -049 * also used for setting the user specified in "doAs" parameter. -050 */ -051@InterfaceAudience.Private -052public class ThriftHttpServlet extends TServlet { -053 private static final long serialVersionUID = 1L; -054 private static final Logger LOG = LoggerFactory.getLogger(ThriftHttpServlet.class.getName()); -055 private transient final UserGroupInformation realUser; -056 private transient final Configuration conf; -057 private final boolean securityEnabled; -058 private final boolean doAsEnabled; -059 private transient ThriftServerRunner.HBaseHandler hbaseHandler; -060 -061 // HTTP Header related constants. -062 public static final String WWW_AUTHENTICATE = "WWW-Authenticate"; -063 public static final String AUTHORIZATION = "Authorization"; -064 public static final String NEGOTIATE = "Negotiate"; -065 -066 public ThriftHttpServlet(TProcessor processor, TProtocolFactory protocolFactory, -067 UserGroupInformation realUser, Configuration conf, ThriftServerRunner.HBaseHandler -068 hbaseHandler, boolean securityEnabled, boolean doAsEnabled) { -069super(processor, protocolFactory); -070this.realUser = realUser; -071this.conf = conf; -072this.hbaseHandler = hbaseHandler; -073this.securityEnabled = securityEnabled; -074this.doAsEnabled = doAsEnabled; -075 } -076 -077 @Override -078 protected void doPost(HttpServletRequest request, HttpServletResponse response) -079 throws ServletException, IOException { -080String effectiveUser = request.getRemoteUser(); -081if (securityEnabled) { -082 try { -083// As Thrift HTTP transport doesn't support SPNEGO yet (THRIFT-889), -084// Kerberos authentication is being done at servlet level. -085final RemoteUserIdentity identity = doKerberosAuth(request); -086effectiveUser = identity.principal; -087// It is standard for client applications expect this header. -088// Please see http://tools.ietf.org/html/rfc4559 for more details. -089 response.addHeader(WWW_AUTHENTICATE, NEGOTIATE + " " + identity.outToken); -090 } catch (HttpAuthenticationException e) { -091LOG.error("Kerberos Authentication failed", e); -092// Send a 401 to the client -093 response.setStatus(HttpServletResponse.SC_UNAUTHORIZED); -094 response.addHeader(WWW_AUTHENTICATE, NEGOTIATE); -095 response.getWriter().println("Authentication Error: " + e.getMessage()); -096return; -097 } -098} -099String doAsUserFromQuery = request.getHeader("doAs"); -100if(effectiveUser == null) { -101 effectiveUser = realUser.getShortUserName(); -102} -103if (doAsUserFromQuery !=
[03/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/src-html/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html -- diff --git a/testdevapidocs/src-html/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html b/testdevapidocs/src-html/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html index e105517..d6439f8 100644 --- a/testdevapidocs/src-html/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html +++ b/testdevapidocs/src-html/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.html @@ -66,181 +66,182 @@ 058 */ 059@Category({ClientTests.class, LargeTests.class}) 060public class TestThriftHttpServer { -061 -062 @ClassRule -063 public static final HBaseClassTestRule CLASS_RULE = -064 HBaseClassTestRule.forClass(TestThriftHttpServer.class); -065 -066 private static final Logger LOG = -067 LoggerFactory.getLogger(TestThriftHttpServer.class); -068 -069 private static final HBaseTestingUtility TEST_UTIL = -070 new HBaseTestingUtility(); -071 -072 private Thread httpServerThread; -073 private volatile Exception httpServerException; +061 @ClassRule +062 public static final HBaseClassTestRule CLASS_RULE = +063 HBaseClassTestRule.forClass(TestThriftHttpServer.class); +064 +065 private static final Logger LOG = +066 LoggerFactory.getLogger(TestThriftHttpServer.class); +067 +068 static final HBaseTestingUtility TEST_UTIL = new HBaseTestingUtility(); +069 +070 private Thread httpServerThread; +071 private volatile Exception httpServerException; +072 +073 private Exception clientSideException; 074 -075 private Exception clientSideException; -076 -077 private ThriftServer thriftServer; -078 private int port; -079 -080 @BeforeClass -081 public static void setUpBeforeClass() throws Exception { -082 TEST_UTIL.getConfiguration().setBoolean("hbase.regionserver.thrift.http", true); -083 TEST_UTIL.getConfiguration().setBoolean("hbase.table.sanity.checks", false); -084TEST_UTIL.startMiniCluster(); -085//ensure that server time increments every time we do an operation, otherwise -086//successive puts having the same timestamp will override each other -087 EnvironmentEdgeManagerTestHelper.injectEdge(new IncrementingEnvironmentEdge()); -088 } -089 -090 @AfterClass -091 public static void tearDownAfterClass() throws Exception { -092TEST_UTIL.shutdownMiniCluster(); -093EnvironmentEdgeManager.reset(); -094 } -095 -096 @Test -097 public void testExceptionThrownWhenMisConfigured() throws Exception { -098Configuration conf = new Configuration(TEST_UTIL.getConfiguration()); -099conf.set("hbase.thrift.security.qop", "privacy"); -100 conf.setBoolean("hbase.thrift.ssl.enabled", false); -101 -102ThriftServerRunner runner = null; -103ExpectedException thrown = ExpectedException.none(); -104try { -105 thrown.expect(IllegalArgumentException.class); -106 thrown.expectMessage("Thrift HTTP Server's QoP is privacy, " + -107 "but hbase.thrift.ssl.enabled is false"); -108 runner = new ThriftServerRunner(conf); -109 fail("Thrift HTTP Server starts up even with wrong security configurations."); -110} catch (Exception e) { -111} -112 -113assertNull(runner); -114 } -115 -116 private void startHttpServerThread(final String[] args) { -117LOG.info("Starting HBase Thrift server with HTTP server: " + Joiner.on(" ").join(args)); -118 -119httpServerException = null; -120httpServerThread = new Thread(() - { -121 try { -122thriftServer.doMain(args); -123 } catch (Exception e) { -124httpServerException = e; -125 } -126}); -127 httpServerThread.setName(ThriftServer.class.getSimpleName() + "-httpServer"); -128httpServerThread.start(); -129 } -130 -131 @Rule -132 public ExpectedException exception = ExpectedException.none(); -133 -134 @Test -135 public void testRunThriftServerWithHeaderBufferLength() throws Exception { -136 -137// Test thrift server with HTTP header length less than 64k -138try { -139 runThriftServer(1024 * 63); -140} catch (TTransportException tex) { -141 assertFalse(tex.getMessage().equals("HTTP Response code: 431")); -142} -143 -144// Test thrift server with HTTP header length more than 64k, expect an exception -145 exception.expect(TTransportException.class); -146exception.expectMessage("HTTP Response code: 431"); -147runThriftServer(1024 * 64); -148 } -149 -150 @Test -151 public void testRunThriftServer() throws Exception { -152runThriftServer(0); -153 } -154 -155 private void runThriftServer(int customHeaderSize) throws Exception { -156ListString args = new ArrayList(3); -157port = HBaseTestingUtility.randomFreePort(); -158args.add("-" + ThriftServer.PORT_OPTION); -159args.add(String.valueOf(port)); -160
[19/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html index 3f84557..e692633 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.HBaseHandler.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -118,826 +118,826 @@ 110import org.apache.thrift.TProcessor; 111import org.apache.thrift.protocol.TBinaryProtocol; 112import org.apache.thrift.protocol.TCompactProtocol; -113import org.apache.thrift.protocol.TProtocol; -114import org.apache.thrift.protocol.TProtocolFactory; -115import org.apache.thrift.server.THsHaServer; -116import org.apache.thrift.server.TNonblockingServer; -117import org.apache.thrift.server.TServer; -118import org.apache.thrift.server.TServlet; -119import org.apache.thrift.server.TThreadedSelectorServer; -120import org.apache.thrift.transport.TFramedTransport; -121import org.apache.thrift.transport.TNonblockingServerSocket; -122import org.apache.thrift.transport.TNonblockingServerTransport; -123import org.apache.thrift.transport.TSaslServerTransport; -124import org.apache.thrift.transport.TServerSocket; -125import org.apache.thrift.transport.TServerTransport; -126import org.apache.thrift.transport.TTransportFactory; -127import org.apache.yetus.audience.InterfaceAudience; -128import org.eclipse.jetty.http.HttpVersion; -129import org.eclipse.jetty.server.HttpConfiguration; -130import org.eclipse.jetty.server.HttpConnectionFactory; -131import org.eclipse.jetty.server.SecureRequestCustomizer; -132import org.eclipse.jetty.server.Server; -133import org.eclipse.jetty.server.ServerConnector; -134import org.eclipse.jetty.server.SslConnectionFactory; -135import org.eclipse.jetty.servlet.ServletContextHandler; -136import org.eclipse.jetty.servlet.ServletHolder; -137import org.eclipse.jetty.util.ssl.SslContextFactory; -138import org.eclipse.jetty.util.thread.QueuedThreadPool; -139import org.slf4j.Logger; -140import org.slf4j.LoggerFactory; -141import org.apache.hbase.thirdparty.com.google.common.base.Joiner; -142import org.apache.hbase.thirdparty.com.google.common.base.Splitter; -143import org.apache.hbase.thirdparty.com.google.common.base.Throwables; -144import org.apache.hbase.thirdparty.com.google.common.util.concurrent.ThreadFactoryBuilder; -145import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; -146import org.apache.hbase.thirdparty.org.apache.commons.cli.Option; -147import org.apache.hbase.thirdparty.org.apache.commons.cli.OptionGroup; -148 -149/** -150 * ThriftServerRunner - this class starts up a Thrift server which implements -151 * the Hbase API specified in the Hbase.thrift IDL file. -152 */ -153@InterfaceAudience.Private -154public class ThriftServerRunner implements Runnable { -155 -156 private static final Logger LOG = LoggerFactory.getLogger(ThriftServerRunner.class); -157 -158 private static final int DEFAULT_HTTP_MAX_HEADER_SIZE = 64 * 1024; // 64k -159 -160 static final String SERVER_TYPE_CONF_KEY = -161 "hbase.regionserver.thrift.server.type"; -162 -163 static final String BIND_CONF_KEY = "hbase.regionserver.thrift.ipaddress"; -164 static final String COMPACT_CONF_KEY = "hbase.regionserver.thrift.compact"; -165 static final String FRAMED_CONF_KEY = "hbase.regionserver.thrift.framed"; -166 static final String MAX_FRAME_SIZE_CONF_KEY = -167 "hbase.regionserver.thrift.framed.max_frame_size_in_mb"; -168 static final String PORT_CONF_KEY = "hbase.regionserver.thrift.port"; -169 static final String COALESCE_INC_KEY = "hbase.regionserver.thrift.coalesceIncrement"; -170 static final String USE_HTTP_CONF_KEY = "hbase.regionserver.thrift.http"; -171 static final String HTTP_MIN_THREADS = "hbase.thrift.http_threads.min"; -172 static final String HTTP_MAX_THREADS = "hbase.thrift.http_threads.max"; -173 -174 static final String THRIFT_SSL_ENABLED = "hbase.thrift.ssl.enabled"; -175 static final String THRIFT_SSL_KEYSTORE_STORE = "hbase.thrift.ssl.keystore.store"; -176 static final String THRIFT_SSL_KEYSTORE_PASSWORD = "hbase.thrift.ssl.keystore.password"; -177 static final String THRIFT_SSL_KEYSTORE_KEYPASSWORD = "hbase.thrift.ssl.keystore.keypassword"; -178 static final String THRIFT_SSL_EXCLUDE_CIPHER_SUITES = "hbase.thrift.ssl.exclude.cipher.suites"; -179 static final String THRIFT_SSL_INCLUDE_CIPHER_SUITES =
[06/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html b/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html new file mode 100644 index 000..84c6e0f --- /dev/null +++ b/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html @@ -0,0 +1,295 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +CoprocessorValidatorTest.MissingClassClassLoader (Apache HBase 3.0.0-SNAPSHOT Test API) + + + + + +var methods = {"i0":10}; +var tabs = {65535:["t0","All Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]}; +var altColor = "altColor"; +var rowColor = "rowColor"; +var tableTab = "tableTab"; +var activeTableTab = "activeTableTab"; + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevClass +NextClass + + +Frames +NoFrames + + +AllClasses + + + + + + + +Summary: +Nested| +Field| +Constr| +Method + + +Detail: +Field| +Constr| +Method + + + + + + + + +org.apache.hadoop.hbase.tool.coprocessor +Class CoprocessorValidatorTest.MissingClassClassLoader + + + +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">java.lang.Object + + +https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true; title="class or interface in java.lang">java.lang.ClassLoader + + +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidatorTest.MissingClassClassLoader + + + + + + + + + +Enclosing class: +CoprocessorValidatorTest + + + +private static class CoprocessorValidatorTest.MissingClassClassLoader +extends https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true; title="class or interface in java.lang">ClassLoader + + + + + + + + + + + +Constructor Summary + +Constructors + +Constructor and Description + + +MissingClassClassLoader() + + + + + + + + + +Method Summary + +All MethodsInstance MethodsConcrete Methods + +Modifier and Type +Method and Description + + +https://docs.oracle.com/javase/8/docs/api/java/lang/Class.html?is-external=true; title="class or interface in java.lang">Class? +loadClass(https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">Stringname) + + + + + + +Methods inherited from classjava.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true; title="class or interface in java.lang">ClassLoader +https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#clearAssertionStatus--; title="class or interface in java.lang">clearAssertionStatus, https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#defineClass-byte:A-int-int-; title="class or interface in java.lang">defineClass, https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#defineClass-java.lang.String-byte:A-int-int-; title="class or interface in java.lang">defineClass, https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#defineClass-java.lang.String-byte:A-int-int-java.security.ProtectionDomain-; title="class or interface in java.lang">defineClass, https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#defineClass-java.lang.String-java.nio.ByteBuffer-java.security.ProtectionDomain-; title="class or inter face in java.lang">defineClass, https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#definePackage-java.lang.String-java.lang.String-java.lang.String-java.lang.String-java.lang.String-java.lang.String-java.lang.String-java.net.URL-; title="class or interface in java.lang">definePackage, https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#findClass-java.lang.String-; title="class or interface in java.lang">findClass, https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#findLibrary-java.lang.String-; title="class or interface in java.lang">findLibrary,
[10/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.html b/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.html index 5616ff0..d2e20ee 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/util/AbstractHBaseTool.html @@ -30,271 +30,270 @@ 022import java.util.HashMap; 023import java.util.List; 024 -025import org.apache.hadoop.conf.Configurable; -026import org.apache.hadoop.conf.Configuration; -027import org.apache.hadoop.hbase.HBaseConfiguration; -028import org.apache.hadoop.util.Tool; -029import org.apache.hadoop.util.ToolRunner; -030import org.apache.yetus.audience.InterfaceAudience; -031import org.slf4j.Logger; -032import org.slf4j.LoggerFactory; -033 -034import org.apache.hbase.thirdparty.org.apache.commons.cli.BasicParser; -035import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; -036import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLineParser; -037import org.apache.hbase.thirdparty.org.apache.commons.cli.DefaultParser; -038import org.apache.hbase.thirdparty.org.apache.commons.cli.HelpFormatter; -039import org.apache.hbase.thirdparty.org.apache.commons.cli.MissingOptionException; -040import org.apache.hbase.thirdparty.org.apache.commons.cli.Option; -041import org.apache.hbase.thirdparty.org.apache.commons.cli.Options; -042import org.apache.hbase.thirdparty.org.apache.commons.cli.ParseException; -043 -044/** -045 * Common base class used for HBase command-line tools. Simplifies workflow and -046 * command-line argument parsing. -047 */ -048@InterfaceAudience.Private -049public abstract class AbstractHBaseTool implements Tool, Configurable { -050 protected static final int EXIT_SUCCESS = 0; -051 protected static final int EXIT_FAILURE = 1; -052 -053 public static final String SHORT_HELP_OPTION = "h"; -054 public static final String LONG_HELP_OPTION = "help"; -055 -056 private static final Option HELP_OPTION = new Option("h", "help", false, -057 "Prints help for this tool."); -058 -059 private static final Logger LOG = LoggerFactory.getLogger(AbstractHBaseTool.class); -060 -061 protected final Options options = new Options(); -062 -063 protected Configuration conf = null; -064 -065 protected String[] cmdLineArgs = null; -066 -067 // To print options in order they were added in help text. -068 private HashMapOption, Integer optionsOrder = new HashMap(); -069 private int optionsCount = 0; -070 -071 private class OptionsOrderComparator implements ComparatorOption { -072@Override -073public int compare(Option o1, Option o2) { -074 return optionsOrder.get(o1) - optionsOrder.get(o2); -075} -076 } -077 -078 /** -079 * Override this to add command-line options using {@link #addOptWithArg} -080 * and similar methods. -081 */ -082 protected abstract void addOptions(); -083 -084 /** -085 * This method is called to process the options after they have been parsed. -086 */ -087 protected abstract void processOptions(CommandLine cmd); -088 -089 /** The "main function" of the tool */ -090 protected abstract int doWork() throws Exception; -091 -092 /** -093 * For backward compatibility. DO NOT use it for new tools. -094 * We have options in existing tools which can't be ported to Apache CLI's {@link Option}. -095 * (because they don't pass validation, for e.g. "-copy-to". "-" means short name -096 * which doesn't allow '-' in name). This function is to allow tools to have, for time being, -097 * parameters which can't be parsed using {@link Option}. -098 * Overrides should consume all valid legacy arguments. If the param 'args' is not empty on -099 * return, it means there were invalid options, in which case we'll exit from the tool. -100 * Note that it's called before {@link #processOptions(CommandLine)}, which means new options' -101 * values will override old ones'. -102 */ -103 protected void processOldArgs(ListString args) { -104 } -105 -106 @Override -107 public Configuration getConf() { -108return conf; -109 } -110 -111 @Override -112 public void setConf(Configuration conf) { -113this.conf = conf; -114 } -115 -116 @Override -117 public int run(String[] args) throws IOException { -118cmdLineArgs = args; -119if (conf == null) { -120 LOG.error("Tool configuration is not initialized"); -121 throw new NullPointerException("conf"); -122} -123 -124CommandLine cmd; -125ListString argsList = new ArrayList(args.length); -126for (String arg : args) { -127 argsList.add(arg); -128} -129// For backward compatibility of args which can't be parsed as Option. See javadoc for -130
[08/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html index fbff915..b72e392 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/procedure2/package-tree.html @@ -205,9 +205,9 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) -org.apache.hadoop.hbase.procedure2.TestYieldProcedures.TestStateMachineProcedure.State -org.apache.hadoop.hbase.procedure2.TestStateMachineProcedure.TestSMProcedureState org.apache.hadoop.hbase.procedure2.TestProcedureRecovery.TestStateMachineProcedure.State +org.apache.hadoop.hbase.procedure2.TestStateMachineProcedure.TestSMProcedureState +org.apache.hadoop.hbase.procedure2.TestYieldProcedures.TestStateMachineProcedure.State http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/procedure2/store/wal/package-tree.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/procedure2/store/wal/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/procedure2/store/wal/package-tree.html index f689826..4d4c7cb 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/procedure2/store/wal/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/procedure2/store/wal/package-tree.html @@ -81,7 +81,7 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.procedure2.store.wal.ProcedureWALLoaderPerformanceEvaluation org.apache.hadoop.hbase.procedure2.store.wal.ProcedureWALPerformanceEvaluation http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.html b/testdevapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.html index d821aea..9fbe072 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.html +++ b/testdevapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.html @@ -18,7 +18,7 @@ catch(err) { } //--> -var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10,"i61":10,"i62":10,"i63":10,"i64":10,"i65":10,"i66":10,"i67":10,"i68":10,"i69":10,"i70":10,"i71":10,"i72":10,"i73":10,"i74":10,"i75":10,"i76":10,"i77":10,"i78":10,"i79":10,"i80":10,"i81":10,"i82":10,"i83":10,"i84":10,"i85":10,"i86":10,"i87":10,"i88":10,"i89":10,"i90":10,"i91":10,"i92":10,"i93":10,"i94":10,"i95":10,"i96":10,"i97":10,"i98":10,"i99":10,"i100":10,"i101":10,"i102":10,"i103":10,"i104":10,"i105":10,"i106":10,"i107":10,"i108":10,"i 109":10}; +var methods =
[21/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.RemoteUserIdentity.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.RemoteUserIdentity.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.RemoteUserIdentity.html index b479b6b..c5277a9 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.RemoteUserIdentity.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.RemoteUserIdentity.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -26,224 +26,252 @@ 018 019package org.apache.hadoop.hbase.thrift; 020 -021import java.io.IOException; -022import java.security.PrivilegedExceptionAction; +021import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_KEYTAB_FILE_KEY; +022import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_PRINCIPAL_KEY; 023 -024import javax.servlet.ServletException; -025import javax.servlet.http.HttpServletRequest; -026import javax.servlet.http.HttpServletResponse; -027 -028import org.apache.hadoop.conf.Configuration; -029import org.apache.hadoop.hbase.security.SecurityUtil; -030import org.apache.hadoop.hbase.util.Base64; -031import org.apache.hadoop.security.UserGroupInformation; -032import org.apache.hadoop.security.authorize.AuthorizationException; -033import org.apache.hadoop.security.authorize.ProxyUsers; -034import org.apache.thrift.TProcessor; -035import org.apache.thrift.protocol.TProtocolFactory; -036import org.apache.thrift.server.TServlet; -037import org.apache.yetus.audience.InterfaceAudience; -038import org.ietf.jgss.GSSContext; -039import org.ietf.jgss.GSSCredential; -040import org.ietf.jgss.GSSException; -041import org.ietf.jgss.GSSManager; -042import org.ietf.jgss.GSSName; -043import org.ietf.jgss.Oid; -044import org.slf4j.Logger; -045import org.slf4j.LoggerFactory; -046 -047/** -048 * Thrift Http Servlet is used for performing Kerberos authentication if security is enabled and -049 * also used for setting the user specified in "doAs" parameter. -050 */ -051@InterfaceAudience.Private -052public class ThriftHttpServlet extends TServlet { -053 private static final long serialVersionUID = 1L; -054 private static final Logger LOG = LoggerFactory.getLogger(ThriftHttpServlet.class.getName()); -055 private transient final UserGroupInformation realUser; -056 private transient final Configuration conf; -057 private final boolean securityEnabled; -058 private final boolean doAsEnabled; -059 private transient ThriftServerRunner.HBaseHandler hbaseHandler; -060 -061 // HTTP Header related constants. -062 public static final String WWW_AUTHENTICATE = "WWW-Authenticate"; -063 public static final String AUTHORIZATION = "Authorization"; -064 public static final String NEGOTIATE = "Negotiate"; -065 -066 public ThriftHttpServlet(TProcessor processor, TProtocolFactory protocolFactory, -067 UserGroupInformation realUser, Configuration conf, ThriftServerRunner.HBaseHandler -068 hbaseHandler, boolean securityEnabled, boolean doAsEnabled) { -069super(processor, protocolFactory); -070this.realUser = realUser; -071this.conf = conf; -072this.hbaseHandler = hbaseHandler; -073this.securityEnabled = securityEnabled; -074this.doAsEnabled = doAsEnabled; -075 } -076 -077 @Override -078 protected void doPost(HttpServletRequest request, HttpServletResponse response) -079 throws ServletException, IOException { -080String effectiveUser = request.getRemoteUser(); -081if (securityEnabled) { -082 try { -083// As Thrift HTTP transport doesn't support SPNEGO yet (THRIFT-889), -084// Kerberos authentication is being done at servlet level. -085final RemoteUserIdentity identity = doKerberosAuth(request); -086effectiveUser = identity.principal; -087// It is standard for client applications expect this header. -088// Please see http://tools.ietf.org/html/rfc4559 for more details. -089 response.addHeader(WWW_AUTHENTICATE, NEGOTIATE + " " + identity.outToken); -090 } catch (HttpAuthenticationException e) { -091LOG.error("Kerberos Authentication failed", e); -092// Send a 401 to the client -093 response.setStatus(HttpServletResponse.SC_UNAUTHORIZED); -094 response.addHeader(WWW_AUTHENTICATE, NEGOTIATE); -095 response.getWriter().println("Authentication Error: " + e.getMessage()); -096return; -097 } -098} -099String doAsUserFromQuery = request.getHeader("doAs"); -100if(effectiveUser == null) {
[14/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html b/devapidocs/src-html/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html new file mode 100644 index 000..11b774f --- /dev/null +++ b/devapidocs/src-html/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html @@ -0,0 +1,180 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + +Source code + + + + +001/** +002 * +003 * Licensed to the Apache Software Foundation (ASF) under one +004 * or more contributor license agreements. See the NOTICE file +005 * distributed with this work for additional information +006 * regarding copyright ownership. The ASF licenses this file +007 * to you under the Apache License, Version 2.0 (the +008 * "License"); you may not use this file except in compliance +009 * with the License. You may obtain a copy of the License at +010 * +011 * http://www.apache.org/licenses/LICENSE-2.0 +012 * +013 * Unless required by applicable law or agreed to in writing, software +014 * distributed under the License is distributed on an "AS IS" BASIS, +015 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +016 * See the License for the specific language governing permissions and +017 * limitations under the License. +018 */ +019package org.apache.hadoop.hbase.tool; +020 +021import java.io.IOException; +022import java.util.List; +023 +024import org.apache.hadoop.hbase.HBaseInterfaceAudience; +025import org.apache.hadoop.hbase.client.Admin; +026import org.apache.hadoop.hbase.client.ColumnFamilyDescriptor; +027import org.apache.hadoop.hbase.client.Connection; +028import org.apache.hadoop.hbase.client.ConnectionFactory; +029import org.apache.hadoop.hbase.client.TableDescriptor; +030import org.apache.hadoop.hbase.io.encoding.DataBlockEncoding; +031import org.apache.hadoop.hbase.util.AbstractHBaseTool; +032import org.apache.hadoop.hbase.util.Bytes; +033import org.apache.yetus.audience.InterfaceAudience; +034import org.slf4j.Logger; +035import org.slf4j.LoggerFactory; +036 +037import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; +038 +039@InterfaceAudience.LimitedPrivate(HBaseInterfaceAudience.TOOLS) +040public class DataBlockEncodingValidator extends AbstractHBaseTool { +041 +042 private static final Logger LOG = LoggerFactory.getLogger(DataBlockEncodingValidator.class); +043 private static final byte[] DATA_BLOCK_ENCODING = Bytes.toBytes("DATA_BLOCK_ENCODING"); +044 +045 /** +046 * Check DataBlockEncodings of column families are compatible. +047 * +048 * @return number of column families with incompatible DataBlockEncoding +049 * @throws IOException if a remote or network exception occurs +050 */ +051 private int validateDBE() throws IOException { +052int incompatibilities = 0; +053 +054LOG.info("Validating Data Block Encodings"); +055 +056try (Connection connection = ConnectionFactory.createConnection(getConf()); +057Admin admin = connection.getAdmin()) { +058 ListTableDescriptor tableDescriptors = admin.listTableDescriptors(); +059 String encoding = ""; +060 +061 for (TableDescriptor td : tableDescriptors) { +062ColumnFamilyDescriptor[] columnFamilies = td.getColumnFamilies(); +063for (ColumnFamilyDescriptor cfd : columnFamilies) { +064 try { +065encoding = Bytes.toString(cfd.getValue(DATA_BLOCK_ENCODING)); +066// IllegalArgumentException will be thrown if encoding is incompatible with 2.0 +067 DataBlockEncoding.valueOf(encoding); +068 } catch (IllegalArgumentException e) { +069incompatibilities++; +070LOG.warn("Incompatible DataBlockEncoding for table: {}, cf: {}, encoding: {}", +071 td.getTableName().getNameAsString(), cfd.getNameAsString(), encoding); +072 } +073} +074 } +075} +076 +077if (incompatibilities 0) { +078 LOG.warn("There are {} column families with incompatible Data Block Encodings. Do not " +079 + "upgrade until these encodings are converted to a supported one.", incompatibilities); +080 LOG.warn("Check http://hbase.apache.org/book.html#upgrade2.0.prefix-tree.removed " +081 + "for instructions."); +082} else { +083 LOG.info("The used Data Block Encodings are compatible with HBase 2.0."); +084} +085 +086return incompatibilities; +087 } +088 +089 @Override +090 protected void printUsage() { +091String header = "hbase " + PreUpgradeValidator.TOOL_NAME + " " + +092 PreUpgradeValidator.VALIDATE_DBE_NAME; +093printUsage(header, null, ""); +094 } +095 +096 @Override +097 protected void addOptions() { +098 } +099 +100
[35/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html b/devapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html index 203692a..63aa3a0 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/package-tree.html @@ -704,20 +704,20 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) +org.apache.hadoop.hbase.regionserver.SplitLogWorker.TaskExecutor.Status +org.apache.hadoop.hbase.regionserver.TimeRangeTracker.Type +org.apache.hadoop.hbase.regionserver.HRegion.FlushResult.Result +org.apache.hadoop.hbase.regionserver.Region.Operation org.apache.hadoop.hbase.regionserver.ScanType +org.apache.hadoop.hbase.regionserver.ChunkCreator.ChunkType org.apache.hadoop.hbase.regionserver.MetricsRegionServerSourceFactoryImpl.FactoryStorage org.apache.hadoop.hbase.regionserver.MemStoreCompactionStrategy.Action -org.apache.hadoop.hbase.regionserver.DefaultHeapMemoryTuner.StepDirection org.apache.hadoop.hbase.regionserver.FlushType -org.apache.hadoop.hbase.regionserver.TimeRangeTracker.Type +org.apache.hadoop.hbase.regionserver.CompactingMemStore.IndexType +org.apache.hadoop.hbase.regionserver.DefaultHeapMemoryTuner.StepDirection org.apache.hadoop.hbase.regionserver.ScannerContext.LimitScope -org.apache.hadoop.hbase.regionserver.SplitLogWorker.TaskExecutor.Status -org.apache.hadoop.hbase.regionserver.Region.Operation -org.apache.hadoop.hbase.regionserver.BloomType -org.apache.hadoop.hbase.regionserver.ChunkCreator.ChunkType org.apache.hadoop.hbase.regionserver.ScannerContext.NextState -org.apache.hadoop.hbase.regionserver.HRegion.FlushResult.Result -org.apache.hadoop.hbase.regionserver.CompactingMemStore.IndexType +org.apache.hadoop.hbase.regionserver.BloomType http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/regionserver/querymatcher/package-tree.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/querymatcher/package-tree.html b/devapidocs/org/apache/hadoop/hbase/regionserver/querymatcher/package-tree.html index 6851ee1..b377318 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/querymatcher/package-tree.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/querymatcher/package-tree.html @@ -130,9 +130,9 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) -org.apache.hadoop.hbase.regionserver.querymatcher.DeleteTracker.DeleteResult -org.apache.hadoop.hbase.regionserver.querymatcher.ScanQueryMatcher.MatchCode org.apache.hadoop.hbase.regionserver.querymatcher.StripeCompactionScanQueryMatcher.DropDeletesInOutput +org.apache.hadoop.hbase.regionserver.querymatcher.ScanQueryMatcher.MatchCode +org.apache.hadoop.hbase.regionserver.querymatcher.DeleteTracker.DeleteResult http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/rest/model/package-tree.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/rest/model/package-tree.html b/devapidocs/org/apache/hadoop/hbase/rest/model/package-tree.html index 034077c..c20ff47 100644 --- a/devapidocs/org/apache/hadoop/hbase/rest/model/package-tree.html +++ b/devapidocs/org/apache/hadoop/hbase/rest/model/package-tree.html @@ -110,8 +110,8 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) -org.apache.hadoop.hbase.rest.model.ScannerModel.FilterModel.ByteArrayComparableModel.ComparatorType
[42/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/checkstyle.rss -- diff --git a/checkstyle.rss b/checkstyle.rss index 3d679df..5fe002a 100644 --- a/checkstyle.rss +++ b/checkstyle.rss @@ -25,8 +25,8 @@ under the License. en-us 2007 - 2018 The Apache Software Foundation - File: 3631, - Errors: 16202, + File: 3640, + Errors: 16197, Warnings: 0, Infos: 0 @@ -3406,6 +3406,20 @@ under the License. + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.tool.DataBlockEncodingValidator.java;>org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.java + + + 0 + + + 0 + + + 0 + + + + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.security.access.UserPermission.java;>org/apache/hadoop/hbase/security/access/UserPermission.java @@ -4073,7 +4087,7 @@ under the License. 0 - 9 + 4 @@ -7928,6 +7942,20 @@ under the License. + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods.java;>org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethods.java + + + 0 + + + 0 + + + 0 + + + + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.regionserver.TestMetricsRegionSourceImpl.java;>org/apache/hadoop/hbase/regionserver/TestMetricsRegionSourceImpl.java @@ -9258,6 +9286,20 @@ under the License. + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.tool.coprocessor.CurrentCoprocessorMethods.java;>org/apache/hadoop/hbase/tool/coprocessor/CurrentCoprocessorMethods.java + + + 0 + + + 0 + + + 0 + + + + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.security.token.TestAuthenticationKey.java;>org/apache/hadoop/hbase/security/token/TestAuthenticationKey.java @@ -10938,6 +10980,20 @@ under the License. + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.tool.coprocessor.CoprocessorViolation.java;>org/apache/hadoop/hbase/tool/coprocessor/CoprocessorViolation.java + + + 0 + + + 0 + + + 0 + + + + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.filter.TestKeyOnlyFilter.java;>org/apache/hadoop/hbase/filter/TestKeyOnlyFilter.java @@ -12870,6 +12926,20 @@ under the License. + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator.java;>org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidator.java + + + 0 + + + 0 + + + 0 + + + + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.security.visibility.ScanLabelGenerator.java;>org/apache/hadoop/hbase/security/visibility/ScanLabelGenerator.java @@ -16062,6 +16132,20 @@ under the License. + http://hbase.apache.org/checkstyle.html#org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethod.java;>org/apache/hadoop/hbase/tool/coprocessor/CoprocessorMethod.java + + + 0 + + + 0 +
[36/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html index 7d45e46..374e848 100644 --- a/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html +++ b/devapidocs/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.html @@ -18,7 +18,7 @@ catch(err) { } //--> -var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10,"i61":10,"i62":10,"i63":10,"i64":10,"i65":10,"i66":10,"i67":10,"i68":10,"i69":10,"i70":10,"i71":10,"i72":10,"i73":10,"i74":10,"i75":10,"i76":10,"i77":10,"i78":10,"i79":10,"i80":10,"i81":10,"i82":10,"i83":10,"i84":10,"i85":10,"i86":10,"i87":10,"i88":10,"i89":10,"i90":10,"i91":10,"i92":10,"i93":10,"i94":10,"i95":10,"i96":10,"i97":10,"i98":10,"i99":10,"i100":10,"i101":10,"i102":10,"i103":10,"i104":10,"i105":10,"i106":10,"i107":10,"i108":10,"i 109":10,"i110":10,"i111":10}; +var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10,"i10":10,"i11":10,"i12":10,"i13":10,"i14":10,"i15":10,"i16":10,"i17":10,"i18":10,"i19":10,"i20":10,"i21":10,"i22":10,"i23":10,"i24":10,"i25":10,"i26":10,"i27":10,"i28":10,"i29":10,"i30":10,"i31":10,"i32":10,"i33":10,"i34":10,"i35":10,"i36":10,"i37":10,"i38":10,"i39":10,"i40":10,"i41":10,"i42":10,"i43":10,"i44":10,"i45":10,"i46":10,"i47":10,"i48":10,"i49":10,"i50":10,"i51":10,"i52":10,"i53":10,"i54":10,"i55":10,"i56":10,"i57":10,"i58":10,"i59":10,"i60":10,"i61":10,"i62":10,"i63":10,"i64":10,"i65":10,"i66":10,"i67":10,"i68":10,"i69":10,"i70":10,"i71":10,"i72":10,"i73":10,"i74":10,"i75":10,"i76":10,"i77":10,"i78":10,"i79":10,"i80":10,"i81":10,"i82":10,"i83":10,"i84":10,"i85":10,"i86":10,"i87":10,"i88":10,"i89":10,"i90":10,"i91":10,"i92":10,"i93":10,"i94":10,"i95":10,"i96":10,"i97":10,"i98":10,"i99":10,"i100":10,"i101":10,"i102":10,"i103":10,"i104":10,"i105":10,"i106":10,"i107":10,"i108":10,"i 109":10}; var tabs = {65535:["t0","All Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]}; var altColor = "altColor"; var rowColor = "rowColor"; @@ -354,49 +354,41 @@ implements readRequestsCount -private double -readRequestsRatePerSecond - - private HRegionServer regionServer - + private double requestsPerSecond - + private https://docs.oracle.com/javase/8/docs/api/java/lang/Runnable.html?is-external=true; title="class or interface in java.lang">Runnable runnable - + private long storefileIndexSize - + private long storeFileSize - + private long totalStaticBloomSize - + private long totalStaticIndexSize - + private long walFileSize - + private long writeRequestsCount - -private double -writeRequestsRatePerSecond - @@ -892,150 +884,138 @@ implements double -getReadRequestsRatePerSecond() -Get the rate of read requests per second to regions hosted on this region server. - - - -double getRequestsPerSecond() Get the number of requests per second. - + long getRootIndexHitCount() - + long getRootIndexMissCount() - + long getRpcGetRequestsCount() Get the number of rpc get requests to this region server. - + long getRpcMultiRequestsCount() Get the number of rpc multi requests to this region server. - + long getRpcMutateRequestsCount() Get the number of rpc mutate requests to this region server. - + long getRpcScanRequestsCount() Get the number of rpc scan requests to this region server. - + https://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String getServerName() Get ServerName - + int getSmallCompactionQueueSize() - + int getSplitQueueSize() Get the size of the split queue - + long getStartCode() Get HRegionServer start time - + long getStoreFileIndexSize() Get the Size (in bytes) of indexes in storefiles on disk. - + long getStoreFileSize() Get the total size of the store files this region server is serving from. - + long getTotalRequestCount() Get the total number of requests per second. - + long getTotalRowActionRequestCount() - + long getTotalStaticBloomSize() Get the size (in bytes) of the static bloom filters. - +
[46/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
Published site at edf60b965be903f205ec689b59c55229e0cb1dbf. Project: http://git-wip-us.apache.org/repos/asf/hbase-site/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase-site/commit/78d8c5d7 Tree: http://git-wip-us.apache.org/repos/asf/hbase-site/tree/78d8c5d7 Diff: http://git-wip-us.apache.org/repos/asf/hbase-site/diff/78d8c5d7 Branch: refs/heads/asf-site Commit: 78d8c5d7da311f7f07357ba62d91abb37f0fe543 Parents: 7b0c87c Author: jenkins Authored: Tue Jun 12 14:49:25 2018 + Committer: jenkins Committed: Tue Jun 12 14:49:25 2018 + -- acid-semantics.html | 4 +- apache_hbase_reference_guide.pdf| 13558 --- .../hadoop/hbase/snapshot/package-tree.html | 2 +- .../apache/hadoop/hbase/util/package-tree.html | 2 +- apidocs/overview-tree.html | 2 +- book.html |46 +- bulk-loads.html | 4 +- checkstyle-aggregate.html | 15252 - checkstyle.rss | 136 +- coc.html| 4 +- dependencies.html | 4 +- dependency-convergence.html | 4 +- dependency-info.html| 4 +- dependency-management.html | 4 +- devapidocs/allclasses-frame.html| 9 + devapidocs/allclasses-noframe.html | 9 + devapidocs/constant-values.html | 175 +- devapidocs/index-all.html | 244 +- .../hbase/backup/mapreduce/package-tree.html| 2 +- .../hadoop/hbase/backup/package-tree.html | 6 +- .../hadoop/hbase/client/package-tree.html |24 +- .../hbase/coprocessor/BulkLoadObserver.html |10 +- .../hadoop/hbase/filter/package-tree.html | 8 +- .../hadoop/hbase/io/hfile/package-tree.html | 4 +- .../apache/hadoop/hbase/ipc/package-tree.html | 4 +- .../hadoop/hbase/mapreduce/package-tree.html| 4 +- .../hbase/master/balancer/package-tree.html | 2 +- .../hadoop/hbase/master/package-tree.html | 4 +- .../hbase/master/procedure/package-tree.html| 4 +- .../hadoop/hbase/monitoring/package-tree.html | 2 +- .../org/apache/hadoop/hbase/package-tree.html |14 +- .../hadoop/hbase/procedure2/package-tree.html | 4 +- .../hadoop/hbase/quotas/package-tree.html |10 +- .../regionserver/MetricsRegionServerSource.html | 522 +- .../MetricsRegionServerSourceImpl.html |18 +- .../MetricsRegionServerWrapper.html | 254 +- ...Impl.RegionServerMetricsWrapperRunnable.html |38 +- .../MetricsRegionServerWrapperImpl.html | 436 +- .../hadoop/hbase/regionserver/package-tree.html |16 +- .../regionserver/querymatcher/package-tree.html | 4 +- .../hadoop/hbase/rest/model/package-tree.html | 2 +- .../access/ShadedAccessControlUtil.html |28 +- .../access/class-use/UserPermission.html| 6 + .../hbase/security/access/package-tree.html | 2 +- .../hadoop/hbase/security/package-tree.html | 2 +- .../hadoop/hbase/snapshot/package-tree.html | 2 +- ...iftHttpServlet.HttpKerberosServerAction.html |32 +- .../ThriftHttpServlet.RemoteUserIdentity.html | 8 +- .../hadoop/hbase/thrift/ThriftHttpServlet.html | 101 +- .../hadoop/hbase/thrift/ThriftServer.html |59 +- .../thrift/ThriftServerRunner.HBaseHandler.html |98 +- .../ThriftServerRunner.IOErrorWithCause.html|12 +- .../thrift/ThriftServerRunner.ImplType.html |45 +- ...ThriftServerRunner.ResultScannerWrapper.html |12 +- .../hadoop/hbase/thrift/ThriftServerRunner.html | 332 +- .../ThriftServerRunner.HBaseHandler.html| 2 +- .../hadoop/hbase/thrift/package-tree.html | 2 +- .../hadoop/hbase/tool/Canary.ZookeeperTask.html | 4 +- .../hbase/tool/DataBlockEncodingValidator.html | 440 + .../hbase/tool/LoadIncrementalHFiles.html | 4 +- .../hadoop/hbase/tool/PreUpgradeValidator.html | 172 +- .../class-use/DataBlockEncodingValidator.html | 125 + .../coprocessor/Branch1CoprocessorMethods.html | 285 + .../tool/coprocessor/CoprocessorMethod.html | 369 + .../tool/coprocessor/CoprocessorMethods.html| 386 + ...ocessorValidator.ResolverUrlClassLoader.html | 330 + .../tool/coprocessor/CoprocessorValidator.html | 594 + .../CoprocessorViolation.Severity.html | 346 + .../tool/coprocessor/CoprocessorViolation.html | 372 + .../coprocessor/CurrentCoprocessorMethods.html | 285 + .../class-use/Branch1CoprocessorMethods.html| 125 + .../class-use/CoprocessorMethod.html| 182 + .../class-use/CoprocessorMethods.html
[15/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html index 3f84557..e692633 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -118,826 +118,826 @@ 110import org.apache.thrift.TProcessor; 111import org.apache.thrift.protocol.TBinaryProtocol; 112import org.apache.thrift.protocol.TCompactProtocol; -113import org.apache.thrift.protocol.TProtocol; -114import org.apache.thrift.protocol.TProtocolFactory; -115import org.apache.thrift.server.THsHaServer; -116import org.apache.thrift.server.TNonblockingServer; -117import org.apache.thrift.server.TServer; -118import org.apache.thrift.server.TServlet; -119import org.apache.thrift.server.TThreadedSelectorServer; -120import org.apache.thrift.transport.TFramedTransport; -121import org.apache.thrift.transport.TNonblockingServerSocket; -122import org.apache.thrift.transport.TNonblockingServerTransport; -123import org.apache.thrift.transport.TSaslServerTransport; -124import org.apache.thrift.transport.TServerSocket; -125import org.apache.thrift.transport.TServerTransport; -126import org.apache.thrift.transport.TTransportFactory; -127import org.apache.yetus.audience.InterfaceAudience; -128import org.eclipse.jetty.http.HttpVersion; -129import org.eclipse.jetty.server.HttpConfiguration; -130import org.eclipse.jetty.server.HttpConnectionFactory; -131import org.eclipse.jetty.server.SecureRequestCustomizer; -132import org.eclipse.jetty.server.Server; -133import org.eclipse.jetty.server.ServerConnector; -134import org.eclipse.jetty.server.SslConnectionFactory; -135import org.eclipse.jetty.servlet.ServletContextHandler; -136import org.eclipse.jetty.servlet.ServletHolder; -137import org.eclipse.jetty.util.ssl.SslContextFactory; -138import org.eclipse.jetty.util.thread.QueuedThreadPool; -139import org.slf4j.Logger; -140import org.slf4j.LoggerFactory; -141import org.apache.hbase.thirdparty.com.google.common.base.Joiner; -142import org.apache.hbase.thirdparty.com.google.common.base.Splitter; -143import org.apache.hbase.thirdparty.com.google.common.base.Throwables; -144import org.apache.hbase.thirdparty.com.google.common.util.concurrent.ThreadFactoryBuilder; -145import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; -146import org.apache.hbase.thirdparty.org.apache.commons.cli.Option; -147import org.apache.hbase.thirdparty.org.apache.commons.cli.OptionGroup; -148 -149/** -150 * ThriftServerRunner - this class starts up a Thrift server which implements -151 * the Hbase API specified in the Hbase.thrift IDL file. -152 */ -153@InterfaceAudience.Private -154public class ThriftServerRunner implements Runnable { -155 -156 private static final Logger LOG = LoggerFactory.getLogger(ThriftServerRunner.class); -157 -158 private static final int DEFAULT_HTTP_MAX_HEADER_SIZE = 64 * 1024; // 64k -159 -160 static final String SERVER_TYPE_CONF_KEY = -161 "hbase.regionserver.thrift.server.type"; -162 -163 static final String BIND_CONF_KEY = "hbase.regionserver.thrift.ipaddress"; -164 static final String COMPACT_CONF_KEY = "hbase.regionserver.thrift.compact"; -165 static final String FRAMED_CONF_KEY = "hbase.regionserver.thrift.framed"; -166 static final String MAX_FRAME_SIZE_CONF_KEY = -167 "hbase.regionserver.thrift.framed.max_frame_size_in_mb"; -168 static final String PORT_CONF_KEY = "hbase.regionserver.thrift.port"; -169 static final String COALESCE_INC_KEY = "hbase.regionserver.thrift.coalesceIncrement"; -170 static final String USE_HTTP_CONF_KEY = "hbase.regionserver.thrift.http"; -171 static final String HTTP_MIN_THREADS = "hbase.thrift.http_threads.min"; -172 static final String HTTP_MAX_THREADS = "hbase.thrift.http_threads.max"; -173 -174 static final String THRIFT_SSL_ENABLED = "hbase.thrift.ssl.enabled"; -175 static final String THRIFT_SSL_KEYSTORE_STORE = "hbase.thrift.ssl.keystore.store"; -176 static final String THRIFT_SSL_KEYSTORE_PASSWORD = "hbase.thrift.ssl.keystore.password"; -177 static final String THRIFT_SSL_KEYSTORE_KEYPASSWORD = "hbase.thrift.ssl.keystore.keypassword"; -178 static final String THRIFT_SSL_EXCLUDE_CIPHER_SUITES = "hbase.thrift.ssl.exclude.cipher.suites"; -179 static final String THRIFT_SSL_INCLUDE_CIPHER_SUITES = "hbase.thrift.ssl.include.cipher.suites"; -180 static final String
[22/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.html b/devapidocs/src-html/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.html index fcf9979..b413e1d 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.html @@ -282,7 +282,18 @@ 274} 275return builder.build(); 276 } -277} +277 +278 /** +279 * Converts a user permission proto to a client user permission object. +280 * +281 * @param proto the protobuf UserPermission +282 * @return the converted UserPermission +283 */ +284 public static UserPermission toUserPermission(org.apache.hadoop.hbase.shaded.protobuf.generated.AccessControlProtos.UserPermission proto) { +285return new UserPermission(proto.getUser().toByteArray(), +286 toTablePermission(proto.getPermission())); +287 } +288} http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.HttpKerberosServerAction.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.HttpKerberosServerAction.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.HttpKerberosServerAction.html index b479b6b..c5277a9 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.HttpKerberosServerAction.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftHttpServlet.HttpKerberosServerAction.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -26,224 +26,252 @@ 018 019package org.apache.hadoop.hbase.thrift; 020 -021import java.io.IOException; -022import java.security.PrivilegedExceptionAction; +021import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_KEYTAB_FILE_KEY; +022import static org.apache.hadoop.hbase.thrift.ThriftServerRunner.THRIFT_SPNEGO_PRINCIPAL_KEY; 023 -024import javax.servlet.ServletException; -025import javax.servlet.http.HttpServletRequest; -026import javax.servlet.http.HttpServletResponse; -027 -028import org.apache.hadoop.conf.Configuration; -029import org.apache.hadoop.hbase.security.SecurityUtil; -030import org.apache.hadoop.hbase.util.Base64; -031import org.apache.hadoop.security.UserGroupInformation; -032import org.apache.hadoop.security.authorize.AuthorizationException; -033import org.apache.hadoop.security.authorize.ProxyUsers; -034import org.apache.thrift.TProcessor; -035import org.apache.thrift.protocol.TProtocolFactory; -036import org.apache.thrift.server.TServlet; -037import org.apache.yetus.audience.InterfaceAudience; -038import org.ietf.jgss.GSSContext; -039import org.ietf.jgss.GSSCredential; -040import org.ietf.jgss.GSSException; -041import org.ietf.jgss.GSSManager; -042import org.ietf.jgss.GSSName; -043import org.ietf.jgss.Oid; -044import org.slf4j.Logger; -045import org.slf4j.LoggerFactory; -046 -047/** -048 * Thrift Http Servlet is used for performing Kerberos authentication if security is enabled and -049 * also used for setting the user specified in "doAs" parameter. -050 */ -051@InterfaceAudience.Private -052public class ThriftHttpServlet extends TServlet { -053 private static final long serialVersionUID = 1L; -054 private static final Logger LOG = LoggerFactory.getLogger(ThriftHttpServlet.class.getName()); -055 private transient final UserGroupInformation realUser; -056 private transient final Configuration conf; -057 private final boolean securityEnabled; -058 private final boolean doAsEnabled; -059 private transient ThriftServerRunner.HBaseHandler hbaseHandler; -060 -061 // HTTP Header related constants. -062 public static final String WWW_AUTHENTICATE = "WWW-Authenticate"; -063 public static final String AUTHORIZATION = "Authorization"; -064 public static final String NEGOTIATE = "Negotiate"; -065 -066 public ThriftHttpServlet(TProcessor processor, TProtocolFactory protocolFactory, -067 UserGroupInformation realUser, Configuration conf, ThriftServerRunner.HBaseHandler -068 hbaseHandler, boolean securityEnabled, boolean doAsEnabled) { -069super(processor, protocolFactory); -070this.realUser = realUser; -071this.conf = conf; -072this.hbaseHandler = hbaseHandler; -073this.securityEnabled = securityEnabled; -074this.doAsEnabled = doAsEnabled; -075 } -076 -077 @Override -078 protected void
[26/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html index 5de82e7..2cdcb06 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.html @@ -264,301 +264,295 @@ 256 String READ_REQUEST_COUNT = "readRequestCount"; 257 String READ_REQUEST_COUNT_DESC = 258 "Number of read requests with non-empty Results that this RegionServer has answered."; -259 String READ_REQUEST_RATE_PER_SECOND = "readRequestRatePerSecond"; -260 String READ_REQUEST_RATE_DESC = -261 "Rate of answering the read requests by this region server per second."; -262 String FILTERED_READ_REQUEST_COUNT = "filteredReadRequestCount"; -263 String FILTERED_READ_REQUEST_COUNT_DESC = -264"Number of filtered read requests this RegionServer has answered."; -265 String WRITE_REQUEST_COUNT = "writeRequestCount"; -266 String WRITE_REQUEST_COUNT_DESC = -267 "Number of mutation requests this RegionServer has answered."; -268 String WRITE_REQUEST_RATE_PER_SECOND = "writeRequestRatePerSecond"; -269 String WRITE_REQUEST_RATE_DESC = -270 "Rate of answering the mutation requests by this region server per second."; -271 String CHECK_MUTATE_FAILED_COUNT = "checkMutateFailedCount"; -272 String CHECK_MUTATE_FAILED_COUNT_DESC = -273 "Number of Check and Mutate calls that failed the checks."; -274 String CHECK_MUTATE_PASSED_COUNT = "checkMutatePassedCount"; -275 String CHECK_MUTATE_PASSED_COUNT_DESC = -276 "Number of Check and Mutate calls that passed the checks."; -277 String STOREFILE_INDEX_SIZE = "storeFileIndexSize"; -278 String STOREFILE_INDEX_SIZE_DESC = "Size of indexes in storefiles on disk."; -279 String STATIC_INDEX_SIZE = "staticIndexSize"; -280 String STATIC_INDEX_SIZE_DESC = "Uncompressed size of the static indexes."; -281 String STATIC_BLOOM_SIZE = "staticBloomSize"; -282 String STATIC_BLOOM_SIZE_DESC = -283 "Uncompressed size of the static bloom filters."; -284 String NUMBER_OF_MUTATIONS_WITHOUT_WAL = "mutationsWithoutWALCount"; -285 String NUMBER_OF_MUTATIONS_WITHOUT_WAL_DESC = -286 "Number of mutations that have been sent by clients with the write ahead logging turned off."; -287 String DATA_SIZE_WITHOUT_WAL = "mutationsWithoutWALSize"; -288 String DATA_SIZE_WITHOUT_WAL_DESC = -289 "Size of data that has been sent by clients with the write ahead logging turned off."; -290 String PERCENT_FILES_LOCAL = "percentFilesLocal"; -291 String PERCENT_FILES_LOCAL_DESC = -292 "The percent of HFiles that are stored on the local hdfs data node."; -293 String PERCENT_FILES_LOCAL_SECONDARY_REGIONS = "percentFilesLocalSecondaryRegions"; -294 String PERCENT_FILES_LOCAL_SECONDARY_REGIONS_DESC = -295"The percent of HFiles used by secondary regions that are stored on the local hdfs data node."; -296 String SPLIT_QUEUE_LENGTH = "splitQueueLength"; -297 String SPLIT_QUEUE_LENGTH_DESC = "Length of the queue for splits."; -298 String COMPACTION_QUEUE_LENGTH = "compactionQueueLength"; -299 String LARGE_COMPACTION_QUEUE_LENGTH = "largeCompactionQueueLength"; -300 String SMALL_COMPACTION_QUEUE_LENGTH = "smallCompactionQueueLength"; -301 String COMPACTION_QUEUE_LENGTH_DESC = "Length of the queue for compactions."; -302 String LARGE_COMPACTION_QUEUE_LENGTH_DESC = "Length of the queue for compactions with input size " -303 + "larger than throttle threshold (2.5GB by default)"; -304 String SMALL_COMPACTION_QUEUE_LENGTH_DESC = "Length of the queue for compactions with input size " -305 + "smaller than throttle threshold (2.5GB by default)"; -306 String FLUSH_QUEUE_LENGTH = "flushQueueLength"; -307 String FLUSH_QUEUE_LENGTH_DESC = "Length of the queue for region flushes"; -308 String BLOCK_CACHE_FREE_SIZE = "blockCacheFreeSize"; -309 String BLOCK_CACHE_FREE_DESC = -310 "Size of the block cache that is not occupied."; -311 String BLOCK_CACHE_COUNT = "blockCacheCount"; -312 String BLOCK_CACHE_COUNT_DESC = "Number of block in the block cache."; -313 String BLOCK_CACHE_SIZE = "blockCacheSize"; -314 String BLOCK_CACHE_SIZE_DESC = "Size of the block cache."; -315 String BLOCK_CACHE_HIT_COUNT = "blockCacheHitCount"; -316 String BLOCK_CACHE_HIT_COUNT_DESC = "Count of the hit on the block cache."; -317 String BLOCK_CACHE_PRIMARY_HIT_COUNT = "blockCacheHitCountPrimary"; -318 String BLOCK_CACHE_PRIMARY_HIT_COUNT_DESC = "Count of hit on primary replica in the block cache."; -319 String BLOCK_CACHE_MISS_COUNT =
[09/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/index-all.html -- diff --git a/testdevapidocs/index-all.html b/testdevapidocs/index-all.html index cf4e92e..3f0d06c 100644 --- a/testdevapidocs/index-all.html +++ b/testdevapidocs/index-all.html @@ -829,6 +829,8 @@ addRSGroup(String) - Method in class org.apache.hadoop.hbase.rsgroup.VerifyingRSGroupAdminClient +addSecurityConfigurations(Configuration) - Static method in class org.apache.hadoop.hbase.thrift.TestThriftSpnegoHttpServer + addStackId(int) - Method in class org.apache.hadoop.hbase.procedure2.ProcedureTestingUtility.TestProcedure addStartEndKeysForTest(TreeMapbyte[], Integer, byte[], byte[]) - Method in class org.apache.hadoop.hbase.tool.TestLoadIncrementalHFiles @@ -2872,6 +2874,8 @@ buildMiniKdc() - Static method in class org.apache.hadoop.hbase.http.TestSpnegoHttpServer +buildMiniKdc() - Static method in class org.apache.hadoop.hbase.thrift.TestThriftSpnegoHttpServer + buildMultiResponse(ClientProtos.MultiRequest) - Static method in class org.apache.hadoop.hbase.master.assignment.MockMasterServices buildNewCoordinator() - Method in class org.apache.hadoop.hbase.procedure.TestProcedureCoordinator @@ -6191,12 +6195,16 @@ CLASS_RULE - Static variable in class org.apache.hadoop.hbase.thrift.TestThriftServerCmdLine +CLASS_RULE - Static variable in class org.apache.hadoop.hbase.thrift.TestThriftSpnegoHttpServer + CLASS_RULE - Static variable in class org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandler CLASS_RULE - Static variable in class org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandlerWithLabels CLASS_RULE - Static variable in class org.apache.hadoop.hbase.thrift2.TestThriftHBaseServiceHandlerWithReadOnly +CLASS_RULE - Static variable in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidatorTest + CLASS_RULE - Static variable in class org.apache.hadoop.hbase.tool.TestCanaryTool CLASS_RULE - Static variable in class org.apache.hadoop.hbase.tool.TestLoadIncrementalHFiles @@ -6753,6 +6761,10 @@ clientKeytab - Static variable in class org.apache.hadoop.hbase.http.TestSpnegoHttpServer +clientKeytab - Static variable in class org.apache.hadoop.hbase.thrift.TestThriftSpnegoHttpServer + +clientPrincipal - Static variable in class org.apache.hadoop.hbase.thrift.TestThriftSpnegoHttpServer + clients - Variable in class org.apache.hadoop.hbase.rest.PerformanceEvaluation.PeInputSplit ClientSideCellSetModel() - Constructor for class org.apache.hadoop.hbase.rest.TestTableScan.ClientSideCellSetModel @@ -8648,6 +8660,20 @@ Tag a test as related to coprocessors. +CoprocessorValidatorTest - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorValidatorTest() - Constructor for class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidatorTest + +CoprocessorValidatorTest.MissingClass - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorValidatorTest.MissingClassClassLoader - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorValidatorTest.MissingClassObserver - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorValidatorTest.ObsoleteMethodObserver - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorValidatorTest.TestObserver - Class in org.apache.hadoop.hbase.tool.coprocessor + COPYRIGHT - Static variable in class org.apache.hadoop.hbase.security.visibility.TestVisibilityLabels COPYRIGHT - Static variable in class org.apache.hadoop.hbase.security.visibility.TestVisibilityLabelsReplication @@ -9431,6 +9457,8 @@ createHtd(boolean) - Method in class org.apache.hadoop.hbase.StripeCompactionsPerformanceEvaluation +createHttpClient() - Method in class org.apache.hadoop.hbase.thrift.TestThriftSpnegoHttpServer + createIOEScannerTable(byte[], int) - Static method in class org.apache.hadoop.hbase.mapred.TestTableInputFormat Create a table that IOE's on first scanner next call @@ -15508,6 +15536,8 @@ getCipherName(Configuration, String) - Method in class org.apache.hadoop.hbase.HFilePerformanceEvaluation +getClassLoader() - Static method in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidatorTest + getClasspathDir(Class?) - Static method in class org.apache.hadoop.hbase.http.ssl.KeyStoreTestUtil getClazz() - Method in class org.apache.hadoop.hbase.HBaseClassTestRule @@ -16312,6 +16342,8 @@ Do a small get/scan against one store. +getFullClassName(String) - Static method in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidatorTest + getGaugeDouble(String, BaseSource) - Method in interface org.apache.hadoop.hbase.test.MetricsAssertHelper Get the value of a gauge as a double. @@ -17442,8 +17474,6 @@ getReadRequestsCount(String) - Method in class org.apache.hadoop.hbase.regionserver.TestMetricsTableSourceImpl.TableWrapperStub
[02/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html -- diff --git a/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html b/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html new file mode 100644 index 000..7896c2f --- /dev/null +++ b/testdevapidocs/src-html/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidatorTest.MissingClassClassLoader.html @@ -0,0 +1,249 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + +Source code + + + + +001/** +002 * Licensed to the Apache Software Foundation (ASF) under one +003 * or more contributor license agreements. See the NOTICE file +004 * distributed with this work for additional information +005 * regarding copyright ownership. The ASF licenses this file +006 * to you under the Apache License, Version 2.0 (the +007 * "License"); you may not use this file except in compliance +008 * with the License. You may obtain a copy of the License at +009 * +010 * http://www.apache.org/licenses/LICENSE-2.0 +011 * +012 * Unless required by applicable law or agreed to in writing, software +013 * distributed under the License is distributed on an "AS IS" BASIS, +014 * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. +015 * See the License for the specific language governing permissions and +016 * limitations under the License. +017 */ +018 +019package org.apache.hadoop.hbase.tool.coprocessor; +020 +021import static org.junit.Assert.assertEquals; +022import static org.junit.Assert.assertTrue; +023 +024import java.io.IOException; +025import java.util.List; +026 +027import org.apache.hadoop.hbase.Coprocessor; +028import org.apache.hadoop.hbase.CoprocessorEnvironment; +029import org.apache.hadoop.hbase.HBaseClassTestRule; +030import org.apache.hadoop.hbase.HRegionInfo; +031import org.apache.hadoop.hbase.HTableDescriptor; +032import org.apache.hadoop.hbase.coprocessor.MasterCoprocessorEnvironment; +033import org.apache.hadoop.hbase.coprocessor.ObserverContext; +034import org.apache.hadoop.hbase.testclassification.SmallTests; +035import org.apache.hadoop.hbase.tool.coprocessor.CoprocessorViolation.Severity; +036import org.junit.ClassRule; +037import org.junit.Test; +038import org.junit.experimental.categories.Category; +039 +040import org.apache.hbase.thirdparty.com.google.common.collect.Lists; +041 +042@Category({ SmallTests.class }) +043@SuppressWarnings("deprecation") +044public class CoprocessorValidatorTest { +045 @ClassRule +046 public static final HBaseClassTestRule CLASS_RULE = +047 HBaseClassTestRule.forClass(CoprocessorValidatorTest.class); +048 +049 private CoprocessorValidator validator; +050 +051 public CoprocessorValidatorTest() { +052validator = new CoprocessorValidator(); +053 } +054 +055 private static ClassLoader getClassLoader() { +056return CoprocessorValidatorTest.class.getClassLoader(); +057 } +058 +059 private static String getFullClassName(String className) { +060return CoprocessorValidatorTest.class.getName() + "$" + className; +061 } +062 +063 @SuppressWarnings({"rawtypes", "unused"}) +064 private static class TestObserver implements Coprocessor { +065@Override +066public void start(CoprocessorEnvironment env) throws IOException { +067} +068 +069@Override +070public void stop(CoprocessorEnvironment env) throws IOException { +071} +072 } +073 +074 @Test +075 public void testFilterObservers() throws Exception { +076String filterObservers = getFullClassName("TestObserver"); +077ListString classNames = Lists.newArrayList( +078filterObservers, getClass().getName()); +079ListString filteredClassNames = validator.filterObservers(getClassLoader(), classNames); +080 +081assertEquals(1, filteredClassNames.size()); +082assertEquals(filterObservers, filteredClassNames.get(0)); +083 } +084 +085 private ListCoprocessorViolation validate(String className) { +086ClassLoader classLoader = getClass().getClassLoader(); +087return validate(classLoader, className); +088 } +089 +090 private ListCoprocessorViolation validate(ClassLoader classLoader, String className) { +091ListString classNames = Lists.newArrayList(getClass().getName() + "$" + className); +092return validator.validate(classLoader, classNames); +093 } +094 +095 /* +096 * In this test case, we are try to load a not-existent class. +097 */ +098 @Test +099 public void testNoSuchClass() throws IOException { +100ListCoprocessorViolation violations = validate("NoSuchClass"); +101assertEquals(1, violations.size()); +102 +103CoprocessorViolation violation = violations.get(0); +104
[17/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ImplType.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ImplType.html b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ImplType.html index 3f84557..e692633 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ImplType.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/thrift/ThriftServerRunner.ImplType.html @@ -6,7 +6,7 @@ -001/** +001/* 002 * Licensed to the Apache Software Foundation (ASF) under one 003 * or more contributor license agreements. See the NOTICE file 004 * distributed with this work for additional information @@ -118,826 +118,826 @@ 110import org.apache.thrift.TProcessor; 111import org.apache.thrift.protocol.TBinaryProtocol; 112import org.apache.thrift.protocol.TCompactProtocol; -113import org.apache.thrift.protocol.TProtocol; -114import org.apache.thrift.protocol.TProtocolFactory; -115import org.apache.thrift.server.THsHaServer; -116import org.apache.thrift.server.TNonblockingServer; -117import org.apache.thrift.server.TServer; -118import org.apache.thrift.server.TServlet; -119import org.apache.thrift.server.TThreadedSelectorServer; -120import org.apache.thrift.transport.TFramedTransport; -121import org.apache.thrift.transport.TNonblockingServerSocket; -122import org.apache.thrift.transport.TNonblockingServerTransport; -123import org.apache.thrift.transport.TSaslServerTransport; -124import org.apache.thrift.transport.TServerSocket; -125import org.apache.thrift.transport.TServerTransport; -126import org.apache.thrift.transport.TTransportFactory; -127import org.apache.yetus.audience.InterfaceAudience; -128import org.eclipse.jetty.http.HttpVersion; -129import org.eclipse.jetty.server.HttpConfiguration; -130import org.eclipse.jetty.server.HttpConnectionFactory; -131import org.eclipse.jetty.server.SecureRequestCustomizer; -132import org.eclipse.jetty.server.Server; -133import org.eclipse.jetty.server.ServerConnector; -134import org.eclipse.jetty.server.SslConnectionFactory; -135import org.eclipse.jetty.servlet.ServletContextHandler; -136import org.eclipse.jetty.servlet.ServletHolder; -137import org.eclipse.jetty.util.ssl.SslContextFactory; -138import org.eclipse.jetty.util.thread.QueuedThreadPool; -139import org.slf4j.Logger; -140import org.slf4j.LoggerFactory; -141import org.apache.hbase.thirdparty.com.google.common.base.Joiner; -142import org.apache.hbase.thirdparty.com.google.common.base.Splitter; -143import org.apache.hbase.thirdparty.com.google.common.base.Throwables; -144import org.apache.hbase.thirdparty.com.google.common.util.concurrent.ThreadFactoryBuilder; -145import org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLine; -146import org.apache.hbase.thirdparty.org.apache.commons.cli.Option; -147import org.apache.hbase.thirdparty.org.apache.commons.cli.OptionGroup; -148 -149/** -150 * ThriftServerRunner - this class starts up a Thrift server which implements -151 * the Hbase API specified in the Hbase.thrift IDL file. -152 */ -153@InterfaceAudience.Private -154public class ThriftServerRunner implements Runnable { -155 -156 private static final Logger LOG = LoggerFactory.getLogger(ThriftServerRunner.class); -157 -158 private static final int DEFAULT_HTTP_MAX_HEADER_SIZE = 64 * 1024; // 64k -159 -160 static final String SERVER_TYPE_CONF_KEY = -161 "hbase.regionserver.thrift.server.type"; -162 -163 static final String BIND_CONF_KEY = "hbase.regionserver.thrift.ipaddress"; -164 static final String COMPACT_CONF_KEY = "hbase.regionserver.thrift.compact"; -165 static final String FRAMED_CONF_KEY = "hbase.regionserver.thrift.framed"; -166 static final String MAX_FRAME_SIZE_CONF_KEY = -167 "hbase.regionserver.thrift.framed.max_frame_size_in_mb"; -168 static final String PORT_CONF_KEY = "hbase.regionserver.thrift.port"; -169 static final String COALESCE_INC_KEY = "hbase.regionserver.thrift.coalesceIncrement"; -170 static final String USE_HTTP_CONF_KEY = "hbase.regionserver.thrift.http"; -171 static final String HTTP_MIN_THREADS = "hbase.thrift.http_threads.min"; -172 static final String HTTP_MAX_THREADS = "hbase.thrift.http_threads.max"; -173 -174 static final String THRIFT_SSL_ENABLED = "hbase.thrift.ssl.enabled"; -175 static final String THRIFT_SSL_KEYSTORE_STORE = "hbase.thrift.ssl.keystore.store"; -176 static final String THRIFT_SSL_KEYSTORE_PASSWORD = "hbase.thrift.ssl.keystore.password"; -177 static final String THRIFT_SSL_KEYSTORE_KEYPASSWORD = "hbase.thrift.ssl.keystore.keypassword"; -178 static final String THRIFT_SSL_EXCLUDE_CIPHER_SUITES = "hbase.thrift.ssl.exclude.cipher.suites"; -179 static final String THRIFT_SSL_INCLUDE_CIPHER_SUITES =
[04/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-use.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-use.html b/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-use.html new file mode 100644 index 000..4d0c8b0 --- /dev/null +++ b/testdevapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-use.html @@ -0,0 +1,158 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +Uses of Package org.apache.hadoop.hbase.tool.coprocessor (Apache HBase 3.0.0-SNAPSHOT Test API) + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Uses of Packageorg.apache.hadoop.hbase.tool.coprocessor + + + + + +Packages that use org.apache.hadoop.hbase.tool.coprocessor + +Package +Description + + + +org.apache.hadoop.hbase.tool.coprocessor + + + + + + + + + +Classes in org.apache.hadoop.hbase.tool.coprocessor used by org.apache.hadoop.hbase.tool.coprocessor + +Class and Description + + + +CoprocessorValidatorTest.MissingClass + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 20072018 https://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/tool/package-summary.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/tool/package-summary.html b/testdevapidocs/org/apache/hadoop/hbase/tool/package-summary.html index 6785597..b28e163 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/tool/package-summary.html +++ b/testdevapidocs/org/apache/hadoop/hbase/tool/package-summary.html @@ -44,7 +44,7 @@ PrevPackage -NextPackage +NextPackage Frames @@ -152,7 +152,7 @@ PrevPackage -NextPackage +NextPackage Frames http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/tool/package-tree.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/tool/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/tool/package-tree.html index 51434fc..7468c9f 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/tool/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/tool/package-tree.html @@ -44,7 +44,7 @@ Prev -Next +Next Frames @@ -124,7 +124,7 @@ Prev -Next +Next Frames http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/trace/package-summary.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/trace/package-summary.html b/testdevapidocs/org/apache/hadoop/hbase/trace/package-summary.html index 9cb168f..caba235 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/trace/package-summary.html +++ b/testdevapidocs/org/apache/hadoop/hbase/trace/package-summary.html @@ -43,7 +43,7 @@ -PrevPackage +PrevPackage NextPackage @@ -130,7 +130,7 @@ -PrevPackage +PrevPackage NextPackage http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/testdevapidocs/org/apache/hadoop/hbase/trace/package-tree.html -- diff --git a/testdevapidocs/org/apache/hadoop/hbase/trace/package-tree.html b/testdevapidocs/org/apache/hadoop/hbase/trace/package-tree.html index 15b2eb4..cdb6c12 100644 --- a/testdevapidocs/org/apache/hadoop/hbase/trace/package-tree.html +++ b/testdevapidocs/org/apache/hadoop/hbase/trace/package-tree.html @@ -43,7 +43,7 @@ -Prev +Prev Next @@ -81,7 +81,7 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object -org.apache.hadoop.hbase.util.AbstractHBaseTool
[43/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/checkstyle-aggregate.html -- diff --git a/checkstyle-aggregate.html b/checkstyle-aggregate.html index 31b13ca..24ebb3a 100644 --- a/checkstyle-aggregate.html +++ b/checkstyle-aggregate.html @@ -7,7 +7,7 @@ - + Apache HBase Checkstyle Results @@ -281,10 +281,10 @@ Warnings Errors -3631 +3640 0 0 -16202 +16197 Files @@ -2277,7 +2277,7 @@ org/apache/hadoop/hbase/coprocessor/BulkLoadObserver.java 0 0 -9 +4 org/apache/hadoop/hbase/coprocessor/ColumnAggregationEndpoint.java 0 @@ -8522,7 +8522,7 @@ org/apache/hadoop/hbase/security/access/ShadedAccessControlUtil.java 0 0 -48 +49 org/apache/hadoop/hbase/security/access/TableAuthManager.java 0 @@ -9004,986 +9004,981 @@ 0 3 -org/apache/hadoop/hbase/thrift/ThriftServerRunner.java -0 -0 -1 - org/apache/hadoop/hbase/thrift2/DemoClient.java 0 0 3 - + org/apache/hadoop/hbase/thrift2/ThriftServer.java 0 0 1 - + org/apache/hadoop/hbase/tool/Canary.java 0 0 44 - + org/apache/hadoop/hbase/tool/LoadIncrementalHFiles.java 0 0 7 - + org/apache/hadoop/hbase/tool/MapreduceTestingShim.java 0 0 1 - + org/apache/hadoop/hbase/tool/TestCanaryTool.java 0 0 5 - + org/apache/hadoop/hbase/tool/TestLoadIncrementalHFiles.java 0 0 8 - + org/apache/hadoop/hbase/tool/TestLoadIncrementalHFilesSplitRecovery.java 0 0 7 - + org/apache/hadoop/hbase/trace/IntegrationTestSendTraceRequests.java 0 0 7 - + org/apache/hadoop/hbase/trace/SpanReceiverHost.java 0 0 1 - + org/apache/hadoop/hbase/trace/TraceTree.java 0 0 9 - + org/apache/hadoop/hbase/trace/TraceUtil.java 0 0 1 - + org/apache/hadoop/hbase/types/TestCopyOnWriteMaps.java 0 0 11 - + org/apache/hadoop/hbase/types/TestOrderedBlob.java 0 0 1 - + org/apache/hadoop/hbase/types/TestOrderedString.java 0 0 2 - + org/apache/hadoop/hbase/types/TestStruct.java 0 0 21 - + org/apache/hadoop/hbase/types/TestTerminatedWrapper.java 0 0 2 - + org/apache/hadoop/hbase/types/TestUnion2.java 0 0 3 - + org/apache/hadoop/hbase/util/AbstractByteRange.java 0 0 4 - + org/apache/hadoop/hbase/util/AbstractFileStatusFilter.java 0 0 3 - + org/apache/hadoop/hbase/util/AbstractHBaseTool.java 0 0 1 - + org/apache/hadoop/hbase/util/AbstractPositionedByteRange.java 0 0 2 - + org/apache/hadoop/hbase/util/Addressing.java 0 0 5 - + org/apache/hadoop/hbase/util/AtomicUtils.java 0 0 1 - + org/apache/hadoop/hbase/util/AvlUtil.java 0 0 9 - + org/apache/hadoop/hbase/util/Base64.java 0 0 28 - + org/apache/hadoop/hbase/util/BaseTestHBaseFsck.java 0 0 12 - + org/apache/hadoop/hbase/util/BloomContext.java 0 0 5 - + org/apache/hadoop/hbase/util/BloomFilter.java 0 0 1 - + org/apache/hadoop/hbase/util/BloomFilterChunk.java 0 0 2 - + org/apache/hadoop/hbase/util/BloomFilterFactory.java 0 0 7 - + org/apache/hadoop/hbase/util/BloomFilterUtil.java 0 0 16 - + org/apache/hadoop/hbase/util/BloomFilterWriter.java 0 0 1 - + org/apache/hadoop/hbase/util/BoundedPriorityBlockingQueue.java 0 0 11 - + org/apache/hadoop/hbase/util/BuilderStyleTest.java 0 0 2 - + org/apache/hadoop/hbase/util/ByteBufferArray.java 0 0 6 - + org/apache/hadoop/hbase/util/ByteBufferUtils.java 0 0 45 - + org/apache/hadoop/hbase/util/ByteRangeUtils.java 0 0 1 - + org/apache/hadoop/hbase/util/Bytes.java 0 0 89 - + org/apache/hadoop/hbase/util/ChecksumType.java 0 0 2 - + org/apache/hadoop/hbase/util/ClassLoaderTestHelper.java 0 0 7 - + org/apache/hadoop/hbase/util/ClassSize.java 0 0 14 - + org/apache/hadoop/hbase/util/Classes.java 0 0 1 - + org/apache/hadoop/hbase/util/CollectionBackedScanner.java 0 0 1 - + org/apache/hadoop/hbase/util/CollectionUtils.java 0 0 4 - + org/apache/hadoop/hbase/util/CommonFSUtils.java 0 0 3 - + org/apache/hadoop/hbase/util/CompressionTest.java 0 0 6 - + org/apache/hadoop/hbase/util/ConcatenatedLists.java 0 0 1 - + org/apache/hadoop/hbase/util/ConfigurationUtil.java 0 0 3 - + org/apache/hadoop/hbase/util/ConnectionCache.java 0 0 4 - + org/apache/hadoop/hbase/util/ConstantDelayQueue.java 0 0 1 - + org/apache/hadoop/hbase/util/CoprocessorClassLoader.java 0 0 11 - + org/apache/hadoop/hbase/util/Counter.java 0 0 2 - + org/apache/hadoop/hbase/util/DirectMemoryUtils.java 0 0 2 - + org/apache/hadoop/hbase/util/DynamicClassLoader.java 0 0 26 - + org/apache/hadoop/hbase/util/EncryptionTest.java 0 0 10 - + org/apache/hadoop/hbase/util/EnvironmentEdgeManager.java 0 0 1 - + org/apache/hadoop/hbase/util/EnvironmentEdgeManagerTestHelper.java 0 0 1 - + org/apache/hadoop/hbase/util/ExceptionUtil.java 0 0 6 - + org/apache/hadoop/hbase/util/FSHDFSUtils.java 0 0 24 - + org/apache/hadoop/hbase/util/FSRegionScanner.java 0 0 2 - + org/apache/hadoop/hbase/util/FSTableDescriptors.java 0 0
[28/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-summary.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-summary.html b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-summary.html new file mode 100644 index 000..e3d88b3 --- /dev/null +++ b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-summary.html @@ -0,0 +1,185 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +org.apache.hadoop.hbase.tool.coprocessor (Apache HBase 3.0.0-SNAPSHOT API) + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevPackage +NextPackage + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Packageorg.apache.hadoop.hbase.tool.coprocessor + + + + + +Class Summary + +Class +Description + + + +Branch1CoprocessorMethods + + + +CoprocessorMethod + + + +CoprocessorMethods + + + +CoprocessorValidator + + + +CoprocessorValidator.ResolverUrlClassLoader + +This classloader implementation calls https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#resolveClass-java.lang.Class-; title="class or interface in java.lang">ClassLoader.resolveClass(Class) + method for every loaded class. + + + +CoprocessorViolation + + + +CurrentCoprocessorMethods + + + + + + + +Enum Summary + +Enum +Description + + + +CoprocessorViolation.Severity + + + + + + + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevPackage +NextPackage + + +Frames +NoFrames + + +AllClasses + + + + + + + + + +Copyright 20072018 https://www.apache.org/;>The Apache Software Foundation. All rights reserved. + + http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-tree.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-tree.html b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-tree.html new file mode 100644 index 000..020689d --- /dev/null +++ b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/package-tree.html @@ -0,0 +1,175 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +org.apache.hadoop.hbase.tool.coprocessor Class Hierarchy (Apache HBase 3.0.0-SNAPSHOT API) + + + + + + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +Prev +Next + + +Frames +NoFrames + + +AllClasses + + + + + + + + + + +Hierarchy For Package org.apache.hadoop.hbase.tool.coprocessor +Package Hierarchies: + +All Packages + + + +Class Hierarchy + +java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object + +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) + +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator + + +java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true; title="class or interface in java.lang">ClassLoader + +java.security.https://docs.oracle.com/javase/8/docs/api/java/security/SecureClassLoader.html?is-external=true; title="class or interface in java.security">SecureClassLoader + +java.net.https://docs.oracle.com/javase/8/docs/api/java/net/URLClassLoader.html?is-external=true; title="class or interface in java.net">URLClassLoader (implements java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Closeable.html?is-external=true; title="class or interface in java.io">Closeable) +
[40/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/backup/mapreduce/package-tree.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/backup/mapreduce/package-tree.html b/devapidocs/org/apache/hadoop/hbase/backup/mapreduce/package-tree.html index 590a972..d7bea31 100644 --- a/devapidocs/org/apache/hadoop/hbase/backup/mapreduce/package-tree.html +++ b/devapidocs/org/apache/hadoop/hbase/backup/mapreduce/package-tree.html @@ -81,7 +81,7 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.snapshot.ExportSnapshot (implements org.apache.hadoop.util.Tool) http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/backup/package-tree.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/backup/package-tree.html b/devapidocs/org/apache/hadoop/hbase/backup/package-tree.html index b385d9a..f55f5e6 100644 --- a/devapidocs/org/apache/hadoop/hbase/backup/package-tree.html +++ b/devapidocs/org/apache/hadoop/hbase/backup/package-tree.html @@ -81,7 +81,7 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object -org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool) +org.apache.hadoop.hbase.util.AbstractHBaseTool (implements org.apache.hadoop.util.Tool) org.apache.hadoop.hbase.backup.BackupDriver org.apache.hadoop.hbase.backup.RestoreDriver @@ -167,10 +167,10 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) -org.apache.hadoop.hbase.backup.BackupType +org.apache.hadoop.hbase.backup.BackupInfo.BackupState org.apache.hadoop.hbase.backup.BackupInfo.BackupPhase +org.apache.hadoop.hbase.backup.BackupType org.apache.hadoop.hbase.backup.BackupRestoreConstants.BackupCommand -org.apache.hadoop.hbase.backup.BackupInfo.BackupState http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/client/package-tree.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/client/package-tree.html b/devapidocs/org/apache/hadoop/hbase/client/package-tree.html index ab86874..d98bc65 100644 --- a/devapidocs/org/apache/hadoop/hbase/client/package-tree.html +++ b/devapidocs/org/apache/hadoop/hbase/client/package-tree.html @@ -552,24 +552,24 @@ java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Enum.html?is-external=true; title="class or interface in java.lang">EnumE (implements java.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Comparable.html?is-external=true; title="class or interface in java.lang">ComparableT, java.io.https://docs.oracle.com/javase/8/docs/api/java/io/Serializable.html?is-external=true; title="class or interface in java.io">Serializable) -org.apache.hadoop.hbase.client.TableState.State -org.apache.hadoop.hbase.client.MasterSwitchType -org.apache.hadoop.hbase.client.IsolationLevel org.apache.hadoop.hbase.client.AsyncScanSingleRegionRpcRetryingCaller.ScanControllerState +org.apache.hadoop.hbase.client.AsyncProcessTask.SubmittedRows org.apache.hadoop.hbase.client.CompactionState -org.apache.hadoop.hbase.client.SnapshotType -org.apache.hadoop.hbase.client.RequestController.ReturnCode -org.apache.hadoop.hbase.client.ScannerCallable.MoreResults +org.apache.hadoop.hbase.client.IsolationLevel +org.apache.hadoop.hbase.client.MasterSwitchType org.apache.hadoop.hbase.client.AsyncRequestFutureImpl.Retry -org.apache.hadoop.hbase.client.Scan.ReadType -org.apache.hadoop.hbase.client.AsyncProcessTask.SubmittedRows -org.apache.hadoop.hbase.client.MobCompactPartitionPolicy org.apache.hadoop.hbase.client.AsyncScanSingleRegionRpcRetryingCaller.ScanResumerState -org.apache.hadoop.hbase.client.RegionLocateType org.apache.hadoop.hbase.client.Consistency -org.apache.hadoop.hbase.client.CompactType -org.apache.hadoop.hbase.client.AbstractResponse.ResponseType org.apache.hadoop.hbase.client.Durability +org.apache.hadoop.hbase.client.RegionLocateType
[41/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/index-all.html -- diff --git a/devapidocs/index-all.html b/devapidocs/index-all.html index 7574121..5194e2b 100644 --- a/devapidocs/index-all.html +++ b/devapidocs/index-all.html @@ -1938,6 +1938,16 @@ Add Dropwizard-Metrics rate information to a Hadoop-Metrics2 record builder, converting the rates to the appropriate unit. +addMethod(String, String...) - Method in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods + +addMethod(String, Class?...) - Method in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods + +addMethod(Method) - Method in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods + +addMethods() - Method in class org.apache.hadoop.hbase.tool.coprocessor.Branch1CoprocessorMethods + +addMethods(Class?) - Method in class org.apache.hadoop.hbase.tool.coprocessor.CurrentCoprocessorMethods + addMobRegion(RegionInfo) - Method in class org.apache.hadoop.hbase.snapshot.SnapshotManifest addMobRegion(RegionInfo, SnapshotManifest.RegionVisitor) - Method in class org.apache.hadoop.hbase.snapshot.SnapshotManifest @@ -1999,7 +2009,9 @@ addOptions() - Method in class org.apache.hadoop.hbase.snapshot.SnapshotInfo -addOptions() - Method in class org.apache.hadoop.hbase.tool.PreUpgradeValidator +addOptions() - Method in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator + +addOptions() - Method in class org.apache.hadoop.hbase.tool.DataBlockEncodingValidator addOptions() - Method in class org.apache.hadoop.hbase.util.AbstractHBaseTool @@ -3566,6 +3578,8 @@ Args(TServerTransport, Configuration) - Constructor for class org.apache.hadoop.hbase.thrift.TBoundedThreadPoolServer.Args +args - Variable in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator + argumentToClassMap - Variable in class org.apache.hadoop.hbase.regionserver.AnnotationReadingPriorityFunction array() - Method in class org.apache.hadoop.hbase.nio.ByteBuff @@ -4410,8 +4424,6 @@ AuthMethod(byte, String, UserGroupInformation.AuthenticationMethod) - Constructor for enum org.apache.hadoop.hbase.security.AuthMethod -AUTHORIZATION - Static variable in class org.apache.hadoop.hbase.thrift.ThriftHttpServlet - AUTHORIZATION_FAILURES_DESC - Static variable in interface org.apache.hadoop.hbase.ipc.MetricsHBaseServerSource AUTHORIZATION_FAILURES_NAME - Static variable in interface org.apache.hadoop.hbase.ipc.MetricsHBaseServerSource @@ -6677,6 +6689,12 @@ BoundedPriorityBlockingQueue.PriorityQueueE - Class in org.apache.hadoop.hbase.util +branch1 - Variable in class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator + +Branch1CoprocessorMethods - Class in org.apache.hadoop.hbase.tool.coprocessor + +Branch1CoprocessorMethods() - Constructor for class org.apache.hadoop.hbase.tool.coprocessor.Branch1CoprocessorMethods + breakLines - Variable in class org.apache.hadoop.hbase.util.Base64.Base64InputStream breakLines - Variable in class org.apache.hadoop.hbase.util.Base64.Base64OutputStream @@ -16273,8 +16291,6 @@ conf - Variable in class org.apache.hadoop.hbase.snapshot.SnapshotManifestV2.ManifestBuilder -conf - Variable in class org.apache.hadoop.hbase.thrift.ThriftHttpServlet - conf - Variable in class org.apache.hadoop.hbase.thrift.ThriftServer conf - Variable in class org.apache.hadoop.hbase.thrift.ThriftServerRunner @@ -16405,6 +16421,8 @@ configuration - Variable in class org.apache.hadoop.hbase.replication.ReplicationPeerConfig.ReplicationPeerConfigBuilderImpl +configuration - Variable in class org.apache.hadoop.hbase.tool.PreUpgradeValidator + configuration - Variable in class org.apache.hadoop.hbase.util.compaction.MajorCompactionRequest configuration - Variable in class org.apache.hadoop.hbase.zookeeper.MiniZooKeeperCluster @@ -17655,6 +17673,14 @@ CoprocessorHost.ObserverOperationWithResultO,R - Class in org.apache.hadoop.hbase.coprocessor +CoprocessorMethod - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorMethod(String) - Constructor for class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethod + +CoprocessorMethods - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorMethods() - Constructor for class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorMethods + coprocessorNames - Static variable in class org.apache.hadoop.hbase.coprocessor.CoprocessorHost Not to be confused with the per-object _coprocessors_ (above), @@ -17797,6 +17823,23 @@ coprocessorServiceHandlers - Variable in class org.apache.hadoop.hbase.regionserver.HRegionServer +CoprocessorValidator - Class in org.apache.hadoop.hbase.tool.coprocessor + +CoprocessorValidator() - Constructor for class org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator + +CoprocessorValidator.ResolverUrlClassLoader -
[32/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html b/devapidocs/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html new file mode 100644 index 000..827cf4c --- /dev/null +++ b/devapidocs/org/apache/hadoop/hbase/tool/DataBlockEncodingValidator.html @@ -0,0 +1,440 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +DataBlockEncodingValidator (Apache HBase 3.0.0-SNAPSHOT API) + + + + + +var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10}; +var tabs = {65535:["t0","All Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]}; +var altColor = "altColor"; +var rowColor = "rowColor"; +var tableTab = "tableTab"; +var activeTableTab = "activeTableTab"; + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevClass +NextClass + + +Frames +NoFrames + + +AllClasses + + + + + + + +Summary: +Nested| +Field| +Constr| +Method + + +Detail: +Field| +Constr| +Method + + + + + + + + +org.apache.hadoop.hbase.tool +Class DataBlockEncodingValidator + + + +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">java.lang.Object + + +org.apache.hadoop.hbase.util.AbstractHBaseTool + + +org.apache.hadoop.hbase.tool.DataBlockEncodingValidator + + + + + + + + + +All Implemented Interfaces: +org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool + + + +@InterfaceAudience.LimitedPrivate(value="Tools") +public class DataBlockEncodingValidator +extends AbstractHBaseTool + + + + + + + + + + + +Field Summary + +Fields + +Modifier and Type +Field and Description + + +private static byte[] +DATA_BLOCK_ENCODING + + +private static org.slf4j.Logger +LOG + + + + + + +Fields inherited from classorg.apache.hadoop.hbase.util.AbstractHBaseTool +cmdLineArgs, conf, EXIT_FAILURE, EXIT_SUCCESS, LONG_HELP_OPTION, options, SHORT_HELP_OPTION + + + + + + + + +Constructor Summary + +Constructors + +Constructor and Description + + +DataBlockEncodingValidator() + + + + + + + + + +Method Summary + +All MethodsInstance MethodsConcrete Methods + +Modifier and Type +Method and Description + + +protected void +addOptions() +Override this to add command-line options using AbstractHBaseTool.addOptWithArg(java.lang.String, java.lang.String) + and similar methods. + + + +protected int +doWork() +The "main function" of the tool + + + +protected void +printUsage() + + +protected void +processOptions(org.apache.hbase.thirdparty.org.apache.commons.cli.CommandLinecmd) +This method is called to process the options after they have been parsed. + + + +private int +validateDBE() +Check DataBlockEncodings of column families are compatible. + + + + + + + +Methods inherited from classorg.apache.hadoop.hbase.util.AbstractHBaseTool +addOption, addOptNoArg, addOptNoArg, addOptWithArg, addOptWithArg, addRequiredOption, addRequiredOptWithArg, addRequiredOptWithArg, doStaticMain, getConf, getOptionAsDouble, getOptionAsInt, getOptionAsLong, newParser, parseArgs, parseInt, parseLong, printUsage, processOldArgs, run, setConf + + + + + +Methods inherited from classjava.lang.https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">Object +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#clone--; title="class or interface in java.lang">clone, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#equals-java.lang.Object-; title="class or interface in java.lang">equals, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#finalize--; title="class or interface in java.lang">finalize, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#getClass--; title="class or interface in java.lang">getClass, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#hashCode--; title="class or interface in java.lang">hashCode, https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true#notify--; title="class or interface in java.lang">notify, https://docs.oracle.com/javase/8/docs/api/ja va/lang/Object.html?is-external=true#notifyAll--" title="class or interface in
[24/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.RegionServerMetricsWrapperRunnable.html -- diff --git a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.RegionServerMetricsWrapperRunnable.html b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.RegionServerMetricsWrapperRunnable.html index 5d53c29..9ec6b6f 100644 --- a/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.RegionServerMetricsWrapperRunnable.html +++ b/devapidocs/src-html/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.RegionServerMetricsWrapperRunnable.html @@ -82,1053 +82,1024 @@ 074 private volatile long numReferenceFiles = 0; 075 private volatile double requestsPerSecond = 0.0; 076 private volatile long readRequestsCount = 0; -077 private volatile double readRequestsRatePerSecond = 0; -078 private volatile long filteredReadRequestsCount = 0; -079 private volatile long writeRequestsCount = 0; -080 private volatile double writeRequestsRatePerSecond = 0; -081 private volatile long checkAndMutateChecksFailed = 0; -082 private volatile long checkAndMutateChecksPassed = 0; -083 private volatile long storefileIndexSize = 0; -084 private volatile long totalStaticIndexSize = 0; -085 private volatile long totalStaticBloomSize = 0; -086 private volatile long numMutationsWithoutWAL = 0; -087 private volatile long dataInMemoryWithoutWAL = 0; -088 private volatile double percentFileLocal = 0; -089 private volatile double percentFileLocalSecondaryRegions = 0; -090 private volatile long flushedCellsCount = 0; -091 private volatile long compactedCellsCount = 0; -092 private volatile long majorCompactedCellsCount = 0; -093 private volatile long flushedCellsSize = 0; -094 private volatile long compactedCellsSize = 0; -095 private volatile long majorCompactedCellsSize = 0; -096 private volatile long cellsCountCompactedToMob = 0; -097 private volatile long cellsCountCompactedFromMob = 0; -098 private volatile long cellsSizeCompactedToMob = 0; -099 private volatile long cellsSizeCompactedFromMob = 0; -100 private volatile long mobFlushCount = 0; -101 private volatile long mobFlushedCellsCount = 0; -102 private volatile long mobFlushedCellsSize = 0; -103 private volatile long mobScanCellsCount = 0; -104 private volatile long mobScanCellsSize = 0; -105 private volatile long mobFileCacheAccessCount = 0; -106 private volatile long mobFileCacheMissCount = 0; -107 private volatile double mobFileCacheHitRatio = 0; -108 private volatile long mobFileCacheEvictedCount = 0; -109 private volatile long mobFileCacheCount = 0; -110 private volatile long blockedRequestsCount = 0L; -111 private volatile long averageRegionSize = 0L; -112 -113 private CacheStats cacheStats; -114 private CacheStats l1Stats = null; -115 private CacheStats l2Stats = null; -116 private ScheduledExecutorService executor; -117 private Runnable runnable; -118 private long period; -119 -120 /** -121 * Can be null if not on hdfs. -122 */ -123 private DFSHedgedReadMetrics dfsHedgedReadMetrics; -124 -125 public MetricsRegionServerWrapperImpl(final HRegionServer regionServer) { -126this.regionServer = regionServer; -127initBlockCache(); -128initMobFileCache(); -129 -130this.period = -131 regionServer.conf.getLong(HConstants.REGIONSERVER_METRICS_PERIOD, -132 HConstants.DEFAULT_REGIONSERVER_METRICS_PERIOD); -133 -134this.executor = CompatibilitySingletonFactory.getInstance(MetricsExecutor.class).getExecutor(); -135this.runnable = new RegionServerMetricsWrapperRunnable(); -136 this.executor.scheduleWithFixedDelay(this.runnable, this.period, this.period, -137 TimeUnit.MILLISECONDS); -138this.metricsWALSource = CompatibilitySingletonFactory.getInstance(MetricsWALSource.class); -139 -140try { -141 this.dfsHedgedReadMetrics = FSUtils.getDFSHedgedReadMetrics(regionServer.getConfiguration()); -142} catch (IOException e) { -143 LOG.warn("Failed to get hedged metrics", e); -144} -145if (LOG.isInfoEnabled()) { -146 LOG.info("Computing regionserver metrics every " + this.period + " milliseconds"); -147} -148 } -149 -150 /** -151 * It's possible that due to threading the block cache could not be initialized -152 * yet (testing multiple region servers in one jvm). So we need to try and initialize -153 * the blockCache and cacheStats reference multiple times until we succeed. -154 */ -155 private synchronized void initBlockCache() { -156CacheConfig cacheConfig = this.regionServer.cacheConfig; -157if (cacheConfig != null) { -158 l1Stats = cacheConfig.getOnHeapCacheStats(); -159 l2Stats =
[30/46] hbase-site git commit: Published site at edf60b965be903f205ec689b59c55229e0cb1dbf.
http://git-wip-us.apache.org/repos/asf/hbase-site/blob/78d8c5d7/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidator.html -- diff --git a/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidator.html b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidator.html new file mode 100644 index 000..c0721c6 --- /dev/null +++ b/devapidocs/org/apache/hadoop/hbase/tool/coprocessor/CoprocessorValidator.html @@ -0,0 +1,594 @@ +http://www.w3.org/TR/html4/loose.dtd;> + + + + + +CoprocessorValidator (Apache HBase 3.0.0-SNAPSHOT API) + + + + + +var methods = {"i0":10,"i1":10,"i2":10,"i3":10,"i4":10,"i5":10,"i6":10,"i7":10,"i8":10,"i9":10}; +var tabs = {65535:["t0","All Methods"],2:["t2","Instance Methods"],8:["t4","Concrete Methods"]}; +var altColor = "altColor"; +var rowColor = "rowColor"; +var tableTab = "tableTab"; +var activeTableTab = "activeTableTab"; + + +JavaScript is disabled on your browser. + + + + + +Skip navigation links + + + + +Overview +Package +Class +Use +Tree +Deprecated +Index +Help + + + + +PrevClass +NextClass + + +Frames +NoFrames + + +AllClasses + + + + + + + +Summary: +Nested| +Field| +Constr| +Method + + +Detail: +Field| +Constr| +Method + + + + + + + + +org.apache.hadoop.hbase.tool.coprocessor +Class CoprocessorValidator + + + +https://docs.oracle.com/javase/8/docs/api/java/lang/Object.html?is-external=true; title="class or interface in java.lang">java.lang.Object + + +org.apache.hadoop.hbase.util.AbstractHBaseTool + + +org.apache.hadoop.hbase.tool.coprocessor.CoprocessorValidator + + + + + + + + + +All Implemented Interfaces: +org.apache.hadoop.conf.Configurable, org.apache.hadoop.util.Tool + + + +@InterfaceAudience.LimitedPrivate(value="Tools") +public class CoprocessorValidator +extends AbstractHBaseTool + + + + + + + + + + + +Nested Class Summary + +Nested Classes + +Modifier and Type +Class and Description + + +private static class +CoprocessorValidator.ResolverUrlClassLoader +This classloader implementation calls https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true#resolveClass-java.lang.Class-; title="class or interface in java.lang">ClassLoader.resolveClass(Class) + method for every loaded class. + + + + + + + + + + +Field Summary + +Fields + +Modifier and Type +Field and Description + + +private https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">Listhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +args + + +private CoprocessorMethods +branch1 + + +private CoprocessorMethods +current + + +private boolean +dieOnWarnings + + +private static org.slf4j.Logger +LOG + + +private boolean +scan + + + + + + +Fields inherited from classorg.apache.hadoop.hbase.util.AbstractHBaseTool +cmdLineArgs, conf, EXIT_FAILURE, EXIT_SUCCESS, LONG_HELP_OPTION, options, SHORT_HELP_OPTION + + + + + + + + +Constructor Summary + +Constructors + +Constructor and Description + + +CoprocessorValidator() + + + + + + + + + +Method Summary + +All MethodsInstance MethodsConcrete Methods + +Modifier and Type +Method and Description + + +protected void +addOptions() +Override this to add command-line options using AbstractHBaseTool.addOptWithArg(java.lang.String, java.lang.String) + and similar methods. + + + +private CoprocessorValidator.ResolverUrlClassLoader +createClassLoader(https://docs.oracle.com/javase/8/docs/api/java/net/URL.html?is-external=true; title="class or interface in java.net">URL[]urls) + + +protected int +doWork() +The "main function" of the tool + + + +protected https://docs.oracle.com/javase/8/docs/api/java/util/List.html?is-external=true; title="class or interface in java.util">Listhttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">String +filterObservers(https://docs.oracle.com/javase/8/docs/api/java/lang/ClassLoader.html?is-external=true; title="class or interface in java.lang">ClassLoaderclassLoader, + https://docs.oracle.com/javase/8/docs/api/java/lang/Iterable.html?is-external=true; title="class or interface in java.lang">Iterablehttps://docs.oracle.com/javase/8/docs/api/java/lang/String.html?is-external=true; title="class or interface in java.lang">StringclassNames) + + +protected
hbase git commit: HBASE-20700 Move meta region when server crash can cause the procedure to be stuck
Repository: hbase Updated Branches: refs/heads/branch-2.0 59a61e99d -> a73d00546 HBASE-20700 Move meta region when server crash can cause the procedure to be stuck Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/a73d0054 Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/a73d0054 Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/a73d0054 Branch: refs/heads/branch-2.0 Commit: a73d005460c281e49f0046bce6f37f3dc93f237c Parents: 59a61e9 Author: zhangduo Authored: Mon Jun 11 21:26:33 2018 +0800 Committer: zhangduo Committed: Tue Jun 12 21:24:34 2018 +0800 -- .../hbase/procedure2/LockedResourceType.java| 2 +- .../org/apache/hadoop/hbase/master/HMaster.java | 23 ++-- .../hbase/master/MasterMetaBootstrap.java | 15 +-- .../master/assignment/AssignmentManager.java| 55 ++ .../hbase/master/assignment/RegionStates.java | 68 .../assignment/RegionTransitionProcedure.java | 2 +- .../master/assignment/UnassignProcedure.java| 27 - .../procedure/MasterProcedureScheduler.java | 105 --- .../procedure/MetaProcedureInterface.java | 32 ++ .../hbase/master/procedure/MetaQueue.java | 36 +++ .../master/procedure/RecoverMetaProcedure.java | 26 ++--- .../hbase/master/procedure/SchemaLocking.java | 25 ++--- .../master/procedure/ServerCrashProcedure.java | 16 +-- .../procedure/ServerProcedureInterface.java | 2 - .../procedure/TableProcedureInterface.java | 3 - .../hbase/master/DummyRegionProcedure.java | 82 +++ .../hbase/master/DummyRegionProcedureState.java | 22 .../hbase/master/TestMasterNoCluster.java | 5 +- ...stServerCrashProcedureCarryingMetaStuck.java | 95 + .../master/TestServerCrashProcedureStuck.java | 66 +--- .../MasterProcedureTestingUtility.java | 5 +- 21 files changed, 515 insertions(+), 197 deletions(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/a73d0054/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockedResourceType.java -- diff --git a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockedResourceType.java b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockedResourceType.java index c5fe62b..a1941b4 100644 --- a/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockedResourceType.java +++ b/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/LockedResourceType.java @@ -22,5 +22,5 @@ import org.apache.yetus.audience.InterfaceAudience; @InterfaceAudience.Private public enum LockedResourceType { - SERVER, NAMESPACE, TABLE, REGION + SERVER, NAMESPACE, TABLE, REGION, META } http://git-wip-us.apache.org/repos/asf/hbase/blob/a73d0054/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java -- diff --git a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java index 214a02e..ab2ac60 100644 --- a/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java +++ b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java @@ -878,7 +878,7 @@ public class HMaster extends HRegionServer implements MasterServices { // Bring up hbase:meta. recoverMeta is a blocking call waiting until hbase:meta is deployed. // It also starts the TableStateManager. -MasterMetaBootstrap metaBootstrap = createMetaBootstrap(this, status); +MasterMetaBootstrap metaBootstrap = createMetaBootstrap(); metaBootstrap.recoverMeta(); //Initialize after meta as it scans meta @@ -1023,12 +1023,18 @@ public class HMaster extends HRegionServer implements MasterServices { } /** + * * Create a {@link MasterMetaBootstrap} instance. + * + * + * Will be overridden in tests. + * */ - MasterMetaBootstrap createMetaBootstrap(final HMaster master, final MonitoredTask status) { + @VisibleForTesting + protected MasterMetaBootstrap createMetaBootstrap() { // We put this out here in a method so can do a Mockito.spy and stub it out // w/ a mocked up MasterMetaBootstrap. -return new MasterMetaBootstrap(master, status); +return new MasterMetaBootstrap(this); } /** @@ -3135,7 +3141,8 @@ public class HMaster extends HRegionServer implements MasterServices { cpHost.preGetLocks(); } -MasterProcedureScheduler procedureScheduler = procedureExecutor.getEnvironment().getProcedureScheduler(); +MasterProcedureScheduler procedureScheduler = +
hbase git commit: HBASE-20689 Docker fails to install rubocop for precommit
Repository: hbase Updated Branches: refs/heads/branch-1.2 cb6990e0d -> 13ca256b0 HBASE-20689 Docker fails to install rubocop for precommit Signed-off-by: Josh Elser Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/13ca256b Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/13ca256b Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/13ca256b Branch: refs/heads/branch-1.2 Commit: 13ca256b08cdafa9a404976ad08a598c1fde6098 Parents: cb6990e Author: Peter Somogyi Authored: Sat Jun 9 14:07:50 2018 +0200 Committer: Peter Somogyi Committed: Tue Jun 12 08:25:06 2018 +0200 -- dev-support/docker/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/13ca256b/dev-support/docker/Dockerfile -- diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile index f706e4f..146b5df 100644 --- a/dev-support/docker/Dockerfile +++ b/dev-support/docker/Dockerfile @@ -150,7 +150,7 @@ RUN echo 'gem: --no-rdoc --no-ri' >> /root/.gemrc RUN apt-add-repository ppa:brightbox/ruby-ng RUN apt-get -q update -RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby-switch +RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby2.2-dev ruby-switch RUN ruby-switch --set ruby2.2
hbase git commit: HBASE-20689 Docker fails to install rubocop for precommit
Repository: hbase Updated Branches: refs/heads/branch-1.3 4cb2378c1 -> c57ccf7b0 HBASE-20689 Docker fails to install rubocop for precommit Signed-off-by: Josh Elser Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/c57ccf7b Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/c57ccf7b Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/c57ccf7b Branch: refs/heads/branch-1.3 Commit: c57ccf7b0f4f05ce54be31154443a3b3b1684563 Parents: 4cb2378 Author: Peter Somogyi Authored: Sat Jun 9 14:07:50 2018 +0200 Committer: Peter Somogyi Committed: Tue Jun 12 08:23:59 2018 +0200 -- dev-support/docker/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/c57ccf7b/dev-support/docker/Dockerfile -- diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile index f706e4f..146b5df 100644 --- a/dev-support/docker/Dockerfile +++ b/dev-support/docker/Dockerfile @@ -150,7 +150,7 @@ RUN echo 'gem: --no-rdoc --no-ri' >> /root/.gemrc RUN apt-add-repository ppa:brightbox/ruby-ng RUN apt-get -q update -RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby-switch +RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby2.2-dev ruby-switch RUN ruby-switch --set ruby2.2
hbase git commit: HBASE-20689 Docker fails to install rubocop for precommit
Repository: hbase Updated Branches: refs/heads/branch-1.4 7eee2f7f0 -> 4b0a87ab8 HBASE-20689 Docker fails to install rubocop for precommit Signed-off-by: Josh Elser Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/4b0a87ab Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/4b0a87ab Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/4b0a87ab Branch: refs/heads/branch-1.4 Commit: 4b0a87ab818df030c19b8591a8bf9bcbe68be71e Parents: 7eee2f7 Author: Peter Somogyi Authored: Sat Jun 9 14:07:50 2018 +0200 Committer: Peter Somogyi Committed: Tue Jun 12 08:22:53 2018 +0200 -- dev-support/docker/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/4b0a87ab/dev-support/docker/Dockerfile -- diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile index f706e4f..146b5df 100644 --- a/dev-support/docker/Dockerfile +++ b/dev-support/docker/Dockerfile @@ -150,7 +150,7 @@ RUN echo 'gem: --no-rdoc --no-ri' >> /root/.gemrc RUN apt-add-repository ppa:brightbox/ruby-ng RUN apt-get -q update -RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby-switch +RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby2.2-dev ruby-switch RUN ruby-switch --set ruby2.2
hbase git commit: HBASE-20689 Docker fails to install rubocop for precommit
Repository: hbase Updated Branches: refs/heads/branch-1 c596fb6c3 -> 1f3957dda HBASE-20689 Docker fails to install rubocop for precommit Signed-off-by: Josh Elser Project: http://git-wip-us.apache.org/repos/asf/hbase/repo Commit: http://git-wip-us.apache.org/repos/asf/hbase/commit/1f3957dd Tree: http://git-wip-us.apache.org/repos/asf/hbase/tree/1f3957dd Diff: http://git-wip-us.apache.org/repos/asf/hbase/diff/1f3957dd Branch: refs/heads/branch-1 Commit: 1f3957dda8b4b0a728beefc6768e84e28f42ca8f Parents: c596fb6 Author: Peter Somogyi Authored: Sat Jun 9 14:07:50 2018 +0200 Committer: Peter Somogyi Committed: Tue Jun 12 08:16:19 2018 +0200 -- dev-support/docker/Dockerfile | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) -- http://git-wip-us.apache.org/repos/asf/hbase/blob/1f3957dd/dev-support/docker/Dockerfile -- diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile index f706e4f..146b5df 100644 --- a/dev-support/docker/Dockerfile +++ b/dev-support/docker/Dockerfile @@ -150,7 +150,7 @@ RUN echo 'gem: --no-rdoc --no-ri' >> /root/.gemrc RUN apt-add-repository ppa:brightbox/ruby-ng RUN apt-get -q update -RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby-switch +RUN apt-get -q install --no-install-recommends -y ruby2.2 ruby2.2-dev ruby-switch RUN ruby-switch --set ruby2.2