[jira] [Resolved] (HBASE-13559) Region stuck in PENDING_OPEN on repeated master failure
[ https://issues.apache.org/jira/browse/HBASE-13559?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-13559. --- Resolution: Cannot Reproduce > Region stuck in PENDING_OPEN on repeated master failure > --- > > Key: HBASE-13559 > URL: https://issues.apache.org/jira/browse/HBASE-13559 > Project: HBase > Issue Type: Bug >Reporter: Elliott Clark > > We had some regions stay un-assigned. They were in pending open on a server > that was dead. The cluster was restarted as a whole a few times and then the > regions were stuck until a manual assign was performed on them. > I know timing things out has been a pain. Could we have a timeout on servers > that are not alive? -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16365) Hook up Put work flow
Elliott Clark created HBASE-16365: - Summary: Hook up Put work flow Key: HBASE-16365 URL: https://issues.apache.org/jira/browse/HBASE-16365 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16305) Multi threaded scan performance bottlenecked on Connection
Elliott Clark created HBASE-16305: - Summary: Multi threaded scan performance bottlenecked on Connection Key: HBASE-16305 URL: https://issues.apache.org/jira/browse/HBASE-16305 Project: HBase Issue Type: Bug Reporter: Elliott Clark Pretty simple repro. On a single region server host ~10 or more regions. Then for each region spawn a thread that starts a scan. Try an pull the scan as fast as possible. If all the scans are created through the same connection then it's slow. If all the scans are created through different connections then the scan speed is doubled. Since we recommend a single connection per application this is pretty surprising behavior. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16292) Can't start a local instance
Elliott Clark created HBASE-16292:
-
Summary: Can't start a local instance
Key: HBASE-16292
URL: https://issues.apache.org/jira/browse/HBASE-16292
Project: HBase
Issue Type: Bug
Reporter: Elliott Clark
Currently master is completely broken.
{code}
./bin/start-hbase.sh
starting master, logging to
/Users/elliott/Code/Public/hbase/bin/../logs/hbase-elliott-master-elliott-mbp.out
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option PermSize=128m;
support was removed in 8.0
Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=128m;
support was removed in 8.0
{code}
{code}
2016-07-27 10:36:20,992 ERROR [main] regionserver.SecureBulkLoadManager: Failed
to create or set permission on staging directory /user/elliott/hbase-staging
ExitCodeException exitCode=1: chmod: /user/elliott/hbase-staging: No such file
or directory
at org.apache.hadoop.util.Shell.runCommand(Shell.java:545)
at org.apache.hadoop.util.Shell.run(Shell.java:456)
at
org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:722)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:815)
at org.apache.hadoop.util.Shell.execCommand(Shell.java:798)
at
org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:728)
at
org.apache.hadoop.fs.FilterFileSystem.setPermission(FilterFileSystem.java:502)
at
org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager.start(SecureBulkLoadManager.java:124)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:624)
at org.apache.hadoop.hbase.master.HMaster.(HMaster.java:403)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.(HMasterCommandLine.java:307)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
at
org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:221)
at
org.apache.hadoop.hbase.LocalHBaseCluster.(LocalHBaseCluster.java:156)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:226)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:127)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2417)
2016-07-27 10:36:20,994 ERROR [main] master.HMasterCommandLine: Master exiting
java.lang.RuntimeException: Failed construction of Master: class
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMasterchmod:
/user/elliott/hbase-staging: No such file or directory
at
org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:145)
at
org.apache.hadoop.hbase.LocalHBaseCluster.addMaster(LocalHBaseCluster.java:221)
at
org.apache.hadoop.hbase.LocalHBaseCluster.(LocalHBaseCluster.java:156)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:226)
at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:139)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:127)
at org.apache.hadoop.hbase.master.HMaster.main(HMaster.java:2417)
Caused by: java.lang.IllegalStateException: Failed to create or set permission
on staging directory /user/elliott/hbase-staging
at
org.apache.hadoop.hbase.regionserver.SecureBulkLoadManager.start(SecureBulkLoadManager.java:141)
at
org.apache.hadoop.hbase.regionserver.HRegionServer.(HRegionServer.java:624)
at org.apache.hadoop.hbase.master.HMaster.(HMaster.java:403)
at
org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.(HMasterCommandLine.java:307)
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62)
at
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:423)
at
org.apache.hadoop.hbase.util.JVMClusterUtil.createMasterThread(JVMClusterUtil.java:140)
... 7 more
Caused by: ExitCodeException exitCode=1: chmod: /user/ell
[jira] [Resolved] (HBASE-16216) Clean up Cell source code.
[ https://issues.apache.org/jira/browse/HBASE-16216?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-16216. --- Resolution: Fixed > Clean up Cell source code. > -- > > Key: HBASE-16216 > URL: https://issues.apache.org/jira/browse/HBASE-16216 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-16216.patch > > > formatting. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16216) Clean up Cell source code.
Elliott Clark created HBASE-16216: - Summary: Clean up Cell source code. Key: HBASE-16216 URL: https://issues.apache.org/jira/browse/HBASE-16216 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark formatting. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16196) Update jruby to a newer version.
Elliott Clark created HBASE-16196: - Summary: Update jruby to a newer version. Key: HBASE-16196 URL: https://issues.apache.org/jira/browse/HBASE-16196 Project: HBase Issue Type: Bug Reporter: Elliott Clark Ruby 1.8.7 is no longer maintained. The TTY library in the old jruby is bad. The newer one is less bad. Since this is only a dependency on the hbase-shell module and not on hbase-client or hbase-server this should be a pretty simple thing that doesn't have any backwards compat issues. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16177) In dev mode thrift server can't be run
Elliott Clark created HBASE-16177:
-
Summary: In dev mode thrift server can't be run
Key: HBASE-16177
URL: https://issues.apache.org/jira/browse/HBASE-16177
Project: HBase
Issue Type: Bug
Reporter: Elliott Clark
Assignee: Elliott Clark
{code}
Error: Could not find or load main class
org.apache.hadoop.hbase.thrift2.ThriftServer
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-16174) Hook cell test up
Elliott Clark created HBASE-16174: - Summary: Hook cell test up Key: HBASE-16174 URL: https://issues.apache.org/jira/browse/HBASE-16174 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Make sure that cell test is working properly. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15945) Patch for Cell
[ https://issues.apache.org/jira/browse/HBASE-15945?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15945. --- Resolution: Fixed > Patch for Cell > -- > > Key: HBASE-15945 > URL: https://issues.apache.org/jira/browse/HBASE-15945 > Project: HBase > Issue Type: Sub-task >Reporter: Sudeep Sunthankar >Assignee: Sudeep Sunthankar > Attachments: HBASE-15945-HBASE-14850.v2.patch, > HBASE-15945-HBASE-14850.v3.patch, HBASE-15945-HBASE-14850.v4.patch, > HBASE-15945.HBASE-14850.v1.patch, HBASE-15945.HBASE-14850.v5.patch, > HBASE-15945.HBASE-14850.v6.patch > > > This patch contains an implementation of Key Value, Bytes and Cell modeled on > the lines of Java implementation. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16111) Truncate preserve shell command is broken
Elliott Clark created HBASE-16111:
-
Summary: Truncate preserve shell command is broken
Key: HBASE-16111
URL: https://issues.apache.org/jira/browse/HBASE-16111
Project: HBase
Issue Type: Bug
Reporter: Elliott Clark
On a recent version of master I get this:
{code}
hbase(main):001:0> truncate_preserve 'TestTable'
ERROR: undefined local variable or method `table' for #
Here is some help for this command:
Disables, drops and recreates the specified table while still maintaing the
previous region boundaries.
Took 0.0290 seconds
hbase(main):002:0> truncate 'TestTable'
Truncating 'TestTable' table (it may take a while):
Disabling table...
Truncating table...
Took 10.0040 seconds
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-16093) Splits failed before creating daughter regions leave meta inconsistent
Elliott Clark created HBASE-16093: - Summary: Splits failed before creating daughter regions leave meta inconsistent Key: HBASE-16093 URL: https://issues.apache.org/jira/browse/HBASE-16093 Project: HBase Issue Type: Bug Reporter: Elliott Clark Priority: Critical This is on branch-1 based code only. Here's the sequence of events. # A regionserver opens a new region. That regions looks like it should split. # So the regionserver starts a split transaction. # Split transaction starts execute # Split transaction encounters an error in stepsBeforePONR # Split transaction starts rollback # Split transaction notifies master that it's rolling back using HMasterRpcServices#reportRegionStateTransition # AssignmentManager#onRegionTransition is called with SPLIT_REVERTED # AssignmentManager#onRegionSplitReverted is called. # That onlines the parent region and offlines the daughter regions. However the daughter regions were never created in meta so all that gets done is that state for those rows gets OFFLINE. Now all clients trying to get the parent instead get the offline daughter. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16089) Add on FastPath for CoDel
Elliott Clark created HBASE-16089: - Summary: Add on FastPath for CoDel Key: HBASE-16089 URL: https://issues.apache.org/jira/browse/HBASE-16089 Project: HBase Issue Type: Improvement Reporter: Elliott Clark Assignee: Elliott Clark If this is all that awesome, so we should have it on CoDel too. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16087) Replication shouldn't start on a master if if only hosts system tables
Elliott Clark created HBASE-16087: - Summary: Replication shouldn't start on a master if if only hosts system tables Key: HBASE-16087 URL: https://issues.apache.org/jira/browse/HBASE-16087 Project: HBase Issue Type: Improvement Reporter: Elliott Clark System tables aren't replicated so we shouldn't start up a replication master if there are no user tables on the master. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16085) Add on metric for failed compactions
Elliott Clark created HBASE-16085: - Summary: Add on metric for failed compactions Key: HBASE-16085 URL: https://issues.apache.org/jira/browse/HBASE-16085 Project: HBase Issue Type: Improvement Reporter: Elliott Clark Failing compactions doesn't stop the server so things can go un-noticed for quite a while if there are no metrics. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16080) Fix flakey tests
Elliott Clark created HBASE-16080: - Summary: Fix flakey tests Key: HBASE-16080 URL: https://issues.apache.org/jira/browse/HBASE-16080 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Joseph Seems like TestTableBasedReplicationSourceManagerImpl.testCleanupFailoverQueues is a little flakey. We should make that more stable even on the apache test infra. https://builds.apache.org/job/HBase-Trunk_matrix/1090/jdk=latest1.7,label=yahoo-not-h2/testReport/junit/org.apache.hadoop.hbase.replication.regionserver/TestTableBasedReplicationSourceManagerImpl/testCleanupFailoverQueues/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-16061) Allow logging to a buffered console
Elliott Clark created HBASE-16061: - Summary: Allow logging to a buffered console Key: HBASE-16061 URL: https://issues.apache.org/jira/browse/HBASE-16061 Project: HBase Issue Type: Bug Reporter: Elliott Clark We've seen some stalls when logging to the ConsoleLogger that's getting redirected to a file. We should allow people to use a buffered console appender to keep from having stalls when the logging disk is busy. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15348) Fix tests broken by recent metrics re-work
[ https://issues.apache.org/jira/browse/HBASE-15348?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15348. --- Resolution: Not A Problem > Fix tests broken by recent metrics re-work > -- > > Key: HBASE-15348 > URL: https://issues.apache.org/jira/browse/HBASE-15348 > Project: HBase > Issue Type: Bug > Components: metrics, test >Reporter: Elliott Clark >Assignee: Elliott Clark > > Counts are appoximate and go away. We should re-work the tests or test utils > to make them work now. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15926) Makefiles don't have headers
Elliott Clark created HBASE-15926: - Summary: Makefiles don't have headers Key: HBASE-15926 URL: https://issues.apache.org/jira/browse/HBASE-15926 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark The makefiles are not correctly licensed anymore after HBASE-15851 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15905) Makefile build env incorrectly links in tests
Elliott Clark created HBASE-15905: - Summary: Makefile build env incorrectly links in tests Key: HBASE-15905 URL: https://issues.apache.org/jira/browse/HBASE-15905 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Right now the makefile build system doesn't seem to do so well. * Tests are included in the lib * Documentation includes the protobuf dir * just running make on a clean check out fails. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15851) Makefile update for build env
[ https://issues.apache.org/jira/browse/HBASE-15851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15851. --- Resolution: Fixed > Makefile update for build env > - > > Key: HBASE-15851 > URL: https://issues.apache.org/jira/browse/HBASE-15851 > Project: HBase > Issue Type: Sub-task >Reporter: Sudeep Sunthankar >Assignee: Sudeep Sunthankar > Attachments: HBASE-15851.HBASE-14850.v2.patch, > hbase-native-client-with-makefile.patch > > > 1) Makefile:- edited to compile using g++ . A SO would be created with the > name libHbaseClient.so. > 2) core/meta-utils.h :- Edited to update an incorrect header file reference > (connection/Request.h -> connection/request.h) -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Reopened] (HBASE-15824) LocalHBaseCluster gets bind exception in master info port
[
https://issues.apache.org/jira/browse/HBASE-15824?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark reopened HBASE-15824:
---
Looks like this broke the web ui on standalone single node installs.
Try running ./bin/start-hbase.sh on a local checkout and no master will come up.
> LocalHBaseCluster gets bind exception in master info port
> -
>
> Key: HBASE-15824
> URL: https://issues.apache.org/jira/browse/HBASE-15824
> Project: HBase
> Issue Type: Bug
>Reporter: Enis Soztutar
>Assignee: Enis Soztutar
> Fix For: 2.0.0, 1.3.0, 1.4.0, 1.2.2, 1.1.6
>
> Attachments: hbase-15824_v1.patch
>
>
> This is seen from Phoenix, since we already configure the ports in
> hbase-site.xml under hbase-server/src/test/resources.
> But this is also important for other {{hbase-testing-util}} consumers.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-15840) WAL.proto compilation broken for cpp
Elliott Clark created HBASE-15840:
-
Summary: WAL.proto compilation broken for cpp
Key: HBASE-15840
URL: https://issues.apache.org/jira/browse/HBASE-15840
Project: HBase
Issue Type: Bug
Reporter: Elliott Clark
Assignee: Elliott Clark
HBASE-15669 seems to have broken generating code for WAL.proto in cpp.
{code}
In file included from buck-out/gen/if/WAL.pb.cc/WAL.pb.cc:5:0:
buck-out/gen/if/WAL.pb.cc/WAL.pb.h:1103:37: error: 'google::protobuf::uint64
hbase::pb::StoreDescriptor::store_file_size() const' cannot be overloaded
inline ::google::protobuf::uint64 store_file_size() const;
^
buck-out/gen/if/WAL.pb.cc/WAL.pb.h:1084:14: error: with 'int
hbase::pb::StoreDescriptor::store_file_size() const'
inline int store_file_size() const;
^
In file included from buck-out/gen/if/WAL.pb.cc/WAL.pb.cc:5:0:
buck-out/gen/if/WAL.pb.cc/WAL.pb.h:3527:35: error: prototype for
'google::protobuf::uint64 hbase::pb::StoreDescriptor::store_file_size() const'
does not match any in class 'hbase::pb::StoreDescriptor'
inline ::google::protobuf::uint64 StoreDescriptor::store_file_size() const {
^
buck-out/gen/if/WAL.pb.cc/WAL.pb.h:3460:12: error: candidate is: int
hbase::pb::StoreDescriptor::store_file_size() const
inline int StoreDescriptor::store_file_size() const {
^
BUILD FAILED: //if:if#compile-WAL.pb.cc.oa0460dda,default failed with exit code
1:
c++-cpp-output compile
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-15826) Clean up ASF license issues
Elliott Clark created HBASE-15826: - Summary: Clean up ASF license issues Key: HBASE-15826 URL: https://issues.apache.org/jira/browse/HBASE-15826 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15823) Use call once for user util
Elliott Clark created HBASE-15823: - Summary: Use call once for user util Key: HBASE-15823 URL: https://issues.apache.org/jira/browse/HBASE-15823 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Faster less locking and more correct. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15822) Move to the latest docker base image
Elliott Clark created HBASE-15822: - Summary: Move to the latest docker base image Key: HBASE-15822 URL: https://issues.apache.org/jira/browse/HBASE-15822 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark The base docker image got an update to use chef to set everything up. It changes some locations but should be pretty easy to migrate to. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15821) Document TestUtil
Elliott Clark created HBASE-15821: - Summary: Document TestUtil Key: HBASE-15821 URL: https://issues.apache.org/jira/browse/HBASE-15821 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Trying to keep everything documented well. Document TestUtil and how it should be used. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15792) Add on a test for locating a region
Elliott Clark created HBASE-15792: - Summary: Add on a test for locating a region Key: HBASE-15792 URL: https://issues.apache.org/jira/browse/HBASE-15792 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15771) Document all the public classes
[ https://issues.apache.org/jira/browse/HBASE-15771?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15771. --- Resolution: Fixed Pushed. Thanks > Document all the public classes > --- > > Key: HBASE-15771 > URL: https://issues.apache.org/jira/browse/HBASE-15771 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-15771.patch > > > Add on doxygen comments for all public classes and methods. > Once that's done then we can turn on doxygen with error on missing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15777) Fix needs header in client handler
Elliott Clark created HBASE-15777: - Summary: Fix needs header in client handler Key: HBASE-15777 URL: https://issues.apache.org/jira/browse/HBASE-15777 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark This needs to be a little more complex or there could be a request sent before the header. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15774) Fix Upgrade lock usage in connection pool.
Elliott Clark created HBASE-15774: - Summary: Fix Upgrade lock usage in connection pool. Key: HBASE-15774 URL: https://issues.apache.org/jira/browse/HBASE-15774 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Just do double checked locking. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15771) Document all the public classes
Elliott Clark created HBASE-15771: - Summary: Document all the public classes Key: HBASE-15771 URL: https://issues.apache.org/jira/browse/HBASE-15771 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Add on doxygen comments for all public classes and methods. Once that's done then we can turn on doxygen with error on missing. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15770) Stop using wangle's global executor
Elliott Clark created HBASE-15770: - Summary: Stop using wangle's global executor Key: HBASE-15770 URL: https://issues.apache.org/jira/browse/HBASE-15770 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark In order to ensure that all things are closed correctly, we need to call IOThreadPool#close. Doing that on the singleton is pretty bad manners. So we should just use our own IOThreadPool and not use the global one at all. This will involve making the client have the threads. Passing the threads to connection pool, connection factory, etc. Calling close on the threads when cleaning up the client. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15766) Show working puts
Elliott Clark created HBASE-15766: - Summary: Show working puts Key: HBASE-15766 URL: https://issues.apache.org/jira/browse/HBASE-15766 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15761) Add on more server name tests
Elliott Clark created HBASE-15761: - Summary: Add on more server name tests Key: HBASE-15761 URL: https://issues.apache.org/jira/browse/HBASE-15761 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Just one test probably isn't good enough. Lets add on lots more. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15750) Add on meta deserialization
Elliott Clark created HBASE-15750: - Summary: Add on meta deserialization Key: HBASE-15750 URL: https://issues.apache.org/jira/browse/HBASE-15750 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15748) Don't link in static libunwind.
[ https://issues.apache.org/jira/browse/HBASE-15748?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15748. --- Resolution: Fixed Assignee: Elliott Clark > Don't link in static libunwind. > --- > > Key: HBASE-15748 > URL: https://issues.apache.org/jira/browse/HBASE-15748 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-15748.patch > > > A static libunwind compiled with gcc prevents clang from catching exceptions. > So just add the dynamic one. :-/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15748) Don't link in static libunwind.
Elliott Clark created HBASE-15748: - Summary: Don't link in static libunwind. Key: HBASE-15748 URL: https://issues.apache.org/jira/browse/HBASE-15748 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark A static libunwind compiled with gcc prevents clang from catching exceptions. So just add the dynamic one. :-/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15739) Add region location lookup from meta
[ https://issues.apache.org/jira/browse/HBASE-15739?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15739. --- Resolution: Fixed > Add region location lookup from meta > > > Key: HBASE-15739 > URL: https://issues.apache.org/jira/browse/HBASE-15739 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-15739-v1.patch, HBASE-15739.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15739) Add region location lookup from meta
Elliott Clark created HBASE-15739: - Summary: Add region location lookup from meta Key: HBASE-15739 URL: https://issues.apache.org/jira/browse/HBASE-15739 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15731) Add on a connection pool
Elliott Clark created HBASE-15731: - Summary: Add on a connection pool Key: HBASE-15731 URL: https://issues.apache.org/jira/browse/HBASE-15731 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark We need to reuse connections so we need a pool -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15730) Add on script to format all files.
Elliott Clark created HBASE-15730: - Summary: Add on script to format all files. Key: HBASE-15730 URL: https://issues.apache.org/jira/browse/HBASE-15730 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15725) make_patch.sh should add the branch name when -b is passed.
Elliott Clark created HBASE-15725: - Summary: make_patch.sh should add the branch name when -b is passed. Key: HBASE-15725 URL: https://issues.apache.org/jira/browse/HBASE-15725 Project: HBase Issue Type: Bug Reporter: Elliott Clark When using something other than master as the base branch we should default to adding the branch name to the patch file name. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15726) Hook this all up to pre-commit tests
Elliott Clark created HBASE-15726: - Summary: Hook this all up to pre-commit tests Key: HBASE-15726 URL: https://issues.apache.org/jira/browse/HBASE-15726 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15724) Use explicit docker image
Elliott Clark created HBASE-15724: - Summary: Use explicit docker image Key: HBASE-15724 URL: https://issues.apache.org/jira/browse/HBASE-15724 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Using an explicit docker image allows the upstream image to change without breaking us. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-14233) Branch-1.2 Merging regions can result in messed up tables
[
https://issues.apache.org/jira/browse/HBASE-14233?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Elliott Clark resolved HBASE-14233.
---
Resolution: Cannot Reproduce
> Branch-1.2 Merging regions can result in messed up tables
> -
>
> Key: HBASE-14233
> URL: https://issues.apache.org/jira/browse/HBASE-14233
> Project: HBase
> Issue Type: Bug
> Components: Region Assignment
>Affects Versions: 1.2.0
>Reporter: Elliott Clark
>Priority: Critical
>
> {code}
> 15/08/17 14:10:50 INFO master.RegionStates: Transition null to
> {6486b9b9409b25f10eb806ec3bad442d state=MERGING_NEW, ts=1439845850422,
> server=hbase508.ash1.facebook.com,16020,1439844470302}
> 15/08/17 14:10:57 INFO master.AssignmentManager: Failed to record merged
> region 6486b9b9409b25f10eb806ec3bad442d
> 15/08/17 14:10:57 ERROR master.AssignmentManager: Failed to transtion region
> from {6486b9b9409b25f10eb806ec3bad442d state=MERGING_NEW, ts=1439845850422,
> server=hbase508.ash1.facebook.com,16020,1439844470302} to MERGE_PONR by
> hbase508.ash1.facebook.com,16020,1439844470302: Failed to record the merging
> in meta
> 15/08/17 14:11:08 WARN master.RegionStates: THIS SHOULD NOT HAPPEN:
> unexpected {6486b9b9409b25f10eb806ec3bad442d state=MERGING_NEW,
> ts=1439845857580, server=hbase508.ash1.facebook.com,16020,1439844470302}
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-15718) Add on TableName implementation and tests
Elliott Clark created HBASE-15718: - Summary: Add on TableName implementation and tests Key: HBASE-15718 URL: https://issues.apache.org/jira/browse/HBASE-15718 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Table name will be needed to look up rows from meta. Add the implementation and a test around TableName. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15705) Add on meta cache.
Elliott Clark created HBASE-15705: - Summary: Add on meta cache. Key: HBASE-15705 URL: https://issues.apache.org/jira/browse/HBASE-15705 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15696) Move region location cache serialization into serde
Elliott Clark created HBASE-15696: - Summary: Move region location cache serialization into serde Key: HBASE-15696 URL: https://issues.apache.org/jira/browse/HBASE-15696 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Now that there's a library for serialization we should have the zookeeper serde. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15601) Split up core in buck
[ https://issues.apache.org/jira/browse/HBASE-15601?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15601. --- Resolution: Fixed Assignee: Elliott Clark Done in HBASE-15620 > Split up core in buck > - > > Key: HBASE-15601 > URL: https://issues.apache.org/jira/browse/HBASE-15601 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > > core in buck is starting to get a little large. If we split it up some then > buck cache can do some good things for us. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15690) Add utility to get current username
Elliott Clark created HBASE-15690: - Summary: Add utility to get current username Key: HBASE-15690 URL: https://issues.apache.org/jira/browse/HBASE-15690 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark Currently we lie about what user is running the connection. We should make a better effort. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15687) Allow decoding more than GetResponse from the server
Elliott Clark created HBASE-15687: - Summary: Allow decoding more than GetResponse from the server Key: HBASE-15687 URL: https://issues.apache.org/jira/browse/HBASE-15687 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark HBASE-15620 adds on Call serialization and de-serialization. However the client-serialize-handler currently assumes that all responses will be GetResponse. We should keep a call id to response type mapping. Maybe the inner request should have a response factory inside it. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15674) HRegionLocator#getAllRegionLocations should put the results in cache
Elliott Clark created HBASE-15674: - Summary: HRegionLocator#getAllRegionLocations should put the results in cache Key: HBASE-15674 URL: https://issues.apache.org/jira/browse/HBASE-15674 Project: HBase Issue Type: Bug Reporter: Elliott Clark getAllRegionLocations walks meta. Well after doing the work, we should put the results into cache. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15656) Fix unused protobuf warning in Admin.proto
Elliott Clark created HBASE-15656:
-
Summary: Fix unused protobuf warning in Admin.proto
Key: HBASE-15656
URL: https://issues.apache.org/jira/browse/HBASE-15656
Project: HBase
Issue Type: Task
Reporter: Elliott Clark
Priority: Minor
{code}
Warning: Unused import: "Admin.proto" imports "Client.proto" which is not used.
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-15655) Set up doxygen for documentation
Elliott Clark created HBASE-15655: - Summary: Set up doxygen for documentation Key: HBASE-15655 URL: https://issues.apache.org/jira/browse/HBASE-15655 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15649) Ignore buck-out when building docker image
Elliott Clark created HBASE-15649: - Summary: Ignore buck-out when building docker image Key: HBASE-15649 URL: https://issues.apache.org/jira/browse/HBASE-15649 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15604) Add a good readme on the build.
[ https://issues.apache.org/jira/browse/HBASE-15604?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15604. --- Resolution: Fixed Pushed to branch. Thanks > Add a good readme on the build. > --- > > Key: HBASE-15604 > URL: https://issues.apache.org/jira/browse/HBASE-15604 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-15604.patch > > > Set up a good readme for the build and what's needed to get this running. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15620) Add on Call serialization
Elliott Clark created HBASE-15620: - Summary: Add on Call serialization Key: HBASE-15620 URL: https://issues.apache.org/jira/browse/HBASE-15620 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark After connections to the regionserver are all set up, now it's time to implement the Call serialization. Lets start with all PB and then go from there. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15604) Good readme on the build.
Elliott Clark created HBASE-15604: - Summary: Good readme on the build. Key: HBASE-15604 URL: https://issues.apache.org/jira/browse/HBASE-15604 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Set up a good readme for the build and what's needed to get this running. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15603) Set up all the license stuff needed for compliance.
Elliott Clark created HBASE-15603: - Summary: Set up all the license stuff needed for compliance. Key: HBASE-15603 URL: https://issues.apache.org/jira/browse/HBASE-15603 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark https://buckbuild.com/rule/prebuilt_cxx_library.html -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15602) Clean up using directives in cc files.
Elliott Clark created HBASE-15602: - Summary: Clean up using directives in cc files. Key: HBASE-15602 URL: https://issues.apache.org/jira/browse/HBASE-15602 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark There's a ton of files that just barf out all of folly, wangle, and hbase into the global namespace. We should use the using directive better than that when possible. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15601) Split up core in buck
Elliott Clark created HBASE-15601: - Summary: Split up core in buck Key: HBASE-15601 URL: https://issues.apache.org/jira/browse/HBASE-15601 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark core in buck is starting to get a little large. If we split it up some then buck cache can do some good things for us. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-13245) Revamp mutation metrics
[ https://issues.apache.org/jira/browse/HBASE-13245?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-13245. --- Resolution: Not A Problem > Revamp mutation metrics > --- > > Key: HBASE-13245 > URL: https://issues.apache.org/jira/browse/HBASE-13245 > Project: HBase > Issue Type: Improvement > Components: metrics >Affects Versions: 2.0.0, 1.1.0 >Reporter: Elliott Clark >Assignee: Elliott Clark > > Counts of deletes and puts ( called mutations in metrics ) are totally off. > The time for delete or mutate is really the time that a batch of mutations > containing a put or delete. The same is true for count. > We should have: > * number of puts > * number of deletes > * time for batch mutations > * number of batch mutations > * histogram of number of mutations in each batch > That way it's less reading tea leaves and more explicit that things are > batched and we don't have more fine grained info. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15559) BaseMasterAndRegionObserver doesn't implement all the methods
Elliott Clark created HBASE-15559: - Summary: BaseMasterAndRegionObserver doesn't implement all the methods Key: HBASE-15559 URL: https://issues.apache.org/jira/browse/HBASE-15559 Project: HBase Issue Type: Bug Reporter: Elliott Clark Assignee: Elliott Clark It's supposed to be a class that allows someone to derive from that class and only need to implement the desired methods. However two methods aren't implemented. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15558) Add random failure co processor to hbase-it
Elliott Clark created HBASE-15558: - Summary: Add random failure co processor to hbase-it Key: HBASE-15558 URL: https://issues.apache.org/jira/browse/HBASE-15558 Project: HBase Issue Type: Bug Reporter: Elliott Clark HBase integration tests don't seem to be able to stress HBase all that much. They don't add enough for there to be failures due to load. So lets add a co-processor that can randomly fail rpc requests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15551) Make call queue too big exception use servername
Elliott Clark created HBASE-15551: - Summary: Make call queue too big exception use servername Key: HBASE-15551 URL: https://issues.apache.org/jira/browse/HBASE-15551 Project: HBase Issue Type: Bug Reporter: Elliott Clark If the rpc server is listening to something other than the hostname ( 0.0.0.0 for example ) then the exception thrown isn't very helpful. We should make that more helpful. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15419) Push HBASE-14850 to apache's git.
[ https://issues.apache.org/jira/browse/HBASE-15419?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15419. --- Resolution: Done > Push HBASE-14850 to apache's git. > - > > Key: HBASE-15419 > URL: https://issues.apache.org/jira/browse/HBASE-15419 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark > > Now that Apache's git isn't locked down it's time to push the code where it > should be. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15418) Clean up un-used warning in test util
[ https://issues.apache.org/jira/browse/HBASE-15418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15418. --- Resolution: Fixed Thanks for the review stack. > Clean up un-used warning in test util > - > > Key: HBASE-15418 > URL: https://issues.apache.org/jira/browse/HBASE-15418 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-15418.patch > > > Clean up the test infra a little bit. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-14854) Read meta location from zk
[ https://issues.apache.org/jira/browse/HBASE-14854?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-14854. --- Resolution: Fixed > Read meta location from zk > -- > > Key: HBASE-14854 > URL: https://issues.apache.org/jira/browse/HBASE-14854 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-14854-v1.patch, HBASE-14854-v2.patch, > HBASE-14854-v3.patch, HBASE-14854.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15504) Fix Balancer in 1.3 not moving regions off overloaded regionserver
Elliott Clark created HBASE-15504: - Summary: Fix Balancer in 1.3 not moving regions off overloaded regionserver Key: HBASE-15504 URL: https://issues.apache.org/jira/browse/HBASE-15504 Project: HBase Issue Type: Bug Reporter: Elliott Clark We pushed 1.3 to a couple of clusters. In some cases the regions were assigned VERY un-evenly and the regions would not move after that. We ended up with one rs getting thousands of regions and most servers getting 0. Running balancer would do nothing. The balancer would say that it couldn't find a solution with less than the current cost. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15475) Allow TimestampsFilter to provide a seek hint
Elliott Clark created HBASE-15475: - Summary: Allow TimestampsFilter to provide a seek hint Key: HBASE-15475 URL: https://issues.apache.org/jira/browse/HBASE-15475 Project: HBase Issue Type: Improvement Reporter: Elliott Clark Assignee: Elliott Clark If a user wants to read specific timestamps currently it's a very linear scan. This is so that all deletes can be respected. However if the user doesn't care about deletes it can dramatically speed up the request to seek. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15471) Add num calls in priority and general queue to RS UI
Elliott Clark created HBASE-15471: - Summary: Add num calls in priority and general queue to RS UI Key: HBASE-15471 URL: https://issues.apache.org/jira/browse/HBASE-15471 Project: HBase Issue Type: Improvement Components: UI Affects Versions: 1.2.0 Reporter: Elliott Clark Fix For: 1.3.0 1.2 added the queue size. We should add the number of calls in the queue. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15470) Add a setting for Priority queue length
Elliott Clark created HBASE-15470: - Summary: Add a setting for Priority queue length Key: HBASE-15470 URL: https://issues.apache.org/jira/browse/HBASE-15470 Project: HBase Issue Type: Improvement Reporter: Elliott Clark Meta can have very different request rates than any other region. We shouldn't use the same call queue length. For example: If a normal request takes 100ms ( long scan or large get ) but a call to meta is all in memory so it takes < 1ms So a call queue length of 100 represents multiple seconds of work for normal requests, but less than a second for meta. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15460) Fix infer issues in hbase-common
Elliott Clark created HBASE-15460: - Summary: Fix infer issues in hbase-common Key: HBASE-15460 URL: https://issues.apache.org/jira/browse/HBASE-15460 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15458) Fix bugs that Infer finds in HBase
Elliott Clark created HBASE-15458: - Summary: Fix bugs that Infer finds in HBase Key: HBASE-15458 URL: https://issues.apache.org/jira/browse/HBASE-15458 Project: HBase Issue Type: Bug Reporter: Elliott Clark http://fbinfer.com/ -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15459) Fix infer issues in hbase-server
Elliott Clark created HBASE-15459: - Summary: Fix infer issues in hbase-server Key: HBASE-15459 URL: https://issues.apache.org/jira/browse/HBASE-15459 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-14979) Update to the newest Zookeeper release
[ https://issues.apache.org/jira/browse/HBASE-14979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-14979. --- Resolution: Duplicate > Update to the newest Zookeeper release > -- > > Key: HBASE-14979 > URL: https://issues.apache.org/jira/browse/HBASE-14979 > Project: HBase > Issue Type: Improvement > Components: Zookeeper >Affects Versions: 1.2.0 >Reporter: Elliott Clark >Assignee: Elliott Clark > Fix For: 2.0.0, 1.3.0 > > Attachments: HBASE-14979.patch > > > ZOOKEEPER-706 is nice to have for anyone running replication that sometimes > gets stalled. We should update to the latest patch version. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15441) Fix WAL splitting when region has moved multiple times
Elliott Clark created HBASE-15441: - Summary: Fix WAL splitting when region has moved multiple times Key: HBASE-15441 URL: https://issues.apache.org/jira/browse/HBASE-15441 Project: HBase Issue Type: Bug Reporter: Elliott Clark Currently WAL splitting is broken when a region has been opened multiple times in recent minutes. Region open and region close write event markers to the wal. These markers should have the sequence id in them. However it is currently getting 1. That means that if a region has moved multiple times in the last few mins then multiple split log workers will try and create the recovered edits file for sequence id 1. One of the workers will fail and on failing they will delete the recovered edits. Causing all split wal attempts to fail. We need to: # make sure that open and close get the correct sequence id for open. # Filter all region events from recovered edits -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15427) Get gtest using buck rather than putting it in third-party
Elliott Clark created HBASE-15427: - Summary: Get gtest using buck rather than putting it in third-party Key: HBASE-15427 URL: https://issues.apache.org/jira/browse/HBASE-15427 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15419) Push HBASE-14850 to apache's git.
Elliott Clark created HBASE-15419: - Summary: Push HBASE-14850 to apache's git. Key: HBASE-15419 URL: https://issues.apache.org/jira/browse/HBASE-15419 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Now that Apache's git isn't locked down it's time to push the code where it should be. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15401) Update third-party deps and add Zoopeeker
[ https://issues.apache.org/jira/browse/HBASE-15401?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15401. --- Resolution: Fixed > Update third-party deps and add Zoopeeker > - > > Key: HBASE-15401 > URL: https://issues.apache.org/jira/browse/HBASE-15401 > Project: HBase > Issue Type: Sub-task >Reporter: Elliott Clark >Assignee: Elliott Clark > Attachments: HBASE-15401.patch > > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15418) Clean up un-used warning in test util
Elliott Clark created HBASE-15418: - Summary: Clean up un-used warning in test util Key: HBASE-15418 URL: https://issues.apache.org/jira/browse/HBASE-15418 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark Assignee: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15402) Add on thrift server that uses cpp client.
Elliott Clark created HBASE-15402: - Summary: Add on thrift server that uses cpp client. Key: HBASE-15402 URL: https://issues.apache.org/jira/browse/HBASE-15402 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15401) Add Zookeeper to third party
Elliott Clark created HBASE-15401: - Summary: Add Zookeeper to third party Key: HBASE-15401 URL: https://issues.apache.org/jira/browse/HBASE-15401 Project: HBase Issue Type: Sub-task Reporter: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15353) Add metric for number of CallQueueTooBigException's
Elliott Clark created HBASE-15353: - Summary: Add metric for number of CallQueueTooBigException's Key: HBASE-15353 URL: https://issues.apache.org/jira/browse/HBASE-15353 Project: HBase Issue Type: Bug Reporter: Elliott Clark Assignee: Elliott Clark This exception is being thrown more. We should add a metric for this one. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15348) Fix tests broken by recent metrics re-work
Elliott Clark created HBASE-15348: - Summary: Fix tests broken by recent metrics re-work Key: HBASE-15348 URL: https://issues.apache.org/jira/browse/HBASE-15348 Project: HBase Issue Type: Bug Components: metrics, test Reporter: Elliott Clark Counts are appoximate and go away. We should re-work the tests or test utils to make them work now. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15316) Add the ability to cache ROOT_INDEX on reads only
Elliott Clark created HBASE-15316: - Summary: Add the ability to cache ROOT_INDEX on reads only Key: HBASE-15316 URL: https://issues.apache.org/jira/browse/HBASE-15316 Project: HBase Issue Type: Bug Reporter: Elliott Clark For larger data sets it's sometimes not needed to fit the entire index in memory ( there can be cold spots in the data, too much data in index, etc). However it's almost always needed to cache the root index. It's always the hottest blocks of the entire region. We should allow the root index block to be cached in memory on write. We should also do that by default. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15222) Use HDR histograms rather than hadoop or yammer's
Elliott Clark created HBASE-15222: - Summary: Use HDR histograms rather than hadoop or yammer's Key: HBASE-15222 URL: https://issues.apache.org/jira/browse/HBASE-15222 Project: HBase Issue Type: Bug Reporter: Elliott Clark Running the benchmarks now, but it looks like the results are pretty extreme. The locking in our histograms is pretty extreme. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15211) Don't run the CatalogJanitor if there are regions in transition
Elliott Clark created HBASE-15211: - Summary: Don't run the CatalogJanitor if there are regions in transition Key: HBASE-15211 URL: https://issues.apache.org/jira/browse/HBASE-15211 Project: HBase Issue Type: Improvement Reporter: Elliott Clark Assignee: Elliott Clark This could make things a little safer to make sure that CatalogJanitor doesn't do something weird while a cluster is starting up. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15166) Remove delayed rpc
[ https://issues.apache.org/jira/browse/HBASE-15166?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15166. --- Resolution: Duplicate > Remove delayed rpc > -- > > Key: HBASE-15166 > URL: https://issues.apache.org/jira/browse/HBASE-15166 > Project: HBase > Issue Type: Bug >Reporter: Elliott Clark > > It's a feature that's not used and makes our RPC much more complex than is > necessary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15166) Remove delayed rpc
Elliott Clark created HBASE-15166: - Summary: Remove delayed rpc Key: HBASE-15166 URL: https://issues.apache.org/jira/browse/HBASE-15166 Project: HBase Issue Type: Bug Reporter: Elliott Clark It's a feature that's not used and makes our RPC much more complex than is necessary. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15165) AsyncProcess can spin wait indefinitly
Elliott Clark created HBASE-15165: - Summary: AsyncProcess can spin wait indefinitly Key: HBASE-15165 URL: https://issues.apache.org/jira/browse/HBASE-15165 Project: HBase Issue Type: Bug Reporter: Elliott Clark When the max outstanding requests per region or per server is reached, all threads trying to send more requests to that server will spin and will spin forever with no sleep, and no regard for timeouts. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15146) Don't block on Reader threads queueing to a scheduler queue
Elliott Clark created HBASE-15146: - Summary: Don't block on Reader threads queueing to a scheduler queue Key: HBASE-15146 URL: https://issues.apache.org/jira/browse/HBASE-15146 Project: HBase Issue Type: Bug Reporter: Elliott Clark Priority: Blocker -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15137) CallTimeoutException should be grounds for PFFE
Elliott Clark created HBASE-15137: - Summary: CallTimeoutException should be grounds for PFFE Key: HBASE-15137 URL: https://issues.apache.org/jira/browse/HBASE-15137 Project: HBase Issue Type: Bug Reporter: Elliott Clark Assignee: Elliott Clark -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15136) Explore different queuing behaviors while busy
Elliott Clark created HBASE-15136: - Summary: Explore different queuing behaviors while busy Key: HBASE-15136 URL: https://issues.apache.org/jira/browse/HBASE-15136 Project: HBase Issue Type: New Feature Components: IPC/RPC Reporter: Elliott Clark http://queue.acm.org/detail.cfm?id=2839461 -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15135) Add metrics for storefile age
Elliott Clark created HBASE-15135: - Summary: Add metrics for storefile age Key: HBASE-15135 URL: https://issues.apache.org/jira/browse/HBASE-15135 Project: HBase Issue Type: New Feature Reporter: Elliott Clark In order to make sure that compactions are fully up to date it would be nice to have metrics on: * Max storefile age * Min storefile age * Average storefile age * Number of reference files If we could have those metrics per region and per regionserver it would be awesome. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15134) Add visibility into Flush and Compaction queues
Elliott Clark created HBASE-15134: - Summary: Add visibility into Flush and Compaction queues Key: HBASE-15134 URL: https://issues.apache.org/jira/browse/HBASE-15134 Project: HBase Issue Type: Bug Reporter: Elliott Clark On busy spurts we can see regionservers start to see large queues for compaction. It's really hard to tell if the server is queueing a lot of compactions for the same region, lots of compactions for lots of regions, or just falling behind. For flushes much the same. There can be flushes in queue that aren't being run because of delayed flushes. There's no way to know from the metrics how many flushes are for each region, how many are delayed. Etc. We should add either more metrics around this ( num per region, max per region, min per region ) or add on a UI page that has the list of compactions and flushes. Or both. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Created] (HBASE-15100) Master WALProcs still never clean up
Elliott Clark created HBASE-15100:
-
Summary: Master WALProcs still never clean up
Key: HBASE-15100
URL: https://issues.apache.org/jira/browse/HBASE-15100
Project: HBase
Issue Type: Bug
Components: master
Affects Versions: 1.2.0
Reporter: Elliott Clark
{code}
bin/hdfs dfs -ls /hbase/MasterProcWALs | wc -l
218631
{code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
[jira] [Created] (HBASE-15083) Gets from Multiactions are not counted in metrics for gets.
Elliott Clark created HBASE-15083: - Summary: Gets from Multiactions are not counted in metrics for gets. Key: HBASE-15083 URL: https://issues.apache.org/jira/browse/HBASE-15083 Project: HBase Issue Type: Bug Reporter: Elliott Clark RSRpcServices#get updates the get metrics. However Multiactions do not. -- This message was sent by Atlassian JIRA (v6.3.4#6332)
[jira] [Resolved] (HBASE-15078) Add ability to start/stop hbase local cluster for tests and gtest support.
[ https://issues.apache.org/jira/browse/HBASE-15078?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Elliott Clark resolved HBASE-15078. --- Resolution: Fixed > Add ability to start/stop hbase local cluster for tests and gtest support. > -- > > Key: HBASE-15078 > URL: https://issues.apache.org/jira/browse/HBASE-15078 > Project: HBase > Issue Type: Sub-task >Reporter: Mikhail Antonov >Assignee: Mikhail Antonov > -- This message was sent by Atlassian JIRA (v6.3.4#6332)
