[ 
https://issues.apache.org/jira/browse/HBASE-1502?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13023465#comment-13023465
 ] 

jirapos...@reviews.apache.org commented on HBASE-1502:
------------------------------------------------------


-----------------------------------------------------------
This is an automatically generated e-mail. To reply, visit:
https://reviews.apache.org/r/647/
-----------------------------------------------------------

Review request for hbase.


Summary
-------

This patch does not completely remove heartbeats.  It unburdens the heartbeat 
of control messages; now heartbeat is used to
send the master load only (At most recent hackathon we had rough agreement that 
we'd keep heartbeat to carry load)... if we miss some, no biggie.   

RPC version changed on HMasterRegionInfo since the regionServerStartup and 
regionServerReport arguments have changed.
We pass a String now instead of HServerAddress so this should help with our DNS 
issues where the two sides disagree.

Removed HMsg.

HServerAddress as been sort_of_deprecated.  Its in our API so can't remove it 
easily (its embedded inside HRegionLocation).
Otherwise, we don't use it internally anymore.

HServerInfo is deprecated.  Server meta data is now available in new class 
ServerName and load lives apart from HSI now.

Fixed up regionserver and master startup so they now look the same.

New tests

Cruft cleanup.


This addresses bug hbase-1502.
    https://issues.apache.org/jira/browse/hbase-1502


Diffs
-----

  src/main/java/org/apache/hadoop/hbase/ClusterStatus.java 26a8bef 
  src/main/java/org/apache/hadoop/hbase/HConstants.java ce0ea12 
  src/main/java/org/apache/hadoop/hbase/HMsg.java 87beb00 
  src/main/java/org/apache/hadoop/hbase/HRegionLocation.java bd353b8 
  src/main/java/org/apache/hadoop/hbase/HServerAddress.java 7f8a472 
  src/main/java/org/apache/hadoop/hbase/HServerInfo.java 7aa8bd9 
  src/main/java/org/apache/hadoop/hbase/HServerLoad.java 2372053 
  src/main/java/org/apache/hadoop/hbase/LocalHBaseCluster.java 0d696ab 
  src/main/java/org/apache/hadoop/hbase/MasterAddressTracker.java 1da9742 
  src/main/java/org/apache/hadoop/hbase/Server.java df396fa 
  src/main/java/org/apache/hadoop/hbase/ServerName.java PRE-CREATION 
  src/main/java/org/apache/hadoop/hbase/avro/AvroUtil.java d7a1e67 
  src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java be31179 
  src/main/java/org/apache/hadoop/hbase/catalog/MetaEditor.java c2ee031 
  src/main/java/org/apache/hadoop/hbase/catalog/MetaReader.java 6e22cf5 
  src/main/java/org/apache/hadoop/hbase/catalog/RootLocationEditor.java aee64c5 
  src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java e022fe4 
  src/main/java/org/apache/hadoop/hbase/client/HConnection.java d8a2fc3 
  src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java 53decd6 
  src/main/java/org/apache/hadoop/hbase/client/HTable.java bb3a8fa 
  
src/main/java/org/apache/hadoop/hbase/client/RetriesExhaustedWithDetailsException.java
 6c62024 
  src/main/java/org/apache/hadoop/hbase/coprocessor/BaseMasterObserver.java 
9576c48 
  src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java db0870b 
  src/main/java/org/apache/hadoop/hbase/executor/EventHandler.java de13e27 
  src/main/java/org/apache/hadoop/hbase/executor/RegionTransitionData.java 
a55f9d6 
  src/main/java/org/apache/hadoop/hbase/io/HbaseObjectWritable.java d8f8463 
  src/main/java/org/apache/hadoop/hbase/ipc/HBaseServer.java ec28de4 
  src/main/java/org/apache/hadoop/hbase/ipc/HMasterRegionInterface.java 25139b3 
  src/main/java/org/apache/hadoop/hbase/ipc/HRegionInterface.java 663cab5 
  src/main/java/org/apache/hadoop/hbase/master/ActiveMasterManager.java 66a3345 
  src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java e9b2af2 
  src/main/java/org/apache/hadoop/hbase/master/DeadServer.java efcbb99 
  src/main/java/org/apache/hadoop/hbase/master/HMaster.java 62789d3 
  src/main/java/org/apache/hadoop/hbase/master/LoadBalancer.java fe5f7e1 
  src/main/java/org/apache/hadoop/hbase/master/MasterCoprocessorHost.java 
c0e9417 
  src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java 7b5181a 
  src/main/java/org/apache/hadoop/hbase/master/ServerManager.java 4b8a59a 
  
src/main/java/org/apache/hadoop/hbase/master/handler/MetaServerShutdownHandler.java
 eb01a6a 
  src/main/java/org/apache/hadoop/hbase/master/handler/OpenedRegionHandler.java 
c478ab7 
  
src/main/java/org/apache/hadoop/hbase/master/handler/ServerShutdownHandler.java 
60662c2 
  src/main/java/org/apache/hadoop/hbase/master/handler/SplitRegionHandler.java 
fee0b3d 
  src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java 516d06d 
  src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java 85b4144 
  src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java 
4051e0b 
  src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java 
1b521f6 
  src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLog.java 7569992 
  src/main/java/org/apache/hadoop/hbase/replication/ReplicationPeer.java 
548c8eb 
  src/main/java/org/apache/hadoop/hbase/replication/ReplicationZookeeper.java 
f282c6d 
  
src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
 78c3b42 
  src/main/java/org/apache/hadoop/hbase/rest/StorageClusterStatusResource.java 
578ee14 
  src/main/java/org/apache/hadoop/hbase/util/Addressing.java PRE-CREATION 
  src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java 55423af 
  src/main/java/org/apache/hadoop/hbase/util/HBaseFsckRepair.java b624d28 
  src/main/java/org/apache/hadoop/hbase/util/JVMClusterUtil.java baf0c27 
  src/main/java/org/apache/hadoop/hbase/zookeeper/RegionServerTracker.java 
0437484 
  src/main/java/org/apache/hadoop/hbase/zookeeper/RootRegionTracker.java 
692b608 
  src/main/java/org/apache/hadoop/hbase/zookeeper/ZKAssign.java 34e17b6 
  src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java c01fe67 
  src/main/resources/hbase-webapps/master/master.jsp 198a188 
  src/main/resources/hbase-webapps/master/table.jsp bba9e5b 
  src/test/java/org/apache/hadoop/hbase/MiniHBaseCluster.java 28d2205 
  src/test/java/org/apache/hadoop/hbase/TestHRegionLocation.java PRE-CREATION 
  src/test/java/org/apache/hadoop/hbase/TestHServerAddress.java PRE-CREATION 
  src/test/java/org/apache/hadoop/hbase/TestHServerInfo.java PRE-CREATION 
  src/test/java/org/apache/hadoop/hbase/TestRegionRebalancing.java 11b94fe 
  src/test/java/org/apache/hadoop/hbase/TestSerialization.java 40874fc 
  src/test/java/org/apache/hadoop/hbase/TestServerName.java PRE-CREATION 
  src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTracker.java e25184e 
  
src/test/java/org/apache/hadoop/hbase/catalog/TestCatalogTrackerOnCluster.java 
66c6959 
  src/test/java/org/apache/hadoop/hbase/catalog/TestMetaReaderEditor.java 
60320a3 
  src/test/java/org/apache/hadoop/hbase/coprocessor/TestMasterObserver.java 
a15d53a 
  
src/test/java/org/apache/hadoop/hbase/master/BROKE_FIX_TestKillingServersFromMaster.java
 21b76fa 
  src/test/java/org/apache/hadoop/hbase/master/OOMEHMaster.java bf5ed03 
  src/test/java/org/apache/hadoop/hbase/master/TestActiveMasterManager.java 
1a19941 
  src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitor.java 3f332ff 
  src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java 
915cdf6 
  src/test/java/org/apache/hadoop/hbase/master/TestHMasterRPCException.java 
a1bb6af 
  src/test/java/org/apache/hadoop/hbase/master/TestLoadBalancer.java e5da229 
  src/test/java/org/apache/hadoop/hbase/master/TestLogsCleaner.java 19220fb 
  src/test/java/org/apache/hadoop/hbase/master/TestMaster.java c4ea83f 
  src/test/java/org/apache/hadoop/hbase/master/TestMasterFailover.java 5a334e0 
  src/test/java/org/apache/hadoop/hbase/master/TestRestartCluster.java dff6c1b 
  src/test/java/org/apache/hadoop/hbase/master/TestRollingRestart.java 6089ae6 
  
src/test/java/org/apache/hadoop/hbase/regionserver/TestMasterAddressManager.java
 319a74e 
  src/test/java/org/apache/hadoop/hbase/regionserver/TestScanner.java 7ff6a2e 
  
src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransactionOnCluster.java
 42ce89d 
  
src/test/java/org/apache/hadoop/hbase/regionserver/handler/TestOpenRegionHandler.java
 c2437bd 
  
src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
 20a1ff8 
  src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java a055082 

Diff: https://reviews.apache.org/r/647/diff


Testing
-------

Most tests pass.  I have yet to run it on a cluster.  Doing that now.


Thanks,

Michael



> Remove need for heartbeats in HBase
> -----------------------------------
>
>                 Key: HBASE-1502
>                 URL: https://issues.apache.org/jira/browse/HBASE-1502
>             Project: HBase
>          Issue Type: Task
>            Reporter: Nitay Joffe
>            Assignee: stack
>            Priority: Blocker
>             Fix For: 0.92.0
>
>         Attachments: 1502-4.txt, 1502-v2.txt, 1502-v5.txt, 1502-v6.txt, 
> 1502-v7.txt, 1502.txt
>
>
> HBase currently uses heartbeats between region servers and the master, 
> piggybacking information on them when it can. This issue is to investigate if 
> we can get rid of the need for those using ZooKeeper events.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira

Reply via email to