This is an automated email from the ASF dual-hosted git repository.
hulee pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/helix.git.
from c2f3c08 Fix ClusterAccessor::createCluster wrt CloudConfig (#937)
new adebe17 Add MetadataStoreRoutingData interface and TrieRoutingData
class to helix-rest
new 1323b25 Enable two test runs with multiZk system property (#710)
new 2eaf882 Upgrade AbstractTestClass with multi-ZK support in helix-rest
(#717)
new c967c7c Upgrade ZkTestBase with multi-ZK support in helix-core (#712)
new d5a042d Add MockMetadataStoreDirectoryServer (#719)
new a4edbd2 Add MetadataStoreRoutingDataReader interface and
ZkRoutingDataReader class to helix-rest (#714)
new 08949f8 Add MetadataStoreDirectory and ZkMetadataStoreDirectory (#720)
new 15cc55e Add TrieRoutingData constructor (#731)
new 661729b Add MetadataStoreRoutingDataWriter with
DistributedLeaderElection (#727)
new c6504f3 Add REST read endpoints to Helix Rest to provide resource
access to metadata store directory (#744)
new 527c215 Rebase ZooScalability from upstream master
new ab4f41e Implement getAllMappingUnderPath and getMetadataStoreRealm in
ZkMetadataStoreDirectory
new e960917 Add write REST endpoints to helix rest for metadata store
directory (#757)
new 7512cfd Add RealmAwareZkClient and RealmAwareZkClientFactory
interfaces (#745)
new c990679 Add validation logic to MSD write operations (#759)
new 01ae06a Create metadata-store-directory-common module (#771)
new 6e4f27d Fix tests in apache/zooscalability and rebase from
apache/master (#787)
new 642ee20 Add DedicatedZkClient and update DedicatedZkClientFactory
(#765)
new df6453e Add REST read endpoints to helix-rest for metadata store
directory (#761)
new 65afec0 [helix-rest] Add endpoint to get namespace routing data (#799)
new 6f9c5c9 Add HttpRoutingDataReader (#775)
new f180cc9 Add getShardingKeyInPath to MetadataStoreRoutingData (#817)
new 3af4c1f Implement request forwarding for ZkRoutingDataWriter (#788)
new 6b2a6ff Fix InvalidRoutingData error message in tests (#821)
new fbddb11 Update bump-up.command and ivy imports (#824)
new 0980063 Add SharedZkClient/InnerSharedZkClient implementation (#796)
new c9a9b7e Improve MetadataStoreDirectoryAccessor endpoints and fix bugs
in ZkRoutingDataReader/Writer
new add11db Make MSDS endpoint configurable for HttpRoutingDataReader
(#836)
new f645496 Add FederatedZkClient (#789)
new 7d46f2a Make ConfigAccessor and ZkUtil realm-aware (#838)
new 1f0d278 Implement setRoutingData for MetadataStoreDirectoryService
(#844)
new c7ab0f2 Make RealmAwareZkClient implementations use
HttpRoutingDataReader for routing data (#819)
new 45f0989 Instrument ConfigAccessor's constructors (#856)
new b01e804 Add rerunFailingTestsCount config to surefire-plugin (#865)
new 7b57e9e Make ClusterSetup realm-aware (#861)
new 92aa631 Make ZkCacheBaseDataAccessor and ZkHelixPropertyStore
realm-aware (#863)
new 6e6862b Make ZkHelixClusterVerifier and its child classes realm-aware
(#867)
new 73ccbc9 Make ZkBaseDataAccessor realm-aware (#855)
new 289085f Make ZKHelixAdmin and ZKHelixManager Realm-aware (#846)
new 56ebbd1 Reformat ZkBaseDataAccessor (#893)
new ef027a9 Update listClusters() in ZkHelixAdmin (#895)
new 7184988 Make ZkBucketDataAccessor realm-aware (#894)
new f90b194 Make ZkUtil realm-aware (#896)
new 8523baa Add integration tests for Helix Java APIs (#892)
new b16ac22 Fix setRoutingData boolean handling; fix leader forwarding
url construction (#902)
new e3f751c Use Java Generics and inheritance to reduce duplicate code in
Helix API Builders (#899)
new 2d310f3 Make Helix REST realm-aware (#908)
new b7f6f3c Make multiZkEnabled configurable in HelixRestNamespace (#915)
new e303ef2 Fix getClusters() in ZKHelixAdmin for multi-zk mode (#916)
new 9381a80 Fix MetadataStoreDirectory routing data cache refresh bug
(#933)
The 50 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
bump-up.command | 19 +
.../java/org/apache/helix/SystemPropertyKeys.java | 21 +
.../main/java/org/apache/helix/ConfigAccessor.java | 49 +-
.../java/org/apache/helix/SystemPropertyKeys.java | 70 ---
.../apache/helix/manager/zk/CallbackHandler.java | 7 +-
.../manager/zk/GenericBaseDataAccessorBuilder.java | 145 ++++++
.../helix/manager/zk/GenericZkHelixApiBuilder.java | 139 ++++++
.../helix/manager/zk/ParticipantManager.java | 7 +-
.../org/apache/helix/manager/zk/ZKHelixAdmin.java | 168 +++++--
.../apache/helix/manager/zk/ZKHelixManager.java | 106 +++-
.../java/org/apache/helix/manager/zk/ZKUtil.java | 103 ++--
.../helix/manager/zk/ZkBaseDataAccessor.java | 407 +++++++++------
.../helix/manager/zk/ZkBucketDataAccessor.java | 24 +-
.../helix/manager/zk/ZkCacheBaseDataAccessor.java | 106 ++--
.../helix/manager/zk/client/SharedZkClient.java | 16 +-
.../java/org/apache/helix/task/TaskDriver.java | 10 +-
.../java/org/apache/helix/tools/ClusterSetup.java | 71 ++-
.../BestPossibleExternalViewVerifier.java | 78 ++-
.../ClusterVerifiers/ClusterLiveNodesVerifier.java | 32 +-
.../StrictMatchExternalViewVerifier.java | 66 +--
.../ClusterVerifiers/ZkHelixClusterVerifier.java | 119 ++++-
.../src/test/java/org/apache/helix/TestHelper.java | 5 +-
.../test/java/org/apache/helix/ZkTestHelper.java | 21 +-
.../java/org/apache/helix/common/ZkTestBase.java | 75 ++-
.../helix/integration/TestEnableCompression.java | 53 +-
.../integration/TestResourceGroupEndtoEnd.java | 3 +-
.../controller/TestControllerLeadershipChange.java | 4 +-
.../manager/ClusterControllerManager.java | 3 +-
.../manager/ClusterDistributedController.java | 3 +-
.../manager/MockParticipantManager.java | 3 +-
.../helix/integration/manager/ZkTestManager.java | 5 +-
.../multizk/TestMultiZkHelixJavaApis.java | 484 ++++++++++++++++++
.../helix/integration/task/WorkflowGenerator.java | 27 +-
.../apache/helix/manager/zk/TestHandleSession.java | 5 +-
helix-rest/pom.xml | 5 +
.../helix/rest/common/HelixRestNamespace.java | 38 +-
...ContextPropertyKeys.java => HttpConstants.java} | 15 +-
.../org/apache/helix/rest/common/ServletType.java | 7 +-
.../rest/metadatastore/MetadataStoreDirectory.java | 137 ++++++
.../metadatastore/ZkMetadataStoreDirectory.java | 374 ++++++++++++++
.../accessor/MetadataStoreRoutingDataReader.java | 50 ++
.../accessor/MetadataStoreRoutingDataWriter.java | 74 +++
.../accessor/ZkRoutingDataReader.java | 160 ++++++
.../accessor/ZkRoutingDataWriter.java | 428 ++++++++++++++++
.../concurrency/ZkDistributedLeaderElection.java | 141 ++++++
.../datamodel/MetadataStoreShardingKey.java | 61 +++
.../MetadataStoreShardingKeysByRealm.java | 56 +++
.../apache/helix/rest/server/HelixRestMain.java | 8 +-
.../apache/helix/rest/server/HelixRestServer.java | 5 +-
.../apache/helix/rest/server/ServerContext.java | 305 ++++++++++--
.../resources/helix/AbstractHelixResource.java | 14 +-
.../server/resources/helix/ClusterAccessor.java | 16 +-
.../resources/helix/PropertyStoreAccessor.java | 6 +-
.../server/resources/helix/ResourceAccessor.java | 10 +-
.../MetadataStoreDirectoryAccessor.java | 392 +++++++++++++++
.../resources/zookeeper/ZooKeeperAccessor.java | 19 +-
.../TestZkMetadataStoreDirectory.java | 375 ++++++++++++++
.../accessor/TestZkRoutingDataReader.java | 136 +++++
.../accessor/TestZkRoutingDataWriter.java | 223 +++++++++
.../integration/TestRoutingDataUpdate.java | 176 +++++++
.../helix/rest/server/AbstractTestClass.java | 179 ++++---
.../MetadataStoreDirectoryAccessorTestBase.java | 149 ++++++
.../rest/server/TestMSDAccessorLeaderElection.java | 261 ++++++++++
.../server/TestMetadataStoreDirectoryAccessor.java | 516 +++++++++++++++++++
.../mock/MockMetadataStoreDirectoryAccessor.java | 124 +++++
.../LICENSE | 0
.../NOTICE | 0
...adata-store-directory-common-0.9.2-SNAPSHOT.ivy | 8 +-
.../pom.xml | 62 ++-
.../src/assemble/assembly.xml | 6 +-
.../src/main/config/log4j.properties | 0
.../msdcommon/callback/RoutingDataListener.java | 13 +-
.../constant/MetadataStoreRoutingConstants.java | 95 ++++
.../datamodel/MetadataStoreRoutingData.java | 78 +++
.../helix/msdcommon/datamodel/TrieRoutingData.java | 327 ++++++++++++
.../exception/InvalidRoutingDataException.java | 12 +-
.../mock/MockMetadataStoreDirectoryServer.java | 157 ++++++
.../helix/msdcommon/util/ZkValidationUtil.java | 34 +-
.../src/test/conf/testng.xml | 2 +-
.../helix/msdcommon/constant/TestConstants.java | 23 +-
.../msdcommon/datamodel/TestTrieRoutingData.java | 346 +++++++++++++
.../mock/TestMockMetadataStoreDirectoryServer.java | 115 +++++
.../src/test/resources/log4j.properties | 0
pom.xml | 3 +-
zookeeper-api/pom.xml | 16 +
.../helix/zookeeper/api/client/HelixZkClient.java | 131 +++++
.../zookeeper/api/client/RealmAwareZkClient.java | 231 +++++++--
.../{HelixZkClient.java => ZkClientType.java} | 24 +-
.../api/factory/RealmAwareZkClientFactory.java | 33 ++
.../zookeeper/impl/client/DedicatedZkClient.java | 504 +++++++++++++++++++
.../zookeeper/impl/client/FederatedZkClient.java | 345 ++++++++++---
.../zookeeper/impl/client/SharedZkClient.java | 547 ++++++++++++++++++---
.../impl/factory/DedicatedZkClientFactory.java | 16 +-
.../impl/factory/HelixZkClientFactory.java | 5 +-
.../impl/factory/SharedZkClientFactory.java | 114 ++++-
.../zookeeper/util/HttpRoutingDataReader.java | 197 ++++++++
zookeeper-api/src/test/conf/testng.xml | 4 +-
.../helix/zookeeper/constant/TestConstants.java | 45 ++
.../apache/helix/zookeeper/impl/ZkTestBase.java | 148 ++++++
.../client/RealmAwareZkClientFactoryTestBase.java | 180 +++++++
.../impl/client/RealmAwareZkClientTestBase.java | 66 +++
.../impl/client/TestDedicatedZkClient.java | 25 +-
.../impl/client/TestFederatedZkClient.java | 283 +++++++++++
.../zookeeper/impl/client/TestSharedZkClient.java | 69 +++
.../zookeeper/util/TestHttpRoutingDataReader.java | 120 +++++
zookeeper-api/zookeeper-api-0.9.2-SNAPSHOT.ivy | 1 +
106 files changed, 10302 insertions(+), 997 deletions(-)
delete mode 100644
helix-core/src/main/java/org/apache/helix/SystemPropertyKeys.java
create mode 100644
helix-core/src/main/java/org/apache/helix/manager/zk/GenericBaseDataAccessorBuilder.java
create mode 100644
helix-core/src/main/java/org/apache/helix/manager/zk/GenericZkHelixApiBuilder.java
create mode 100644
helix-core/src/test/java/org/apache/helix/integration/multizk/TestMultiZkHelixJavaApis.java
copy
helix-rest/src/main/java/org/apache/helix/rest/common/{ContextPropertyKeys.java
=> HttpConstants.java} (79%)
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/MetadataStoreDirectory.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/ZkMetadataStoreDirectory.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/accessor/MetadataStoreRoutingDataReader.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/accessor/MetadataStoreRoutingDataWriter.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/accessor/ZkRoutingDataReader.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/accessor/ZkRoutingDataWriter.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/concurrency/ZkDistributedLeaderElection.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/datamodel/MetadataStoreShardingKey.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/metadatastore/datamodel/MetadataStoreShardingKeysByRealm.java
create mode 100644
helix-rest/src/main/java/org/apache/helix/rest/server/resources/metadatastore/MetadataStoreDirectoryAccessor.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/metadatastore/TestZkMetadataStoreDirectory.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/metadatastore/accessor/TestZkRoutingDataReader.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/metadatastore/accessor/TestZkRoutingDataWriter.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/metadatastore/integration/TestRoutingDataUpdate.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/server/MetadataStoreDirectoryAccessorTestBase.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/server/TestMSDAccessorLeaderElection.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/server/TestMetadataStoreDirectoryAccessor.java
create mode 100644
helix-rest/src/test/java/org/apache/helix/rest/server/mock/MockMetadataStoreDirectoryAccessor.java
copy {helix-rest => metadata-store-directory-common}/LICENSE (100%)
copy {helix-rest => metadata-store-directory-common}/NOTICE (100%)
copy helix-rest/helix-rest-0.9.2-SNAPSHOT.ivy =>
metadata-store-directory-common/metadata-store-directory-common-0.9.2-SNAPSHOT.ivy
(88%)
copy {zookeeper-api => metadata-store-directory-common}/pom.xml (65%)
copy {helix-admin-webapp =>
metadata-store-directory-common}/src/assemble/assembly.xml (88%)
copy {zookeeper-api =>
metadata-store-directory-common}/src/main/config/log4j.properties (100%)
copy
helix-core/src/main/java/org/apache/helix/manager/zk/zookeeper/IZkStateListener.java
=>
metadata-store-directory-common/src/main/java/org/apache/helix/msdcommon/callback/RoutingDataListener.java
(78%)
create mode 100644
metadata-store-directory-common/src/main/java/org/apache/helix/msdcommon/constant/MetadataStoreRoutingConstants.java
create mode 100644
metadata-store-directory-common/src/main/java/org/apache/helix/msdcommon/datamodel/MetadataStoreRoutingData.java
create mode 100644
metadata-store-directory-common/src/main/java/org/apache/helix/msdcommon/datamodel/TrieRoutingData.java
copy
helix-core/src/main/java/org/apache/helix/manager/zk/zookeeper/IZkStateListener.java
=>
metadata-store-directory-common/src/main/java/org/apache/helix/msdcommon/exception/InvalidRoutingDataException.java
(71%)
create mode 100644
metadata-store-directory-common/src/main/java/org/apache/helix/msdcommon/mock/MockMetadataStoreDirectoryServer.java
copy
helix-core/src/main/java/org/apache/helix/api/cloud/CloudInstanceInformation.java
=>
metadata-store-directory-common/src/main/java/org/apache/helix/msdcommon/util/ZkValidationUtil.java
(64%)
copy {zookeeper-api =>
metadata-store-directory-common}/src/test/conf/testng.xml (94%)
copy
helix-core/src/main/java/org/apache/helix/healthcheck/ParticipantHealthReportCollector.java
=>
metadata-store-directory-common/src/test/java/org/apache/helix/msdcommon/constant/TestConstants.java
(59%)
create mode 100644
metadata-store-directory-common/src/test/java/org/apache/helix/msdcommon/datamodel/TestTrieRoutingData.java
create mode 100644
metadata-store-directory-common/src/test/java/org/apache/helix/msdcommon/mock/TestMockMetadataStoreDirectoryServer.java
copy {zookeeper-api =>
metadata-store-directory-common}/src/test/resources/log4j.properties (100%)
copy
zookeeper-api/src/main/java/org/apache/helix/zookeeper/api/client/{HelixZkClient.java
=> ZkClientType.java} (55%)
create mode 100644
zookeeper-api/src/main/java/org/apache/helix/zookeeper/impl/client/DedicatedZkClient.java
create mode 100644
zookeeper-api/src/main/java/org/apache/helix/zookeeper/util/HttpRoutingDataReader.java
create mode 100644
zookeeper-api/src/test/java/org/apache/helix/zookeeper/constant/TestConstants.java
create mode 100644
zookeeper-api/src/test/java/org/apache/helix/zookeeper/impl/ZkTestBase.java
create mode 100644
zookeeper-api/src/test/java/org/apache/helix/zookeeper/impl/client/RealmAwareZkClientFactoryTestBase.java
create mode 100644
zookeeper-api/src/test/java/org/apache/helix/zookeeper/impl/client/RealmAwareZkClientTestBase.java
copy
helix-core/src/test/java/org/apache/helix/integration/task/TaskTestBase.java =>
zookeeper-api/src/test/java/org/apache/helix/zookeeper/impl/client/TestDedicatedZkClient.java
(58%)
create mode 100644
zookeeper-api/src/test/java/org/apache/helix/zookeeper/impl/client/TestFederatedZkClient.java
create mode 100644
zookeeper-api/src/test/java/org/apache/helix/zookeeper/impl/client/TestSharedZkClient.java
create mode 100644
zookeeper-api/src/test/java/org/apache/helix/zookeeper/util/TestHttpRoutingDataReader.java