[ 
https://issues.apache.org/jira/browse/BOOKKEEPER-950?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15947206#comment-15947206
 ] 

Hudson commented on BOOKKEEPER-950:
-----------------------------------

FAILURE: Integrated in Jenkins build bookkeeper-master #1702 (See 
[https://builds.apache.org/job/bookkeeper-master/1702/])
BOOKKEEPER-950: Ledger placement policy to accomodate different storage (sijie: 
rev 0583175de72446d00088611000310b000e8e61df)
* (edit) 
bookkeeper-server/src/test/java/org/apache/bookkeeper/test/BookieClientTest.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/BookKeeperClientStats.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookkeeperInternalCallbacks.java
* (edit) 
bookkeeper-server/src/test/java/org/apache/bookkeeper/client/TestRackawareEnsemblePlacementPolicy.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/bookie/Bookie.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/bookie/BookieShell.java
* (add) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/GetBookieInfoProcessorV3.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/BookieWatcher.java
* (add) 
bookkeeper-server/src/test/java/org/apache/bookkeeper/client/TestGetBookieInfoTimeout.java
* (edit) bookkeeper-server/src/main/proto/BookkeeperProtocol.proto
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/bookie/LedgerDirsManager.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/bookie/LocalBookieEnsemblePlacementPolicy.java
* (add) 
bookkeeper-server/src/test/java/org/apache/bookkeeper/client/BookKeeperDiskSpaceWeightedLedgerPlacementTest.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/PerChannelBookieClient.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/EnsemblePlacementPolicy.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/RackawareEnsemblePlacementPolicyImpl.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/RegionAwareEnsemblePlacementPolicy.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookkeeperProtocol.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/DefaultEnsemblePlacementPolicy.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/conf/ClientConfiguration.java
* (add) 
bookkeeper-server/src/test/java/org/apache/bookkeeper/client/TestWeightedRandomSelection.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/BookKeeper.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/RackawareEnsemblePlacementPolicy.java
* (add) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/WeightedRandomSelection.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/bookie/BookKeeperServerStats.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookieClient.java
* (edit) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/proto/BookieRequestProcessor.java
* (add) 
bookkeeper-server/src/main/java/org/apache/bookkeeper/client/BookieInfoReader.java


> Ledger placement policy to accomodate different storage capacity of bookies
> ---------------------------------------------------------------------------
>
>                 Key: BOOKKEEPER-950
>                 URL: https://issues.apache.org/jira/browse/BOOKKEEPER-950
>             Project: Bookkeeper
>          Issue Type: New Feature
>            Reporter: Rithin Shetty
>            Assignee: Rithin Shetty
>             Fix For: 4.5.0
>
>   Original Estimate: 672h
>  Remaining Estimate: 672h
>
> In our environment, in Salesforce, we are likely to have bookie nodes with 
> different storage capacity: some will have 1TB others might have 3TB. Also, 
> our ledgers are likely going to be long lived. The current ledger placement 
> policy selects the bookies randomly leading to uniform distribution. This 
> would cause some of bookies to reach high utilization while the rest would be 
> underutilized. We need a new ledger placement policy that has higher 
> probability of selecting bookies with higher free disk space than the ones 
> with lower disk free space.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Reply via email to