[GitHub] helix pull request #298: Bump up ivy versions

2019-01-29 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/298 Bump up ivy versions From 0.8.3-SNAPSHOT to 0.8.4-SNAPSHOT to make it consistent with pom.xml You can merge this pull request into a Git repository by running: $ git pull https://github.com

[GitHub] helix pull request #295: PR

2018-11-13 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/295 PR You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you can review and apply these changes as the patch at

[GitHub] helix pull request #293: PR

2018-11-02 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/293 PR You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you can review and apply these changes as the patch at

[GitHub] helix pull request #288: PR

2018-11-01 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/288 PR You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you can review and apply these changes as the patch at

[GitHub] helix pull request #284: PR

2018-10-31 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/284 PR You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you can review and apply these changes as the patch at

[GitHub] helix pull request #277: [HELIX-770] HELIX: Fix a possible NPE in loadBalanc...

2018-10-29 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/277 [HELIX-770] HELIX: Fix a possible NPE in loadBalance in IntermediateS… …tateCalcStage In isLoadBalanceDownwardForAllReplicas() in IntermediateStateCalcStage, statePriorityMap was

[GitHub] helix pull request #276: PR

2018-10-29 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/276 PR You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you can review and apply these changes as the patch at

[GitHub] helix pull request #275: PR

2018-10-26 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/275 PR You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you can review and apply these changes as the patch at

[GitHub] helix pull request #271: [HELIX-756] TASK: Change LOG mode from info to debu...

2018-10-26 Thread narendly
Github user narendly closed the pull request at: https://github.com/apache/helix/pull/271 ---

[GitHub] helix pull request #271: [HELIX-756] TASK: Change LOG mode from info to debu...

2018-09-25 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/271 [HELIX-756] TASK: Change LOG mode from info to debug You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you

[GitHub] helix pull request #269: [HELIX-752] Add missing shutdown for RoutingTablePr...

2018-09-19 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/269 [HELIX-752] Add missing shutdown for RoutingTableProvider Changelist: 1. Add a missing shutdown() call to avoid having a background thread keep printing out error messages You can merge this

[GitHub] helix pull request #268: TASK: Fix AssignableInstanceComparator so that it s...

2018-09-19 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/268 TASK: Fix AssignableInstanceComparator so that it sorts unsupported quota types …nsupported quota types Currently, if the quota type does not exist, it will not sort AssignableInstances

[GitHub] helix pull request #263: [TASK] Fix removeJob so its behavior is more consis...

2018-07-24 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/263 [TASK] Fix removeJob so its behavior is more consistent with removeWorkflow …oveWorkflow Change the behavior of removeJob() so that it's more consistent with removeWorkflow(). Th

[GitHub] helix pull request #262: [TASK] Make AssignableInstanceManager listen on dat...

2018-07-24 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/262 [TASK] Make AssignableInstanceManager listen on data changes to update AssignableInstances …update AssignableInstances Previously, although AssignableInstanceManager provided an API for

[GitHub] helix pull request #261: [TASK] Allow undefined workflow/job types to be ass...

2018-07-24 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/261 [TASK] Allow undefined workflow/job types to be assigned as DEFAULT type …ULT type Previously, we ignored undefined types, that is workflow/job types that are not defined in

[GitHub] helix pull request #260: [TASK] Fix purgeExpiredJobs() so that jobs whose re...

2018-07-24 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/260 [TASK] Fix purgeExpiredJobs() so that jobs whose removal has failed do not get removed from DAG …led do not get removed from DAG Previously, even if the job removal had failed, Task

[GitHub] helix pull request #256: [TASK] Remove old comments from TestQuotaBasedSched...

2018-07-17 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/256 [TASK] Remove old comments from TestQuotaBasedScheduling Remove legacy comments that are no longer true to prevent confusion in the future. Changelist: 1. Remove old comments You can merge

[GitHub] helix pull request #255: Remove quotaType APIs and make jobs inherit type fr...

2018-07-17 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/255 Remove quotaType APIs and make jobs inherit type from workflows …kflows For quota-based task scheduling, for each job, we provided get/setQuotaType APIs. However, the use case for

[GitHub] helix pull request #252: Expose ExternalViews in RoutingTable and RoutingTab...

2018-07-16 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/252 Expose ExternalViews in RoutingTable and RoutingTableSnap… …shot Exposing ExternalViews in RoutingTable allows users an easy access to ExternalViews to track resource/partition/replica

[GitHub] helix pull request #251: Make AssignmentCalculators non-static so that tests...

2018-07-16 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/251 Make AssignmentCalculators non-static so that tests pass With the introduction of quota-based scheduling, every task that gets scheduled takes up a thread. However, previously these

[GitHub] helix pull request #250: Modify TestGetLastScheduledTaskTimestamp for increa...

2018-07-16 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/250 Modify TestGetLastScheduledTaskTimestamp for increased stability …ability This test was experiencing an intermittent failure. No inherent faults of its own, but sometimes tasks were not

[GitHub] helix pull request #249: Fix test configs for TestRecoveryLoadBalance

2018-07-16 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/249 Fix test configs for TestRecoveryLoadBalance There was a fix checked in for NumberOfErrorOrRecoveryPartitionThreshold in IntermediateStateCalcStage from less than equal to to strictly less than

[GitHub] helix pull request #247: Fix TestAssignableInstanceManagerControllerSwitch

2018-07-16 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/247 Fix TestAssignableInstanceManagerControllerSwitch This test uses RoutingTableProvider. It was not being shut down, causing an ExecutorService thread to continue executing periodic updates. This RB

[GitHub] helix pull request #246: [HELIX-732] Expose UserContentStore in TaskDriver

2018-07-16 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/246 [HELIX-732] Expose UserContentStore in TaskDriver There was a user request for this feature. The intended use is to allow for aggregation work reading from temporary data written by tasks, by

[GitHub] helix pull request #245: Fix TestStateTransitionThrottle and comparison oper...

2018-07-16 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/245 Fix TestStateTransitionThrottle and comparison operator change …hange Due to the change made in relation to allowing downward state transitions to take place while error or recovery

[GitHub] helix pull request #243: Add ThreadCountBasedAssignmentCalculator and integr...

2018-07-13 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/243 Add ThreadCountBasedAssignmentCalculator and integrate with Workflow/JobRebalancer and fix rebalancing logic …th Workflow/JobRebalancer and fix rebalancing logic For quota-based

[GitHub] helix pull request #238: [TASK] Modify APIs and TaskDataCache so that it has...

2018-07-12 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/238 [TASK] Modify APIs and TaskDataCache so that it has AssignableInstanceManager …stanceManager For scheduling based on quota type support, integration with the currently existing pipeline

[GitHub] helix pull request #236: Restore TaskConfig's quotaType related APIs tempora...

2018-07-12 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/236 Restore TaskConfig's quotaType related APIs temporarily Restore TaskConfig's quotaType related APIs temporarily You can merge this pull request into a Git repository by running:

[GitHub] helix pull request #234: [HELIX] Verify downward load balance and fix TestPa...

2018-07-10 Thread narendly
Github user narendly closed the pull request at: https://github.com/apache/helix/pull/234 ---

[GitHub] helix pull request #234: [HELIX] Verify downward load balance and fix TestPa...

2018-07-10 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/234 [HELIX] Verify downward load balance and fix TestPartitionMovementThrottle …nMovementThrottle TestPartitionMovementThrottle was failing after the improvement was made in

[GitHub] helix pull request #232: [TASK] Remove method for setting quota type for Tas...

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/232 [TASK] Remove method for setting quota type for TaskConfig Changelist: 1. A setter for quota type was removed to comply with the definition that quota types only exist down to the job level

[GitHub] helix pull request #231: Refactor AssignableInstanceManager

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/231 Refactor AssignableInstanceManager This RB refactors AssignableInstanceManager's constructor so that the actual building of AssignableInstances is separated into another public method. This a

[GitHub] helix pull request #230: [TEST] Remove null statement from AssignableInstanc...

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/230 [TEST] Remove null statement from AssignableInstanceManagerControllerSwitch …erControllerSwitch Controller was set to null during development of the test and never got removed after

[GitHub] helix pull request #229: Add quotaType field to WorkflowConfig and JobConfig

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/229 Add quotaType field to WorkflowConfig and JobConfig WorkflowConfig and JobConfig define workflows and jobs respectively. In order to support job scheduling based on quota types, we need to

[GitHub] helix pull request #228: Clean up code in ClusterDataCache

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/228 Clean up code in ClusterDataCache Clean up code in ClusterDataCache You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix 1321916

[GitHub] helix pull request #227: [TASK] Implement AssignableInstanceManager

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/227 [TASK] Implement AssignableInstanceManager AssignableInstanceManager supports job quotas in Task Framework by 1. Re-creates AssignableInstance map with correct resource usage based on TaskContexts

[GitHub] helix pull request #226: [HELIX-719] [HELIX] Verify downward load balance an...

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/226 [HELIX-719] [HELIX] Verify downward load balance and fix TestPartitio… …nMovementThrottle TestPartitionMovementThrottle was failing after the improvement was made in

[GitHub] helix pull request #225: [HELIX] Verify downward load balance and fix TestPa...

2018-07-09 Thread narendly
Github user narendly closed the pull request at: https://github.com/apache/helix/pull/225 ---

[GitHub] helix pull request #225: [HELIX] Verify downward load balance and fix TestPa...

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/225 [HELIX] Verify downward load balance and fix TestPartitionMovementThrottle …nMovementThrottle TestPartitionMovementThrottle was failing after the improvement was made in

[GitHub] helix pull request #217: Add NOP classes for quota management support

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/217 Add NOP classes for quota management support The following classes and interfaces were added: TaskAssigner, AssignableInstance, and TaskAssignResult. You can merge this pull request into a Git

[GitHub] helix pull request #216: [HELIX] Make downward load balance also be subject ...

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/216 [HELIX] Make downward load balance also be subject to StateTransitionThrottleConfig …teTransitionThrottleConfig In the previous implementation of allowing downward transitions, downward

[GitHub] helix pull request #215: [HaaS] Fix aggregate metrics in ClusterStatusMonito...

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/215 [HaaS] Fix aggregate metrics in ClusterStatusMonitor Names of the metrics have been fixed per Helix's convention and loops are now used instead of using delta values. You can merge this

[GitHub] helix pull request #213: [HELIX-713] Remove unused imports in TaskAssignment...

2018-07-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/213 [HELIX-713] Remove unused imports in TaskAssignmentCalculator [HELIX-713] Remove unused imports in TaskAssignmentCalculator You can merge this pull request into a Git repository by running

[GitHub] helix pull request #211: Allow downward state transition during recovery and...

2018-06-28 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/211 Allow downward state transition during recovery and add recovery threshold …recovery threshold Previously, a single partition requiring recovery balance would block all types of load

[GitHub] helix pull request #203: [HELIX-703] Change print statement to log statement

2018-06-25 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/203 [HELIX-703] Change print statement to log statement You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix master Alternatively you

[GitHub] helix pull request #192: Revert setting job state to NOT_STARTED on creation...

2018-04-19 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/192 Revert setting job state to NOT_STARTED on creation in WorkflowRebala… …ncer Temporarily remove because it could cause confusion on the client side You can merge this pull request into

[GitHub] helix pull request #189: Refactor log statements in RebalanceScheduler

2018-04-19 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/189 Refactor log statements in RebalanceScheduler You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix logRefactorRebalanceScheduler

[GitHub] helix pull request #188: [HELIX-699] Compare InstanceConfigs using their IDs...

2018-04-19 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/188 [HELIX-699] Compare InstanceConfigs using their IDs in RoutingTable A possible race condition was causing a NPE on InstanceConfig.getHostName(). Instead of comparing hostnames and ports, we

[GitHub] helix pull request #187: [HELIX-698] Add periodic refresh to RoutingTablePro...

2018-04-19 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/187 [HELIX-698] Add periodic refresh to RoutingTableProvider There have been incidents where RoutingTableProvider was not getting a proper refresh potentially due to the lag in ZKClient CallbackHandler

[GitHub] helix pull request #186: [HELIX-697] Add cluster level metrics in ClusterSta...

2018-04-19 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/186 [HELIX-697] Add cluster level metrics in ClusterStatusMonitor You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix

[GitHub] helix pull request #176: [HELIX-691] Allow users to update InstanceConfig

2018-04-09 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/176 [HELIX-691] Allow users to update InstanceConfig In helix-rest, we provide a method in InstanceAccessor, updateInstanceConfig, that updates the instance's config through a POST call. You can

[GitHub] helix pull request #174: [HELIX-691] Allow users to update InstanceConfig

2018-04-09 Thread narendly
Github user narendly closed the pull request at: https://github.com/apache/helix/pull/174 ---

[GitHub] helix pull request #174: [HELIX-691] Allow users to update InstanceConfig

2018-04-05 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/174 [HELIX-691] Allow users to update InstanceConfig In helix-rest, we provide a method in InstanceAccessor, updateInstanceConfig, that updates the instance's config through a POST call. You can

[GitHub] helix pull request #170: [HELIX-688] Add method that returns start time of t...

2018-03-27 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/170 [HELIX-688] Add method that returns start time of the most recent tas… …k scheduled getLastScheduledTaskTimestamp returns the timestamp for the start time of the task that was

[GitHub] helix pull request #168: Add synchronized delete for workflows

2018-03-26 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/168 Add synchronized delete for workflows This commit adds the method deleteAndWaitForCompletion that deletes and returns only after the delete operation has completed. The pre-existing delete does

[GitHub] helix pull request #167: Add synchronized delete for workflows

2018-03-26 Thread narendly
Github user narendly closed the pull request at: https://github.com/apache/helix/pull/167 ---

[GitHub] helix pull request #167: Add synchronized delete for workflows

2018-03-26 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/167 Add synchronized delete for workflows This commit adds the method deleteAndWaitForCompletion that deletes and returns only after the delete operation has completed. The pre-existing delete does

[GitHub] helix pull request #166: Add support for WorkflowContext in PropertyKey

2018-03-26 Thread narendly
GitHub user narendly reopened a pull request: https://github.com/apache/helix/pull/166 Add support for WorkflowContext in PropertyKey You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix propertykey Alternatively you

[GitHub] helix pull request #166: Add support for WorkflowContext in PropertyKey

2018-03-26 Thread narendly
Github user narendly closed the pull request at: https://github.com/apache/helix/pull/166 ---

[GitHub] helix pull request #166: Add support for WorkflowContext in PropertyKey

2018-03-26 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/166 Add support for WorkflowContext in PropertyKey You can merge this pull request into a Git repository by running: $ git pull https://github.com/narendly/helix propertykey Alternatively you

[GitHub] helix pull request #165: Set job state to NOT_STARTED at job creation in Wor...

2018-03-26 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/165 Set job state to NOT_STARTED at job creation in WorkflowRebalancer Previously, when jobs are created, their states were not set (null). Jobs are now in NOT_STARTED at workflow context creation for

[GitHub] helix pull request #164: Add health status API in ResourceAccessor

2018-03-26 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/164 Add health status API in ResourceAccessor The getResourceHealth method returns the status of all resources in a given cluster. The getPartitionHealth method returns the status of all partitions of

[GitHub] helix pull request #163: Add health status API in ResourceAccessor

2018-03-26 Thread narendly
Github user narendly closed the pull request at: https://github.com/apache/helix/pull/163 ---

[GitHub] helix pull request #163: Add health status API in ResourceAccessor

2018-03-26 Thread narendly
GitHub user narendly opened a pull request: https://github.com/apache/helix/pull/163 Add health status API in ResourceAccessor The getResourceHealth method returns the status of all resources in a given cluster. The getPartitionHealth returns the status of all partitions of a given