[ https://issues.apache.org/jira/browse/SAMZA-2688?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lakshmi Manasa Gaduputi updated SAMZA-2688: ------------------------------------------- Description: Introduce config: task.elasticity.factor which defaults to 1. If elasticity factor = 1 then each task consumes the whole input SSP. If elasticity factor = X, then each task is split into X elastic tasks and each elastic task consumes 1/X th of the input SSP. Each of the 1/X th of the input SSP is referred to as the sub-SSP. Additionally, introduce sub-SSP concept as SystemStreamParitionKeyHash where each SSP has X KeyHashes. was: Introduce config: task.elasticity.factor which defaults to 1. If elasticity factor = 1 then each task consumes the whole input SSP. If elasticity factor = X, then each task is split into X virtual tasks and each virtual task consumes 1/X th of the input SSP. Each of the 1/X th of the input SSP is referred to as the sub-SSP. Additionally, introduce sub-SSP concept as SystemStreamParitionKeyHash where each SSP has X KeyHashes. > Elasticity: introduce configs and sub-partition concept > ------------------------------------------------------- > > Key: SAMZA-2688 > URL: https://issues.apache.org/jira/browse/SAMZA-2688 > Project: Samza > Issue Type: Sub-task > Reporter: Lakshmi Manasa Gaduputi > Assignee: Lakshmi Manasa Gaduputi > Priority: Major > > Introduce config: task.elasticity.factor which defaults to 1. If elasticity > factor = 1 then each task consumes the whole input SSP. If elasticity factor > = X, then each task is split into X elastic tasks and each elastic task > consumes 1/X th of the input SSP. Each of the 1/X th of the input SSP is > referred to as the sub-SSP. > Additionally, introduce sub-SSP concept as SystemStreamParitionKeyHash where > each SSP has X KeyHashes. -- This message was sent by Atlassian Jira (v8.3.4#803005)