ramesh-muthusamy commented on pull request #9319: URL: https://github.com/apache/kafka/pull/9319#issuecomment-731236707
We will get the same results because the task distribution considers all the tasks independent of a connector. On Fri, Nov 20, 2020 at 8:26 PM Basile Deustua <notificati...@github.com> wrote: > @BDeus <https://github.com/BDeus> it is currently not possible to > differentiate the load parameters of a connector, it is assumed that all > connectors are equally while ingestion. We do have similar scenarios where > we run multiple clusters instead of loading a single cluster with variety > of loads. > > I'm aware that the connector's load cannot be differentiate. > But currently, in eager mode, it's assure that each connector is equally > balanced on each workers and that worker as the same amount of tasks. > I'm asking myself if it will be the same result or if it randomly move > tasks from all connectors to workers to assure an equally balanced tasks > (and can lead to have a worker with more task from "connector1" than > another worker) ? > Thank you for your answers > > — > You are receiving this because you were mentioned. > Reply to this email directly, view it on GitHub > <https://github.com/apache/kafka/pull/9319#issuecomment-731217584>, or > unsubscribe > <https://github.com/notifications/unsubscribe-auth/AB57QP3GW5U2I2G2BQCF3BTSQZ7RXANCNFSM4RVUWQIQ> > . > ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
