Sudarshan Vasudevan created GOBBLIN-1455:
--------------------------------------------
Summary: Limit gobblin.kafka.minContainersForTopic config to the
number of partitions of the topic
Key: GOBBLIN-1455
URL: https://issues.apache.org/jira/browse/GOBBLIN-1455
Project: Apache Gobblin
Issue Type: Bug
Components: gobblin-kafka
Affects Versions: 0.15.0
Reporter: Sudarshan Vasudevan
Assignee: Shirshanka Das
Fix For: 0.16.0
We need to upper bound the config gobblin.kafka.minContainersForTopic so as not
to exceed the number of partitions for the topic. When this config value
exceeds the number of partitions, current behavior incorrectly estimates the
work unit size in KafkaTopicGroupingWorkUnitPacker.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
