[
https://issues.apache.org/jira/browse/KAFKA-6890?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Allen Tang updated KAFKA-6890:
------------------------------
Description:
Right now, each source connector and sink connector inherit their client
configurations from the worker properties. Within the worker properties, all
configurations that have a prefix of "producer." or "consumer." are applied to
all source connectors and sink connectors respectively.
We should also provide connector-level overrides whereby connector properties
that are prefixed with "producer." and "consumer." are used to feed into the
producer and consumer clients embedded within source and sink connectors
respectively. The prefixes will be removed via a String#substring() call, and
the remainder of the connector property key will be used as the client
configuration key. The value is fed directly to the client as the configuration
value.
was:
Right now, each source connector and sink connector inherit their client
configurations from the worker properties. Within the worker properties, any
configuration that has a prefix of "producer." or "consumer." are applied to
all source connectors and sink connectors respectively.
We should also provide connector-level overrides whereby connector properties
that are prefixed with "producer." and "consumer." are used to feed into the
producer and consumer clients embedded within source and sink connectors
respectively. The prefixes will be removed via a String#substring() call, and
the remainder of the configuration key will be used as the client configuration
key. The value is fed directly to the client as the configuration value. If
there were client configurations defined at the worker level, they are
overriden by the connector-level client configurations.
> Add connector level configurability for producer/consumer client configs
> ------------------------------------------------------------------------
>
> Key: KAFKA-6890
> URL: https://issues.apache.org/jira/browse/KAFKA-6890
> Project: Kafka
> Issue Type: New Feature
> Components: KafkaConnect
> Reporter: Allen Tang
> Priority: Minor
>
> Right now, each source connector and sink connector inherit their client
> configurations from the worker properties. Within the worker properties, all
> configurations that have a prefix of "producer." or "consumer." are applied
> to all source connectors and sink connectors respectively.
> We should also provide connector-level overrides whereby connector properties
> that are prefixed with "producer." and "consumer." are used to feed into the
> producer and consumer clients embedded within source and sink connectors
> respectively. The prefixes will be removed via a String#substring() call, and
> the remainder of the connector property key will be used as the client
> configuration key. The value is fed directly to the client as the
> configuration value.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
