Yifan Ying created KAFKA-3134:
---------------------------------

             Summary: Missing required configuration "value.deserializer" when 
initializing a KafkaConsumer with a valid "valueDeserializer"
                 Key: KAFKA-3134
                 URL: https://issues.apache.org/jira/browse/KAFKA-3134
             Project: Kafka
          Issue Type: Bug
    Affects Versions: 0.9.0.0
            Reporter: Yifan Ying


I tried to initialize a KafkaConsumer object using 

{code}
public KafkaConsumer(Properties properties, Deserializer<K> keyDeserializer,
                         Deserializer<V> valueDeserializer)
{code}

Then I got an exception as follows:
{code}
Caused by: org.apache.kafka.common.config.ConfigException: Missing required 
configuration "value.deserializer" which has no default value.
        at org.apache.kafka.common.config.ConfigDef.parse(ConfigDef.java:148)
        at 
org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:49)
        at 
org.apache.kafka.common.config.AbstractConfig.<init>(AbstractConfig.java:56)
        at 
org.apache.kafka.clients.consumer.ConsumerConfig.<init>(ConsumerConfig.java:336)
        at 
org.apache.kafka.clients.consumer.KafkaConsumer.<init>(KafkaConsumer.java:518)
        .....
{code}

Then I went ConsumerConfig.java file and found this block of code causing the 
problem:
{code}
public static Map<String, Object> addDeserializerToConfig(Map<String, Object> 
configs,
                                                              Deserializer<?> 
keyDeserializer,
                                                              Deserializer<?> 
valueDeserializer) {
        Map<String, Object> newConfigs = new HashMap<String, Object>();
        newConfigs.putAll(configs);
        if (keyDeserializer != null)
            newConfigs.put(KEY_DESERIALIZER_CLASS_CONFIG, 
keyDeserializer.getClass());
        if (keyDeserializer != null)
            newConfigs.put(VALUE_DESERIALIZER_CLASS_CONFIG, 
valueDeserializer.getClass());
        return newConfigs;
    }

    public static Properties addDeserializerToConfig(Properties properties,
                                                     Deserializer<?> 
keyDeserializer,
                                                     Deserializer<?> 
valueDeserializer) {
        Properties newProperties = new Properties();
        newProperties.putAll(properties);
        if (keyDeserializer != null)
            newProperties.put(KEY_DESERIALIZER_CLASS_CONFIG, 
keyDeserializer.getClass().getName());
        if (keyDeserializer != null)
            newProperties.put(VALUE_DESERIALIZER_CLASS_CONFIG, 
valueDeserializer.getClass().getName());
        return newProperties;
    }
{code}

Instead of checking valueDeserializer, the code checks keyDeserializer every 
time. So when keyDeserializer is null but valueDeserializer is not, the 
valueDeserializer property will never get set. 




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to