Vu Le created KAFKA-8664: ---------------------------- Summary: non-JSON format messages when streaming data from Kafka to Mongo Key: KAFKA-8664 URL: https://issues.apache.org/jira/browse/KAFKA-8664 Project: Kafka Issue Type: Bug Components: KafkaConnect Affects Versions: 2.1.1 Reporter: Vu Le Attachments: MongoSinkConnector.properties, log_error_when_stream_data_not_a_json_format.txt
Hi team, I can stream data from Kafka to MongoDB with JSON messages. I use [MongoDB Kafka Connector|[https://github.com/mongodb/mongo-kafka/blob/master/docs/install.md]] However, if I send a non-JSON format message the Connector died. Please see the log file for details. My config file: {code:java} name=mongo-sink topics=testconnector.class=com.mongodb.kafka.connect.MongoSinkConnector tasks.max=1 key.ignore=true # Specific global MongoDB Sink Connector configuration connection.uri=mongodb://localhost:27017 database=test_kafka collection=transaction max.num.retries=3 retries.defer.timeout=5000 type.name=kafka-connect key.converter=org.apache.kafka.connect.json.JsonConverter key.converter.schemas.enable=false value.converter=org.apache.kafka.connect.json.JsonConverter value.converter.schemas.enable=false {code} I have 2 separated questions: # how to ignore the message which is non-json format? # how to defined a default-key for this kind of message (for example: abc -> \{{ { "non-json": "abc" } }} -- This message was sent by Atlassian JIRA (v7.6.14#76016)