Re: Problem with Flink job and Kafka.

2021-10-20 Thread Marco Villalobos
Hi Qingsheng, Thank you. I am running Flink in EMR 6.3.0 which uses Flink version 1.12.1. We AWS MSK Kafka, and we are currently using Kafka 2.2.1. The stack trace seems empty, it only states this error: org.apache.kafka.common.errors.UnsupportedVersionException: Attempted to write a

Re: Problem with Flink job and Kafka.

2021-10-18 Thread Qingsheng Ren
Hi Marco, Sorry I forgot to cc the user mailing list just now. From the exception message it looks like a versioning issue. Could you provide some additional information, such as Flink & Kafka connector version, Kafka broker version, and full exception stack? Also it will be helpful to paste

Problem with Flink job and Kafka.

2021-10-18 Thread Marco Villalobos
I have the simplest Flink job that simply deques off of a kafka topic and writes to another kafka topic, but with headers, and manually copying the event time into the kafka sink. It works as intended, but sometimes I am getting this error: