Hello team, Is it possible to somehow retrieve metadata like topic, partition and offset information from the consumed messages from Kafka source? I mean, if that’s possible to do so in Python. I understand, that in Java, there is the KafkaRecord construct, which offers these metadata, but I haven’t found any alternative in Python.
The reasoning is that we need to consume CDC data, where the offset indicates the message’s order, i.e. the order of the CDC operation, and we need to store it to process it later in BigQuery. Best regards, Ondrej
