Bowen Li created FLINK-15262: -------------------------------- Summary: kafka connector doesn't read from beginning immediately when 'connector.startup-mode' = 'earliest-offset' Key: FLINK-15262 URL: https://issues.apache.org/jira/browse/FLINK-15262 Project: Flink Issue Type: Bug Components: Connectors / Kafka Affects Versions: 1.10.0 Reporter: Bowen Li Assignee: Jiangjie Qin Fix For: 1.10.0, 1.11.0
I created a kafka table in Flink to read from my kakfa topic (already has messages in it) in earliest offset, but `select * from test` query in Flink doesn't start to read until a new message comes. If no new message arrives, the query just sit there and never produce result. What I expect is that the query should immediate produce result on all existing message without having to wait for a new message to "trigger" data processing. DDL that I used according to DDL document at https://ci.apache.org/projects/flink/flink-docs-release-1.9/dev/table/connect.html#kafka-connector {code:java} create table test(name String, age Int) with ( 'connector.type' = 'kafka', 'connector.version' = 'universal', 'connector.topic' = 'test', 'connector.properties.zookeeper.connect' = 'localhost:2181', 'connector.properties.bootstrap.servers' = 'localhost:9092', 'connector.startup-mode' = 'earliest-offset', 'format.type' = 'csv', 'update-mode' = 'append' ); {code} -- This message was sent by Atlassian Jira (v8.3.4#803005)