??????????kafka??????Offset?????????? kafka-run-class.sh kafka.tools.ConsumerOffsetChecker --zookeeper zkhost:2181 --group ${group.id} --topic ${topic_name} ????zkhost ??group.id??topic_name???? ???????????? Group Topic Pid Offset logSize Lag Owner test dy_event 0 8115733 10658588 2542855 none test dy_event 1 8114221 10658585 2544364 none test dy_event 2 8115173 10658587 2543414 none test dy_event 3 8115127 10658585 2543458 none test dy_event 4 8115160 10658587 2543427 none
????pid Offset?????????????????????????????????? ------------------ ???????? ------------------ ??????: "Benchao Li"<libenc...@gmail.com>; ????????: 2020??1??12??(??????) ????9:46 ??????: "user-zh"<user-zh@flink.apache.org>; ????: Re: Re: flink????kafka????????????kafka?????????????????? Flink????commit offset??Kafka??[1]??????????checkpoint??????checkpoint???????????????????? offset ??????commit????kafka??????offset????????????????????????commit??offset??????????????????????????????????????flink??????topic??????offset??????????check????????????????commit offset. [1] https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/kafka.html#kafka-consumers-offset-committing-behaviour-configuration wqpapa <wqp...@126.com> ??2020??1??12?????? ????9:34?????? > ????????????????????????????kafka??????????????????????????????????????????????????????java????????kafka??????????kafka-consumer-groups.sh > --describe????????????????????????????flink????????????????????kafka???????????????? > > > > > > > > > > ?? 2020-01-12 21:17:40??"Benchao Li" <libenc...@gmail.com> ?????? > >setStartFromGroupOffsets > > >????????kafka??????????offset??????????flink??????????kafka????????????consumer??offset??????????????????????kafka > >consumer??????'auto.offset.reset'??????????partition??offset?? > > > >????????????????????[1]. > > > >[1] > > > https://ci.apache.org/projects/flink/flink-docs-master/dev/connectors/kafka.html#kafka-consumers-start-position-configuration > > > >wqpapa <wqp...@126.com> ??2020??1??12?????? ????9:09?????? > > > >> flink????FlinkKafkaConsumer????kafka??????????group.id > >> ??setStartFromGroupOffsets??????????????kafka??????????group.id???????????? > >> kafka??0.9????????zk????????????????group.id??????kafka-consumer-groups.sh --describe > >> --group ???????????????????????????????? > > > > > > > >-- > > > >Benchao Li > >School of Electronics Engineering and Computer Science, Peking University > >Tel:+86-15650713730 > >Email: libenc...@gmail.com; libenc...@pku.edu.cn > -- Benchao Li School of Electronics Engineering and Computer Science, Peking University Tel:+86-15650713730 Email: libenc...@gmail.com; libenc...@pku.edu.cn