回复:请教大佬一个在flink调用kafka数据源时'scan.startup.mode'参数的使用问题
建议先不使用flink的Kafka来消费,先自己编码写一个kafka消费看是否还是有这个问题,作个对比,看是否是flink提供的kafka接口的问题。 | | 魏子涵 | | 邮箱:wzh1007181...@163.com | 签名由 网易邮箱大师 定制 在2020年08月14日 13:27,yulu yang 写道: 我这个flink作业和和分组都是新创建的,没有抽取历史 group是新的 魏子涵 于2020年8月14日周五 下午1:20写道: > Kafka客户端的group. id参数有改吗? > > > | | > 魏子涵 > | > | > 邮箱:wzh1007181...@163.com > | > > 签名由 网易邮箱大师 定制 > > 在2020年08月14日 12:44,yulu yang 写道: > 在flink作业中从kafka数据源获取数据,将 参数设置为'scan.startup.mode' = 'earliest-offset', > 检测flink运行结果时,发现只抽取了kafka中的newest数据,没有获取到oldest数据。 > 不知道是不是我这里'scan.startup.mode' 参数用的不对。 > Flink 版本1.11.1 kafka版本 2.6.0 >
回复:请教大佬一个在flink调用kafka数据源时'scan.startup.mode'参数的使用问题
Kafka客户端的group. id参数有改吗? | | 魏子涵 | | 邮箱:wzh1007181...@163.com | 签名由 网易邮箱大师 定制 在2020年08月14日 12:44,yulu yang 写道: 在flink作业中从kafka数据源获取数据,将 参数设置为'scan.startup.mode' = 'earliest-offset', 检测flink运行结果时,发现只抽取了kafka中的newest数据,没有获取到oldest数据。 不知道是不是我这里'scan.startup.mode' 参数用的不对。 Flink 版本1.11.1 kafka版本 2.6.0
Re:Re: The bytecode of the class does not match the source code
I'm sure the two versions match up. Following is the pic comparing codes in IDEA https://img-blog.csdnimg.cn/20200805180232929.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NTRE5yaG1t,size_16,color_FF,t_70 At 2020-08-05 16:46:11, "Chesnay Schepler" wrote: Please make sure you have loaded the correct source jar, and aren't by chance still using the 1.11.0 source jar. On 05/08/2020 09:57, 魏子涵 wrote: Hi, everyone: I found the 【org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl】 class in【flink-runtime_2.11-1.11.1.jar】does not match the source code. Is it a problem we need to fix(if it is, what should we do)? or just let it go?
Re:Re: The bytecode of the class does not match the source code
I'm sure the two versions match up. Following is the pic comparing codes in IDEA https://img-blog.csdnimg.cn/20200805180232929.png?x-oss-process=image/watermark,type_ZmFuZ3poZW5naGVpdGk,shadow_10,text_aHR0cHM6Ly9ibG9nLmNzZG4ubmV0L0NTRE5yaG1t,size_16,color_FF,t_70 At 2020-08-05 16:46:11, "Chesnay Schepler" wrote: Please make sure you have loaded the correct source jar, and aren't by chance still using the 1.11.0 source jar. On 05/08/2020 09:57, 魏子涵 wrote: Hi, everyone: I found the 【org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl】 class in【flink-runtime_2.11-1.11.1.jar】does not match the source code. Is it a problem we need to fix(if it is, what should we do)? or just let it go?
The bytecode of the class does not match the source code
Hi, everyone: I found the 【org.apache.flink.runtime.jobmaster.slotpool.SlotPoolImpl】 class in【flink-runtime_2.11-1.11.1.jar】does not match the source code. Is it a problem we need to fix(if it is, what should we do)? or just let it go?