好的,我再研究研究,谢谢 在 2020/5/12 下午12:01,“Benchao Li”<user-zh-return-3495-gougang_1991=163....@flink.apache.org 代表 libenc...@gmail.com> 写入:
看起来你使用的应该不是blink planner,因为blink planner里的Trigger跟DataStream里面的Trigger是不一样的。 所以如果你用的是legacy planner,可能这个方法是可行的。(我对legacy planner不熟悉) 但是如果你以后转到blink planner,这个应该是搞不了的。 gang.gou <gougang_1...@163.com> 于2020年5月12日周二 上午11:18写道: > 我想通过trigger的方式来实现这个需求,想法是重写EventTimeTrigger > ,在首条记录进入系统时,触发一下purge,通过ValueStatus > 记录状态。但是现在遇到的问题是,会重复触发多少。而且窗口关闭时的触发,WindowFunction > Function收到的记录也不对。请问是我使用方式不对吗? > > 自定义的trigger: > public class SessionComputeTrigger extends Trigger<SessionConvertBean, > TimeWindow> { > private static final long serialVersionUID = 1L; > static Logger logger = > LoggerFactory.getLogger(SessionComputeTrigger.class); > private final ReducingStateDescriptor<Long> countDesc = new > ReducingStateDescriptor<>("count", new SessionComputeTrigger.Sum(), > LongSerializer.INSTANCE); > > private final ValueStateDescriptor<Boolean> existDesc = new > ValueStateDescriptor<>("exist", BooleanSerializer.INSTANCE); > > private SessionComputeTrigger() { > } > > @Override > public TriggerResult onElement(SessionConvertBean element, long > timestamp, TimeWindow window, TriggerContext ctx) throws Exception { > ValueState<Boolean> exist = ctx.getPartitionedState(existDesc); > ReducingState<Long> count = ctx.getPartitionedState(countDesc); > > if (exist == null || exist.value() == null || !exist.value()) { > count.add(1L); > logger.info("mau fire =====>exits:{} > ====>count:{}====>date_time:{}", exist.value(), count.get(), > element.dateTime); > exist.update(true); > return TriggerResult.FIRE; > } > > if (window.maxTimestamp() <= ctx.getCurrentWatermark()) { > // if the watermark is already past the window fire immediately > return TriggerResult.FIRE; > } else { > ctx.registerEventTimeTimer(window.maxTimestamp()); > return TriggerResult.CONTINUE; > } > } > > @Override > public TriggerResult onEventTime(long time, TimeWindow window, > TriggerContext ctx) { > return time == window.maxTimestamp() ? TriggerResult.FIRE : > TriggerResult.CONTINUE; > } > > @Override > public TriggerResult onProcessingTime(long time, TimeWindow window, > TriggerContext ctx) throws Exception { > return TriggerResult.CONTINUE; > } > > @Override > public void clear(TimeWindow window, TriggerContext ctx) throws > Exception { > ctx.deleteEventTimeTimer(window.maxTimestamp()); > } > > @Override > public boolean canMerge() { > return true; > } > > @Override > public void onMerge(TimeWindow window, > OnMergeContext ctx) { > long windowMaxTimestamp = window.maxTimestamp(); > if (windowMaxTimestamp > ctx.getCurrentWatermark()) { > ctx.registerEventTimeTimer(windowMaxTimestamp); > } > } > > @Override > public String toString() { > return "EventTimeTrigger()"; > } > > public static SessionComputeTrigger create() { > return new SessionComputeTrigger(); > } > > private static class Sum implements ReduceFunction<Long> { > private static final long serialVersionUID = 1L; > > @Override > public Long reduce(Long value1, Long value2) throws Exception { > logger.info("value1={},value2={}", value1, value2); > return value1 + value2; > } > > } > } > > 输出值: > > mau fire =====>exits:null > ====>count:1====>date_time:2020-05-10T23:22:40.298+0800 > (date_time是当前记录的eventtime) > > result=>用户:48b132cb-f40b-4cf5-bf7f-b6411525b1982,开始时间:2020-05-10T23:22:40.298+0800,结束时间:2020-05-10T23:23:10.298+0800,间隔:30000.0,总数:1 > mau fire =====>exits:null > ====>count:1====>date_time:2020-05-10T23:22:43.298+0800 > > result=>用户:48b132cb-f40b-4cf5-bf7f-b6411525b1982,开始时间:2020-05-10T23:22:40.298+0800,结束时间:2020-05-10T23:23:13.298+0800,间隔:33000.0,总数:2 > mau fire =====>exits:null > ====>count:1====>date_time:2020-05-10T23:22:46.298+0800 > > result=>用户:48b132cb-f40b-4cf5-bf7f-b6411525b1982,开始时间:2020-05-10T23:22:40.298+0800,结束时间:2020-05-10T23:23:16.298+0800,间隔:36000.0,总数:3 > mau fire =====>exits:null > ====>count:1====>date_time:2020-05-10T23:22:49.298+0800 > > > > 在 2020/5/11 下午4:12,“Benchao Li”<user-zh-return-3480-gougang_1991= > 163....@flink.apache.org 代表 libenc...@gmail.com> 写入: > > 这个暂时应该是没有办法做到这一点。或者你可以用两个query来实现这个? > 比如一个query是统计first_value;第二个是真正的session window。 > > gang.gou <gougang_1...@163.com> 于2020年5月11日周一 下午3:07写道: > > > Hi, > > > > 我想使用Flink的Session Window > > > 去统计一个用户的在线访问时长,和统计当前活跃的用户数量,目前只能在window结束的时候才输出一条包含窗口开始和结束时间的记录,怎么在窗口创建的时候就先输出一条记录,结束的时候再去更新这条记录呢,谢谢! > > > > > > -- > > Benchao Li > School of Electronics Engineering and Computer Science, Peking > University > Tel:+86-15650713730 > Email: libenc...@gmail.com; libenc...@pku.edu.cn > > > -- Benchao Li School of Electronics Engineering and Computer Science, Peking University Tel:+86-15650713730 Email: libenc...@gmail.com; libenc...@pku.edu.cn