Hi all,
It is a common requirement to measure data latency in Hudi tables. There
isn't a metric reporting latency directly from HoodieMetrics. I'm proposing
to measure the latency for each commit by this formula
latency = commitTime + commitDuration - earliest event time of the incoming
records
+1?? It feels great, but in actual business scenarios, due to some data
abnormalities, the event time will be inaccurate.
This situation seems to affect the monitoring of this indicator?
Best??
liujinhui
-- --
??:
"dev"
> <
> xu.shiyan.raym...@gmail.com>;
> 发送时间: 2021年2月3日(星期三) 上午9:55
> 收件人: "dev"
> 主题: [DISCUSS] Measure latency by storing event time in WriteStatus
>
>
>
> Hi all,
>
> It is a common
; >
> >
> > Best，
> > liujinhui
> >
> >
> >
> >
> > -- 原始邮件 --
> > 发件人:
> > "dev"
> > <
> > xu.shiyan.raym..
>
> > >
> > > ---------- 原始邮件 ------
> > > 发件人:
> > > "dev"
> > > <
> > > xu.shiyan.raym...@gmai
