Re: [DISCUSS] Measure latency by storing event time in WriteStatus

2021-02-09 Thread Vinoth Chandar
> > > > > > > ------原始邮件-- > > > 发件人: > > > "dev" > > > < > > > xu.shiyan.raym...@gmail

Re: [DISCUSS] Measure latency by storing event time in WriteStatus

2021-02-05 Thread Raymond Xu
> > > > > Best, > > liujinhui > > > > > > > > > > --原始邮件-- > > 发件人: > > "dev" > > < > > xu.shiyan.raym...

Re: [DISCUSS] Measure latency by storing event time in WriteStatus

2021-02-02 Thread Vinoth Chandar
"dev" > < > xu.shiyan.raym...@gmail.com; > 发送时间:2021年2月3日(星期三) 上午9:55 > 收件人:"dev" > 主题:[DISCUSS] Measure latency by storing event time in WriteStatus > > > > Hi all, > > It is a common re

??????[DISCUSS] Measure latency by storing event time in WriteStatus

2021-02-02 Thread ??????
+1??It feels great, but in actual business scenarios, due to some data abnormalities, the event time will be inaccurate. This situation seems to affect the monitoring of this indicator? Best?? liujinhui ---- ??:

[DISCUSS] Measure latency by storing event time in WriteStatus

2021-02-02 Thread Raymond Xu
Hi all, It is a common requirement to measure data latency in Hudi tables. There isn't a metric reporting latency directly from HoodieMetrics. I'm proposing to measure the latency for each commit by this formula latency = commitTime + commitDuration - earliest event time of the incoming records