Hi, the `dt` field is the time in UTC (no timezone specified) at which the request ends being processed by Varnish. Cheers Joseph
On Mon, Mar 15, 2021 at 8:36 AM Luca Toscano <ltosc...@wikimedia.org> wrote: > +A mailing list for the Analytics Team at WMF and everybody who has an > interest in Wikipedia and analytics. <analytics@lists.wikimedia.org> > > Hi! > > I added the Analytics mailing list in Cc so other people can chime in, > this is the canonical way to follow up with us and the community, please > avoid direct email if possible :) > > Thanks! > > Luca > > > > On Sat, Mar 13, 2021 at 10:57 PM Ho Chung <chungho4...@gmail.com> wrote: > >> Hello >> >> I have some problem request , about refine_webrequest.hql >> >> >> In this file timestamp is use utc ? >> >> This file is it connect wmf_raw.webrequest and wmf.webrequest ? >> >> Because i can't read the code have add Z / +/- zone time >> >> >> >> -- Hack to get a correct timestamp because of hive inconsistent >> conversion >> >> CAST(unix_timestamp(dt, "yyyy-MM-dd'T'HH:mm:ss") * 1.0 as timestamp) as >> ts, >> >> >> https://github.com/wikimedia/analytics-refinery/blob/master/oozie/webrequest/load/refine_webrequest.hql >> >> I emailed wiki legal request 3 month they not sure , can you clearly ask >> me . >> >> If not use utc, is use your server clock or , my computer clock? >> >> >> _______________________________________________ > Analytics mailing list > Analytics@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/analytics > -- Joseph Allemandou (joal) (he / him) Staff Data Engineer Wikimedia Foundation
_______________________________________________ Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
