https://bugzilla.wikimedia.org/show_bug.cgi?id=64181

--- Comment #2 from Andrew Otto <o...@wikimedia.org> ---
Doing some sleuthing.

I found a line that was in udp2log output, but not in kafkatee output:

  cp1046.eqiad.wmnet    2014-04-19T07:00:35    0.000164270    119.160.119.171  
 hit/200    17375    GET   
http://en.m.wikipedia.org/wiki/Mobile_application_software    -    text/html;
charset=UTF-8    -    -    Nokia205/2.0 (04.51) Profile/MIDP-2.1
Configuration/CLDC-1.1    en    zero=410-01

(Note that the sequence number has been removed from this line.)

I checked the webrequest_mobile Hive table in hdfs for this line, and it does
exist.  That means that the kafkatee missing logs were in the kafka log buffer,
as they were consumed properly by Camus into HDFS.

Still sleuthing...

-- 
You are receiving this mail because:
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l

Reply via email to