[WikimediaMobile] event logging bloat

2015-08-11 Thread Jon Katz
Hi folks, Back in January, the size of MobileWebClickTracking had gotten to be over 200 gb, making it so slow as to be unusable. As a result, we split up the into 3 separate tables. However, it seems that 90% of the clicks are coming from the article table (or adding search created bloat) and

Re: [WikimediaMobile] event logging bloat

2015-08-11 Thread Gergo Tisza
On Tue, Aug 11, 2015 at 12:29 PM, Jon Katz jk...@wikimedia.org wrote: However, it seems that 90% of the clicks are coming from the article table (or adding search created bloat) and MobileWebUIClickTracking_10742159 is now approaching 300gb. Mostly this is due to search. I would encourage

Re: [WikimediaMobile] event logging bloat

2015-08-11 Thread Federico Leva (Nemo)
Gergo Tisza, 11/08/2015 22:44: replace the user agent and the URL with an empty string. Is there still no way to avoid storing those fields altogether? They are both nasty. Nemo ___ Mobile-l mailing list Mobile-l@lists.wikimedia.org

Re: [WikimediaMobile] event logging bloat

2015-08-11 Thread Gergo Tisza
On Tue, Aug 11, 2015 at 2:59 PM, Federico Leva (Nemo) nemow...@gmail.com wrote: Gergo Tisza, 11/08/2015 22:44: replace the user agent and the URL with an empty string. Is there still no way to avoid storing those fields altogether? They are both nasty. User agent is a default field and