[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 Ricordisamoa ricordisa...@live.it changed: What|Removed |Added CC||ricordisa...@live.it --- Comment #5 from Ricordisamoa ricordisa...@live.it --- The patch has been merged, but I'm still seeing outdated statistics. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 Nemo federicol...@tiscali.it changed: What|Removed |Added Status|PATCH_TO_REVIEW |NEW --- Comment #6 from Nemo federicol...@tiscali.it --- Yes, as noted it the commit message the patch doesn't actually enable updates. just pave the way for them. I suppose it's a hardcoded crontab, unless there's some other repo I missed. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 Nemo federicol...@tiscali.it changed: What|Removed |Added CC||ar...@wikimedia.org --- Comment #3 from Nemo federicol...@tiscali.it --- So, I finally found the file responsible of updates navigating the obscure repo tree: http://git.wikimedia.org/blob/operations%2Fdebs%2Fwikistats.git/HEAD/usr%2Flib%2Fwikistats%2Fupdate.php If I understand correctly the update is run every 24h in a cron. The simplest change I can think of is: 1) add a sleep time of 1 second between a request and the following; 2) if a table has 1000 wikis or less (or is mediawikis), update them all; 3) if a table has 1000 wikis or more, update only 1000-1500, in this way: a) start from those whose last update was earlier, b) first update up to 500 wikis with more than 100 articles, c) then update up to 1000 of the other wikis. In this way we would update the whole Wikia table in a month (or one year once it's completely filled) but have data 10 or so days old at most for the bigger wikis. And the cron would always run in a reasonable time. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 --- Comment #4 from Gerrit Notification Bot gerritad...@wikimedia.org --- Change 108670 had a related patch set uploaded by Nemo bis: [s23.org wikistats] Throttle updates for big farms, keep updating big wikis' stats https://gerrit.wikimedia.org/r/108670 -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 Gerrit Notification Bot gerritad...@wikimedia.org changed: What|Removed |Added Status|ASSIGNED|PATCH_TO_REVIEW -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 --- Comment #2 from Daniel Zahn dz...@wikimedia.org --- yea, we just stopped them. and it seemed too extreme to update them even just once in 24hrs because there are just so many and we also did not have a good way to sync the list of current existing wikis. the plan was always to maybe ask Wikia if it's possible to provide all the stats from their DB somehow. no idea if that's easy for them or hard. but it would avoid tens of thousands of requests to each single API -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 Nemo federicol...@tiscali.it changed: What|Removed |Added CC||federicol...@tiscali.it --- Comment #1 from Nemo federicol...@tiscali.it --- The stats are not broken, they were stopped (as far as I know) because Wikia complained about the number of requests to their API. I suggest you to write commun...@wikia.com and make them comment somewhere (e.g. this bug) that it's ok to make requests to their API. -- You are receiving this mail because: You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 LWChris lwch...@gmx.de changed: What|Removed |Added Priority|Unprioritized |Normal Blocks||36291 -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
[Bug 59943] Fix all the Wikia stats
https://bugzilla.wikimedia.org/show_bug.cgi?id=59943 Robert Hanke ro...@gmx.de changed: What|Removed |Added Status|NEW |ASSIGNED CC||ro...@gmx.de Assignee|wikibugs-l@lists.wikimedia. |dz...@wikimedia.org |org | -- You are receiving this mail because: You are the assignee for the bug. You are on the CC list for the bug. ___ Wikibugs-l mailing list Wikibugs-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
