Thanks Eric, it looks interesting. Actually I am able to maintain a full
dataset for users but not for pages on big wikis, it may be a good
alternative to display the approximative number of edited pages over a
month or more.

2017-07-31 17:22 GMT+02:00 Erik Bernhardson <ebernhard...@wikimedia.org>:

> On Mon, Jul 31, 2017 at 7:18 AM, Akeron <akeron...@gmail.com> wrote:
>
>> Hi Igal,
>> All suggestions are welcome :)
>> Supporting this feature shouldn't be too difficult in theory because it
>> is already working with this kind of aggregation (month are built from
>> days, years from months...). The main problem is scalability for stats
>> which require uniqueness like number of users or number of edits *per
>> page*. That's why yearly stats can actually be disabled on some big wikis.
>> So it would be feasible but with edits limitations for the range (like 3-5
>> millions) and it would be very slow to load with lots of edits.
>>
>
> One way to handle the scalability problem is to use HyperLogLog counters.
> These are an approximate algorithm for which you can store daily counters,
> and then merge the counters to get weekly/monthly/etc, avoiding the cost of
> doing the calculation over something like an entire year just for the one
> stat.  Of course because these are approximate they may not be exactly what
> you are looking for, just an idea.
>
>
>>
>> Akeron
>>
>> 2017-07-31 14:29 GMT+02:00 יגאל חיטרון <khit...@gmail.com>:
>>
>>> Hello. It's amazing, thank you very much!
>>> Could I suggest one more feature, please? With it, the tool will be
>>> perfect. I'm talking about aggregation. Any kind of historical statistics
>>> for some day, month or year can be also shown as range of time. For
>>> example, if we have month statistics, we could fill From field to be Jan
>>> 2008 and To field to be May 2011, and get the aggregated numbers for this
>>> range. Is it possible?
>>> Thank you very much again,
>>> Igal (User:IKhitron)
>>>
>>> On Jul 30, 2017 22:18, "Pine W" <wiki.p...@gmail.com> wrote:
>>>
>>> > Wikiscan is an interesting tool for statistics fans. I suggest briefly
>>> > reading this IEG page
>>> > <https://meta.wikimedia.org/wiki/Grants:IEG/Wikiscan_multi-wiki>, then
>>> > playing with the tool on https://wikiscan.org/
>>> >
>>> > Pine
>>> > _______________________________________________
>>> > Wikitech-l mailing list
>>> > Wikitech-l@lists.wikimedia.org
>>> > https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>>> _______________________________________________
>>> Wikitech-l mailing list
>>> Wikitech-l@lists.wikimedia.org
>>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>>
>>
>>
>> _______________________________________________
>> Analytics mailing list
>> analyt...@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/analytics
>>
>>
>
> _______________________________________________
> Analytics mailing list
> analyt...@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/analytics
>
>
_______________________________________________
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l

Reply via email to