I think we need to step back from the "how" for a moment in order to better understand the "why".
RhinosF1, what is the original question that you are really asking that resulted in your original request? It may be that there are other ways to answer your question than to obtain those particular statistics. For example, my guess is that your original question might be along the lines of "is Wikimedia driven top-down or bottom-up"? Which might be answered by looking at who is active on meta and who is active on the projects themselves and seeing how they intersect. If so, that assumption of intersection may be flawed if users are operating with different user accounts on meta to other platforms. This definitely occurs with WMF staff who often have two separate accounts for their work role vs their personal contributions and also for people active in the chapters/user groups/outreach where they need to operate with a real world name (real world engagement tends to need real names), but prefer a pseudonym for their personal contributions. If you can tell us more about what you are trying to achieve, we may be able to better assist you. Kerry -----Original Message----- From: Wiki-research-l [mailto:wiki-research-l-boun...@lists.wikimedia.org] On Behalf Of Jonathan Morgan Sent: Tuesday, 7 January 2020 6:58 AM To: Wiki Research-l <wiki-researc...@lists.wikimedia.org> Cc: A mailing list for the Analytics Team at WMF and everybody who has an interest in Wikipedia and analytics. <analytics@lists.wikimedia.org> Subject: Re: [Wiki-research-l] [Analytics] Active meta users v active wikimedia users (Last reply to both lists; sorry for the spam) This sounds like it'd be a bit of work to build, and I don't think there are curated datasets to help out. I think you would need to... 1. get the count of active editors on Meta for [PERIOD OF TIME]. Easy. 2. perform a query or parse dumps to get the *list *of active editors from every individual Wikimedia project for the same [PERIOD OF TIME]. Hard. 3. de-duplicate that list (since many people edit multiple wikis in a given say, month, and you don't want to overcount). Pretty easy. 4. compare the resulting all-projects count with the Meta-only count. Easy. This sounds like a lot of work to me! Again, there might be tools or resources for this that already exist, but I'm not aware of them. It seems like having topline/platform-level counts for active editors could be useful, as a dashboard or a public dataset. You might try requesting this as a feature <https://phabricator.wikimedia.org/maniphest/task/edit/?title=Wikistats%20New%20Feature&projectPHIDs=Analytics-Wikistats,Analytics> for WikiStats. The worst they can say is "no", or "not yet" :) - J On Mon, Jan 6, 2020 at 12:34 PM RhinosF1 - <rhino...@gmail.com> wrote: > Hi, > > I’ve just seen the replies and thanks to everyone whose replied. > > I was looking to try and work out what percent lf the active wikimedia > community are participating on meta and comparing to another wiki > farm. Any thoughts on that? > > RhinosF1 > > On Mon, 6 Jan 2020 at 20:31, Aaron Halfaker <aaron.halfa...@gmail.com> > wrote: > > > It doesn't look like Active Editors works for all wikis. I think > > you'd have to merge activity across all wikis to get a stat like > > that. I'm not sure I know of a good data strategy to get that. > > > > If you were to query it with quarry, you'd need to write a query for > every > > wiki and then write some code to merge the results. Oof. > > > > If you to extract it from the XML dumps, you'd need to process each > > Wiki separately and then merge the results. Oof. > > > > The best solution to this is to have a common table/relation across > > all Wikis and to aggregate from there. I don't think there's any > > such cross-wiki table/relation available. > > > > On Mon, Jan 6, 2020 at 1:38 PM Jonathan Morgan > > <jmor...@wikimedia.org> > > wrote: > > > > > Same dashboard, but for "All wikis": > > > https://stats.wikimedia.org/v2/#/all-projects > > > > > > That work? > > > > > > - J > > > > > > On Mon, Jan 6, 2020 at 11:32 AM RhinosF1 - <rhino...@gmail.com> wrote: > > > > > > > Hi, > > > > > > > > That provides active users for meta but not globally. Anything > > > > for > > > global? > > > > > > > > RhinosF1 > > > > > > > > On Mon, 6 Jan 2020 at 18:10, Jonathan Morgan > > > > <jmor...@wikimedia.org> > > > > wrote: > > > > > > > > > RhinosF1, > > > > > > > > > > Are you looking for information like this > > > > > <https://stats.wikimedia.org/v2/#/meta.wikimedia.org>, or > something > > > > > different? > > > > > > > > > > - J > > > > > > > > > > On Mon, Jan 6, 2020 at 8:51 AM RhinosF1 - <rhino...@gmail.com> > > wrote: > > > > > > > > > > > Hi, > > > > > > > > > > > > Does anyone know a way to find out how many wikimedia users > > > > > > are > > > active > > > > > > globally compared to active on metawiki? > > > > > > > > > > > > This mean they've made more than 5 edits in the last 30 days > > > > > > for > > > this. > > > > > > > > > > > > Thanks, > > > > > > RhinosF1 > > > > > > _______________________________________________ > > > > > > Analytics mailing list > > > > > > Analytics@lists.wikimedia.org > > > > > > https://lists.wikimedia.org/mailman/listinfo/analytics > > > > > > > > > > > > > > > > > > > > > -- > > > > > Jonathan T. Morgan > > > > > Senior Design Researcher > > > > > Wikimedia Foundation > > > > > User:Jmorgan (WMF) < > > https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF) > > > > > > > > > (Uses He/Him) > > > > > _______________________________________________ > > > > > Wiki-research-l mailing list > > > > > wiki-researc...@lists.wikimedia.org > > > > > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > > > > > > > > > _______________________________________________ > > > > Wiki-research-l mailing list > > > > wiki-researc...@lists.wikimedia.org > > > > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > > > > > > > > > > > > > -- > > > Jonathan T. Morgan > > > Senior Design Researcher > > > Wikimedia Foundation > > > User:Jmorgan (WMF) > > > <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF) > > > > > (Uses He/Him) > > > _______________________________________________ > > > Wiki-research-l mailing list > > > wiki-researc...@lists.wikimedia.org > > > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > > > > > _______________________________________________ > > Wiki-research-l mailing list > > wiki-researc...@lists.wikimedia.org > > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > > > _______________________________________________ > Wiki-research-l mailing list > wiki-researc...@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wiki-research-l > -- Jonathan T. Morgan Senior Design Researcher Wikimedia Foundation User:Jmorgan (WMF) <https://meta.wikimedia.org/wiki/User:Jmorgan_(WMF)> (Uses He/Him) _______________________________________________ Wiki-research-l mailing list wiki-researc...@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wiki-research-l _______________________________________________ Analytics mailing list Analytics@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/analytics
