[Wikitech-l] ? user status history
Dear All, Many thanks for all your work with Wikipedia, we use it daily for various tasks and in our research on Wikipedia. ("we" = a subset of a research group of the Hungarian Academy of Sciences) I just managed to wget the history dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like to combine this with status information about users. Do you happen to know if the status (admin, steward, bot, etc.) of all users has been logged for enwiki? In what way would this be available for download and for non-profit basic research? Thanks, Illes -- http://hal.elte.hu/fij ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] ? user status history
http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-user_groups.sql.gz But the latest dump seems broken and I don't know why. On Tue, Mar 9, 2010 at 5:49 AM, Farkas, Illes wrote: > Dear All, > > Many thanks for all your work with Wikipedia, we use it daily for various > tasks and in our research on Wikipedia. > ("we" = a subset of a research group of the Hungarian Academy of Sciences) > > I just managed to wget the history > dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like > to combine this with status information about users. Do you happen to know > if the status (admin, steward, bot, etc.) of all users has been logged for > enwiki? In what way would this be available for download and > for non-profit basic research? > > Thanks, > Illes > -- > http://hal.elte.hu/fij > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] ? user status history
If you want a history, maybe you can try: http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-pages-logging.xml.gz and http://download.wikimedia.org/metawiki/20100306/metawiki-20100306-pages-logging.xml.gz On Tue, Mar 9, 2010 at 12:53 PM, Liangent wrote: > http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-user_groups.sql.gz > But the latest dump seems broken and I don't know why. > > On Tue, Mar 9, 2010 at 5:49 AM, Farkas, Illes wrote: >> Dear All, >> >> Many thanks for all your work with Wikipedia, we use it daily for various >> tasks and in our research on Wikipedia. >> ("we" = a subset of a research group of the Hungarian Academy of Sciences) >> >> I just managed to wget the history >> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like >> to combine this with status information about users. Do you happen to know >> if the status (admin, steward, bot, etc.) of all users has been logged for >> enwiki? In what way would this be available for download and >> for non-profit basic research? >> >> Thanks, >> Illes >> -- >> http://hal.elte.hu/fij >> ___ >> Wikitech-l mailing list >> Wikitech-l@lists.wikimedia.org >> https://lists.wikimedia.org/mailman/listinfo/wikitech-l >> > ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] ? user status history
You might also get a history of user rights through MediaWiki API. For a documentation, see http://en.wikipedia.org/w/api.php . For a list of stewards at a given time you would have to query Meta-Wiki: http://meta.wikimedia.org/w/api.php?action=query&list=logevents&letype=gblrights&lelimit=5000(although it might just be easier to look at the human readable lists at: http://meta.wikimedia.org/wiki/Stewards) For the sysops and other rights you would have to query and filter the user rights logs of the English Wikipedia: http://en.wikipedia.org/w/api.php?action=query&list=logevents&letype=rights&lelimit=5000 Best regards, Bence Damokos On 9 March 2010 11:01, Liangent wrote: > If you want a history, maybe you can try: > > http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-pages-logging.xml.gz > and > > http://download.wikimedia.org/metawiki/20100306/metawiki-20100306-pages-logging.xml.gz > > On Tue, Mar 9, 2010 at 12:53 PM, Liangent wrote: > > > http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-user_groups.sql.gz > > But the latest dump seems broken and I don't know why. > > > > On Tue, Mar 9, 2010 at 5:49 AM, Farkas, Illes wrote: > >> Dear All, > >> > >> Many thanks for all your work with Wikipedia, we use it daily for > various > >> tasks and in our research on Wikipedia. > >> ("we" = a subset of a research group of the Hungarian Academy of > Sciences) > >> > >> I just managed to wget the history > >> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would > like > >> to combine this with status information about users. Do you happen to > know > >> if the status (admin, steward, bot, etc.) of all users has been logged > for > >> enwiki? In what way would this be available for download and > >> for non-profit basic research? > >> > >> Thanks, > >> Illes > >> -- > >> http://hal.elte.hu/fij > >> ___ > >> Wikitech-l mailing list > >> Wikitech-l@lists.wikimedia.org > >> https://lists.wikimedia.org/mailman/listinfo/wikitech-l > >> > > > > ___ > Wikitech-l mailing list > Wikitech-l@lists.wikimedia.org > https://lists.wikimedia.org/mailman/listinfo/wikitech-l > ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] ? user status history
Farkas, Illes wrote: > Dear All, > > Many thanks for all your work with Wikipedia, we use it daily for various > tasks and in our research on Wikipedia. > ("we" = a subset of a research group of the Hungarian Academy of Sciences) > > I just managed to wget the history > dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like > to combine this with status information about users. Do you happen to know > if the status (admin, steward, bot, etc.) of all users has been logged for > enwiki? In what way would this be available for download and > for non-profit basic research? > > Thanks, > Illes You need to download user_groups.sql.gz The left value of the pair is the entry in The right one, the goup he belongs to. Note however that you can't have a complete enwiki-20100130-pages-meta-history.xml.bz2 from a week ago, since it hasn't finished yet. Most likely, your dump is incomplete (you can resume it). ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] ? user status history
Platonides wrote: > Farkas, Illes wrote: >> Dear All, >> >> Many thanks for all your work with Wikipedia, we use it daily for various >> tasks and in our research on Wikipedia. >> ("we" = a subset of a research group of the Hungarian Academy of Sciences) >> >> I just managed to wget the history >> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like >> to combine this with status information about users. Do you happen to know >> if the status (admin, steward, bot, etc.) of all users has been logged for >> enwiki? In what way would this be available for download and >> for non-profit basic research? >> >> Thanks, >> Illes > > You need to download user_groups.sql.gz > The left value of the pair is the entry in The right > one, the goup he belongs to. > > Note however that you can't have a complete > enwiki-20100130-pages-meta-history.xml.bz2 from a week ago, since it > hasn't finished yet. > Most likely, your dump is incomplete (you can resume it). Indeed. It's not scheduled to finish until 2010-03-13 12:03:56 ( UTC ) and will likely take a bit longer as I'm seeing the revs/sec drop lower by about .01 every 5 minutes The deviation isn't much but when were talking about millions of revisions that starts adding up. Almost there ... --tomasz ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l
Re: [Wikitech-l] ? user status history
Tomasz Finc wrote: > Platonides wrote: >> Farkas, Illes wrote: >>> Dear All, >>> >>> Many thanks for all your work with Wikipedia, we use it daily for >>> various >>> tasks and in our research on Wikipedia. >>> ("we" = a subset of a research group of the Hungarian Academy of >>> Sciences) >>> >>> I just managed to wget the history >>> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I >>> would like >>> to combine this with status information about users. Do you happen to >>> know >>> if the status (admin, steward, bot, etc.) of all users has been >>> logged for >>> enwiki? In what way would this be available for download and >>> for non-profit basic research? >>> >>> Thanks, >>> Illes >> >> You need to download user_groups.sql.gz >> The left value of the pair is the entry in The >> right one, the goup he belongs to. >> >> Note however that you can't have a complete >> enwiki-20100130-pages-meta-history.xml.bz2 from a week ago, since it >> hasn't finished yet. >> Most likely, your dump is incomplete (you can resume it). > > Indeed. It's not scheduled to finish until 2010-03-13 12:03:56 ( UTC ) > and will likely take a bit longer as I'm seeing the revs/sec drop lower > by about .01 every 5 minutes > > The deviation isn't much but when were talking about millions of > revisions that starts adding up. > > Almost there ... > > --tomasz > Poor ms3 is is doing all the work now. I can't blame it for all the slow down as i/o wait is just under 10% but its certainly making just enough of a difference to push this later. --tomasz ___ Wikitech-l mailing list Wikitech-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikitech-l