[Wikitech-l] ? user status history

2010-03-08 Thread Farkas, Illes
Dear All,

Many thanks for all your work with Wikipedia, we use it daily for various
tasks and in our research on Wikipedia.
("we" = a subset of a research group of the Hungarian Academy of Sciences)

I just managed to wget the history
dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like
to combine this with status information about users. Do you happen to know
if the status (admin, steward, bot, etc.) of all users has been logged for
enwiki? In what way would this be available for download and
for non-profit basic research?

Thanks,
Illes
-- 
http://hal.elte.hu/fij
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Re: [Wikitech-l] ? user status history

2010-03-08 Thread Liangent
http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-user_groups.sql.gz
But the latest dump seems broken and I don't know why.

On Tue, Mar 9, 2010 at 5:49 AM, Farkas, Illes  wrote:
> Dear All,
>
> Many thanks for all your work with Wikipedia, we use it daily for various
> tasks and in our research on Wikipedia.
> ("we" = a subset of a research group of the Hungarian Academy of Sciences)
>
> I just managed to wget the history
> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like
> to combine this with status information about users. Do you happen to know
> if the status (admin, steward, bot, etc.) of all users has been logged for
> enwiki? In what way would this be available for download and
> for non-profit basic research?
>
> Thanks,
> Illes
> --
> http://hal.elte.hu/fij
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Re: [Wikitech-l] ? user status history

2010-03-09 Thread Liangent
If you want a history, maybe you can try:
http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-pages-logging.xml.gz
and
http://download.wikimedia.org/metawiki/20100306/metawiki-20100306-pages-logging.xml.gz

On Tue, Mar 9, 2010 at 12:53 PM, Liangent  wrote:
> http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-user_groups.sql.gz
> But the latest dump seems broken and I don't know why.
>
> On Tue, Mar 9, 2010 at 5:49 AM, Farkas, Illes  wrote:
>> Dear All,
>>
>> Many thanks for all your work with Wikipedia, we use it daily for various
>> tasks and in our research on Wikipedia.
>> ("we" = a subset of a research group of the Hungarian Academy of Sciences)
>>
>> I just managed to wget the history
>> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like
>> to combine this with status information about users. Do you happen to know
>> if the status (admin, steward, bot, etc.) of all users has been logged for
>> enwiki? In what way would this be available for download and
>> for non-profit basic research?
>>
>> Thanks,
>> Illes
>> --
>> http://hal.elte.hu/fij
>> ___
>> Wikitech-l mailing list
>> Wikitech-l@lists.wikimedia.org
>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>>
>

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Re: [Wikitech-l] ? user status history

2010-03-09 Thread Bence Damokos
You might also get a history of user rights through MediaWiki API. For a
documentation, see http://en.wikipedia.org/w/api.php .

For a list of stewards at a given time you would have to query Meta-Wiki:
http://meta.wikimedia.org/w/api.php?action=query&list=logevents&letype=gblrights&lelimit=5000(although
it might just be easier to look at the human readable lists at:
http://meta.wikimedia.org/wiki/Stewards)

For the sysops and other rights you would have to query and filter the user
rights logs of the English Wikipedia:
http://en.wikipedia.org/w/api.php?action=query&list=logevents&letype=rights&lelimit=5000

Best regards,
Bence Damokos

On 9 March 2010 11:01, Liangent  wrote:

> If you want a history, maybe you can try:
>
> http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-pages-logging.xml.gz
> and
>
> http://download.wikimedia.org/metawiki/20100306/metawiki-20100306-pages-logging.xml.gz
>
> On Tue, Mar 9, 2010 at 12:53 PM, Liangent  wrote:
> >
> http://download.wikimedia.org/enwiki/20100116/enwiki-20100116-user_groups.sql.gz
> > But the latest dump seems broken and I don't know why.
> >
> > On Tue, Mar 9, 2010 at 5:49 AM, Farkas, Illes  wrote:
> >> Dear All,
> >>
> >> Many thanks for all your work with Wikipedia, we use it daily for
> various
> >> tasks and in our research on Wikipedia.
> >> ("we" = a subset of a research group of the Hungarian Academy of
> Sciences)
> >>
> >> I just managed to wget the history
> >> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would
> like
> >> to combine this with status information about users. Do you happen to
> know
> >> if the status (admin, steward, bot, etc.) of all users has been logged
> for
> >> enwiki? In what way would this be available for download and
> >> for non-profit basic research?
> >>
> >> Thanks,
> >> Illes
> >> --
> >> http://hal.elte.hu/fij
> >> ___
> >> Wikitech-l mailing list
> >> Wikitech-l@lists.wikimedia.org
> >> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
> >>
> >
>
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Re: [Wikitech-l] ? user status history

2010-03-09 Thread Platonides
Farkas, Illes wrote:
> Dear All,
>
> Many thanks for all your work with Wikipedia, we use it daily for various
> tasks and in our research on Wikipedia.
> ("we" = a subset of a research group of the Hungarian Academy of Sciences)
>
> I just managed to wget the history
> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like
> to combine this with status information about users. Do you happen to know
> if the status (admin, steward, bot, etc.) of all users has been logged for
> enwiki? In what way would this be available for download and
> for non-profit basic research?
>
> Thanks,
> Illes

You need to download user_groups.sql.gz
The left value of the pair is the  entry in  The right 
one, the goup he belongs to.

Note however that you can't have a complete 
enwiki-20100130-pages-meta-history.xml.bz2 from a week ago, since it 
hasn't finished yet.
Most likely, your dump is incomplete (you can resume it).


___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Re: [Wikitech-l] ? user status history

2010-03-09 Thread Tomasz Finc
Platonides wrote:
> Farkas, Illes wrote:
>> Dear All,
>>
>> Many thanks for all your work with Wikipedia, we use it daily for various
>> tasks and in our research on Wikipedia.
>> ("we" = a subset of a research group of the Hungarian Academy of Sciences)
>>
>> I just managed to wget the history
>> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I would like
>> to combine this with status information about users. Do you happen to know
>> if the status (admin, steward, bot, etc.) of all users has been logged for
>> enwiki? In what way would this be available for download and
>> for non-profit basic research?
>>
>> Thanks,
>> Illes
> 
> You need to download user_groups.sql.gz
> The left value of the pair is the  entry in  The right 
> one, the goup he belongs to.
> 
> Note however that you can't have a complete 
> enwiki-20100130-pages-meta-history.xml.bz2 from a week ago, since it 
> hasn't finished yet.
> Most likely, your dump is incomplete (you can resume it).

Indeed. It's not scheduled to finish until 2010-03-13 12:03:56 ( UTC ) 
and will likely take a bit longer as I'm seeing the revs/sec drop lower 
by about .01 every 5 minutes

The deviation isn't much but when were talking about millions of 
revisions that starts adding up.

Almost there ...

--tomasz

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Re: [Wikitech-l] ? user status history

2010-03-09 Thread Tomasz Finc
Tomasz Finc wrote:
> Platonides wrote:
>> Farkas, Illes wrote:
>>> Dear All,
>>>
>>> Many thanks for all your work with Wikipedia, we use it daily for 
>>> various
>>> tasks and in our research on Wikipedia.
>>> ("we" = a subset of a research group of the Hungarian Academy of 
>>> Sciences)
>>>
>>> I just managed to wget the history
>>> dump enwiki-20100130-pages-meta-history.xml.bz2 a week ago, and I 
>>> would like
>>> to combine this with status information about users. Do you happen to 
>>> know
>>> if the status (admin, steward, bot, etc.) of all users has been 
>>> logged for
>>> enwiki? In what way would this be available for download and
>>> for non-profit basic research?
>>>
>>> Thanks,
>>> Illes
>>
>> You need to download user_groups.sql.gz
>> The left value of the pair is the  entry in  The 
>> right one, the goup he belongs to.
>>
>> Note however that you can't have a complete 
>> enwiki-20100130-pages-meta-history.xml.bz2 from a week ago, since it 
>> hasn't finished yet.
>> Most likely, your dump is incomplete (you can resume it).
> 
> Indeed. It's not scheduled to finish until 2010-03-13 12:03:56 ( UTC ) 
> and will likely take a bit longer as I'm seeing the revs/sec drop lower 
> by about .01 every 5 minutes
> 
> The deviation isn't much but when were talking about millions of 
> revisions that starts adding up.
> 
> Almost there ...
> 
> --tomasz
> 

Poor ms3 is is doing all the work now. I can't blame it for all the slow 
down as i/o wait is just under 10% but its certainly making just enough 
of a difference to push this later.

--tomasz

___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l