Re: [Wikitech-l] Releasing a small tool to explore wikipedia users contributions

2021-01-13 Thread Nicholas Skaggs
Wonderful to hear toolforge worked out for you! I especially liked that you
included a prominent link to your source code repository. Best wishes!

On Tue, Jan 12, 2021 at 1:53 PM Shrinivasan T 
wrote:

>
> Hi All,
>
> A quick update, Dinesh moved the above tool which was hosted in Heroku to
> Wikimedia Toolforge.
>
>
>
>- *Tool Url: *https://wiki-user-contributions.toolforge.org
>- *Toolforge tool page:*
>https://toolsadmin.wikimedia.org/tools/id/wiki-user-contributions
>
>
> Thanks dinesh for the development and deploying on the toolforge.
>
> Shrini
>
> வியா., 26 நவ., 2020, பிற்பகல் 8:05 அன்று, Shrinivasan T <
> tshriniva...@gmail.com> எழுதியது:
>
>> Last week, we had a Indic Wikisource Proofreadthon 2020 event. see
>> here for full details
>>
>> https://meta.wikimedia.org/wiki/Indic_Wikisource_Proofreadthon_2020
>>
>> Though I did not participate in this event, (feels sad for this. Life
>> is too messy nowadays), I thought to build a small tool to give report
>> on any wikipedia user’s contribution on a given wikisite for a given
>> date range.
>>
>> It may help to calculate, measure, decide on the contributions for
>> such competitions.
>>
>> Mediawiki has a good API to fetch user contributions.
>> https://www.mediawiki.org/wiki/API:Usercontribs
>>
>> Get all edits by a user.
>> https://www.mediawiki.org/wiki/Special:MyLanguage/API:Usercontribs
>>
>> For my wonder, there was a sample python code on the same page.
>>
>> The code gave only 500 results. I wrote a loop to get the data batch
>> by batch till all the data is received.
>>
>> Published the tool here –
>> https://github.com/tshrinivasan/wiki_user_contributions_report
>>
>> How to run?
>>
>> python3 get_user_contributions.py   
>>  
>>
>> This will give the data as a CSV file. Used a csv-to-html converter
>> utility to convert this to a web page with all the data in a sortable
>> table.
>>
>> For my wonder, my friend Dinesh Karthik, converted this as a nice web
>> application with flask, dash and hosted in heroku.
>>
>> https://wiki-user-contributions.herokuapp.com/
>>
>> Source : https://github.com/Dineshkarthik/wiki-user-contributions
>>
>> Thanks to Info-farmer for providing the idea, Bartosz Dziewoński on
>> wikipedia mailing list for answering all my questions, Dinesh for
>> making a web application quickly.
>>
>> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>> is a good place to ask any tech questions regarding wikipedia.
>>
>> Thanks to all wikisource contributors for the event and in general.
>>
>>
>> --
>> Regards,
>> T.Shrinivasan
>>
>>
>> My Life with GNU/Linux : http://goinggnu.wordpress.com
>> Free E-Magazine on Free Open Source Software in Tamil :
>> http://kaniyam.com
>>
>> Get Free Tamil Ebooks for Android, iOS, Kindle, Computer :
>> http://FreeTamilEbooks.com
>>
>
>
> --
> Regards,
> T.Shrinivasan
>
>
> My Life with GNU/Linux : http://goinggnu.wordpress.com
> Free E-Magazine on Free Open Source Software in Tamil : http://kaniyam.com
>
> Get Free Tamil Ebooks for Android, iOS, Kindle, Computer :
> http://FreeTamilEbooks.com
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>


-- 
*Nicholas Skaggs*
Engineering Manager, Cloud Services
Wikimedia Foundation <https://wikimediafoundation.org/>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l


Re: [Wikitech-l] executing long running queries in PAWS

2020-12-21 Thread Nicholas Skaggs
Hi Mat, can you share the PAWS notebook? That might make it easier for
others to see what you are seeing.

On Fri, Dec 18, 2020 at 5:17 PM Mat Kelcey  wrote:

> hi all!
>
> as part of task "Look into matching images of the same painting"
> https://phabricator.wikimedia.org/T131553
> <https://phabricator.wikimedia.org/T131553>
> i've been trying to reproduce some sql queries as described in
> https://github.com/multichill/toollabs/blob/master/bot/wikidata/find_painting_images.py
>
> where as usually these scripts would be running under toolforge (or some
> other bot execution environment i'm not sure of) i've been finding these
> long running queries timeout under PAWS
>
> does anyone have suggestions / examples for running queries such as
> http://tools.wmflabs.org/multichill/queries2/commons/paintings_without_wikidata_all.sql
> under PAWS?
>
> cheers,
> mat
> ___
> Wikitech-l mailing list
> Wikitech-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/wikitech-l
>


-- 
*Nicholas Skaggs*
Engineering Manager, Cloud Services
Wikimedia Foundation <https://wikimediafoundation.org/>
___
Wikitech-l mailing list
Wikitech-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikitech-l