Re: [Pywikipedia-l] Python MediaWiki developers meetup at Lyon hackathon

2015-05-04 Thread Maarten Dammers
Hi Legoktm, Legoktm schreef op 3-5-2015 om 21:35: Hello, A few people who work on some Python MediaWiki libraries started talking on IRC today about how much duplication there is in the ecosystem, resulting basically in wasted effort. As long as we have bots as long as people start new ones

[Pywikipedia-l] Scrutinizer for Pywikibot (was Re: [Wikitech-l] MediaWiki Technical Debt)

2014-10-25 Thread Maarten Dammers
Hi Antoine, Antoine Musso schreef op 23-10-2014 21:49: Le 23/10/2014 14:46, Tyler Romeo a écrit : Found this today: https://twitter.com/symfony_en/status/525222757567827968 It's probably a useless statistic, but I still found it amusing. Good to know we still have less technical debt than

[Pywikipedia-l] Wikidata reference implementation in Pywikibot

2014-10-12 Thread Maarten Dammers
Hi guys, I'm wondering how to add references that have multiple parts. Take for example https://www.wikidata.org/wiki/Q76 (Barack Obama). The third reference of date of birth has two parts: * stated in - Integrated Authority File * date retrieved - 9 April 2014 Currently a reference in our

Re: [Pywikipedia-l] dropping support for Python 2.6

2014-08-17 Thread Maarten Dammers
Hi Ricordisamoa, Ricordisamoa schreef op 7-8-2014 23:37: py2.6 tests on Travis-CI are now allowed to fail, meaning that we are, actually, supporting only 2.7+. I renew my proposal to *drop* support for py2.6 at all. Python2.6.x is still the default version on Redhat Linux. So if you use it in

Re: [Pywikipedia-l] drop support for python 2.6

2014-06-15 Thread Maarten Dammers
Hi Ricordi, Ricordisamoa schreef op 14-6-2014 21:44: Some tests fail only in py2.6: https://travis-ci.org/wikimedia/pywikibot-core/jobs/27558463 (https://gerrit.wikimedia.org/r/139591/ is an attempted fix). But I think we may instead drop support for py2.6 entirely, focusing ourselves on

Re: [Pywikipedia-l] Bot request: 250+ thousands person data

2014-04-27 Thread Maarten Dammers
Hi Jan, Jan Dudík schreef op 26-4-2014 21:38: Or import with https://www.wikidata.org/wiki/User:Underlying_lk/harvest_template_old.py which allows to import dates (timedate) too I filed several bugs to get this functionality to Pywikibot too. * 64501 - Modify pywikibot.Timestamp to support

Re: [Pywikipedia-l] Bot request: 250+ thousands person data

2014-04-26 Thread Maarten Dammers
Hi Federico, Federico Leva (Nemo) schreef op 25-4-2014 18:31: Wikidata feels empty... even data on people is almost non-existing. The Italian Wikipedia has the most complete persondata dataset in Wikimedia world, ready for import. Legoktm's bot was almost ready to parse the {{bio}} template,

Re: [Pywikipedia-l] [Wikidata-tech] Heads up: Changes to API error codes

2014-04-20 Thread Maarten Dammers
Hi Daniel, Daniel Kinzler schreef op 15-4-2014 19:16: Today, Thiemo merged my patch introducing the ApiErrorReporter class: https://gerrit.wikimedia.org/r/#/c/124323/. This should help us with providing error reports from the API in a consistent manner; This way, we will hopefully soon be able

[Pywikipedia-l] ***UNCHECKED*** Re: Can I get commit access on Gerrit?

2014-03-30 Thread Maarten Dammers
Hi Ben, Ben McIlwain schreef op 30-3-2014 6:21: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 Can someone give me commit access on Gerrit, or if there's some more formal process I need to follow, can someone point me to that? Anyone can submit changes to Gerrit. You just need a Wikitech

Re: [Pywikipedia-l] MySQLPageGenerator and Tool*

2014-03-09 Thread Maarten Dammers
Hi Strainu, Strainu schreef op 8-3-2014 18:46: Hi Maarten, Do note that a valid use case is to run pywikibot with a local database dump (I haven't done this myself, but I know at least 1 person who does that), so the user needs to be able to configure this field. The user variable seems like

[Pywikipedia-l] MySQLPageGenerator and Tool*

2014-03-08 Thread Maarten Dammers
Hi, We currently have the MySQLPageGenerator to do database queries. It uses site.dbName() to figure out the name of the site, but we don't seem to have any system to figure out what database server to connect to. For example: * Dutch Wikipedia on Toolserver: connect nlwiki_p nlwiki-p.db *

Re: [Pywikipedia-l] Zürich Hackathon and pywikibot

2014-03-06 Thread Maarten Dammers
Hi Amir, I plan to come. Maybe an additional topic: What to do to kill off the old branch? That way we can focus on one software package instead of two. Maarten Amir Ladsgroup schreef op 6-3-2014 18:51: Hello all, Zürich Hackathon will be held in 9-11 May and It is a great opportunity to

Re: [Pywikipedia-l] (no subject)

2013-12-17 Thread Maarten Dammers
Alex Brollo schreef op 17-12-2013 7:32: Is this a test for responcy speed of the list? :-) Dunno, got multiple (empty) emails from him so I put him on moderation. Maarten ___ Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org

[Pywikipedia-l] RecentChangesLinked generator

2013-11-18 Thread Maarten Dammers
Hi guys, I wondered if anyone managed to implement a recent changed linked generator in Pywikibot. See for example https://www.wikidata.org/w/index.php?namespace=tagfilter=target=Property%3AP197showlinkedto=1title=Special%3ARecentChangesLinked . Would be quite useful. It looks like we don't

Re: [Pywikipedia-l] Mailing lists

2013-09-23 Thread Maarten Dammers
Hi Pyfisch, Op 23-9-2013 19:43, Pyfisch schreef: Hello, at the moment Pywikibot has four mailing lists. * pywikipedia-announce – Only two messages this year (one spam, the other one to say sorry.) no last year We could use this more, but we need to have better criteria what to post there *

Re: [Pywikipedia-l] Wikibase data model implementation in Python

2013-09-20 Thread Maarten Dammers
Hi guys, Op 20-9-2013 4:12, legoktm schreef: Hi Jeroen, Sorry about the late response... Talked with Jeroen a bit about this on irc. Forgot to send an email here. On Fri, Sep 6, 2013 at 11:47 AM, Jeroen De Dauw jeroended...@gmail.com mailto:jeroended...@gmail.com wrote: Hey,

[Pywikipedia-l] Fwd: [Wikitech-l] Fwd: Wiki DevRoom at FOSDEM?

2013-09-05 Thread Maarten Dammers
FYI, maybe something Pywiki developers should go too? Origineel bericht Onderwerp: [Wikitech-l] Fwd: Wiki DevRoom at FOSDEM? Datum: Wed, 04 Sep 2013 15:29:40 -0700 Van:Quim Gil q...@wikimedia.org Antwoord-naar: Wikimedia developers wikitec...@lists.wikimedia.org

[Pywikipedia-l] Fwd: [Wikidata-tech] imminent breaking change to the API

2013-06-17 Thread Maarten Dammers
FYI Origineel bericht Onderwerp: [Wikidata-tech] imminent breaking change to the API Datum: Sun, 16 Jun 2013 13:43:05 +0200 Van:Daniel Kinzler daniel.kinz...@wikimedia.de Antwoord-naar: Wikidata technical discussion wikidata-t...@lists.wikimedia.org Organisatie:

Re: [Pywikipedia-l] import CSV bot

2013-06-02 Thread Maarten Dammers
Hi Yury, Op 2-6-2013 12:15, Yury Katkov schreef: Good to know, fortunately I'm working for 3rd party wiki. For Wiki Loves Monuments a lot of people are using http://area23.brightbyte.de/csv2template.php . If you happen to make something in python, please publish it, we still have many

Re: [Pywikipedia-l] Two wikidata bots

2013-05-11 Thread Maarten Dammers
Hi Jan, Op 10-5-2013 9:38, Jan Dudík schreef: It looks good, but only works for [[links]], not for strings :-( You're welcome to expand it to support more data types! :-) Maarten ___ Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org

[Pywikipedia-l] Two wikidata bots

2013-05-09 Thread Maarten Dammers
Hi everyone, Today I published and documented two scripts to mass add claims using the rewrite branch: * claimit.py: A script to mass add Wikidata claims to a lot of items based on pages on Wikipedia [1] * harvest_template.py: A script to mass add Wikidata claims based on information

[Pywikipedia-l] Wikimedia Hackathon Amsterdam 2013: Registration opened

2013-03-08 Thread Maarten Dammers
Hi everyone, Wikimedia Nederland invites all developers to the Wikimedia Hackathon. The Wikimedia Hackathon will be in 2013 from 24-26 May. The registration is now open and also includes the possibility to apply for a travel, accommodation or full scholarship. You can find the form at

[Pywikipedia-l] Wikidata and Pywikipedia

2013-03-02 Thread Maarten Dammers
Hi everyone, As you might know phase 1 of Wikidata (interwiki links) is live at a lot of Wikipedia's and soon to be turned on for all Wikipedia's. Phase 2 is next, that's basically about infobox data. We are going to need a lot of clever bots to fill Wikidata. To make that possible

Re: [Pywikipedia-l] Wikidata and Pywikipedia

2013-03-02 Thread Maarten Dammers
to update the framework? Maarten On Sat, Mar 2, 2013 at 10:49 AM, Maarten Dammers maar...@mdammers.nl mailto:maar...@mdammers.nl wrote: Hi everyone, As you might know phase 1 of Wikidata (interwiki links) is live at a lot of Wikipedia's and soon to be turned on for all Wikipedia's

Re: [Pywikipedia-l] LDAP Authentication fails

2013-02-24 Thread Maarten Dammers
Hi Mario, Op 21-2-2013 12:33, Mario Schubert schreef: Hi Maarten, thank you for your help. I have set the self.ldapDomain = ('abc'). I am using the pywikipedia-rewrite at the moment. I have searched the code, but ldapdomain is not used. Is the pywikipedia-rewrite able to login to LDAP? If

Re: [Pywikipedia-l] Advanced use of replace.py/fixes.py

2013-02-24 Thread Maarten Dammers
Hi Bináris, Op 24-2-2013 13:18, Bináris schreef: The presentation I held on Wikimania last summer (http://wikimania2012.wikimedia.org/wiki/Submissions/Efficient_and_flexible_text_manipulation,_spelling_correction_and_page_collections_with_Pywikibot) is now downloadable from Hungarian

Re: [Pywikipedia-l] LDAP Authentication fails

2013-02-13 Thread Maarten Dammers
Hi Mario, Op 13-2-2013 14:02, Mario Schubert schreef: Hello, I am writing a bot to upload svn commited files to my MediaWiki. The authentication is done by LDAP / Active Directory. For humans it works. But with my bot it fails: PHP Warning: ldap_start_tls(): Unable to start TLS: Can't

[Pywikipedia-l] Save the date: Amsterdam Hackathon 2013 (May 24-26)

2013-02-10 Thread Maarten Dammers
Hi everyone, Wikimedia Nederland invites all developers to the Amsterdam Hackathon 2013. The hackathon is an opportunity for all Wikimedia community developers and sysadmins to come together, squash bugs and write great new features tools. Unlike the previous years (2012, 2011, etc.) this

Re: [Pywikipedia-l] svn migration

2012-12-26 Thread Maarten Dammers
Hoi Merlijn, Op 26-12-2012 13:28, Merlijn van Deen schreef: Hello all, As you might know, the Wikimedia Foundation (WMF) has moved most Mediawiki (MW)-related repositories from svn version control to git + gerrit. As a consequence, the WMF also wants to stop running their svn server - which is

[Pywikipedia-l] Amsterdam Hackathon 2013

2012-12-01 Thread Maarten Dammers
Hi everyone, Unlike previous years the big European Hackathon won't be in Berlin, but in Amsterdam. We're aiming to do the hackathon in May 2013 with a preference for the weekend of Saturday the 25th. To make sure this is a good weekend I've set up a straw poll at

[Pywikipedia-l] Wikimedia Nederland Hackathon 2012

2012-10-06 Thread Maarten Dammers
/Hackathon_2012 Maarten Dammers Wikimedia Nederland ___ Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

[Pywikipedia-l] Move to bugzilla

2012-06-09 Thread Maarten Dammers
Hi everyone, At the moment we use Wikimedia infrastructure for most aspects of Pywikipedia (documentation, version management, mailman etc), but not for the bug tracker. Merlijn and I talked a bit about moving to https://bugzilla.wikimedia.org . It's not that we love bugzilla, but that way

Re: [Pywikipedia-l] Move to bugzilla

2012-06-09 Thread Maarten Dammers
Hi Doug and Bináris, Op 9-6-2012 18:31, Doug schreef: I proposed this or Jira, which is used on toolserver, a few months back and got some resistance. For me Jira is out because I think that will stop at some point. I still support anything other than what we have but note that wikimedia is

Re: [Pywikipedia-l] [Commons-l] Help test chunked uploading

2012-05-05 Thread Maarten Dammers
Hi Raimond, Op 5-5-2012 10:46, Raimond Spekking schreef: Am 04.05.2012 05:16, schrieb Erik Moeller: http://commons.wikimedia.org/wiki/Special:Preferences#mw-prefsection-uploads There's a new user preference chunked uploads for files over 1 MB for Upload Wizard. The intent of this feature is

[Pywikipedia-l] SOPA tomorrow

2012-01-17 Thread Maarten Dammers
Hi guys, You probably know by now that the English Wikipedia will be closed tomorrow [1]. Keep an eye on your bots if they're running on the English Wikipedia (don't forget interwiki.py) because you might see some unexpected behaviour or just crashes tomorrow. Maarten [1]

Re: [Pywikipedia-l] Is there interest in migration to Toolserver JIRA?

2011-12-31 Thread Maarten Dammers
Hi Doug, Op 30-12-2011 16:27, Doug schreef: I chatted with one or two regulars on IRC about the idea and there seemed to be some general support if someone else was willing to take the lead. Is there general interest in taking the initial steps for a migration to JIRA, setting up a project,

Re: [Pywikipedia-l] Making pagenerators shut up

2011-12-23 Thread Maarten Dammers
Hi Merlijn, Op 22-12-2011 21:48, Merlijn van Deen schreef: Last but not least, feel free to rewrite all bots to use the python logging module, as it exists for long enough to be used (since python 2.3). I think we can distinguish two kinds of output: 1. Output for user interaction (diff,

[Pywikipedia-l] Commons messages mess

2011-07-06 Thread Maarten Dammers
Hi guys, The Commons messages are now a big mess. Everything gets imported from other bots, duplication etc etc. I was thinking about just making a lib (commons_lib.py?) to store the messages and moving the translations to the i18n later on. Good plan? Or should it be in the family file?

[Pywikipedia-l] Category.isHidden()

2011-06-05 Thread Maarten Dammers
Hi guys, Fun and useful thing to implement: A isHidden() function for the category object. Who feels like implementing this? You don't have to actually get the fulltext of the category to see if it's hidden, you should be able to get it like

Re: [Pywikipedia-l] Beauty Award for isDisabled

2011-04-15 Thread Maarten Dammers
Op 15-4-2011 15:48, John schreef: There are people watching About 297 (the number of members on this list). Maarten ___ Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l

Re: [Pywikipedia-l] Please approve me for commit access

2011-02-07 Thread Maarten Dammers
Hi MJB, Op 7-2-2011 15:22, MJB schreef: Hello , Tim Starling told me that i can ask here to approve me for commit access, i am working always with python and as i am working in Persian community, my codes is about working on Persian Wikis you can see a summary here

Re: [Pywikipedia-l] SourceForge passwords

2011-01-29 Thread Maarten Dammers
Hi Bináris, Op 29-1-2011 15:05, Bináris schreef: Have you also got an e-mail with subject SourceForge.net passwords reset? Is that authentic? Appears so, see http://sourceforge.net/blog/sourceforge-net-global-password-reset/ . Maybe a good moment to switch to a different bugtracker.

Re: [Pywikipedia-l] problem with replace.py

2011-01-16 Thread Maarten Dammers
Hi guys, Op 16-1-2011 12:20, Bináris schreef: What does it mean didn’t work at all? What have you seen on the screen? Are you sure those are really empty, and no space in them? By the way, now I remember, that earlier I had problems, too, when I wanted to substitute a newline (searching works

Re: [Pywikipedia-l] commonscat.py is broken

2010-11-24 Thread Maarten Dammers
Hi Antoine, Op 24-11-2010 19:27, Antoine Delarue schreef: Hello, when I launch commonscat.py I have this error : Traceback (most recent call last): File D:\Pywikipedia\commonscat.py, line 542, in module main() File D:\Pywikipedia\commonscat.py, line 517, in main primaryCommonscat,

[Pywikipedia-l] Internationalization

2010-10-23 Thread Maarten Dammers
Hi everyone, Currently translation of messages outputted to the wiki's is done in source. This is quite tedious to maintain. A good step would be to move translations to http://www.translatewiki.org so it is much easier to get things translated. But how? We have several options. 1. Gettext:

Re: [Pywikipedia-l] Retrying in 1 minute...

2010-09-25 Thread Maarten Dammers
Hi Lucas, Op 25-9-2010 1:22, Lucas Nunes schreef: Every time I get this message: WARNING: Could not open 'http://en.wikipedia.org/w/api.php'. Maybe the server or your connection is down. Retrying in 1 minutes... , is it possible to change the time to retry connecting? about 10 seconds? I'm

Re: [Pywikipedia-l] Which is official?

2010-08-24 Thread Maarten Dammers
Hi Bináris, Op 24-8-2010 11:29, Bináris schreef: http://www.mediawiki.org/wiki/Special:Code/pywikipedia http://svn.wikimedia.org/viewvc/pywikipedia/trunk/pywikipedia/ What is the difference, or which is to be regarded as more up-do-date? Both are just views of

Re: [Pywikipedia-l] Python 2.7

2010-07-31 Thread Maarten Dammers
Op 31-7-2010 17:12, Lewis Cawte schreef: On 31/07/10 16:03, Manuelt15 Wiki wrote: Hi, I wanted to notice you that the new Python 2.7 has been released, and I was wondering.. does Pywikipedia will work properly with it? Hm, I'm not sure.. I haven't got python 2.7 on my Ubuntu yet.. I'm

Re: [Pywikipedia-l] Fwd: Re: [Pywikipedia-svn] SVN: [8136] trunk/pywikipedia/wikipedia.py

2010-05-16 Thread Maarten Dammers
Op 12-5-2010 14:40, Maarten Dammers schreef: Op 4-5-2010 0:08, Merlijn van Deen schreef: This e-mail was sent by Maarten to the pywikipedia-svn mailing list. Sorry about that. Probably pressed the wrong reply button. Looks like the behavior was changed. Categories() should only return

Re: [Pywikipedia-l] Fwd: Re: [Pywikipedia-svn] SVN: [8136] trunk/pywikipedia/wikipedia.py

2010-05-12 Thread Maarten Dammers
and not categories transcluded by templates. This is not the way how you should change a library. Please change api=True to api=False in the trunk otherwise a lot of bots will break. Maarten -- Forwarded message -- From: Maarten Dammers maar...@mdammers.nl mailto:maar...@mdammers.nl

Re: [Pywikipedia-l] [Wikitech-l] New committers

2010-05-12 Thread Maarten Dammers
Hi Tim, Op 12-5-2010 11:09, Tim Starling schreef: knip * Amir Sarabadani (amir): pywikipediabot Aka Ladsgroup? How come? I'm wondering because my experience in the past with him wasn't that good. He tried to run bots on Commons and failed. Very hard to communicate with him. I can only

Re: [Pywikipedia-l] Request for feedback on rewrite branch

2010-04-01 Thread Maarten Dammers
Hi Russell, Russell Blau schreef: I am at a point where it would be helpful to have some feedback from other Pywikipedia users about the future of the rewrite branch. As those who watch the SVN commits know, I have not had as much time to work on this lately, and have to prioritize what

[Pywikipedia-l] FancyURLopener?

2009-11-20 Thread Maarten Dammers
Hi everyone, Could anyone tell me why FancyURLopener was replaced by this? MyURLopener = urllib2.build_opener(U2RedirectHandler) MyURLopener.add_handler(proxyHandler) MyURLopener.add_handler(proxyAuthHandler) MyURLopener.add_handler(authhandler) MyURLopener.addheaders = [('User-agent',

Re: [Pywikipedia-l] [Pywikipedia-svn] SVN: [7591] trunk/pywikipedia/wikipedia.py

2009-11-15 Thread Maarten Dammers
Hi everyone, I'm getting so freaking tired of these untested sloppy commits which keep breaking the bots. ale...@svn.wikimedia.org schreef: Revision: 7591 Author: alexsh Date: 2009-11-04 13:22:17 + (Wed, 04 Nov 2009) Log Message: --- * site().getUrl(): change all HTTP

[Pywikipedia-l] Upload api

2009-10-09 Thread Maarten Dammers
Hi guys, I'm playing around with the new upload api (it's enabled at http://test.wikipedia.org/). Now I'm wondering what the best way would be to implement it in the rewrite branch because uploading goes down to the core. Three ways of uploading are possible: file, url and chunks 1. File:

[Pywikipedia-l] Update bots for pt wikipedia

2009-10-07 Thread Maarten Dammers
Hi people, Pt wikipedia decided to get a local version of #redirect. Please update your bots to at least r7390 to prevent a mess (and a block). Maarten ___ Pywikipedia-l mailing list Pywikipedia-l@lists.wikimedia.org

Re: [Pywikipedia-l] [ pywikipediabot-Patches-2871229 ] commons_link.py update

2009-10-02 Thread Maarten Dammers
Jan Dudík schreef: Comment By: siebrand (siebrand) Date: 2009-10-02 11:18 Message: r7345. Please attach a proper diff next time, and not a whole file. But how to make proper diff? svn diff filename or with tortoise svn use create patch Maarten JAn Dudík

[Pywikipedia-l] flickrripper

2009-09-04 Thread Maarten Dammers
Hi everyone, I same to be able to transfer batches of images without a crash. Installation of Flickrapi and PIL seems to be difficult for users (process described at http://commons.wikimedia.org/wiki/Commons:Tools/Flickrripper). Any suggestions on how to improve this? Maarten Maarten Dammers

[Pywikipedia-l] Pywikipedia plans

2009-04-07 Thread Maarten Dammers
Hi guys, This weekend I went to the dev meeting in Berlin. Spoke to a number of people and now I have some things i want to work on: *Mailing lists : Already did a post about that a while ago (you probably missed that one). Bug filed at https://bugzilla.wikimedia.org/show_bug.cgi?id=18388

[Pywikipedia-l] Split this list?

2009-01-28 Thread Maarten Dammers
Hi guys, Currently this list is flooded with automated messages from Sourceforge and svn commits. I propose to split up the list so it's workable again. -pywikipeida-l - discussion by humans -pywikipedia-svn - svn commits -pywikipedia-bugs - automated bug mails (now by sourceforge maybe in the

Re: [Pywikipedia-l] SVN: [6270] trunk/pywikipedia

2009-01-22 Thread Maarten Dammers
Hi Cyde, Cyde Weys schreef: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 If this commit is causing any problems and you can't figure out what's wrong, please contact me and I'll have a look. Changing the behavior of the generator factory required touching every bot that used it, and I'm