A changeset to switch to python-requests has been merged into pywikibot-core.
https://gerrit.wikimedia.org/r/#/c/213977/
Note that config.proxy support doesnt exist. requests will read your
environment variables to find a proxy. If this doesnt work for you,
please raise a bug.
A minimum versio
At the Lyon Hackthon, updates to the tarball releases were turned off,
and Pywikibot 2.0 release candidate (RC) 1 was published onto PYPI.
https://pypi.python.org/pypi/pywikibot
The tarball releases are currently locked to the git revision before
the Lyon Hackathon. This was done to prevent larg
On Thu, May 7, 2015 at 4:43 PM, Strainu wrote:
> 2015-05-07 7:51 GMT+03:00 John Mark Vandenberg :
>>
>> Another way to reduce the impact of the move is allowing pwb to find &
>> execute commands located in the pywikibot/ directory.
>>
>> https://gerrit.wikim
cosmetic_changes.py has been moved from scripts/ into pywikibot/ , so
that the library package 'pywikibot' is not dependant on the 'scripts'
package.
https://gerrit.wikimedia.org/r/#/c/190715
The script can still be run using its new location explicitly; e.g.
$ python3 pwb.py pywikibot/cosmetic_
The core and compat codebase have code to support SVN pre 1.7. I have
tested it with 1.6, and it looks *roughly* correct, but our code does
not work, and has not worked since Feb 2014 as detailed at
https://phabricator.wikimedia.org/T95077
In addition, SVN 1.6 is no longer supported by the SVN d
Hi,
I think the problem is that langlinks did/can/could use &#;
https://no.wikipedia.org/w/index.php?title=Wikipedia:Om&diff=9814748&oldid=9792310
However, those &'s dont appear to be in the current API langlinks
results for the old revision.
https://no.wikipedia.org/w/api.php?action=query&
On 27 Feb 2015 10:41, "Ricordisamoa" wrote:
>
> Il 26/02/2015 22:31, John Mark Vandenberg ha scritto:
>
>>
>> We need a wiki page which explains the current combat v core situation
suitable for new users.
>>
> Pun inten
We need a wiki page which explains the current combat v core situation
suitable for new users.
___
Pywikipedia-l mailing list
Pywikipedia-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
On Sun, Feb 22, 2015 at 10:33 PM, Amir Ladsgroup wrote:
> So what do you suggest? If a CS is old enough, rebase is the least of the
> problems.
What is the problem that you are trying to solve?
Gerrit allows filtering by review status using url parameters, etc, so
'too many patches' is hardly a
On Sun, Feb 22, 2015 at 10:16 PM, John Mark Vandenberg wrote:
> On Sun, Feb 22, 2015 at 7:40 PM, Amir Ladsgroup wrote:
>> Hey,
>> There are about 200 open patches in pywikibot right now, huge part of them
>> are obsolete, really problematic, or redundant patches.
>
>
On Sun, Feb 22, 2015 at 7:40 PM, Amir Ladsgroup wrote:
> Hey,
> There are about 200 open patches in pywikibot right now, huge part of them
> are obsolete, really problematic, or redundant patches.
Can you identify some that fit into these categories? Maybe add a
note on them recommending what sh
HI Strainu,
I am guessing you're using $ python pwb.py
Thanks.
Which GCC is your CPython compiled for? Also GCC 4.9.0 ?
What would be especially useful is if we can determine which methods
are performing vastly slower on CPython vs PyPy for that workload.
On Fri, Jan 2, 2015 at 8:45 PM, Ricordisamoa
wrote:
> Il 02/01/2015 14:07, John M
On Fri, Jan 2, 2015 at 6:10 PM, Ricordisamoa
wrote:
> PyPy is an alternative implementation of Python primarily focused on
> performance.
> During a very rough benchmark I made with CosmeticChangesToolkit and a few
> pages, it didn't provide significant speed improvements, but it did work.
> Have
Done.
On Mon, Dec 15, 2014 at 3:20 PM, Ricordisamoa
wrote:
> Xqt made gerrit:178796 not depend on gerrit:179591 anymore.
> The latter should be merged, or the former should be reverted, because of
> failing tests.
> I remember this already happened some time ago. Please do not remove
> dependenci
On Fri, Dec 12, 2014 at 10:18 PM, Bináris wrote:
>
> 2014-12-12 14:24 GMT+01:00 John Mark Vandenberg :
>>
>> Ugh. It is all about compat :/
>
>
> Compat is nice and delicious. :-)
> I was proud to find some of my own contributions there, but the whole thing
> doe
Ugh. It is all about compat :/
On Fri, Dec 12, 2014 at 9:16 PM, Ricordisamoa
wrote:
> Just found this :-)
>
> ___
> Pywikipedia-l mailing list
> Pywikipedia-l@lists.wikimedia.org
> https://lists.wikimedia.org/mailman/listinfo/pywikipedia-l
>
--
Joh
Hi,
There are a few aspects of packaging which will benefit from more
brains and a collective decision we can all live with, both in the
short term for '2.0' and what we want long term (e.g. '2.1', etc).
I would appreciate assistance with...
https://www.mediawiki.org/wiki/Requests_for_comment/py
On Thu, Nov 20, 2014 at 6:13 AM, Mpaa wrote:
> I would like to have a real example where this line and the following are
> used:
> -
> https://github.com/wikimedia/pywikibot-core/blob/master/pywikibot/data/api.py#L1474
That is used for list=querypage.
https://en.wikipedia.org/w/api.php?action=qu
On Sat, Nov 15, 2014 at 2:12 AM, Andre Klapper wrote:
> Hi,
>
> On Fri, 2014-11-14 at 11:39 +0330, Amir Ladsgroup wrote:
>> If you are using the mailing list (pywikipedia-bugs) to track bugs you
>> don't need to worry, All of the phabricators e-mails will go through
>> the old mailing list and won
On Fri, Nov 14, 2014 at 2:23 PM, Bináris wrote:
> In a lucky case we will loose the tracked e-mail threads again. Once on SF
> when I opened a new bug or contributed to one, I immediately marked the
> e-mail coming from SF with a label, and in Gmail all subsequent mails were
> automatically marked
On Thu, Oct 30, 2014 at 6:54 AM, John Mark Vandenberg wrote:
> The entire codebase now passes a mandatory jenkins job
> (pre-code-review) , which requires valid docstrings except for
> functions and methods.
>
> Thanks to everyone involved in bringing the documentation up t
Hi Rubin,
You mentioned "wikipedia.py" in your email; are you using compat for
these tasks?
On Sun, Nov 2, 2014 at 3:46 PM, rubin.happy wrote:
> Hello!
>
> I set up my bot on Labs and use shared repo of pywikibot.
> That's why I am interested in 2 options:
>
> 1) how can I define which file shou
The entire codebase now passes a mandatory jenkins job
(pre-code-review) , which requires valid docstrings except for
functions and methods.
Thanks to everyone involved in bringing the documentation up to this standard.
There is still lots to do, like adding docstrings for functions and
methods;
On Fri, Oct 3, 2014 at 1:29 PM, Manpreet Kaur
wrote:
> Hi! I am new to pywikibot and have been going through
> installation/contribution articles. I have two questions:
> 1. What is the difference b/w pywikibot-core/compat and core/compat? Do i
> need to install both?
Repeating what Amir and Fabi
Hi Tessy,
A fun 'big one' is 'badtoken' handling. It would be fantastic to even
build a test case which reliably causes the error, after which it is
pretty much solved ;-)
https://bugzilla.wikimedia.org/show_bug.cgi?id=59678
There are a few other network problems if that is your thing. Here is
On Mon, Sep 8, 2014 at 10:45 AM, Wiki Billinghurst
wrote:
> For English Wikisource, I have a series of 63 volumes of the "Dictionary of
> National Biography" that have now been transcribed. ...
> I am trying work out how to use pywikibot to generate a list of the pages
> with red links.
I am gues
On Wed, Sep 3, 2014 at 2:29 AM, Sorawee Porncharoenwase
wrote:
> I propose this change:
>
> - set `page.text` to `None` to discard changes
Doesn't the page.text setter already do this?
> - delete `page.text` to reload content -- equivalent to get(force=True)
del page.text already removes the ca
On Sun, Aug 10, 2014 at 8:08 PM, Amir Ladsgroup wrote:
> For me it breaks with or without -break:
> ladsgroup@tools-dev:~/core-clean$ python pwb.py welcome -lang:fa
> Traceback (most recent call last):
> File "pwb.py", line 157, in
> run_python_file(fn, argv, argvu)
> File "pwb.py", line
Thanks to many of you who have worked on the flake warnings over the
last few months, the code base now has zero flakes, and thanks to
hashar a 'flake8' job now votes against any changeset which has
flakes.
Also, nose tests are also run for every changeset before the code is
merged, but only the t
On Thu, Aug 14, 2014 at 8:00 PM, Amir Ladsgroup wrote:
> Hello,
> Yesterday after some talks in IRC we thought It would be good if we
> kill off the i18n submodule and bring the files into core, compat will
> have the i18n folder but won't receive any updates. One of major
> advantage of this acti
On Fri, Aug 8, 2014 at 5:06 AM, Ricordisamoa
wrote:
>> Il 07/08/2014 23:48, John Mark Vandenberg ha scritto:
>>
>>> On Fri, Aug 8, 2014 at 4:37 AM, Ricordisamoa
>>> wrote:
>>>
>>> py2.6 tests on Travis-CI are now allowed to fail, meaning that we
On Fri, Aug 8, 2014 at 5:06 AM, Ricordisamoa
wrote:
> What about adding the Python version to the User-Agent?
Yes, we discussed that in the last py 2.6 thread, but not in the
user-agent thread as I recall.
Now included in a related patch:
https://gerrit.wikimedia.org/r/#/c/152200/
--
John Van
On Fri, Aug 8, 2014 at 4:37 AM, Ricordisamoa
wrote:
> py2.6 tests on Travis-CI are now allowed to fail, meaning that we are,
> actually, supporting only 2.7+.
I would prefer to say that we've made py 2.6 a second tier supported
platform. ;-)
When we add py 3 support, py 2.6 would drop down to th
On Fri, Jul 18, 2014 at 1:40 PM, Amir Ladsgroup wrote:
> I made a patch to add any customized user agent and (username would be
> default) and if the person doesn't want to add any user agent, they just can
> set it to " "
>
> https://gerrit.wikimedia.org/r/#/c/147381/
This was merged a week ago.
On Wed, Aug 6, 2014 at 11:59 PM, Ricordisamoa
wrote:
>
> Il 06/08/2014 12:56, Merlijn van Deen ha scritto:
>
> Siebrand confirms: we should change it in code, and tw.net will pick it up.
>
> Merlijn
>
> Thanks a lot! Filed gerrit:152138 and gerrit:152139.
Both merged.
https://gerrit.wikimedia.or
The following shows a list of 21 easy fixes to scripts, which will
help our build system be able to do basic sanity checks on these
scripts after each patch is merged.
https://bugzilla.wikimedia.org/showdependencytree.cgi?id=69069&hide_resolved=0
The only 'hard' one in there is 68797, as it requi
Recently we had a few cases of code that didnt compile getting merged
(I have +2 some of them.. :/), so I have fast tracked the addition of
a set of tests which run every script with -help , and with -simulate.
These new tests add about 3 minutes to the test suite execution, and
add basic validatio
On Fri, Jun 13, 2014 at 10:10 AM, Ricordisamoa
wrote:
> Please sign off a Code-Review+1 for
> https://gerrit.wikimedia.org/r/#/c/139294/.
> Thanks in advance.
>
> Il 09/06/2014 10:02, Nicolas Dumazet ha scritto:
>
> Hey folks,
>
> Sorry about that. I'd happily relicense the original code under wh
What is the minimum supported mw version for core and compat?
It looks like the lowest family version() are..
core: lockwiki with 1.15.1 (not confirmed as special:version requires
registration)
compat: wesolve with 1.5.7, loveto with 1.8.2, and then
wikitravel_shared with 1.10.1 and mozilla with 1
I disagree with adding 'both'.
I think we should use the whiteboard, or a tracking bug, for core bugs
inherited from compat and the fixes therefore need backporting.
On Sun, Jul 27, 2014 at 7:35 AM, Ricordisamoa
wrote:
> Currently, the "Version" field of our bugs can only be set to one of "compa
On Sat, Jul 26, 2014 at 10:39 PM, Ricordisamoa
wrote:
>
> The build is still broken, but because of this edit, that breaks the
> timestamp detection of the ArchiveBot.
> Maybe a fictitious, write-protected talk page should be used?
That is being tracked on
https://bugzilla.wikimedia.org/show_bu
The build was repeatedly broken over the last week.
Two of the build breakages have been fixed.
I think one was caused by changes to WMF site configuration.
https://travis-ci.org/wikimedia/pywikibot-core/builds/30824554
And the other caused by merging a fix without checking the tests
worked cor
I've created a new bug for a component for all scripts, or "Other scripts".
https://bugzilla.wikimedia.org/show_bug.cgi?id=68542
It would be nice if we can break them into a few sets of scripts.
"sysop scripts" might be a useful group.
"Commons scripts" could be another.
--
John Vandenberg
__
Sort of related, I see there is no http://test.wiktionary.org/ ;-(
On Tue, Jul 22, 2014 at 1:53 PM, Legoktm wrote:
> On 7/21/14, 6:56 PM, John Mark Vandenberg wrote:
>> On Tue, Jul 22, 2014 at 8:46 AM, Ricordisamoa
>> wrote:
>>> ..
>>> IMHO compat should
On Tue, Jul 22, 2014 at 8:46 AM, Ricordisamoa
wrote:
> ..
> IMHO compat should be left with its old version and /wiktionary be added as
> submodule in core.
I agree with this solution.
Could we arrange a hack 'day' when someone familiar with the code is
available, and others help get the new rep
On Fri, Jul 18, 2014 at 9:26 PM, Ricordisamoa
wrote:
> Many of our scripts have copyright notices at the top like this
> (category.py):
> # (C) Rob W.W. Hooft, 2004
> and then:
> # (C) Pywikibot team, 2008-2013
> even if most contributors (e.g. Rob W.W. Hooft) are regularly listed in
> CREDITS.
>
On Mon, Jul 14, 2014 at 6:59 PM, Bináris wrote:
> The bot account itself is not enough until we get a centralized notice for
> each userpage wikiwide. The main wiki should be included. hu:user:binbot is
> enogh to contact, and an urlencoded username can be easily inserted into the
> URL bar of bro
Re user agents, 2010 was a long time ago from an ops perspective.
The need for a user agent is no doubt as strong as in the 2010 edict
from Domas, but I would like clarification from ops regarding 'gold
standard' before we build something which may no longer be needed by
them.
On Fri, Jul 11, 201
On Sun, Jul 6, 2014 at 9:14 PM, Amir Ladsgroup wrote:
> I made some comments in the talk page.
concluding the gzip query, it is definitely occurring.
https://gerrit.wikimedia.org/r/#/c/144850/
A discussion about user-agents is on the talk page:
https://www.mediawiki.org/wiki/API_talk:Client_code
On Sat, Jul 5, 2014 at 9:19 PM, Amir Ladsgroup wrote:
> I think this blog post would help us a lot (it suggests in stream
> compression we use zlib instead of gzip)
> http://rationalpie.wordpress.com/2010/06/02/python-streaming-gzip-decompression/
>
> What do you think?
It appears that bug is fix
Likewise, thank you Francis for this evaluation. It is very helpful.
Are we sure that gzip isnt occurring by default? I started to investigate
this a few weeks ago, and confirmed httplib2 defaults to gzip, but I didnt
verify that pywiki core isnt meddling with that default.
This is quite import
Many scripts accept page titles spanning multiple command line
arguments, usually put into an array called titleParts and joined
together. It is redundant to pagegenerators argument -page:"..." ,
and a poor equivalent as only one page can be specified with
titleParts. Also not using quotes on the
I dont know much about the history of these decisions, so just my own
thoughts...
On Wed, Jun 18, 2014 at 12:15 PM, Sorawee Porncharoenwase
wrote:
> 1) What is the preferable shebang? What I have seen are:
> - #!/usr/bin/python (such as scripts/add_text.py)
> - #!/usr/bin/env python (such as scri
On Tue, Jun 17, 2014 at 4:39 PM, Amir Ladsgroup wrote:
> I disagree, I wrote lots of codes that deletion is a part of them (e.g. this
> [https://www.wikidata.org/wiki/User:Ladsgroup/del.py]
> code for deleting items in Wikidata).
> Maybe there is one usage of them in core but it has been widely us
On Sun, Jun 15, 2014 at 8:12 PM, Bináris wrote:
>
>
>
> 2014-06-15 12:37 GMT+02:00 Maarten Dammers :
>
>> I was wondering, does the user-agent include the python version? If so, we
>> could ask the wmf analytics team to do some logging for us.
>
>
> Currently doesn't, but it is a good idea to impl
> On 16 June 2014 16:33, John wrote:
>>
>> Avoiding the headache of re-inventing the wheel across dozens of scripts
>> that use that code?
There is only one use of Page.protect() , even in compat, so IMO that
code should mostly be moved from Page to scripts/protect.py.
There is also only one use
In https://gerrit.wikimedia.org/r/#/c/139792
I noticed that Page.delete() and page.protect() have a lot of user
interaction logic which would normally be in a script. e.g. asking a
user what actions to take. Also, they set a flag in the site object.
i.e. site._noDeletePrompt = True and site._noPr
On Mon, Jun 16, 2014 at 12:23 PM, Amir Ladsgroup wrote:
> We can make a new mailing list named pywikibot-l and mass-subscribe
> pywikipedia-l members and then close pywikipedia-l
> We did this for pywikibot-commits, but the archives would be disconnected
>
> If you think it's okay to do this with
On Fri, Jun 13, 2014 at 2:51 PM, Jeroen De Dauw wrote:
> Hey,
>
>> Are the claims a large part of the network traffic for items you are
>> processing? Some client time might be saved by lazy loading the claim
>> objects from _content. The claims data is even smaller when using raw
>> revisions i
On Sun, Jun 15, 2014 at 2:32 AM, Antoine Musso wrote:
> Hello Amir and Quim,
>
> That looks much much nicer than the default mailman wikipage.
> Congratulations!
It looks nice. Thanks.
Could we change the name of the list to pywikibot-l ?
--
John Vandenberg
___
On Sun, Jun 15, 2014 at 9:25 PM, Merlijn van Deen wrote:
> On 15 June 2014 09:19, John Mark Vandenberg wrote:
>>
>> We have four sets of cleartext passwords (http & proxy & db), and secrets
>> such as various API keys and mw cookies and edit tokens.
>>
>>
We have four sets of cleartext passwords (http & proxy & db), and secrets
such as various API keys and mw cookies and edit tokens.
The passwords are stored in two files in clear text (user-config.py and.
passwd). Other secrets are in cached api files, etc.
I would like to introduce an optional de
On Sun, Jun 15, 2014 at 2:44 AM, Ricordisamoa
wrote:
> Some tests fail only in py2.6:
> https://travis-ci.org/wikimedia/pywikibot-core/jobs/27558463
> (https://gerrit.wikimedia.org/r/139591/ is an attempted fix).
If a proper fix for 2.6 cant be found quickly, any use of Wikibase
WbQuantity should
On Fri, Jun 13, 2014 at 9:34 AM, Ricordisamoa
wrote:
> I still can't find a way to query only some item properties (e.g. claims)
> from the Wikibase API using pywikibot.
> I've tried all of them:
>
> .get('claims')
> .get(True, 'claims')
> .get(force=True, 'claims')
> .get('claims', force=True)
>
I have also found core to be difficult to use in some cases, but it is
a much better codebase in general than the 'compat' dumping ground,
and I am thankful for the people who have worked hard to bring it to
its current state.
It is close to being ready for general use. We need more people
trying
On Jun 4, 2014 6:16 PM, "Legoktm" wrote:
>
> On 6/4/14, 1:07 AM, Antoine Musso wrote:
>
>> Your gerrit remote must be out of date, you can refresh it using either:
>
>
> Err, I don't think that's the case here. There are probably 140 commits
that are in httplib2 0.9 that weren't in 0.8.
No. There
I've found myself behind a proxy this week, and probably next week,
and the proxy support in core is quite broken, which is slowing me
down but also giving me something new to work on...
To unbreak pywikibot in my current environment, the online git repo
version detection needs to be either rewrit
On Mon, Jun 2, 2014 at 8:00 PM, Amir Ladsgroup wrote:
> Core has one million advantages on compat but easy-installation is not one
> of them, a week ago I was trying to teach some bot operators to migrate to
> core and there were three main problems:
>
> 1- core suggests people to make the user-co
On Jun 1, 2014 6:44 AM, "Ricordisamoa" wrote:
>
> Per gerrit:127467 and bug 55882#c5, we should add
https://pypi.python.org/pypi/ordereddict as a requirement for
installing/using pywikibot.
> Any volunteers for a patch?
I mentioned on IRC that I could do it, but i didnt get to it before
travellin
On Jun 1, 2014 7:42 AM, "Ricordisamoa" wrote:
>
> How about creating a wikibase.py file in the pywikibot/ directory to
contain DataSite, WikibasePage, ItemPage, Claim, WbTime, WbQuantity, etc.?
>
Sounds good to me
___
Pywikipedia-l mailing list
Pywikipe
On Wed, May 28, 2014 at 11:43 AM, Ian Kelling wrote:
> My first experience with pywikibot, downloaded core, i wanted to change
> a few pages. Immediately ran into an error when trying to set a page's
> text to empty. The error message was unhelpful, but I dug through the
> source and found the iss
72 matches
Mail list logo
