[Pywikipedia-bugs] [Maniphest] [Commented On] T124141: weblinkchecker should not process URLS in fullurl

2016-01-20 Thread jayvdb 
jayvdb added a comment.

GCI task: https://codein.withgoogle.com/dashboard/tasks/5158918728712192/


TASK DETAIL
  https://phabricator.wikimedia.org/T124141

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, jayvdb, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Changed Project Column] T124141: weblinkchecker should not process URLS in fullurl

2016-01-20 Thread jayvdb 
jayvdb moved this task to Imported into GCI site on the Google-Code-In-2015 
workboard.

TASK DETAIL
  https://phabricator.wikimedia.org/T124141

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1587/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, jayvdb, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124005: Create tests for fake user agent

2016-01-20 Thread jayvdb 
jayvdb added a comment.

(This is using the clonable GCI tests task)


TASK DETAIL
  https://phabricator.wikimedia.org/T124005

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MtDu, jayvdb
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Nemo_bis, MtDu, gerritbot, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124012: Allow custom-defined threshold to suppress "Waiting for X pages to be put" message

2016-01-20 Thread jayvdb 
jayvdb added a comment.

GCI task: https://codein.withgoogle.com/dashboard/tasks/5642085369643008/

(@harej needs to be added as a mentor to that task)


TASK DETAIL
  https://phabricator.wikimedia.org/T124012

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, jayvdb, StudiesWorld, Harej, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Changed Project Column] T124005: Create tests for fake user agent

2016-01-20 Thread jayvdb 
jayvdb moved this task to Imported into GCI site on the Google-Code-In-2015 
workboard.

TASK DETAIL
  https://phabricator.wikimedia.org/T124005

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1587/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MtDu, jayvdb
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Nemo_bis, MtDu, gerritbot, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Changed Project Column] T124012: Allow custom-defined threshold to suppress "Waiting for X pages to be put" message

2016-01-20 Thread jayvdb 
jayvdb moved this task to Imported into GCI site on the Google-Code-In-2015 
workboard.

TASK DETAIL
  https://phabricator.wikimedia.org/T124012

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1587/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, jayvdb, StudiesWorld, Harej, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Created] T124145: pagegenerators.LinksearchPageGenerator should skip pages only containing illegal matching links

2016-01-20 Thread jayvdb 
jayvdb created this task.
jayvdb added a subscriber: pywikibot-bugs-list.
jayvdb added projects: Pywikibot-pagegenerators, pywikibot-core.
Herald added a subscriber: Aklapper.

TASK DESCRIPTION
  MediaWiki treats `http://*.books.google.com` as a hyperlink, even though it 
is an illegal URL since it contains `*` in the domain.
  
  When the command line `-weblink:books.google.com` is used (which uses 
`pagegenerators.LinksearchPageGenerator`), and MediaWiki API results include a 
page that only contains `http://*.books.google.com` and not a real 
`books.google.com` URL, the page should be skipped as it doesnt contain the 
requested URL.

TASK DETAIL
  https://phabricator.wikimedia.org/T124145

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, pywikibot-bugs-list, jayvdb



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Edited] T124145: pagegenerators.LinksearchPageGenerator should skip pages only containing illegal matching links

2016-01-20 Thread jayvdb 
jayvdb edited the task description.
jayvdb set Security to None.

TASK DETAIL
  https://phabricator.wikimedia.org/T124145

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Created] T124146: weblinkchecker should report links to sites on interwiki map

2016-01-20 Thread jayvdb 
jayvdb created this task.
jayvdb added a subscriber: jayvdb.
jayvdb added projects: Pywikibot-weblinkchecker.py, pywikibot-core.
Herald added subscribers: pywikibot-bugs-list, Aklapper.

TASK DESCRIPTION
  weblinkchecker should highlight when a page links to another wiki on the 
Interwiki Map using an external link instead of a interwiki link.
  
  ```
  $ python pwb.py weblinkchecker -family:wikipedia -lang:sv -weblink:cev.lu
  Retrieving 1 pages from wikipedia:sv.
  
  
  >>> Europamästerskap i volleyboll <<<
  checking http://cev.lu/News.aspx?NewsID=11129&ID=10
  checking http://www.fivb.org/viewPressRelease.asp?No=37232&Language=en
  checking 
https://en.wikipedia.org/w/index.php?title=European_Volleyball_Championship&oldid=598095502
  
  1 pages read
  0 pages written
  Execution time: 1 seconds
  Read operation time: 1 seconds
  Script terminated successfully.
  Waiting for remaining 3 threads to finish, please wait...
  Waiting for remaining 3 threads to finish, please wait...
  Waiting for remaining 3 threads to finish, please wait...
  http://cev.lu/News.aspx?NewsID=11129&ID=10 ok
  http://www.fivb.org/viewPressRelease.asp?No=37232&Language=en ok
  Waiting for remaining 1 threads to finish, please wait...
  Waiting for remaining 1 threads to finish, please wait...
  
https://en.wikipedia.org/w/index.php?title=European_Volleyball_Championship&oldid=598095502
 ok
  Saving history...
  ```

TASK DETAIL
  https://phabricator.wikimedia.org/T124146

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, pywikibot-bugs-list, jayvdb



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Changed Subscribers] T124141: weblinkchecker should not process URLS in fullurl

2016-01-20 Thread jayvdb 
jayvdb added a subscriber: Emijrp.
jayvdb added a comment.

https://en.wikipedia.org/wiki/User:Emijrp/External_Links_Ranking exists in 33 
languages of Wikipedia, so it frequently appears in `-weblink:` results.

T124142: Do not process URLs containing * in domain name 
 is another approach to prevent 
weblinkchecker choking on this page.


TASK DETAIL
  https://phabricator.wikimedia.org/T124141

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Emijrp, Aklapper, jayvdb, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124015: Review ignore list

2016-01-20 Thread jayvdb 
jayvdb added a comment.

I cant find any problems with links to cev.lu

  $ python pwb.py weblinkchecker -family:wikipedia -lang:de -weblink:cev.lu 
-namespace:0
  ...
  1 pages read
  
  $ python pwb.py weblinkchecker -family:wikipedia -lang:fr -weblink:cev.lu 
-namespace:0
  ...
  17 pages read
  
  $ python pwb.py weblinkchecker -family:wikipedia -lang:en -weblink:cev.lu 
-namespace:0
  ...
  37 pages read
  
  $ python pwb.py weblinkchecker -family:wikipedia -lang:lb -weblink:cev.lu 
-namespace:0
  
  0 pages read


TASK DETAIL
  https://phabricator.wikimedia.org/T124015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Masti, Xqt, Aklapper, StudiesWorld, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124015: Review ignore list

2016-01-20 Thread jayvdb 
jayvdb added a comment.

(note these tests will need to repeated with a `*.` prefix to be 100% sure.  
The addition of a fake user-agent is probably the reason they are now working 
fine.


TASK DETAIL
  https://phabricator.wikimedia.org/T124015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Masti, Xqt, Aklapper, StudiesWorld, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124005: Create tests for fake user agent

2016-01-20 Thread Nemo_bis 
Nemo_bis added a comment.

In https://phabricator.wikimedia.org/T124005#1947180, @jayvdb wrote:

> (This is using the clonable GCI tests task)


Do you mean 
https://codein.withgoogle.com/dashboard/task-instances/4884036929454080/ ?


TASK DETAIL
  https://phabricator.wikimedia.org/T124005

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MtDu, Nemo_bis
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Nemo_bis, MtDu, gerritbot, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124005: Create tests for fake user agent

2016-01-20 Thread jayvdb 
jayvdb added a comment.

Yes


TASK DETAIL
  https://phabricator.wikimedia.org/T124005

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MtDu, jayvdb
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Nemo_bis, MtDu, gerritbot, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124005: Create tests for fake user agent

2016-01-20 Thread MtDu 
MtDu added a comment.

@jayvdb,
I forgot to copy the reply you gave me when I asked you for a little guidance. 
You gave me some grep commands and a few other hints. Could you post those in 
the task description? 
Thanks,
MtDu


TASK DETAIL
  https://phabricator.wikimedia.org/T124005

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MtDu
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Nemo_bis, MtDu, gerritbot, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124005: Create tests for fake user agent

2016-01-20 Thread jayvdb 
jayvdb added a comment.

To allow tests to be skipped if a package is not installed, and to alter user 
configuration...

  $ git grep require_modules tests/
  ...
  $ git grep 'config\.' tests/
  ...


TASK DETAIL
  https://phabricator.wikimedia.org/T124005

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MtDu, jayvdb
Cc: Aklapper, pywikibot-bugs-list, jayvdb, Nemo_bis, MtDu, gerritbot, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Closed] T85311: archivebot.py does not update counter

2016-01-20 Thread whym 
whym added a subscriber: whym.
whym closed this task as "Resolved".
whym claimed this task.
whym added a comment.

I believe this was caused by the canonical (local-language) namespace prefix of 
the template being not recognized. In the old archivebot only English prefixes 
worked properly. After gerrit:136532 
 (merged Feb 20, 2015) it should 
support both English and localized ones.


TASK DETAIL
  https://phabricator.wikimedia.org/T85311

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: whym
Cc: whym, Rajdeep594, revi, Aklapper, pywikibot-bugs-list, Ladsgroup



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124015: Review ignore list

2016-01-20 Thread jayvdb 
jayvdb added a comment.

I've processed ~1500 pages with matching `*.jpl.nasa.gov` on en.wp, and only 
found two problems.  All of the other HTTP and socket errors were real 
problems, checked against DNS records or reproducible using a web browser on a 
very different IP address range.

The command used:

  $ python pwb.py weblinkchecker -family:wikipedia -lang:en 
-weblink:'*.jpl.nasa.gov' -namespace 0

The first and only serious problem was [[w:en:Real versus nominal value]] 
linked to 
http://jpl.nasa.gov/news/news.cfm?release=2009-191&icid='NewsFeaturesHome' , 
which weblinkchecker sees as 404 Not Found.

When I change 

 the article to remove the unnecessary `&icid...`, weblinkchecker works 
correctly, which I suspect means there is a bug encoding `'` in URLs.  Note 
this will be fixed by `requests` anyway.

The other difference is entirely understandable: `[[List of NASA websites]] 
links to https://nightsky.jpl.nasa.gov/ - Socket Error: u'[SSL: 
CERTIFICATE_VERIFY_FAILED] certificate verify failed (_ssl.c:590)`.  A 
web-browser shows this website, but with a certificate warning.  IMO this is 
still a real error.  Ignoring certificate warnings will be much easier with 
`requests`.

Another SSL issue worth mentioning is `[[SHARAD]] links to 
http://starbrite.jpl.nasa.gov/pds/viewInstrumentProfile.jsp?INSTRUMENT_ID=SHARAD&INSTRUMENT_HOST_ID=MRO
 - Socket Error: u'[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed 
(_ssl.c:590)'.`  In a web-browser that also is a HTTP 500.


TASK DETAIL
  https://phabricator.wikimedia.org/T124015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Masti, Xqt, Aklapper, StudiesWorld, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124142: Do not process URLs containing * in domain name

2016-01-20 Thread MtDu 
MtDu added a subscriber: MtDu.
MtDu added a comment.

@jayvdb,
This just requires adding a re.compile line to the ignore list right in 
weblinkchecker.py right? 
Thanks,
MtDu


TASK DETAIL
  https://phabricator.wikimedia.org/T124142

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: MtDu
Cc: MtDu, Aklapper, StudiesWorld, jayvdb, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Created] T124192: compact selflink.py freezes trying saving an edit

2016-01-20 Thread Vituzzu 
Vituzzu created this task.
Vituzzu added a subscriber: Vituzzu.
Vituzzu added projects: pywikibot-compat, Pywikibot-compat-to-core.
Herald added subscribers: pywikibot-bugs-list, StudiesWorld, Aklapper.

TASK DESCRIPTION
  I have to use compact selflink.py because core's one doesn't support -xml 
option. Anyway (even using -page) it freezes trying saving any edit. Here's the 
traceback after a keyboard interrupt:
  
File "selflink.py", line 306, in 
  main()
File "selflink.py", line 301, in main
  bot.run()
File "selflink.py", line 240, in run
  self.treat(page)
File "selflink.py", line 222, in treat
  pywikibot.showDiff(oldText, text)
File "/home/.../compat/pywikibot/support.py", line 161, in showDiff
  diff += lastline + '\n'
  KeyboardInterrupt

TASK DETAIL
  https://phabricator.wikimedia.org/T124192

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Vituzzu
Cc: Aklapper, StudiesWorld, Vituzzu, pywikibot-bugs-list, Anshoe, droid, jayvdb



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Changed Subscribers] T60941: [tracking] [clonable] Missing unit tests for pywikibot library

2016-01-20 Thread AndyTechGuy 
AndyTechGuy added a subscriber: AndyTechGuy.

TASK DETAIL
  https://phabricator.wikimedia.org/T60941

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: AndyTechGuy
Cc: AndyTechGuy, gerritbot, Mandarj7, Aklapper, jayvdb, valhallasw, 
Ricordisamoa, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T123808: Statistics for SCM project 'core' mix pywikibot/core, mediawiki/core and oojs/core

2016-01-20 Thread Aklapper 
Aklapper added a comment.

...that dropdown also lists quite some duplicate entries like wikipedia, 
vendor, varnish, wikimetrics, wikibugs, wikistats, ... Might be also somehow 
related.


TASK DETAIL
  https://phabricator.wikimedia.org/T123808

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Aklapper
Cc: pywikibot-bugs-list, Lcanasdiaz, Qgil, jayvdb, Aklapper, Dicortazar



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T113140: Convert weblinkchecker to requests

2016-01-20 Thread MtDu 
MtDu added a subscriber: MtDu.
MtDu added a comment.

@jayvdb, 
I'm pretty lost. Not sure what needs to be rewritten using requests. Are you 
saying just not use LinkChecker at all? I guess I just don't really understand 
what the function I'm changing is doing. Please guide me a little. 
Thanks,
MtDu


TASK DETAIL
  https://phabricator.wikimedia.org/T113140

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb, MtDu
Cc: MtDu, StudiesWorld, Beta16, pywikibot-bugs-list, Ricordisamoa, jayvdb, 
gerritbot, Aklapper, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T113140: Convert weblinkchecker to requests

2016-01-20 Thread jayvdb 
jayvdb added a comment.

@MtDu, the function is checking that each link is alive.  It is very similar to 
reflinks.py. Do a fetch, check the response, and for non-OK status codes 
capture the error message / exception message.


TASK DETAIL
  https://phabricator.wikimedia.org/T113140

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: MtDu, StudiesWorld, Beta16, pywikibot-bugs-list, Ricordisamoa, jayvdb, 
gerritbot, Aklapper, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Triaged] T123198: Implement action=mergehistory support

2016-01-20 Thread Sn1per 
Sn1per triaged this task as "Normal" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per
Cc: jayvdb, Aklapper, StudiesWorld, Sn1per, pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T113140: Convert weblinkchecker to requests

2016-01-20 Thread gerritbot 
gerritbot added a comment.

Change 265398 had a related patch set uploaded (by MtDu):
[WIP] Convert weblinkchecker to requests

https://gerrit.wikimedia.org/r/265398


TASK DETAIL
  https://phabricator.wikimedia.org/T113140

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb, gerritbot
Cc: MtDu, StudiesWorld, Beta16, pywikibot-bugs-list, Ricordisamoa, jayvdb, 
gerritbot, Aklapper, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Updated] T113140: Convert weblinkchecker to requests

2016-01-20 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T113140

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb, gerritbot
Cc: MtDu, StudiesWorld, Beta16, pywikibot-bugs-list, Ricordisamoa, jayvdb, 
gerritbot, Aklapper, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124015: Review ignore list

2016-01-20 Thread jayvdb 
jayvdb added a comment.

I've processed 50 pages linking to http://science.ksc.nasa.gov and subdomains, 
and dont see any problems.

For britannica.com I see

*[[Ottoman Empire]] links to 
http://cache-media.britannica.com/eb-media/47/20547-004-D655EA04.gif - 404 Not 
Found.
*[[Yukon River]] links to 
http://cache.britannica.com/EBchecked/topic/654842/Yukon-River - 404 Not Found.
*[[Thermodynamic temperature]] links to 
http://britannica.com/eb/article-9078341 - 404 Not Found.
*[[Zeppo Marx]] links to 
http://blogs.britannica.com/blog/main/2006/11/on-the-silver-and-plasma-screen-duck-soup/
 - 404 Not Found.
*[[Taxila]] links to http://www.britannica.com/eb/article-7133 - 404 Not Found. 
(twice!)
*[[Taxila]] links to http://britannica.com/eb/article-9044882 - 404 Not Found.
*[[Academia]] links to http://britannica.com/eb/article-9044882 - 404 Not Found.
*[[History of the Ottoman Empire]] links to 
http://cache-media.britannica.com/eb-media/47/20547-004-D655EA04.gif - 404 Not 
Found.
*[[Dane Axe]] links to 
http://cache-media.britannica.com/eb-media/77/13177-004-C6966659.jpg - 404 Not 
Found.
*[[Nicholas G. Carr]] links to 
http://blogs.britannica.com/blog/main/2008/01/nick-carr-david-gelernter-and-michael-wesch-new-britannica-advisors/
 - 404 Not Found.
*[[Robert McHenry]] links to http://www.britannica.com/eb/article-9345326 - 404 
Not Found.
*[[Robert McHenry]] links to 
http://blogs.britannica.com/blog/main/author/rmchenry - 404 Not Found.
*[[Kayan people (Borneo)]] links to 
http://cache.britannica.com/eb/article-9044919 - 404 Not Found.
*[[Klondike River]] links to 
http://cache.britannica.com/EBchecked/topic/320125/Klondike-River - 404 Not 
Found.
*[[Scottish inventions and discoveries]] links to 
http://cache.britannica.com/EBchecked/topic/76466/John-Boyd-Orr-Baron-Boyd-Orr-of-Brechin-Mearns
 - 404 Not Found.

All those look to be real errors which weblinkchecker shouldnt skip.


TASK DETAIL
  https://phabricator.wikimedia.org/T124015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Masti, Xqt, Aklapper, StudiesWorld, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Edited] T113140: Convert weblinkchecker to requests

2016-01-20 Thread jayvdb 
jayvdb edited the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T113140

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: MtDu, StudiesWorld, Beta16, pywikibot-bugs-list, Ricordisamoa, jayvdb, 
gerritbot, Aklapper, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Created] T124253: core selflink.py doesnt support xml

2016-01-20 Thread jayvdb 
jayvdb created this task.
jayvdb added subscribers: Aklapper, StudiesWorld, Vituzzu, pywikibot-bugs-list, 
jayvdb.
jayvdb added projects: Pywikibot-compat-to-core, Pywikibot-xmlreader.py, 
Pywikibot-pagegenerators, Pywikibot-Other-scripts.

TASK DESCRIPTION
  selflink.py should support xml, like compat.

TASK DETAIL
  https://phabricator.wikimedia.org/T124253

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: jayvdb, pywikibot-bugs-list, Vituzzu, StudiesWorld, Aklapper, droid



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Edited] T124192: compact selflink.py freezes trying saving an edit

2016-01-20 Thread jayvdb 
jayvdb edited the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T124192

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, StudiesWorld, Vituzzu, pywikibot-bugs-list, Anshoe



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Updated] T124192: compact selflink.py freezes trying saving an edit

2016-01-20 Thread jayvdb 
jayvdb removed a project: Pywikibot-compat-to-core.
jayvdb set Security to None.

TASK DETAIL
  https://phabricator.wikimedia.org/T124192

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, StudiesWorld, Vituzzu, pywikibot-bugs-list, Anshoe



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124192: compact selflink.py freezes trying saving an edit

2016-01-20 Thread jayvdb 
jayvdb added a subscriber: jayvdb.
jayvdb added a comment.

Could you provide more context to how you encounter this?  What is the command 
line you are using; which db dump are you using? etc.


TASK DETAIL
  https://phabricator.wikimedia.org/T124192

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: jayvdb, Aklapper, StudiesWorld, Vituzzu, pywikibot-bugs-list, Anshoe



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124192: compact selflink.py freezes trying saving an edit

2016-01-20 Thread Vituzzu 
Vituzzu added a comment.

I've tested it against last four pages-meta-current it.wiki's dumps. I 
eventually came to a simple workaround: commenting out 
"pywikibot.showDiff(oldText, text)".

Anyway I've made a deeper investigation and I found more compact's script don't 
work.
Here's portale.py:

It seems to be a problem with showDiff method in pywikibot/support.py relying 
upond std difflib.

Traceback (most recent call last):

  File "compat/portale.py", line 199, in 
main()
  File "compat/portale.py", line 188, in main
wikipedia.showDiff(oldtext, newtext)
  File "/home/.../compat/pywikibot/support.py", line 147, in showDiff
for line in difflib.ndiff(oldtext.splitlines(),newtext):
  File "/usr/lib/python2.7/difflib.py", line 907, in compare
cruncher = SequenceMatcher(self.linejunk, a, b)
  File "/usr/lib/python2.7/difflib.py", line 219, in __init__
self.set_seqs(a, b)
  File "/usr/lib/python2.7/difflib.py", line 231, in set_seqs
self.set_seq2(b)
  File "/usr/lib/python2.7/difflib.py", line 285, in set_seq2
self.__chain_b()
  File "/usr/lib/python2.7/difflib.py", line 318, in __chain_b
for i, elt in enumerate(b):

TypeError: 'bool' object is not iterable


TASK DETAIL
  https://phabricator.wikimedia.org/T124192

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Vituzzu
Cc: jayvdb, Aklapper, StudiesWorld, Vituzzu, pywikibot-bugs-list, Anshoe



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Edited] T122958: Analyse and fix issues highlighted by QuantifiedCode

2016-01-20 Thread jayvdb 
jayvdb edited the task description.
jayvdb set Security to None.

TASK DETAIL
  https://phabricator.wikimedia.org/T122958

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: Aklapper, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Triaged] T124253: core selflink.py doesnt support xml

2016-01-20 Thread jayvdb 
jayvdb triaged this task as "High" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T124253

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: jayvdb, pywikibot-bugs-list, Vituzzu, StudiesWorld, Aklapper, droid



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T124015: Review ignore list

2016-01-20 Thread gerritbot 
gerritbot added a subscriber: gerritbot.
gerritbot added a comment.

Change 265442 had a related patch set uploaded (by John Vandenberg):
Remove old unneeded URL exclusion rules

https://gerrit.wikimedia.org/r/265442


TASK DETAIL
  https://phabricator.wikimedia.org/T124015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Masti, Xqt, Aklapper, StudiesWorld, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Updated] T124015: Review ignore list

2016-01-20 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T124015

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Masti, Xqt, Aklapper, StudiesWorld, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Edited] T113140: Convert weblinkchecker to requests

2016-01-20 Thread jayvdb 
jayvdb edited the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T113140

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: MtDu, StudiesWorld, Beta16, pywikibot-bugs-list, Ricordisamoa, jayvdb, 
gerritbot, Aklapper, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Updated] T123198: Implement action=mergehistory support

2016-01-20 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per, gerritbot
Cc: gerritbot, jayvdb, Aklapper, StudiesWorld, Sn1per, pywikibot-bugs-list, 
Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T123198: Implement action=mergehistory support

2016-01-20 Thread gerritbot 
gerritbot added a subscriber: gerritbot.
gerritbot added a comment.

Change 265448 had a related patch set uploaded (by Sn1per):
History merge API support

https://gerrit.wikimedia.org/r/265448


TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per, gerritbot
Cc: gerritbot, jayvdb, Aklapper, StudiesWorld, Sn1per, pywikibot-bugs-list, 
Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Edited] T113140: Convert weblinkchecker to requests

2016-01-20 Thread jayvdb 
jayvdb edited the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T113140

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: jayvdb
Cc: MtDu, StudiesWorld, Beta16, pywikibot-bugs-list, Ricordisamoa, jayvdb, 
gerritbot, Aklapper, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T123198: Implement action=mergehistory support

2016-01-20 Thread gerritbot 
gerritbot added a comment.

Change 265450 had a related patch set uploaded (by Sn1per):
History merge API support

https://gerrit.wikimedia.org/r/265450


TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per, gerritbot
Cc: gerritbot, jayvdb, Aklapper, StudiesWorld, Sn1per, pywikibot-bugs-list, 
Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T123198: Implement action=mergehistory support

2016-01-20 Thread gerritbot 
gerritbot added a comment.

Change 265452 had a related patch set uploaded (by Sn1per):
History merge API support

https://gerrit.wikimedia.org/r/265452


TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per, gerritbot
Cc: gerritbot, jayvdb, Aklapper, StudiesWorld, Sn1per, pywikibot-bugs-list, 
Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T123198: Implement action=mergehistory support

2016-01-20 Thread gerritbot 
gerritbot added a comment.

Change 265452 abandoned by Sn1per:
History merge API support

Reason:
oops

https://gerrit.wikimedia.org/r/265452


TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per, gerritbot
Cc: gerritbot, jayvdb, Aklapper, StudiesWorld, Sn1per, pywikibot-bugs-list, 
Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T123198: Implement action=mergehistory support

2016-01-20 Thread gerritbot 
gerritbot added a comment.

Change 265450 abandoned by Sn1per:
History merge API support

Reason:
oops

https://gerrit.wikimedia.org/r/265450


TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per, gerritbot
Cc: gerritbot, jayvdb, Aklapper, StudiesWorld, Sn1per, pywikibot-bugs-list, 
Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Changed Subscribers] T123198: Implement action=mergehistory support

2016-01-20 Thread Sn1per 
Sn1per added subscribers: Petrb, Nemo_bis.
Sn1per added a comment.

In https://phabricator.wikimedia.org/T123198#1941088, @jayvdb wrote:

> https://codein.withgoogle.com/dashboard/tasks/6514395710488576/


@aklapper @nemo_bis @petrb
#GCI2015 is ending soon; could an admin publish? :)


TASK DETAIL
  https://phabricator.wikimedia.org/T123198

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Sn1per
Cc: Nemo_bis, Petrb, gerritbot, jayvdb, Aklapper, StudiesWorld, Sn1per, 
pywikibot-bugs-list, Jay8g



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Commented On] T123887: reflinks bad link color formatting regression

2016-01-20 Thread gerritbot 
gerritbot added a subscriber: gerritbot.
gerritbot added a comment.

Change 265462 had a related patch set uploaded (by John Vandenberg):
color logging fixes

https://gerrit.wikimedia.org/r/265462


TASK DETAIL
  https://phabricator.wikimedia.org/T123887

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Aklapper, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs

[Pywikipedia-bugs] [Maniphest] [Updated] T123887: reflinks bad link color formatting regression

2016-01-20 Thread gerritbot 
gerritbot added a project: Patch-For-Review.

TASK DETAIL
  https://phabricator.wikimedia.org/T123887

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: gerritbot
Cc: gerritbot, Aklapper, jayvdb, pywikibot-bugs-list



___
pywikibot-bugs mailing list
pywikibot-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/pywikibot-bugs